Many times, during development one comes across a gap in a project that is easy to fix in essence but there are other factors at play. One such example from my work is the need for an OPC UA bridge. In this post we will explore the use cases that I have come across and build an OPC UA bridge in Python.
Many systems exist today that were simply not optimised for time-series data analysis and machine learning. People may not even know the data is being collected regularly as part of day-to-day operations. This is often referred to as dark data. As the hunger for data increases, data engineers are tasked to make this dark data available.
Over this six plus one blog series we covered many different technologies and integrations, as we built our data pipeline. While there are standard patterns we can often use, sometimes we need to be able to flexible and use what is available.