Many times, you need to view the latest log entries generated by your app to check that everything is working or see what is currently broken. We will be creating a FastAPI app that will stream our latest log files entries over websockets.
Over this six plus one blog series we covered many different technologies and integrations, as we built our data pipeline. While there are standard patterns we can often use, sometimes we need to be able to flexible and use what is available.
We refactored code for our web server and created a utils module. The utils module handles file saving and ETL methods as background tasks.
In this part, I will rebuild the secure server from part 1 using FastAPI. This allows for multiple workers and running background tasks that we will be using in part 3.