We discuss the importance of proper data management upfront and the need to always be in control of data sharing. We send the appropriate data automatically to our vendor via an Azure Function App.
We added a new uploader method to store data in Azure Blob storage and started to deal with leaky data pipelines by handling failed uploads.
We refactored code for our web server and created a utils module. The utils module handles file saving and ETL methods as background tasks.
In this part, I will rebuild the secure server from part 1 using FastAPI. This allows for multiple workers and running background tasks that we will be using in part 3.
In this first part, we will be building a simple web server using the standard Python library. This is for initial testing and we will secure the web server to use HTTPS.