In this lecture we will explain how companies have treated data over the last decades moving from standard relational databases, to datawarehouses, data lakes and lakehouses. We will explain the differences as well as the commonalities, and will end with a workshop where you will build your own modern data pipeline using the latest tools and insights.
The lecture will start by taking you on a journey as we explain the different phases of data platforms in companies over time, and what is the current state-of-art with respect to data pipelines. After the lecture-part, we will work in groups to create a data pipeline using the techniques discussed in the lecture. Experience in python or SQL is convenient but not required.
The lecture includes dinner and drinks.
17:00 | Doors open & dinner
18:00 | Start lecture
19:00 | Workshop
20:00 | Closing