Creating your first Apache Airflow DAG

Creating your first Apache Airflow DAG

Throughout the past few years, Apache Airflow has established itself as the go-to data workflow management tool within any modern tech ecosystem. One of the main reasons for which Airflow rapidly became this popular is its simplicity and how easy it is to get it up...
Structured Streaming in Spark

Structured Streaming in Spark

Streaming processing is a set of techniques used to extract information from unbounded data (a type of dataset theoretically infinite in size) Some examples of streaming are device monitoring, fault detection, billing modernization, fleet management, media...