data-engineering-zoomcamp-2025

Docker terrform

docker compose postgresql terrform

Workflow orchestration

• kestra - 2025
• Mage ai 2024
• Prefect 2023
• airflow 2022

Data warehouse

• airflow 2022

Analytics engineering

Batch Processing

Spark, PySpark 2022 2023 2024 2025

Stream Processing

Kafka 2023 2024 2025 redpanda 2024 flink 2025