BEGINNER · 8 MODULES · 64 LESSONS
Data Engineering Foundations
Go from writing code to thinking like a data engineer: model your first tables, validate the data, and build a pipeline you can rerun without duplicates.
- For you if
- You already code in Python and want to get into data engineering with solid foundations, not just tool names.
- By the end
- You'll know how to choose batch or streaming based on the business, tell ETL from ELT, and backfill without breaking anything.
- You need
- Intermediate Python and Python 3.11 or later on your laptop. Everything runs locally, no cloud account.

Curriculum
01What Is Data Engineering
02Batch Vs Streaming And The Sla
- Module overview: the question that comes before any tool
- Batch processing: what it is and why it exists
- Streaming processing: what it is and why it exists
- The SLA question, before any tool
- Does Kiosko need batch or streaming?
- Extracting multiple files with pathlib
- Parsing a full week of orders
- Mini-project: Kiosko's daily extraction job
03Etl Elt And The Warehouse
- Module 3 overview: what changed when storage stopped being expensive
- ETL vs ELT: what changed with the cloud warehouse
- OLTP vs OLAP: two different jobs
- The map: the warehouse, the lake, and the lakehouse
- Columnar storage and why Parquet is different
- Loading raw data with SQLite: your first ELT
- A first look at DuckDB
- Mini-project: Kiosko's landing zone
04Modeling Your First Tables
06Idempotency And Backfill
07Partitioning And Orchestration
08Project Kioskos Batch Pipeline
Reviews
What students say
These reviews are from enrolled students who completed at least 50% of the course. We moderate reviews only on content grounds (spam, offensive language, personal data), never for being critical or negative.
No approved reviews yet.
Be the first to share your experience!