← All paths
Data for AI
The data layer AI depends on: data engineering foundations, Python and SQL for data, modeling for analytics, dbt, orchestration with Airflow, Spark, lakehouse with Iceberg, streaming with Kafka and Flink, reliability and governance, and SQL that LLMs and agents can use safely.
- Route
- 13 guides · 704 lessons
- Level
- Beginner to intermediate
Data Engineering FoundationsGo from writing code to thinking like a data engineer: model your first tables, validate the data, and build a pipeline you can rerun without duplicates.Start →
Python for Data EngineeringTurn a data script into a Python package an engineering team would accept for review: installable, tested, with useful logs, retries, and fast transformations.Open →
Advanced SQL QueryingAnswer complex business questions with a single clear, fast SQL query, and stop exporting to spreadsheets what the database can already do for you.Open →
Data Modeling for AnalyticsTurn a flat data model into a real analytics warehouse, with dimensions that keep their history and tables your BI team can query without mistakes.Open →
dbt and Analytics EngineeringTurn scattered SQL transformations into a versioned, tested, and documented data project with dbt that runs end to end with a single command.Open →
Airflow and Declarative OrchestrationGet your data pipeline running on its own with Apache Airflow: scheduled daily, with retries, waiting for data to arrive, and ready to reprocess past dates.Open →
Spark and Distributed ProcessingFind out when your data stops fitting on one machine and process it with Spark on your laptop, reading the execution plan to see what things cost.Open →
Lakehouse and IcebergTurn your Parquet files into Apache Iceberg tables with transactions, queryable history, schema changes without rewriting data, and native upserts.Open →
Streaming with Kafka and FlinkRecognize when streaming is worth it and use Kafka and Flink to solve what batch can't, like knowing within minutes that a store stopped reporting.Open →
Data Reliability and GovernanceProve your data is correct, not just that the pipeline finished green, with quality tests, data contracts, lineage, and protection for personal data.Open →- Embeddings Deep DiveTurn text into vectors your team can search: compare embedding models, pick the right distance metric, chunk with care and measure retrieval quality before it reaches production.Open →
- Vector Database FundamentalsUnderstand how vector databases work inside, why a RAG system needs one, and how to choose the right one for your team's project.Open →
SQL for LLMs and AgentsLet an AI agent answer questions about your database by writing SQL, without risking deletes or leaks, and validating each query before it runs.Open →
Your team builds data pipelines that analytics and AI agents can trust.