Data Engineering

Etl Pipeline

Explore recommended reads, summarized by AI

ETL Development and Tools

Guides and practices for building data pipelines and integrating transformation tools.

Airflow and Spark Pipelines

ETL Best Practices and Techniques

Popular this week

In

Towards Data Engineering

by

Think Data

10 Hard‑Earned Lessons for Designing Reliable Data Pipelines

Avinash

Snowflake Data Engineer — Real-World Scenario-Based Interview Questions

Ovindu Hathnapitiya

ETL vs ELT: How I Think About Choosing Between Them

Asif Mahaldar

From Zero to Data Engineer: A Practical Roadmap for Complete Beginners

Nusrat Gulbarga

Building Production-Ready ETL Pipelines With Python

Latest stories

Puja Chattopadhyay

How I Built an Automated ETL Pipeline in Databricks with Genie: Accelerating Data Engineering…

Ogochukwu A.

Did they tell you data engineering is moving data from point A to point B?

Thilagavathimani

One Pipeline, Multiple Tables: Understanding Metadata-Driven ETL in Azure Data Factory

In

Python in Plain English

by

Aliakbar Hosseinzadeh

Pydantic in Python: The Difference Between Receiving Data and Trusting It

Charan Kumar Kharade Somoji Rao

Writing Efficient Python for Data Engineers: Combining, Counting, Iterating, and Profiling

See more stories

Who to follow

Popular this week

In

Towards Data Engineering

by

Think Data

10 Hard‑Earned Lessons for Designing Reliable Data Pipelines

Avinash

Snowflake Data Engineer — Real-World Scenario-Based Interview Questions

Ovindu Hathnapitiya

ETL vs ELT: How I Think About Choosing Between Them

Asif Mahaldar

From Zero to Data Engineer: A Practical Roadmap for Complete Beginners

Nusrat Gulbarga

Building Production-Ready ETL Pipelines With Python

Latest stories

Puja Chattopadhyay

How I Built an Automated ETL Pipeline in Databricks with Genie: Accelerating Data Engineering…

Ogochukwu A.

Did they tell you data engineering is moving data from point A to point B?

Thilagavathimani

One Pipeline, Multiple Tables: Understanding Metadata-Driven ETL in Azure Data Factory

In

Python in Plain English

by

Aliakbar Hosseinzadeh

Pydantic in Python: The Difference Between Receiving Data and Trusting It

Charan Kumar Kharade Somoji Rao

Writing Efficient Python for Data Engineers: Combining, Counting, Iterating, and Profiling

See more stories

Who to follow