Spark Sql

Explore recommended reads, summarized by AI

Development Practices

Writing about code quality, API choices, framework design, and new language features in Spark.

Code Quality and API Design

Performance and Optimization

Writing about query execution, join strategies, and techniques for improving Spark application performance.

Benchmarking and Tool Integration

Join Strategies and Execution Internals

Popular this week

Towards Data Engineering

Ángel Álvarez Pascua

Apache Spark WTF??? 🙏 Losing My Precision 🧮

Jun 5

Pandraju Isaac

SQL UDFs in Spark 4: Functions the Optimizer Can Actually Read

2d ago

Praveenkrishnan

10 PySpark Optimization Techniques Every Data Engineer Should Know

Jul 3

DataWithRohit

A Complete Associate and Professional Exam Guide on CDC and CDF

Jul 28

M Jahanzaib Anwar

Building a Watermark Control Table in Microsoft Fabric Lakehouse

May 20

Latest stories

Pandraju Isaac

Subqueries Without SQL Strings: scalar(), exists() and lateralJoin() in PySpark 4

19h ago

Pandraju Isaac

SQL UDFs in Spark 4: Functions the Optimizer Can Actually Read

2d ago

DataWiseCode

Dipak Shaw

Why Your Spark Window Functions Are Slow

Oct 27

Aqila Nafisa Salma

Integrated Case Study: End-to-end Big Data Analysis — BIG DATA Week 7

Oct 9

Spark Sql

Development Practices

Code Quality and API Design

Performance and Optimization

Benchmarking and Tool Integration

Join Strategies and Execution Internals

Popular this week

Apache Spark WTF??? 🙏 Losing My Precision 🧮

SQL UDFs in Spark 4: Functions the Optimizer Can Actually Read

10 PySpark Optimization Techniques Every Data Engineer Should Know

A Complete Associate and Professional Exam Guide on CDC and CDF

Building a Watermark Control Table in Microsoft Fabric Lakehouse

Latest stories

Subqueries Without SQL Strings: scalar(), exists() and lateralJoin() in PySpark 4

SQL UDFs in Spark 4: Functions the Optimizer Can Actually Read

Why Your Spark Window Functions Are Slow

Integrated Case Study: End-to-end Big Data Analysis — BIG DATA Week 7

The Art of Writing to Object Storage at Scale

Who to follow

Popular this week

Apache Spark WTF??? 🙏 Losing My Precision 🧮

SQL UDFs in Spark 4: Functions the Optimizer Can Actually Read

10 PySpark Optimization Techniques Every Data Engineer Should Know

A Complete Associate and Professional Exam Guide on CDC and CDF

Building a Watermark Control Table in Microsoft Fabric Lakehouse

Latest stories

Subqueries Without SQL Strings: scalar(), exists() and lateralJoin() in PySpark 4

SQL UDFs in Spark 4: Functions the Optimizer Can Actually Read

Why Your Spark Window Functions Are Slow

Integrated Case Study: End-to-end Big Data Analysis — BIG DATA Week 7

The Art of Writing to Object Storage at Scale

Who to follow