Himanshi Dahiya·Aug 26Solving the Data Skew Problem using few techniquesSalting → Extremely skewed/hot keys
Muthubabu Sethuraman·Mar 3Adaptive Query Execution AQE in Databricks SparkListen, we’ve all been there. It’s 2 AM, you’re staring at a Spark job that’s been stuck at 99% for forty minutes, and you’re wondering why…
InTowards DevbyBasavaraj Dharegonnavar·Jul 9, 2025🔥 Optimizing PySpark with Adaptive Query Execution (AQE)💡 What Is Adaptive Query Execution?
InAWS TipbyTHE BRICK LEARNING·Mar 9, 2025100 Days of Data Engineering on Databricks Day 42: How Adaptive Query Execution (AQE) Minimizes…Adaptive Query Execution (AQE) is one of the most powerful performance optimization features in Spark, significantly improving shuffle…
Subham Singhal·Oct 7, 2024AQE optimisationsIn prev blog I discussed internal of AQE and how AQE nodes converge to a final physical plan. In this blog I will some of the optimisations…
