Ghita EL AMLAQUI·Oct 3The Ghost Cluster: The EMR Cluster That Never Received Jobs but Kept Costing Us MoneyIntroduction
InNetflix TechBlogbyNetflix Technology Blog·Sep 25Trading a Cloud Identity for Your Own: Workload Attestation on Managed ComputeBy Dhruv PratapA response icon3A response icon3
akaicomet·Sep 23Stop trying to guess why your Spark jobs failed: A masterclass in MWAA and EMR serverless debuggingA nightmare every data engineer has experienced: 3 AM. A critical production data pipeline orchestrated by Amazon MWAA (Airflow) fails. You…
InData And BeyondbySriw World of Coding·Jul 22Your Spark Job Succeeded. Airflow Called It a Failure Anyway. Here’s the Bug Nobody Explains WellThree hours of compute. A clean success in the EMR logs. And Airflow still marks it FAILED — with a cryptic scheduler message that sounds…A response icon1A response icon1
Hitesh Laxman·Jul 3EMR Was Costing Us Thousands Every Month. The Fix Took Five Minutes.“We didn’t optimize Spark.”
Pankaj Goswami·May 24Federated Compute vs. Centralised Warehouse: A Decision Framework From Someone Who Built BothTrino on EMR and Redshift solve different problems. Here is how to know which one you actually need.
InEndToEndDatabySriw World of Coding·Apr 5AWS Glue vs EMR: Which One Should You Really Use for Big Data ETL?The “Which Service Do I Pick : AWS Glue vs EMR?” Nightmare
Vermashruti·Mar 11My Hudi Table Was Fine for 1 Year… Then Suddenly It Took 4+ Hours 😶For almost one year, everything was smooth.
