Bartosz Malec·1h agoLooking for a perfect SCD for Lakehouse workloads (Part 1)Looking for a perfect SCD for Lakehouse workloads, Part 1 of 10: the problem, the history of the SCD types and the gaps they leave.
Sergii Nazarevych (Aqueelone)·5h agoTensor Lakehouse on GCP: Architecture, Trade-offs, and Production Lessons. Part 1Part 1. Why the tensor-lakehouse?A response icon1A response icon1
Shree Kavya·7h agoDelta, Iceberg or DuckLake? A Practical Guide to Choosing a Table FormatNot “which is best”, but “which fits your readers, engines and team”, with a comparison table and a decision flow
InTowards Data EngineeringbyDr.Michael·10h agoI Built a Mini Lakehouse Using Apache Iceberg, Spark, and MinIO on My Local MachineI assembled an open-source data platform using object storage, Parquet files, Iceberg tables, Spark processing, and a catalog service. I…
IndatalexbyAlexandre Bergere·17h agoFrom Lakebase to LTAP: Databricks is Removing the PipelineThe architecture we were speculating about is becoming real
Zeynepbkn·20h agoApache Spark: Temel Kavramlardan Data Lakehouse Mimarisine Kapsamlı Bir RehberApache Spark, büyük verileri dağıtık biçimde işlemek için geliştirilmiş açık kaynaklı, birleşik bir veri işleme motorudur. Veri…
Greg Deckler·23h agoRun Microsoft Fabric on a Laptop!With Fabric trials finally ending; mine lasted for over 3 years, I figured that people might want a free way to play around with…
InLevel Up Codingbydk.websolutions·23h agoHow to Keep Apache Iceberg Tables Fast: Compaction, Snapshot Expiry and Orphan File CleanupA Practical Spark SQL Playbook for Small Files, Snapshot Bloat and Storage Leaks in Your Lakehouse
Ajay Uppu·1d ago3.4 Million NYC Taxi Trips, Zero Servers: Building an Iceberg Lakehouse on AWSHave you ever dropped a few CSV and Parquet files into an S3 bucket, called it a “data lake”, and then got stuck the first time someone…
Nazmul Hasan·2d agoIceberg v3: The First DELETE After Upgrading Broke 3 of My 12 ReadersThe upgrade alone changed no reader’s answer. One table, 12 reader versions, 19 engines’ docs, and the checks to run first.A response icon1A response icon1
