Kamal Thapa·1d agoDelta Lake Time Travel in Plain English: What the Transaction Log Actually DoesWhy your lakehouse tables can undo mistakes, show their history, and still cost you storage, explained without the jargon
Kulveer Singh·1d agoDelta Lake Deep Dive: ACID on Object StorageThe transaction log is the whole trick: how Delta turns dumb files on S3 into real tables with time travel — and how to recover one.
Parul S·3d agoStep-by-Step Guide to Enriching Streaming Data with Reference Data in Microsoft FabricIn today’s data-driven environment, organizations increasingly rely on real-time data to monitor operations, identify anomalies, and make…
Tanujamane·3d agoWhere Should an Online Store Keep Its Data? Warehouse vs Lake vs LakehouseImagine you work for an online shopping company. Every day, customers register, buy products, pay, write reviews, and track deliveries…
Kamal Thapa·5d agoBuilding a Medallion Lakehouse on Azure Databricks with Unity Catalog, Step by StepA practical walkthrough from raw JSON to governed gold tables using Auto Loader, Lakeflow pipelines, and Lakeflow Jobs
Fabricexperts In·Oct 29Lakehouse vs Data Warehouse in Fabric: Which One Do You Really Need?Imagine you are setting up your first real project in Microsoft Fabric. You create a workspace, click “New item,” and suddenly face two…
Amit Dass·Oct 23Five Eras of DatabricksFrom a managed Spark service to an agentic data platform: the ideas and the vocabulary, era by era.
InTowards Data EngineeringbyMuthupalaniappan Ramanathan·Oct 10Federation Solved Reachability, Not AuthorityWho owns an Iceberg table when three catalogs can see it?A response icon1A response icon1
Lily·Oct 8Data engineering (1): Spark architectureThis part, I am going to cover Spark architecture basics: driver, executors, lazy evaluation, transformations vs. actions, DAG, stages…A response icon1A response icon1
Raghu Chennaverggala·Oct 6E-COMMERCE AGENTIC AI PLATFORM(EKS+DATABRCIKS)Friendly link : https://medium.com/@raghu.chennavajjhala/e-commerce-agentic-ai-platform-eks-databrciks-3b5545e9fb1e