Member-only story
ACID For Data Engineers
How well do you know Atomicity, Consistency, Isolation, and Durability?
I only publish 1/4 of my deep-dive data engineering articles on Medium. Access the full repository here.
Intro
Like many other guys who are interested in data management systems, I heard and learned about ACID guarantees. However, I find that internet resources on this topic are quite oversimplified, and I decided to invest my time in researching it.
This article is my note on the relational database ACID constraints. I hope that the next time we read a document about an OLAP database, when it mentions that it supports ACID, we will understand what it is referring to.
Note: This article is written for my newsletter audience, who are primarily data engineers, so that the content will focus more on the ACID properties of OLAP systems.
Durability
For me, this property is the easiest one to understand. It ensures that once the transaction commits successfully, all of its changes will never be lost in any circumstances.
Most OLAP systems are multi-node, as they operate across multiple servers. Durability is ensured by successfully…
