04.3.4 · Skill in Data engineering
Consistency
Keeping data correct when many things read and write at once.
Consistency problems appear with concurrent writes, caches, replicas and distributed systems. Transactions, constraints and idempotency are the main tools. Users notice inconsistency as lost work or numbers that do not add up.
Resources
1- bookGo deeper · PaidDesigning data-intensive applications ↗Martin Kleppmann · 600 pages
The standard book on data systems, consistency and scale. Read it when a product's data starts to hurt.
Tools
none yetTools for this topic are being researched.