Building Transactional Systems Using Apache Kafka

This article discusses an event-based architecture that leverages Apache Kafka® as a scalable and highly available single source of truth for businesses processing large amounts of data. It presents a system where all API calls are transformed into events and written to a Kafka topic using the tenant identifier as key and the remaining data as value. The system ensures atomicity, consistency, isolation, and durability in transactions, similar to ACID transactions in relational databases. It also discusses ways to handle duplicate requests or events, make the system idempotent, and scale horizontally by adding additional partitions to the tenant topic.