Building Shared State Microservices for Distributed Systems Using Kafka Streams

Imperva has successfully implemented Kafka Streams API for building shared state microservices that serve as fault-tolerant, highly available single sources of truth about the state of objects in their system. They used Kafka Streams to maintain global state in a distributed system and address issues such as maintaining consistency and synchronization, avoiding bottlenecks, and preventing race conditions and unpredictability. The microservices built with Kafka Streams have been able to meet all requirements set by Imperva, including providing a RESTful CRUD API, distributing processing load, improving availability, preserving state stores, and scheduling tasks in response to incoming messages. Overall, Kafka Streams has proven to be very robust in their production environment, allowing them to shorten development times and bring uniformity to their code.