/plushcap/analysis/confluent/confluent-shift-left-bad-data-in-event-streams-part-2

Shift Left: Bad Data in Event Streams, Part 2

What's this blog post about?

The text discusses strategies for handling bad data in event streams. It emphasizes prevention through robust testing and schema validation, good event design using state events that can be compacted to remove old or incorrect data, and a final strategy of rewinding, rebuilding, and retrying when all else fails. State events are preferred as they simplify the process of fixing bad data by allowing corrections at the source to propagate to all subscribed consumers. The text also highlights the importance of prevention in avoiding bad data issues.

Company
Confluent

Date published
Oct. 11, 2024

Author(s)
-

Word count
4447

Hacker News points
None found.

Language
English


By Matt Makai. 2021-2024.