Track and improve the performance of streaming data pipelines with Datadog Data Streams Monitoring
Datadog Data Streams Monitoring (DSM) is a tool that helps track and improve the performance of streaming data pipelines and event-driven applications using Kafka and RabbitMQ. It provides deep visibility into services, queues, and infrastructure across the entire pipeline, enabling users to monitor latency, pinpoint bottlenecks, identify issues such as blocked messages or offline consumers, and enhance existing troubleshooting workflows. DSM automatically maps the architecture of streaming data pipelines and visualizes interdependencies, service ownership, and key health metrics across services and infrastructure. This helps users monitor end-to-end latency, alert on bottlenecks, identify and remediate floods of backed-up messages, and improve overall pipeline performance.
Company
Datadog
Date published
April 27, 2023
Author(s)
Nicholas Thomson, Jane Wang, Jonathan Morin
Word count
1695
Hacker News points
None found.
Language
English