/plushcap/analysis/datadog/datadog-observability-pipelines-generate-metrics-from-high-volume-logs

Generate metrics from your high-volume logs with Datadog Observability Pipelines

What's this blog post about?

Logs are valuable sources of information but managing billions generated daily is impractical and expensive. By extracting metrics from logs using Observability Pipelines, teams can retain important information while minimizing costs associated with log management. This approach enables the reduction of high-volume logs without compromising analytics capabilities or developer efficiency. Metrics extracted from logs are stored in Datadog for 15 months, allowing for predictive forecasting and seasonality checks. Observability Pipelines can also reduce log size before sending them to a destination, decreasing network and egress costs while maintaining optimal resource performance.

Company
Datadog

Date published
Oct. 21, 2024

Author(s)
Candace Shamieh, Pratik Parekh

Word count
895

Hacker News points
None found.

Language
English


By Matt Makai. 2021-2024.