/plushcap/analysis/acceldata/aiops-forecasting-cloud-infra-spend

AIOps: Forecasting Cloud Infra Spend

What's this blog post about?

The text describes the advanced capacity warning and prediction capabilities of Acceldata's Data Observability Platform for modern data applications that require large resources such as streaming operations, ETL, and batch processing. It explains how the platform helps forecast resource outages and provides advanced warnings to cluster administrators. The solution involves creating a generic data processing pipeline using machine learning algorithms like Facebook's Prophet, LSTM, and VAR. The results are written back to a TimeSeries Database (TSDB), which can be visualized on customizable dashboards for cluster admins. This approach has helped customers manage their AWS costs dynamically by adjusting compute capacity based on accurate predictions of Yarn capacity usage.

Company
Acceldata

Date published
May 8, 2020

Author(s)
Rohit Choudhary

Word count
1748

Language
English

Hacker News points
None found.


By Matt Makai. 2021-2024.