/plushcap/analysis/temporal/temporal-get-insights-from-workflow-histories-export-on-temporal-cloud

Get Insights From Workflow Histories Export On Temporal Cloud

What's this blog post about?

The Temporal Web UI offers a view of workflows and history events within a single workflow execution, providing valuable feedback on operational efficiencies and bottlenecks. Workflow History Export in Temporal Cloud allows users to export closed workflow histories to AWS S3 for further analysis. By transforming the data from proto format to Parquet, it becomes more suitable for analysis and can be fed into various datastores like Amazon S3, Athena, Redshift, Snowflake or Databricks. Sample queries are provided for insights such as frequently triggered workflow types, activity types, average execution times of top workflow types, and longest running activities. Limitations include the need to dedupe data based on runID, exclusion of payload field, and variability in schema over time. Future enhancements may include support for more data types and improvements to customer experience.

Company
Temporal

Date published
April 24, 2024

Author(s)
Alice Yin

Word count
1084

Language
English

Hacker News points
None found.


By Matt Makai. 2021-2024.