Get Insights From Workflow Histories Export On Temporal Cloud
The Temporal Web UI offers a view of workflows and history events within a single workflow execution, providing valuable feedback on operational efficiencies and bottlenecks. Workflow History Export in Temporal Cloud allows users to export closed workflow histories to AWS S3 for further analysis. By transforming the data from proto format to Parquet, it becomes more suitable for analysis and can be fed into various datastores like Amazon S3, Athena, Redshift, Snowflake or Databricks. Sample queries are provided for insights such as frequently triggered workflow types, activity types, average execution times of top workflow types, and longest running activities. Limitations include the need to dedupe data based on runID, exclusion of payload field, and variability in schema over time. Future enhancements may include support for more data types and improvements to customer experience.
Company
Temporal
Date published
April 24, 2024
Author(s)
Alice Yin
Word count
1084
Language
English
Hacker News points
None found.