Company
Date Published
Author
Alex Noonan
Word count
1062
Language
English
Hacker News points
None

Summary

The team at Elementl has released version 0.6.0 of Dagster, a big release that builds on their previous announcement. This new version comes with several key features, including the ability to deploy Dagit — their graphical development and monitoring environment — to AWS with a simple CLI invocation. The release also includes an integrated scheduler built into Dagit, which allows users to define schedules for executing pipelines in code. With 0.6.0, Dagster now ships with its own execution engine, suitable for multi-process execution on a single node, as well as support for Dask and Airflow. Additionally, the release introduces hosted monitoring of production pipelines, flexible deployment options, and structured logging that allows users to communicate events with specific meaning along with rich metadata rendering. The new version is 100% open source and installable as a Python module.