Company
Date Published
Author
Anais Dotis-Georgiou
Word count
968
Language
English
Hacker News points
None

Summary

InfluxDB 3.0 has been released, providing 45x better write throughput and 5-25x faster queries compared to previous versions. One of the deprioritized features is the task engine, which led to the development of Mage.ai, an open-source data pipeline tool for transforming and integrating data. Mage is designed to be easy to use, with a customizable UX, templates for sharing pipelines, and AI-powered pipeline generation. It uses Polars and Parquet under the hood and has excellent community support. To run Mage, users need to deploy and manage it themselves, but the documentation provides detailed instructions for deployment on various cloud platforms. The tutorial demonstrates how to create a materialized view of time series data in InfluxDB Cloud v3 using Mage.ai, including creating triggers to schedule pipeline runs.