How We Can Commoditize Data Integration Pipelines
Data integrations are becoming increasingly complex as companies use more B2B tools. While some companies have emerged for batch-based and event-based integrations, none have solved the problem entirely. Airbyte aims to commoditize data integration pipelines by addressing limitations of current offers such as limited pre-built connectors, volume-indexed pricing, and security concerns in the enterprise world. The vision includes a large number of open-source connectors, easy building of new integrations, built-in scheduling, orchestration, monitoring, and upgrading mechanisms, and enabling other data engineering work like transformation. Airbyte's timeline is to focus on batch data replication to warehouses in the next year and aims to have at least 50 connectors by the end of 2020.
Company
Airbyte
Date published
Sept. 22, 2020
Author(s)
John Lafleur
Word count
1400
Hacker News points
None found.
Language
English