Airbyte Schema Propagation: Keeping your replicated catalog up to date

Schema propagation has been introduced in both Airbyte Open Source and Cloud, allowing users more control over the schema of replicated data. This feature enables automatic handling of changes in source schemas, with options for adding new fields or streams, ignoring changes, pausing connections on changes, or prompting manual review before resuming syncing. The implementation relies on existing Airbyte protocol primitives and is available to all connectors. The goal is to reduce operational load in maintaining data pipelines by making them more resilient to infrastructure issues and source changes.