Native S3 connector vs. Airbyte S3 connector

DoubleCloud, a cloud agnostic service for aggregating and migrating data, developed its own high-performance native S3 connector after encountering performance issues with the Airbyte S3 connector when dealing with larger volumes of data. The native S3 connector supports reading objects in Parquet, CSV, and JSON Lines formats from an S3 bucket for both snapshotting and replication transfers. In benchmark tests, DoubleCloud's native S3 connector outperformed the Airbyte S3 connector by a factor of 5.85x to 8.24x depending on file size and composition.