/plushcap/analysis/fivetran/change-data-capture-what-it-is-and-how-to-use-it

Change data capture: What it is and how to use it

What's this blog post about?

Change data capture (CDC) is a technique used to replicate data from databases and process it from various sources such as SaaS applications or systems accessible through APIs. It's gaining popularity due to its ability to drive powerful data-driven use cases, enable real-time analytics, data streaming, and machine learning. CDC allows for the transfer of data as changes happen, which is crucial for organizations operating critical systems 24/7 with no convenient time for batch windows. There are multiple types of change data capture methods, including log-based CDC, trigger-based CDC, CDC based on timestamps or another low watermark, and difference-based CDC. Fivetran is a modern data integration solution that leverages CDC to efficiently move high volumes of data between applications.

Company
Fivetran

Date published
May 10, 2022

Author(s)
Mark Van De Wiel

Word count
1031

Language
English

Hacker News points
None found.


By Matt Makai. 2021-2024.