/plushcap/analysis/aiven/using-kafka-connect-jdbc-source-a-postgresql-example

Using Kafka Connect JDBC Source: a PostgreSQLĀ® example

What's this blog post about?

This tutorial demonstrates how to use Apache Kafka Connect to update an old app-to-db design, making it more efficient by incorporating up-to-date tech tools without disrupting the original solution. The example provided uses the Kafka Connect JDBC Connector to source data from an existing table in PostgreSQL and populate a Kafka topic with only the changed rows. This approach is beneficial for many use cases, but when additional query load on the source system is not allowed, change data capture solutions like Debezium can be used instead. The tutorial guides users through creating a PostgreSQL database to act as backend data storage and then adding a Kafka cluster with Kafka Connect. It also provides an example of the Kafka Connect JDBC Source based on a PostgreSQL database.

Company
Aiven

Date published
March 25, 2021

Author(s)
Francesco Tisiot

Word count
2724

Hacker News points
4

Language
English


By Matt Makai. 2021-2024.