/plushcap/analysis/datastax/2021-03-developing-enterprise-level-apache-cassandra-sink-connector-apache-pulsar

Developing an Enterprise-Level Apache Cassandra Sink Connector for Apache Pulsar

What's this blog post about?

DataStax has developed a powerful Pulsar Sink Connector that enables users to connect data streams from Apache Pulsarâ„¢ to Cassandra, leveraging the same power and flexibility as their Kafka connector. The Messaging Connectors Commons framework was created by extracting common business logic from the Kafka Sink, allowing for easy implementation of relevant APIs within the Pulsar Sink framework. This new sink supports schema information management and offers various features such as batching strategies and dynamic building of schemas. It is compatible with Apache Cassandra, Datastax Enterprise (DSE), and Astra, ensuring 100% compatibility across different versions. Users can map multiple topics to multiple tables and configure different mappings for each pair. The Sink automatically handles conversions and efficient writing to Cassandra.

Company
DataStax

Date published
March 15, 2021

Author(s)
Enrico Olivelli

Word count
1076

Hacker News points
None found.

Language
English


By Matt Makai. 2021-2024.