Developing an Enterprise-Level Apache Cassandra Sink Connector for Apache Pulsar
DataStax has developed a powerful Pulsar Sink Connector that enables users to connect data streams from Apache Pulsarâ„¢ to Cassandra, leveraging the same power and flexibility as their Kafka connector. The Messaging Connectors Commons framework was created by extracting common business logic from the Kafka Sink, allowing for easy implementation of relevant APIs within the Pulsar Sink framework. This new sink supports schema information management and offers various features such as batching strategies and dynamic building of schemas. It is compatible with Apache Cassandra, Datastax Enterprise (DSE), and Astra, ensuring 100% compatibility across different versions. Users can map multiple topics to multiple tables and configure different mappings for each pair. The Sink automatically handles conversions and efficient writing to Cassandra.
Company
DataStax
Date published
March 15, 2021
Author(s)
Enrico Olivelli
Word count
1076
Hacker News points
None found.
Language
English