Introducing Kafka Quotas in Aiven for Apache Kafka®
Aiven for Apache Kafka introduces quotas to help organizations control the resources client applications can use within a Kafka cluster. This feature is particularly useful for shared Kafka clusters, where multiple teams often share the cluster resources by having dedicated topics where data is produced, consumed, enriched, and transformed. Quotas in Apache Kafka provide a mechanism for managing and limiting the number of broker resources Kafka clients use, ensuring that the performance of the cluster remains consistent and there are no potential degradations. Key benefits include more accurate operations and governance, greater cost optimization, and minimization of data and schema duplication. Aiven for Apache Kafka now supports consumer throttle, producer throttle, and CPU throttle quotas to help manage network bandwidth and CPU usage effectively.
Company
Aiven
Date published
July 11, 2023
Author(s)
Filip Yonov, Markos Sfikas
Word count
1520
Language
English
Hacker News points
None found.