Kafka key features
A Kafka cluster can be elastically and transparently expanded without downtime.
Even with modest hardware, Kafka can support hundreds of thousands of messages per second, with latencies as low as a few milliseconds.
Messages are persisted on disk and replicated within the cluster to prevent data loss. Rolling restarts available through Cloudera Manager for added reliability.
Support for high concurrency and multi-tenancy
Ability to simultaneously handle up to thousands of diverse clients—simultaneously writing to and reading from Kafka, with throttling based on client quotas.
Secure the Kafka cluster with Kerberos integration and protect data as it comes in with native over-the-wire encryption.
Common use cases
Kafka’s flexibility enables end-to-end workloads for a variety of critical use cases all within a single system, including:
- Internet of Things and stream processing
- Log aggregation
- Large-scale messaging
- Customer activity tracking
- Operational alerting and reporting
Integrated across the platform
As an integrated part of Cloudera’s platform, Kafka can seamlessly work with other components—such as Apache HBase, Spark Streaming, and Apache Flume—to build complete workloads all within a single platform. Only Cloudera provides simple deployment, and robust troubleshooting and monitoring of Kafka (through Cloudera Manager), as well as shared compliance-ready security and governance (through Apache Sentry and Cloudera Navigator)—all critical for running in production.
Cloudera’s commitment to Kafka
Cloudera is actively involved with the Kafka community and has deep engineering relationships with partners, such as Confluent, and other Kafka committers. This relationship has led to critical production-ready improvements, especially around reliability and deployment, and continued work to further security integrations.
Cloudera’s engineering expertise, combined with support experience with large-scale production customers, equals direct access and influence to the roadmap based on your needs and use cases.