Apache Kafka is a popular open source streaming platform that makes it easy to share data between enterprise systems and applications. The HiveMQ Enterprise Extension for Kafka implements the native Kafka protocol inside the HiveMQ MQTT broker and makes it possible to:
Solve the difficulty of using Kafka for IoT by seamlessly integrating MQTT messages into the Kafka messaging flow.
Add monitored, bidirectional MQTT messaging to and from Kafka clusters for a highly scalable and resilient end-to-end IoT solution.
Forward MQTT messages from IoT devices that are connected to HiveMQ to topics in one or more Kafka clusters.
Get information from a Kafka topic and publish this information as MQTT messages to one or more MQTT topics.
Bidirectional communication between HiveMQ and Kafka.
Chapters
01:10 - Use multiple MQTT topic filters to route MQTT messages to relevant Kafka topics
01:30 - Message buffering ensures high availability and failure tolerance
01:44 - Monitor all MQTT messages written to and from Kafka
01:58 - Validate messages from Kafka
02:16 - Specify custom handling of message transformations between HiveMQ and Kafka
Video Overview
Watch this 3-minute overview of the HiveMQ Enterprise Extension for Kafka to learn how it supports bidirectional communication between IoT devices and Kafka.
Why HiveMQ and Kafka
HiveMQ’s MQTT platform is the ideal choice for supplementing your investment in Kafka. Unlock the power of IoT with HiveMQ and Kafka with these key features:
Ingest Any IoT Data
Ingest MQTT data from any IoT or IIoT device in its original format into a Kafka cluster, including payload, topic, timestamps, and more.
Publish Kafka Topic Data
Forward polling information from Kafka clusters as MQTT messages to one or more MQTT topics that can be acted on by IoT devices.
Intelligently Route Messages
Utilize multiple MQTT topic filters with the full support of wildcards to route MQTT messages to the desired Kafka topics.
Ensure High Availability
Utilize the message buffering feature on the HiveMQ MQTT broker to ensure high availability and failure tolerance whenever a Kafka cluster becomes temporarily unavailable.
Critical Reliability
Operate mission-critical systems reliably 24/7 with zero message loss and redundant clustering technology.
Manageability and Observability
Centrally monitor all MQTT messages written to and from Kafka, and validate the messages using the schema registry.
HiveMQ and Kafka
The Kafka extension is part of a broader set of technologies you can leverage to unlock the power of IoT with Kafka. We have a complete solution page detailing this approach.
HiveMQ extensions are plugins that provide seamless integration with streaming services, databases, data warehouses, and security services. There is a Custom SDK to build tailored extensions for specific integration needs.
Scalability
Extensions usage scales along with the rest of the cluster and each enterprise extension is designed and tested for use in a cluster.
Availability
Extensions run on each cluster node, so if a node exits the cluster the extension will be present on the replacement node.
Manageability
No separate nodes to manage. Easily manage cluster-wide configuration in a Kubernetes cluster with the HiveMQ Operator.
Get started with HiveMQ today
Choose between a fully-managed cloud or self-managed MQTT platform. Our MQTT experts can help you with your solution and demonstrate HiveMQ in action.
By clicking the subscribe button you give your consent to the use of your data according to our
Privacy Policy. You can withdraw your consent at any time with future effect.
