Creating IIoT Data Pipeline Using MQTT and Kafka: A Step-by-Step Guide

  Рет қаралды 10,311

HiveMQ

HiveMQ

Жыл бұрын

Watch this step-by-step video guide to learn how to create a data pipeline for your Industrial IoT solution using MQTT and Apache Kafka.
Why create an IIoT data pipeline using MQTT and Kafka? In a typical Industrial IoT scenario, your IIoT solution streams and processes millions of data samples per day. This continues to grow as you digitally transform. To process large volumes of data reliably and in a persistent manner at scale, and to make it readily available to enterprise applications, you need a scalable solution.
Apache Kafka is suitable for a very large and reliable storage and distribution system with high throughput. It acts as a buffer for the real-time stream of information coming from your industrial facility, and then timely feeds it into multiple enterprise applications such as Data Science and Analytics apps. However, Kafka is not well suited for structuring communication with Industrial IoT devices and sensors, which is a domain in which MQTT really shines. By creating a data pipeline using MQTT and Apache Kafka, you can address the challenges of bringing structured data seamlessly from your legacy systems, with proprietary software, to enterprise applications.
**** Link to Resources ****
👉 MQTT Essentials E-Book: bit.ly/3D1spwB
👉 MQTT Essentials blog series: bit.ly/2Y7cGxn
👉 MQTT 5 Essentials blog series: bit.ly/3mdRm0Z
👉 MQTT FAQs: bit.ly/3oo9Iio
👉 HiveMQ MQTT broker: bit.ly/3in5Pq6
👉 HiveMQ Cloud: bit.ly/3mdlgSX
👉 To get an overview of MQTT Sparkplug, visit: bit.ly/3CWdxzs
👉 Subscribe to our newsletter to always stay updated on our upcoming webinars and latest blog posts: bit.ly/2YiNuDT
#industry40 #mqtt #apachekafka

Пікірлер: 9
@chrisnocker3437
@chrisnocker3437 9 ай бұрын
Really clear demo, thank you
@sreeja43
@sreeja43 Жыл бұрын
Great video and explanation. This helped us a lot with our project. Many thanks
@mohanpannirselvam4102
@mohanpannirselvam4102 Ай бұрын
the hivemq-kafka extension file is totaly different now
@ibrahimesawy5659
@ibrahimesawy5659 7 ай бұрын
Good
@JeffRankinenAmyJoey
@JeffRankinenAmyJoey Жыл бұрын
Thanks Kudzai! Great job of explaining why someone would use Kafka for high volume data collection. Wondering why you did not use the publish/subscribe capability of MQTT and instead published every 5 seconds? I think you're demonstration would be more useful if you created both subsecond data changes as well as longer data changes. Date is published only when it changes. Keep up the good work!
@HiveMQ
@HiveMQ Жыл бұрын
Hi Jeff, yes ideally this information will be published based on Report-by-Exception. 5 second publishing was purely used for demonstration purposes.
@tatatadooooo11
@tatatadooooo11 Жыл бұрын
sir , at 7:33 i cant log in with my hivemq account, what happen ? many thanks ^^
@mohanpannirselvam4102
@mohanpannirselvam4102 Ай бұрын
use the default login details (username:admin password:hivemq)
🤔Какой Орган самый длинный ? #shorts
00:42
아이스크림으로 체감되는 요즘 물가
00:16
진영민yeongmin
Рет қаралды 59 МЛН
Playing hide and seek with my dog 🐶
00:25
Zach King
Рет қаралды 29 МЛН
What is the Unified NameSpace?
17:58
4.0 Solutions
Рет қаралды 21 М.
How to Structure Node-RED for the Industrial IoT
9:49
United Manufacturing Hub
Рет қаралды 12 М.
Kafka vs. RabbitMQ vs. Messaging Middleware vs. Pulsar
4:31
ByteByteGo
Рет қаралды 83 М.
Integrate Kafka and MQTT - How to connect MQTT and Kafka
25:05
Techletters
Рет қаралды 20 М.
What is Sparkplug B for MQTT?
19:17
4.0 Solutions
Рет қаралды 21 М.
Raspberry Pi IoT Server Tutorial: InfluxDB, MQTT, Grafana, Node-RED & Docker
12:32
Learn Embedded Systems
Рет қаралды 212 М.
Как правильно выключать звук на телефоне?
0:17
Люди.Идеи, общественная организация
Рет қаралды 1,7 МЛН
تجربة أغرب توصيلة شحن ضد القطع تماما
0:56
صدام العزي
Рет қаралды 57 МЛН