Apache Kafka® Components & Architecture Detailed Explanation in 15 min

Apache Kafka® Components & Architecture Detailed Explanation in 15 min | Javatechie

Рет қаралды 66,048

Күн бұрын

In this Tutorial, we will discuss Apache Kafka Components and its architecture with Internal flow
📚Agenda📚
Producer
Consumer
Broker
Cluster
Topic
Partitions
Offset
Consumer Groups
Zookeeper
#JavaTechie #Kafka
Spring boot microservice Live course Just started (Recordings available)
Hurry-up & Register today itself!
COURSE LINK : javatechie5246.ongraphy.com/
PROMO CODE : Java40
GitHub:
github.com/Java-Techie-jt
Blogs:
/ javatechie
Facebook:
/ javatechie
guys if you like this video please do subscribe now and press the bell icon to not miss any update from Java Techie
Disclaimer/Policy:
--------------------------------
Note : All uploaded content in this channel is mine and its not copied from any community ,
you are free to use source code from above mentioned GitHub account

Пікірлер: 100

@subhashjha936 Жыл бұрын

Thank you for starting the Kafka series and I am eagerly waiting for more videos on this topic..🙂🙂👍👍

@ramakrishna-jm4lc 5 ай бұрын

Excellent, Simplified well Thank you Java Techie

@grrlgd3835 Жыл бұрын

Nice work JT - again ! really appreciate these. Perfect

@senbagasundareswaranmuruga6396 Жыл бұрын

Loved it, thanks for such core details on Kafka.

@vengateshan7800 4 ай бұрын

This tutorial really very helpful to understand from base architecture and its explained each component as easily understandable. Thank you so much and post more videos.

@raghuvardhansaripalli9636 Жыл бұрын

Mega star is back with high voltage Kafka action.. All of us are Waiting here for upcoming videos .. God bless you Basant !!:)

@Javatechie Жыл бұрын

Thanks Raghu . Mega star 🤣 i am planning for this weekend but getting enough time. After March i will actively post as my first spring boot microservice The live course will be complete .

@jasper5016 Жыл бұрын

As always, great content brother. Thanks so much.

@vaibhavmanwatkar534 Жыл бұрын

Thanks for such detailed videos. Great job.

@sudhanshusemwal-hg6sc Жыл бұрын

Thanks java techie for crisp and clear explanation

@rishabhshukla5199 Жыл бұрын

one of the best explanations, thank you.

@beaumontmuni4294 Жыл бұрын

Awesome! Thanks for sharing. 👍

@HarshSingh-ly8mw Жыл бұрын

Most awaited videos sir 😍

@CodeWithAqeel 9 ай бұрын

Top-notch Explanation. Loved It.

@punyabikash3624 Жыл бұрын

Excellent sir i was crying 😢 earlier thinking that it would be difficult topic...how easily you explained thanks a lot for this video....

@Javatechie Жыл бұрын

Thanks punya . Keep learning 😃

@vengateshan7800 4 ай бұрын

Yes.... they way explanation with real time examples is awesome and easily understandable..

@lolitaad19 2 ай бұрын

Me too

@rajkumarwinc9372 3 ай бұрын

Finally.... I learnt kafka😊 thanks Basant ❤

@manu27161 4 ай бұрын

Excellent explanation, explaining in simple way with realistic examples

@zahidhasankhan5762 Ай бұрын

Nice presentation and understanding about KAFKA

@bhaumikpatel5932 Жыл бұрын

Waiting for it.. thanks sir

@akshayengineer2018 Жыл бұрын

Thanks again for next part 👏...

@kvsm123 10 ай бұрын

Great video. Thank you.

@indrajeetsharma7306 7 ай бұрын

Very creative and helpful video anyone can understand. I went through many articles and videos, and I was very confused, and my thought was Kafka is very big and very vast. But by watching this video I am full cleared on Kafka concepts.

@devireddyfavreddy4785 11 ай бұрын

Very well explained and I worked on Solace it’s also same as like Kafka

@viki.04677 Жыл бұрын

Great session with presentation 👏

@carlpei6570 Жыл бұрын

Thanks ..very good playlist

@divakarpandey9094 9 күн бұрын

Thanku yuh sir you've been a great help!!❤

@mohanr8009 Жыл бұрын

Great quality content 👍

@uttam4alltech114 6 ай бұрын

thanks for sharing the kafka series , could you please share or create knowledge on DLQ . dead letter queue implementation in spring boot

@Javatechie 6 ай бұрын

Yes i will

@sureshmanne7245 Жыл бұрын

As usual default like to your videos from me always, keep going

@Breakdownsmth Жыл бұрын

Tech, you touch, it becomes interesting❤️

@sutirthabrahmachari6387 Жыл бұрын

amazing explainations and presentation

@cnaresh6930 8 ай бұрын

Thank you so much

@raghuvardhansaripalli9636 Жыл бұрын

Hi Basant, after this Kafka series could you please create knowledge sessions on SPARK. And integrating kafka with spark using spring boot by creating a data pipeline. thanks

@BhaaRaThh Жыл бұрын

Really great 👍

@sharmarahul17 Жыл бұрын

Excellent explanation 👌

@itsnarahari Жыл бұрын

Great and clean explanation bro

@muhammadsidheek2994 7 ай бұрын

very informative video ,good job👍👍

@maddipatlamadhura1500 2 ай бұрын

Great efforts

@evsatyamblog4218 Жыл бұрын

Thank you❤

@maciejmaciek2967 Жыл бұрын

Bro you are the most understandeble Indian tech guy on the world:) !

@Javatechie Жыл бұрын

Thank you so much buddy for your word 🥰. Keep learning

@lokeshparihar5693 10 ай бұрын

Great explanation sir 👍

@yogeshy7736 9 ай бұрын

Thnks for sharing

@chandrashekarkambalapally1087 Жыл бұрын

Superb Brother 👍🏻👍🏻👍🏻👍🏻

@bharathr5223 Жыл бұрын

Super explanation

@samsameer3214 Жыл бұрын

thank you sir

@kannadasankaruppaiyan1155 Жыл бұрын

Awesome

@gulraizjaved147 8 ай бұрын

very nice explaination brother.

@kalaiselvankesavel2971 Жыл бұрын

I am a big fan of you buddy ❤The way you explain with example even a fresh mind will be expert of the topic . Kudos to you.

@Javatechie Жыл бұрын

Thank you so much buddy 😊. Keep learning

@evsatyamblog4218 Жыл бұрын

Thanks❤🌹🙏

@tusharfasate7388 Жыл бұрын

Suppose,there is a topic which has 5 partitions and one partition's broker dies,in that case,there will be data loss and that why we use replication factor which keeps back up on each partition on other broker

@bugrae9341 Жыл бұрын

Easy and strong explained as usual thanks a lot man keep go on :)

@sachinpete4507 10 ай бұрын

We have right to send the msg on which partition as i have read from kafka. In case you doesn't specify it will works as round robin. Please make the note of this. Thank you for video

@Javatechie 10 ай бұрын

Yes absolutely correct. It's in my queue and will upload soon

@surajmahato2557 Жыл бұрын

Could you please frequently upload the videos for this series

@rajthakkar0071 Жыл бұрын

Quick question : if there are two systems or application who is working as consumer and producer , how consumer knows that they need to create multiple consumer for consuming from multiple kafka partitions ? how to specify those in real world projects when desiging kafka clusters ? Can you please make a video on designing kafka clusters ?

@Amitkumarswain-ud1gx Жыл бұрын

How many consumer group needs to be created that totally depends on requirements of consumer application.let a scinario we have kafka topic and consumer application wants to get all the messages in all env then they create 3 consumer group .

@dharmeshajudiya1709 Жыл бұрын

Comment for support your work

@Javatechie Жыл бұрын

Thanks buddy

@itsnarahari Жыл бұрын

Please cover all the components in upcoming videos by practical

@afuadanquah836 Жыл бұрын

Java Techie, I love your videos. When is your next video? I am eagerly waiting.

@Javatechie Жыл бұрын

Afun thanks for your interest. Occupied with lots of work so please expect a bit of a delay on the Kafka series

@charmbracelets Жыл бұрын

@@Javatechie Thanks for the response and all the best.

@AmlandeepNandi 8 ай бұрын

Hi Basant, if possible can you make a video on how consumer is related to offset commit. Kindly explain the auto and manual commit. Thank you in advance.

@Javatechie 8 ай бұрын

Sure buddy it's a good point to discuss. Thanks

@user-nv1bp6fk6z Жыл бұрын

PLEASE DO THE VIDEO ON REACTIVE KAFKA FOR PUB AND SUB

@raghavendrapatil659 7 ай бұрын

Query: 13:17" videos shows figure of multiple partitions within a topic and messages in it. Here squence number are specific to partition or topic ?

@Javatechie 7 ай бұрын

To partition

@alokdeo123 8 ай бұрын

@javatechie I have one confusion. Does all the partitions under one topic have the same messages or does each partition have different messages. If the same messages then a storage issue will come and if different messages then if partition goes down or corrupts we will lose the message

@Javatechie 8 ай бұрын

No message won't be duplicated across partition

@rushikeshpangare9917 Жыл бұрын

Thank you for the information. When the next video will come.

@Javatechie Жыл бұрын

In the coming days i will upload . Most probably before coming weekend

@kannadasankaruppaiyan1155 Жыл бұрын

I have created both producer and consumer applications, but I am unable to start the zookeeper in windows.. Any inputs?

@santoshkamat6132 Жыл бұрын

Bro make video where we have to re trigger event in case where consumer logic doesn't get executed Also talk about idempotency. Example In my ecommerce project rewards are getting deducted twice for customer because consumer logic is getting executed twice Will thank you👍👍

@Javatechie Жыл бұрын

Santosh will go from the beginning don't worry

@santoshkamat6132 Жыл бұрын

@@Javatechie thanks bro i love your videos I know you like to do challenging things too 🙌🙌

@shilpasingla1739 Жыл бұрын

Hi Basant..here you have considered employee and payment topic separately..what if we want payment information of an employee...are we going to create new topic(having emp-payment) info and emp-payment table also?

@Javatechie Жыл бұрын

It depends on your business to decide the payload structure per topic . To simplify the purpose of the topic i have explained this scenario

@venkateswararao2142 7 ай бұрын

How Kafka will relate with mainframe and MQ?

@rssaini01 Жыл бұрын

Is Kafka Topic like RabbitMQ Queue??

@PradeepKumar-sx6ms 11 ай бұрын

we can divide it into several partitions My question is suppose we divide a topic into 6 partitions can we have 3 partitions in one computer and another 3 in one computer like that

@Javatechie 11 ай бұрын

The entire partition needs to be part of one computer We can't be segregated with partition but yes you can segregate brokers