Kafka Architecture | Key terminologies | Kafka Features | Apache Kafka Tutorial in Hindi | Video 2
Вставка
- Опубліковано 7 лют 2025
- This video explains kafka's Overall Architecture, Key terminologies used in Kafka Ecosystem and What are the features/advantages kafka provides over other messaging systems.
Find below the link to previous video.
• What is Kafka | Messag...
Find below the link to Kafka tutorial series Playlist.
• Apache Kafka Tutorial ...
Find below the official documentation of Apache kafka -
kafka.apache.o...
I graduated from IIT BHU Varanasi and currently work as a Software engineer with a MNC company.
MIC :- amzn.to/34Z12rr
TRIPOD :- amzn.to/3FxFI91
LIGHT STAND :- amzn.to/322VXNr
Green Curtain :- amzn.to/3KdKbB6
Connect with me on LinkedIn.
/ brijeshgupta96
Connect with me on FaceBook.
/ brijesh.iitbhu
Connect with me on Instagram.
/ brijeshgupta__
Simplest explanation you can find on internet about KAFKA Architecture.
Too good !!
The simplest meaning of a Topic in Kafka is that it is equivalent to a Table in SQL database . I immediately understood the concept of topic.
I generally wont comment but your detailed and well explained content forced me to add an appreciation coment,bro u are just awesome,please keep making videos .
Thank you for appreciating. 😊
Brother, if you keep making videos, you will go viral very fast. Your teaching way is excellent.
Thank you so much 🙂
Agree 👍
Like the simplicity but not lacking any technical explanation. Excellent work. Thanks a lot for such wonderful work.
So nice of you
You have no idea how good you teach and how helping this is to many of us. Please make playlist of docker and Kubernets please
Thanks Sumaiya, Docker playlist is in progress. 😊
where is dpocker and kubernets playlist?????????????
@@BrijeshGupta
@@BrijeshGupta pls upload docker and kubernates tutorial
Thank you soooo much!!! I literally went through a lot of kafka explanations on youtube but yours was truly the best! Very well explained bro. You have made this topic very easy to understand. You are truly adding value in people's lives.
You're very welcome!
Brijesh, I'm loving your way of explaining the things. Please make it continue
Thank u so much Roshan
I wanted to learn what is Kafka. This is great video to understand kafka and zookeeper . Thanks Brijesh
Glad to hear that
No words about your explanation bro....................THANK YOU BRO
So nice of you
Explained in better way you need to keep doing it 🙏
Finally got the perfect Kafka tutorial for me.. Thanks Brijesh
Glad you liked it Vivek. 😊😊
You are an amazing person. The way you have explained each and every process is remarkable. Keep growing brother. Cheers !!!
Really good and well explained. I am regularly following your videos now. thanks
Glad to hear that Jyotsna. Feel free to give feedbacks wherever possible
Excellent Teaching, Crisp content . Keep it up. Gr8 social service. May god Bless You
So nice of you
This is my second video which I watch. Well explanation
Nice teaching sir, I recommended every microservice developer must watch your series.
Thanks a ton
Great Sir maza he aagaya in market huge demand now. Dil se thanku sir
You are explaining everything very well.. keep posting such tutorials.
Aap boht hi jyada accha padhate hain.. Please bring such more videos on different tools.🥰🥰🥰🥰🥰🥰😝
Though, I am not able to understand the contents but I like the content's explanation.
Woow brijesh...what an amazing piece of work..kudos
Thanks 😊
What a explaination Brijesh. not only every topics but every word you have described very well. Thanks Bhai you did a great job..
Thank you Ritesh 😊
You explained it very clearly..... awesome explained.... thanks 🙏🙏🙏 I am searching this type of videos and channel ❤❤
You have made a Kafka so simple keep going.
Thanks a lot
Awesome , the best teacher I ever saw
well narrated Brijesh .. way to go man !!!
Many thanks for sharing such nice videos from the very beginning. You are really a great tutor.
I like your way of explanation to understand the stuffs for new learners also .thank you
Glad to hear that. Thanks Darshana 😊
Bhai, excellent video. Dont give up. Your channel is going to be a big hit. I am able to understand Kafka so well after watching this video. Subscribed to your channel..
Thanks a ton. I'll try my best
hi brijesh your content and way of explaining things is amazing...
Thank you so much 😀
Bro..you are sharing much needed knowledge..thanks bro
Ur teaching way is very good
Best kafka tutorial ever
His way of explanation is lit 🔥🔥🔥
Thanks Divakar
Really loved your work brother :) Keep going. Waiting for your new playlists.
Thank you Suman, I am planning to upload a playlist on docker series. will try to upload at the earliest.
Hi Brijesh, You are an awesome person who explains each term and topic, Keep it up.
Thanks a ton
Amazing ! content about Kafka it's really helpful
Thank so much sir
Glad to hear that. Thanks
Hi Brijesh Thanks from Pakistan :) . You way of teaching is very awesome and detailed explanation of each and every concept is really remarkable. keep going on dear (y)
👌👌best explanation on utube
Thanks a lot Nikhil 😊
bro....i like the way u explained the things
Thanks a ton
Thank you brother....., You made my day.....
Glad to hear that
Hi Brijesh,
Loved the video. Very well explained. But some of the clarifications I would love to know about are:
a) What is the advantage for the producer to publish messages at Partition level Vs. Topic level?
b) How does the consumer know which partition to extract data from? Advantage of subscribing at Partition level?
c) Can we directly replicate at Topic level instead of Partition level?
d) How do we bring back the broker which may have stopped functioning or is the data loss permanent?
Hi Amit thanks for the appreciation. Below are the answers to your questions.
1) Lets suppose A producer has data related to sports, And there is a topic named "SportsTopic" in kafka cluster. Now Producer can opt to send Cricket related sports data to one partition, Football related sports data to other partition and so on. By doing so, he is further categorising the sports data, and reducing the number of topics to be created on kafka cluster. It also helps consumers in many ways which I'll be explaining in the coming videos.
2) Producers need to tell the consumers that the specific data which you are interested in is present in this topic and this partition. Advantage of subscribing at partiton level is to prevent the consumer processes to act on all the messages present in the topic, which may not be meant for them.
3) Replication is property of a Topic, meaning while creating the topic you provide the value of this property to kafka cluster. Replication only has significance for partitions.
4) This point will be coverd in later lectures.
Nice videos man very good way to explain. Thank you :D
you are to good for teaching brijesh🙏
great explanation brother keept it up!
Glad you liked it!
Your knowledge and presentation are excellant! Kudos!
Which tool you are using for the diagram?
Thanks buddy. I m using draw.io for diagrams and microsoft ppt for the presentations
Thank You soo much, very well explained. keep it up🙌
Good way if explaining bro . Thanks a lot 🙏
Happy to help vikash🤟🏽🤟🏽
Hello Brijesh..Thanks for such great efforts you are taking..The way you are explaining is really awesome.. Keep it up!!😊
Easy to understand... Great Video.
superb sir ..plz provide some more good tutorial
Sure I will. 😊
Too good bro. Thank you so much.
thank you 😊
Nice explanation :-) from scratch
Glad you liked it Chandan 😊
bhai, khatarnaak padhate ho yaar.
Thank you Bhai
beautifully explained.
Thanks Akash
Why are u not making videos from last 2 years, please make it ur content is too good.
Excellent teaching ❤️
Please cover other Apache services like Hadoop HDFS, hive , HBase, spark etc
Sure I will
Great work bro, please made other technologies video too....
Thanks sanchit. sure I'll make other series as well
Hi, amazing videos. One request, you are explaining these, now creating the notes with those diagrams is a bit messy, is it possible for you can share the pdf of the notes, in which you have added those diagrams and points.
you are awesome. Could you please explain Spark in same fashion.
very good explanation
Very informative tutorial
Glad you liked it
best explanation
thank you 😊
How to we define No. of brokers in it?Is it by default 2 or we can change no. of broker on the basis of our data requirements.
you are really awesome
Thank you 😊
Beautiful explanation 👌👏👍
Thanks for liking Sanjay. 😊
Thank you very much, awesome tutorial.. :) Just had a query actually regarding the data splitting into partition. Assume we have a single file of 5 GB so how the flow will be here, like 5 gb get splitted into multiple partition or complete 5gb get stored into one partition & the next file move to 2nd partition
Its very nice and excellently explained series. Could you please share the presentation slides ?
Thank you.
I'll attach the slides link next week.
Explanation is good but need to elaborate more without skipping topic
Sure prateek, will try in coming videos
Hi Brijesh
this video series is very informative. Thanks a lot for this.
Can you please share the PPT you are showcasing in your video ?
It will be great for notes purpose.
Thanks in advance.
Hi Ayush, thanks for the appreciation
Currently I don't have the notes handy, will share the link on UA-cam once available
excellent content .
Glad you think so!
Bro can we expect some tutorial on apache flink after Kafka ?
You did a great job creating these videos!
Thanks a ton! 🙏
Hello, I am using Kafka and I am producing data to Kafka at very High speed after sometimes my groupid expired, and my producer is not working.
I am working on application which is based on stock exchange.
Can you please help me how to stop groupId memeber expiration.
Bhai video clarity is very poor. Try to use better camera . Amazing session ever !!❤
Hello brother, you are awesome with kafka tutorial. I have one question is, from where I can get this PPT? can you share it?
Very good
Shandar
super ♥👍
Thank you! Cheers!
hey nice vid again.
I am working on some project and cant get my head around one thing - i create a topic with three partitions and my consumer group has just one consumer. Is this better or having just one partition in the topic better?
Context - It is must that I ensure that there is one consumer per consumer group since i am following pub sub model, but I am having hard time deciding if it should be 1 partition per topic or multiple partitions? your opinion?
Hi Shashank, Main motive behind partitions is throughput at consumer level. If you are sure that there will be exactly one consumer per consumer group then its better to have only one partition, but also make sure to set replication value to more than one as it'll prevent data loss.
Thanks for the informative tutorial. I have one query, when we have a partiton in one broker then for replica we replicate the same partiton in another broker to avoid data loss, now the first broker is down and the partition has 100 records initially out of which 30 are consumed by a consumer, which means 70 records will be available in this partition when broker is down. How the replica of the same partition in the second broker will handle this scenario , will there be 100 records or it will have 70 records. Please share your thoughts. Thanks
it'll have 70, as leader partition shares its state to its replica after every modification
Nice Sir
Thanks and welcome
Hi Brijesh,
I must say your videos are really very good. Excellent work !!!!! I have one query related to this video. In Kafka cluster you can have many brokers. Does broker share the same topic. At 6.18 MyTopic had 3 Partition. P0 and P2 went to Broker 1 and P1 went to Broker 2 or Topics are independent of Brokers ?
Thanks,
Vivek
It depends on the number of partitions, All the partitions of a given topic is distributed within brokers in a round robin fashion
what is consumer-offsets ? what are its use?
Explained in later videos of the series pankaj
Thanks
Welcome
I guess, distribution of partitions into different brokers is not round robin. Its random.
Can you confirm?
Its round robin, written in kafka documentation
sir can i connect python kafka to node js?
jo ppt aap use kar rahe ho. wo mujhhe kahan se milenge
Hi Brijesh sir, I'm loving your way of explaining the things, Do you have notes for this.
Thanks Praveen😊, Yes I have, but I keep on modifying them.
Great tutorial.. thanks for information..
Glad it was helpful!
Bro's video quality 🥴,
Bro's content 🗿
It is a complete playlist
Its not, but most of the basics are covered in this playlist, I m working on to add more videos in the series
@@BrijeshGupta hope we will get soon sir...I like the way you explaining the topic. We need more people like you for boosting our educational system 🔥. Waiting hard for upcoming videos....
Gaand faad bhai..bhut shi explanation.
😄😄😄
It was very helpful session..how can I contact you for some queries
You can mail me at brijesh.krgupta.cse14@iitbhu.ac.in
How can I get this architecture diagram
Take a screenshot maybe
what is a Broker ? What is the purpose of Broker?
Explained in later videos of the series pankaj
🎉🎉🎉
Sir how do I get it's complete notes
By complete notes you mean The ppts ??
or maybe u can follow the official documentation. I have shared the link in the description.
Wow👌
Though I am not able to understand the contents but I like the content's explanation.