Apache Kafka Basics - A Layman's guide for beginners | Explained with real life examples (2023)

Поділитися
Вставка
  • Опубліковано 17 вер 2020
  • Apache Kafka Basics - A Layman's guide for beginners | Explained with real life examples
    #apachekafka #kafka
    **Do check out our popular playlists**
    1) Latest technology tutorial (2020) -
    • What is a Data Vault ?...
    2) Google Cloud Platform Beginner Series (2020) -
    • Google Cloud Platform ...
    3) Crunching Data Series (2020) - • Learn - Data Engineeri...
    Hi Friends, I am Anshul Tiwari, and welcome to our youtube channel I.T. k Funde.
    In this video we will take baby steps towards understanding apache kafka. Apache Kafka has become a defacto standard as an event streaming platform.
    So in this video we will learn about -
    - History of Kafka
    - Kafka Basics
    - Key Concepts with real life example
    - Kafka Architecture
    - Apache Kafka Benifits
    Credits & Resources -
    Confluent.io - Kafka The Definitive Guide
    ***********************FOLLOW US ON ********************************
    Facebook - / itkfunde
    Linkedin - / ansh9685
    Twitter - / ansh9685
    Blog - blogs.itkfunde.com/
    Instagram - / itkfunde
    **************************************************************************
    **About This Channel**
    Friends ITkFUNDE channel wants to bring I.T related knowledge, information, career advice, and much more to every individual regardless of whether he or she belongs to I.T or not. This channel is for everyone interested in learning something new!

КОМЕНТАРІ • 249

  • @juanpalma7562
    @juanpalma7562 3 роки тому +79

    I spent quite a while trying to find a relatable set of examples to understand this topic with a solid foundation, and I found them here. Thank you for the detailed yet easy-to-understand explanation! 🙏🏻

    • @ITkFunde
      @ITkFunde  3 роки тому

      Thanks Juan glad it helped !!

    • @kylespencer5395
      @kylespencer5395 2 роки тому

      You prolly dont give a shit but does anybody know of a trick to log back into an instagram account..?
      I was stupid forgot my login password. I appreciate any tips you can give me

    • @zaynwesson1064
      @zaynwesson1064 2 роки тому

      @Kyle Spencer instablaster =)

    • @kylespencer5395
      @kylespencer5395 2 роки тому

      @Zayn Wesson Thanks for your reply. I got to the site through google and Im waiting for the hacking stuff now.
      Looks like it's gonna take quite some time so I will get back to you later when my account password hopefully is recovered.

  • @neonatal123
    @neonatal123 2 роки тому +9

    No-Nonsense Teacher. Thank You !

    • @ITkFunde
      @ITkFunde  2 роки тому

      Thanks a ton ☺️☺️

  • @S0912S
    @S0912S Рік тому +1

    An absolute beginner with zero understanding of Kafka, after this video I am aware of the basic concepts. Thank you so much for all the efforts!

  • @AMOLPALAV44
    @AMOLPALAV44 3 роки тому +39

    All the efforts you have taken while preparing those board diagrams, ppt, examples have made understanding of Kafkfa basics very easily. Thank you and keep up the good work.

    • @ITkFunde
      @ITkFunde  3 роки тому

      Thanks Amol for your generous feedback keeps me motivated 🙏☺️

  • @swapnasundar
    @swapnasundar 3 роки тому +1

    Amazing. Thank you, you explained the concepts in layman's words. Thank you once agian.

  • @sertcow
    @sertcow 2 роки тому

    I feel compelled to say thank you for this important piece of work you've published here. Very grateful.

  • @rkgramani7896
    @rkgramani7896 День тому

    Good mind ,shares knowledge to others.
    +ve ,mind leads to healthy body

  • @RobinSharmaVlogs
    @RobinSharmaVlogs Рік тому

    Great explanation with relevant examples

  • @funluvingguy
    @funluvingguy 2 роки тому

    Well explained as usual and detailed enough to explore further. Nice and clean job!

  • @rohitdeshmukh197
    @rohitdeshmukh197 Рік тому

    I am a big fan of yours, you explain all the complex concepts/topics with such great clarity. Kudos to you!! I hope your channel grows 10x this year. Thanks a lot!!

  • @technoarunav
    @technoarunav Рік тому

    Wow! This video is wonderful!! I wish I could get to discover this channel earlier!! This channel is a boon for many aspiring data engineers!!

  • @gayatriambulkar375
    @gayatriambulkar375 3 роки тому

    Thank you for sharing this video

  • @An12uj
    @An12uj Рік тому

    This video is also an example of Kafka, like explaining big topic with minimalistic time so that the main brain (server) can pick up the important points easily from subconscious brain (pipeline) as a consumer and if the main brain wants data again to remind, the pictures shown in the video can be remembered from the subconscious brain (broker) to store it into the main brain again!
    Great job my friend, you have shown the easiest way of explaining the complex things just like Kafka, thanks 🙏

  • @artsavish
    @artsavish 3 роки тому +4

    I do understand the Apache Kafka architecture but still like the way you presented here. Sure It will help many learner

  • @mrrishiraj88
    @mrrishiraj88 3 роки тому +1

    Amazing tutorial.
    Great thanks.
    🙏🙏🙏

  • @shibasispatel6624
    @shibasispatel6624 3 роки тому

    You have a great teaching skill. You explained in such a way that even a child can understand.

  • @muniharish
    @muniharish 2 роки тому

    Very well explained with good examples!

  • @jennifereis8639
    @jennifereis8639 3 роки тому

    Great video! These examples were so helpful

  • @kanhaglobal
    @kanhaglobal 3 роки тому

    Very well explained Basics of Kafka. I am new for Kafka and looks like I got good 101 knowledge to start the journey.

  • @Jonathan-rm6kt
    @Jonathan-rm6kt 3 місяці тому

    Awesome explanation thank you so much !!!

  • @suhailhassun4570
    @suhailhassun4570 Рік тому

    You made this so simple to understand, thank you!

  • @VlasTrunov
    @VlasTrunov 2 роки тому +1

    Kafka seems so familiar, but I have never yet touched kSQL. Thanks again for laying things out in a very comprehensive way. Now your videos take up my mealtime...

  • @laxmeshdh
    @laxmeshdh 2 роки тому

    Your style is very down to earth & engaging. Thanks for a clear content.

  • @cssensei610
    @cssensei610 2 роки тому +1

    bruh I’ve been a data engineer for about a year, prepping for a senior role-your videos have really helped me with my system design interviews.

  • @yuvrajsingh-vk7fj
    @yuvrajsingh-vk7fj 3 роки тому

    Buddy, the way you described this topic with ease is commendable.

  • @calmmantra1
    @calmmantra1 Рік тому

    This is amazing. GOd bless you brother !!

  • @Goshut
    @Goshut 2 роки тому

    If I got any doubt I always first check his videos and then I would do google. This is very much detailed explanation about Kafka basics. Thank you for your efforts..

  • @prashanthmj4907
    @prashanthmj4907 3 роки тому +5

    You are an excellent communicator and break complex topics into simple understandable concepts. Kudos to you. I just happened to bump into your video this morning and I have listened to 10+ videos of yours on various topics. Great work and your overview, explanation would definitely help millions of people who want to have strong foundation and understanding of upcoming technologies....

    • @shruthiv463
      @shruthiv463 3 роки тому

      Exactly!Excellent material! I accidentally saw the video.. And looked for more videos from this tutor. Thanks a lot Sir.

  • @mvenkatesh-tu6so
    @mvenkatesh-tu6so 2 роки тому

    This is the best video out of 50 videos in youtube. 👍😊 Thanks a lot.

  • @madhupriya4885
    @madhupriya4885 Рік тому

    All in one video. Thank you for explaining it so well. Pls bring some more videos like this :)

  • @nishantdeshpande3457
    @nishantdeshpande3457 2 роки тому

    Nice explanation for solid basic foundation. Thank you

  • @elenaromanova2841
    @elenaromanova2841 2 роки тому

    Great content. Thank you!

  • @deeptidogra7948
    @deeptidogra7948 Рік тому

    Thanks for explaining it so well !

  • @prithwisdas9423
    @prithwisdas9423 2 місяці тому

    It's an awesome experience - learning from you

  • @my_students6966
    @my_students6966 2 роки тому

    Very good examples and explanation was fantastic

  • @raffaeledileo6513
    @raffaeledileo6513 Рік тому

    Very Good explanation! That's a complex topic, however you made it easy to understand!

  • @Dave-bz3lr
    @Dave-bz3lr 4 місяці тому

    Great explanation with good analogies

  • @KamleshSingh-um9jy
    @KamleshSingh-um9jy Рік тому

    Well explained .. appreciate your efforts!!

  • @masheTyMasha
    @masheTyMasha Рік тому

    Lovely video dear..clearly explained

  • @nivedithahn3574
    @nivedithahn3574 Рік тому

    thank you for such a fantastic explanation and for breaking them into smaller concepts.

  • @python2448
    @python2448 2 роки тому +1

    Brilliant introduction! You made a very important topic interesting.

  • @lloydprescott2722
    @lloydprescott2722 2 роки тому

    So helpful and clear. Thank you.

  • @anutripathi0304
    @anutripathi0304 Рік тому

    Amazing job of explaining concepts very nicely 🎉❤

  • @mvenkatesh-tu6so
    @mvenkatesh-tu6so 2 роки тому

    Your presentation is awesome.
    Liked & Subscribed 😊

  • @arvindsharma469
    @arvindsharma469 Рік тому +1

    Very easy and clear to understand. Thank you sir !

  • @aishmash5325
    @aishmash5325 Рік тому

    You are just Amazing!!!! This is such an amazing explanation!!! Just mind blowing!

  • @akshay0240
    @akshay0240 2 роки тому +1

    Such a clear and crisp explaination ! Thanks a lot for this video!

    • @ITkFunde
      @ITkFunde  2 роки тому

      Thanks Akshay ☺️

  • @asifjec
    @asifjec 2 роки тому +1

    Starting to view your lession from today onwards as i liked your explanation very practical and easy to grab.all the best.

  • @xingxingtong2015
    @xingxingtong2015 2 роки тому +4

    Thank you so much for creating this video. I am new to data engineering. Your videos explained those fancy technology in a very concise and understandable way. Amazing work!

    • @ITkFunde
      @ITkFunde  2 роки тому

      Thanks Tong☺️🙏

  • @TWorldCup-ez2wt
    @TWorldCup-ez2wt 9 місяців тому

    Thanks for making it easy to understand....

  • @mrs.jyotimaheshnimbalkar8316
    @mrs.jyotimaheshnimbalkar8316 2 роки тому +1

    Thanks for the best video very well explained...Liked & Subscribed

  • @james-innes
    @james-innes Рік тому

    Great!

  • @abhilashpatel3036
    @abhilashpatel3036 2 роки тому

    That's the smoothest way you asked for subscribe. Kudos!! You're a genius.♥️

  • @gautamssinha9000
    @gautamssinha9000 Рік тому +1

    very well done

  • @bonvivant8618
    @bonvivant8618 7 місяців тому

    This man truly deserves 10M subscribers, i leraned from his previous video how switch, hub, subnet, IP, router, firewall, DMZ, Port forwarding work with simplest analogy of School, Students, Roll no, peon etc etc.. He is genius of teaching with effective learning.. God bless this gem.. ❤

  • @noopurpandey9107
    @noopurpandey9107 3 роки тому

    well explained. Thanks!

  • @mohamedeljahmi2454
    @mohamedeljahmi2454 Рік тому

    Very good tutorial, thank you!

  • @yashadattsawant9266
    @yashadattsawant9266 10 місяців тому

    Really good explanation in easy words👌👌

  • @pascal30
    @pascal30 2 місяці тому

    great content !

  • @eddanapudir
    @eddanapudir 3 місяці тому

    Thankyou very much. Very well explained.😊

  • @udaypatel83
    @udaypatel83 3 роки тому +3

    One of the best explanation! Many thanks for so very great videos. I have seen your other videos and like the way you explain on board with great examples. Keep up the great work and I wont be surprised if the subscription to your channel crosses million users in no time! Great job and thanks once again. Please do start the video series too so that one topic (e.g. Kafka zero to hero.. :-) or ML etc) can be learnt fully with small projects under one channel (i.e. your channel) so we don't have to look for other sources to gain detail knowledge.

    • @ITkFunde
      @ITkFunde  3 роки тому +2

      Thanks Uday really appreciate your kind support and wishes. And I will work on your suggeations thanks for that too. Keep supporting 🙏☺️

  • @lucidCoder0
    @lucidCoder0 Місяць тому

    Great job

  • @samyukthaprabhu4493
    @samyukthaprabhu4493 Рік тому +1

    Very clear, and extremely helpful. Thank you for getting this topic sorted for me in Layman terms! Cheers! :)

  • @daves4026
    @daves4026 2 роки тому

    Great video

  • @666sekhar
    @666sekhar 2 роки тому

    Actually good!!Thanks Sir!!

  • @ganeshmadhunala9953
    @ganeshmadhunala9953 Рік тому

    You are too good 👍. Explained with ease

  • @shivanshutyagi83
    @shivanshutyagi83 Рік тому

    Helpful

  • @SaintSaint
    @SaintSaint Рік тому

    Very well done. I loved the examples and the models. This helped me better understand what Kafka has to offer!

    • @SaintSaint
      @SaintSaint Рік тому

      MQTT was my first exposure to pub/sub brokers. Kafka can be a publish/subscribe system to provide database multiplexing! How cool is that!? Very elegant. I was hoping that I could use Kafka to keep my database information in sync between databases. I'm still not sure if this is the best option, but it's interesting.

  • @saradatalluri9577
    @saradatalluri9577 2 роки тому

    lovely tutorial

  • @sripalpathak7282
    @sripalpathak7282 Рік тому +1

    Nicely explained.

  • @jasper5016
    @jasper5016 2 роки тому

    Thanks so much. It was very easy to understand.

  • @jkaushik1207
    @jkaushik1207 3 роки тому +1

    I am new to this topic related to Data Pipeline. Just for the curiosity I started overview but the way you explained I watched it thoroughly with interest. Thanks. I would say compare to others you are under rated eventhou your knowledge and presentation is excellent. Thanks and all the very best.

    • @koularambayetonedeag1205
      @koularambayetonedeag1205 Рік тому

      It's one of the best videos that explains in a simple and comprehensive words to understand Kafka. I really like the way it was explained. Thanks a lot !!!

  • @anoopv3750
    @anoopv3750 2 роки тому

    Awesome explanation

  • @ravidoddy3308
    @ravidoddy3308 3 роки тому +3

    It's a great video to start with the Kafka journey. Brilliantly explained 👌 though I have to deep dig into it, I guess it can be used as a datalake , where we can staore and transform data and send to different tools analytics tools like elastisearch etc.

    • @ITkFunde
      @ITkFunde  3 роки тому

      Thanks Ravi👍 kafka can be a key component feeding data into your datalake but in itself is a message queue so we can not treat it as a datalake

  • @irfansiddiqui9458
    @irfansiddiqui9458 3 роки тому +1

    Well explained, I was looking around of Clear explanation and not that easy. Appreciate it!

  • @ankitakolhe9142
    @ankitakolhe9142 2 роки тому +1

    Very nicely explained.

  • @mayurm4671
    @mayurm4671 Рік тому +1

    Very very well explained!!!

    • @ITkFunde
      @ITkFunde  Рік тому +1

      Thanks Mayur ☺️☺️

  • @ksh5u81
    @ksh5u81 2 роки тому +7

    I love your videos. Only feedback I have is break down the video into discrete timelines so that the viewer can watch the section that he / she is interested in. So for this video the various sections could be 1) data-drive 2) Log commit 3) Kafka cluster, etc.

    • @ITkFunde
      @ITkFunde  2 роки тому +1

      Thanks for your valuable feedback

  • @thangtrantoan4600
    @thangtrantoan4600 3 роки тому +2

    It took me 2 days to found this video, very easy to understand, great job ! thank you very much, best explanation among dozen videos I found, thanks again

    • @ITkFunde
      @ITkFunde  3 роки тому

      Thanks Thang🙏☺️

  • @arunkumarprajapat3692
    @arunkumarprajapat3692 2 роки тому

    Excellent video 😊

  • @abduljalil5147
    @abduljalil5147 2 роки тому

    highly appreciated

  • @viktorandy6080
    @viktorandy6080 7 місяців тому

    Big KUDO for your content! Saved numerous of hours.

  • @supriyodatta3116
    @supriyodatta3116 3 роки тому +1

    Thank you! Very well explained!

    • @ITkFunde
      @ITkFunde  3 роки тому

      Thanks Supriyo🙏

  • @sandygreenberg7282
    @sandygreenberg7282 18 днів тому

    Good video

  • @waterp2202
    @waterp2202 Рік тому

    Excellent explanation

  • @snehadesai8424
    @snehadesai8424 3 роки тому +5

    Thank you for making such nice videos. I am experienced full stack developer and mother of 2yr old. I get very less time to seat in front of computer screen and read technical stuff. In this situation I like to watch/listen videos on you tube while doing kitchen chores and your videos helps a lot. Keep it up! 👏🙂

    • @ITkFunde
      @ITkFunde  3 роки тому +2

      Thanks Sneha being a mother is the most difficult and rewarding job on this planet and I am so happy my videos are helping you 🙏☺️.. Love and blessing for the 2yr old bundle of joy ♥️

    • @snehadesai8424
      @snehadesai8424 3 роки тому

      @@ITkFunde Thank you 🙂

    • @anilbhasin8782
      @anilbhasin8782 Рік тому

      I kc first

  • @suniguha
    @suniguha Рік тому +1

    Clear and concise explanation. I went through many videos to get the kafka concept but this one is the best to get the idea.

  • @coltellochakku
    @coltellochakku 3 роки тому +1

    Thank you for such simple way of explaining kafka architecture and its benefits.This is what exactly I needed to start knowing more about Kafka.

  • @ranjithr2422
    @ranjithr2422 2 роки тому

    Good explanation

  • @arpangupta2162
    @arpangupta2162 2 роки тому

    best video of kafka so far

  • @UMS9695
    @UMS9695 5 місяців тому

    Well explained!

  • @Noizept
    @Noizept 2 роки тому +1

    very well put. congrats

  • @singhalvikash
    @singhalvikash 2 роки тому

    Pretty Good explanation !

  • @salihugurkmll7675
    @salihugurkmll7675 2 роки тому

    Yok too great!!!

  • @rembautimes8808
    @rembautimes8808 3 роки тому +1

    One of my go to channels for Data Engineering. Must watch for anyone in the data space.

  • @archanasharma2412
    @archanasharma2412 2 роки тому

    Very Well Explained :)

  • @captainbr0st.189
    @captainbr0st.189 9 місяців тому

    I do not usually comment on youtube but man what a video you gave us, infinite thanks!

  • @balakrishnajupudi8515
    @balakrishnajupudi8515 Рік тому +1

    simple, effective and great articulation and teaching; ✴✴✴✴✴

  • @avinandanmukherjee104
    @avinandanmukherjee104 3 роки тому +1

    very nice explanation.... great work !

  • @mksmurff
    @mksmurff 3 роки тому +1

    Brilliant video thanks