Apache Kafka Explained (Comprehensive Overview)

Поділитися
Вставка
  • Опубліковано 26 вер 2024

КОМЕНТАРІ • 139

  • @jimmortenson9383
    @jimmortenson9383 4 роки тому +192

    This video does what 2 hour conference talks wish they could. Thank you!

    • @Finematics
      @Finematics  4 роки тому +1

      thanks Jim!

    • @kenchang3456
      @kenchang3456 4 роки тому +1

      I agree with @Jim Mortenson, great video. I'm subscribed. Thank you very much.

  • @Marius5404
    @Marius5404 3 роки тому +33

    Honestly one of the best introductions into a technology I have ever seen. Everything is so clear and it has great examples. Thank you!

  • @cheatman05
    @cheatman05 3 роки тому +16

    This is the most comprehensible presentation I've seen in a long time!

  • @andrewhting
    @andrewhting 2 роки тому +5

    Wow, the first 1:30 and things have become way more clear to me than the last 3 hours of kafka videos combined from multiple other content creators. Thank you for breaking it down from a high level like that. Bravo!

  • @alexkumpula
    @alexkumpula 3 роки тому +5

    This really answered all the nitty-gritty architectural questions I was puzzling over while watching through other videos. Thanks for the video!

  • @StyleTrick
    @StyleTrick 4 роки тому +8

    This is one of the best videos on Kafka I've seen, thorough and straight to the point!

  • @osallllllll
    @osallllllll 4 роки тому +4

    This video proves that teaching is not for everybody. 20 minutes straight to the point.

  • @oswaldumeh
    @oswaldumeh 4 роки тому +8

    This video has totally lifted me from a zero in terms of my understanding of Kafka. The explanations are concise and clear, shows a firm understanding of the topic from the creator. Thanks for this. Well done!

    • @Finematics
      @Finematics  4 роки тому

      Thanks Oswald! I'm happy it was helpful

  • @ardsandlived
    @ardsandlived 4 роки тому

    This is an excellent presentation on Kafka. As a solution architect with 20+ years experience in messaging middleware, I will recommend it to anyone who is starting to look at using Kafka (as I am).

  • @victorgomez335
    @victorgomez335 Рік тому +1

    Great video, everything was explained clearly and concisely. One of the best introductions to a topic that I have ever seen in my life. Continue like that

  • @axelhuachacona6227
    @axelhuachacona6227 4 роки тому +2

    Thanks for your work man! This is so far the best video talking about Kafka

  • @ritviksharmacooldude
    @ritviksharmacooldude 3 роки тому +11

    Every time i “replay” this video to understand kafka 😎

  • @deepsikhakar9166
    @deepsikhakar9166 2 роки тому

    one of the best deep dive in kafka great work

  • @VictorRomanC
    @VictorRomanC 4 роки тому +25

    Great video! I would love to see a Finematics on Spark, Micro-services or Functional Programming

    • @evisionwithjps602
      @evisionwithjps602 3 роки тому

      New kafka practical tutorial ..ua-cam.com/video/mlH0y7FOukU/v-deo.html

  • @irekd.4077
    @irekd.4077 4 роки тому +4

    Please keep up the good work. Great explanation of complicated matter. If we had academic teachers like you, we would be in a better place. Thank you!

    • @evisionwithjps602
      @evisionwithjps602 3 роки тому

      New kafka practical tutorial ..ua-cam.com/video/mlH0y7FOukU/v-deo.html

  • @laxmigo
    @laxmigo 3 роки тому +1

    One of the best Kafka video, i came across. Thanks you !

    • @evisionwithjps602
      @evisionwithjps602 3 роки тому

      New kafka practical tutorial ..ua-cam.com/video/mlH0y7FOukU/v-deo.html

  • @BrankaSando-l3b
    @BrankaSando-l3b Рік тому

    Thank you for this video!!! One of the best on this topic!

  • @AllenLVW
    @AllenLVW 3 роки тому

    The best video to begin understanding Kafka!

  • @aycanayhan3680
    @aycanayhan3680 4 роки тому +11

    Wonderful explanation, thanks a lot!

  • @Finematics
    @Finematics  4 роки тому +1

    If you want to learn even more about Kafka you can check out Kafka The Definitive Guide ► amzn.to/2Ra68Yn

  • @ckhare11
    @ckhare11 4 роки тому +2

    Great to get a quick overview of Kafka. Nicely explained.

  • @imyashdeepsharma
    @imyashdeepsharma 4 роки тому +8

    Loved it, Great Explanation to the each component of the architecture.

  • @imariomm
    @imariomm Рік тому

    Thank you for such short and comprehensive explanation... THANK YOU!

  • @robertfowler2811
    @robertfowler2811 8 місяців тому

    fantastic explanation one the best explanations I have ever read

  • @sgwong513
    @sgwong513 3 роки тому +1

    This is a video to make me subscribe. short video but a lot of contents. much better than some 2 or 3 hours video. Thanks for the awesome video, i think the creator did spend a lot of time to come out this video.

  • @mahenrathod5285
    @mahenrathod5285 2 роки тому +1

    Very informative and easy to follow. One of the best refresher videos I found on the internet. Thanks for this amazing video 👍

  • @satyanarayanapeteti2690
    @satyanarayanapeteti2690 4 роки тому +1

    Nice explanation with in depth analysis of architecture

  • @micha6568
    @micha6568 Рік тому

    Great Kafka tutorial. Thanks a much👍

  • @mehdimomeni6671
    @mehdimomeni6671 4 місяці тому

    Clean and concise! Niiice work...

  • @anaschtourou288
    @anaschtourou288 3 роки тому +1

    excellent video, thank you.

  • @demidevil666
    @demidevil666 3 роки тому +2

    Thanks a lot for this comprehensive overview. I recently started a new job and we use Kafka in our team, yet I still have a lot of questions about it. Your video helped a lot! :)

  • @acupfb
    @acupfb Рік тому

    Greatly explained!

  • @davidfang2725
    @davidfang2725 4 роки тому +1

    Quick, meaningful, and useful overview of Kafka. Thank you!

  • @juanpabloaguirre5837
    @juanpabloaguirre5837 4 роки тому +3

    Extremely useful. Is like 4 months of traditional University courses

  • @filipeschenkel
    @filipeschenkel 3 роки тому +1

    Amazing video, you summarize a really great amount of information very well... Thank you :)

  • @parkavimani3995
    @parkavimani3995 3 роки тому

    Such a refresher this video is!

  • @1982jayanth
    @1982jayanth 4 роки тому +1

    I am new to kafka, and this gives a great idea about the topic.
    Thanks Finematics.

  • @rajkrishna5439
    @rajkrishna5439 2 роки тому

    great intro well summarized

  • @bws462
    @bws462 5 років тому +2

    thanks for making these videos. Well done, I learned a lot. Looking forward to more

  • @SharpKnife523
    @SharpKnife523 4 роки тому +1

    great tutorial in such a short time. excellent work!!

  • @lakshay510
    @lakshay510 3 роки тому +1

    Wow, What an amazing video. Subscribed!

  • @funkiekeda
    @funkiekeda 4 роки тому +2

    Superb content, sir. Please do continue.

  • @pailacognizant
    @pailacognizant 2 роки тому

    Fantastic Video.. Great demonstration skills in action and easy to understand

  • @海璃-m2u
    @海璃-m2u 4 роки тому +2

    A good overview, thank you!

  • @rajkkorrapati
    @rajkkorrapati 4 роки тому +1

    Great Explanation ! I'm new to this but after the video now I can go back and talk , trigger my solutions around it.

  • @nandrajmeshram8755
    @nandrajmeshram8755 3 роки тому +1

    great video thanks for share such worthful information.

  • @niharikapatil902
    @niharikapatil902 4 роки тому +2

    THIS IS A BRILLIANT VIDEOOOO!!!

  • @marcosferreira220863
    @marcosferreira220863 11 місяців тому

    Very good introduction

  • @jonathanmeyer4842
    @jonathanmeyer4842 4 роки тому +2

    Amazing detailed presentation ! Keep it up :)

  • @9998872108
    @9998872108 4 роки тому +1

    Very good explanation.

  • @nditahsamweld346
    @nditahsamweld346 4 роки тому +1

    An amazing video. Well done!

    • @evisionwithjps602
      @evisionwithjps602 3 роки тому

      New kafka practical tutorial ..ua-cam.com/video/mlH0y7FOukU/v-deo.html

  • @AbdulMannan-rv5yx
    @AbdulMannan-rv5yx 4 роки тому +1

    Really nicely explained. I loved it

    • @evisionwithjps602
      @evisionwithjps602 3 роки тому

      New kafka practical tutorial ..ua-cam.com/video/mlH0y7FOukU/v-deo.html

  • @juliahuanlingtong6757
    @juliahuanlingtong6757 3 роки тому

    Really compreheasive with a compact of gold!!~ If given some examples, it would make 10/10!

  • @havefuntrading6263
    @havefuntrading6263 3 роки тому +1

    Great stuff, very well explained

  • @suckyboy
    @suckyboy 4 роки тому +1

    Tanks for explaining

  • @meee3107
    @meee3107 4 роки тому +2

    Thank you so much for the great video, so informative in few minutes.
    I have a question that is a little off topic, what software do you use to create your videos ?
    Thank you.

  • @CraigStrachanZA
    @CraigStrachanZA 3 роки тому

    Brilliant overview. Very well done.

    • @evisionwithjps602
      @evisionwithjps602 3 роки тому

      New kafka practical tutorial ..ua-cam.com/video/mlH0y7FOukU/v-deo.html

  • @alrighttheresham
    @alrighttheresham 5 років тому +1

    @Finematics Fantastic video, would love to see similar sized overview for streams and connect

  • @miguelangelojeda8382
    @miguelangelojeda8382 2 роки тому

    really nice video!

  • @Hraffnir
    @Hraffnir 4 роки тому +1

    Very well explained, well done.

  • @郑鹤-s1s
    @郑鹤-s1s 4 роки тому

    Great presentation and explanation. Thank you!

  • @rosewinjr
    @rosewinjr 2 роки тому

    Nice explanation

  • @carapungo
    @carapungo 3 роки тому +1

    Excellent presentation bro!!

    • @evisionwithjps602
      @evisionwithjps602 3 роки тому

      New kafka practical tutorial ..ua-cam.com/video/mlH0y7FOukU/v-deo.html

  • @russ_fx
    @russ_fx 4 роки тому +2

    Such a clear explanation. Do you have a video like this for each Apache technology ? (Spark, airflow, flume etc)

    • @Finematics
      @Finematics  4 роки тому

      Not yet, but there will be more videos coming up on different topics including Apache tech. You can subscribe to the channel to stay in the loop.

  • @dozedyolk
    @dozedyolk 4 роки тому

    Great explanation of a complex topic.

  • @MartynInEurope
    @MartynInEurope 4 роки тому +1

    Great job! Thanks!

  • @rishisaireddysudireddy5437
    @rishisaireddysudireddy5437 4 роки тому +1

    Great video , keep doing more

  • @roberts1782
    @roberts1782 3 роки тому

    Thank you

  • @sahillamba3879
    @sahillamba3879 4 роки тому +1

    Thanks for sharing knowledge. Video is good

  • @saravanprathi6956
    @saravanprathi6956 4 роки тому +1

    Thank you, very nice video! I hope you use a black screen with white pen for your future videos. It would be easy on our eyes!

  • @ssingh2k8
    @ssingh2k8 3 роки тому +1

    Beautiful.

  • @qmar1980
    @qmar1980 Рік тому

    Thank you for the content. I am totally beginner in Kafka - so I have question related to the distributing messages into the Kafka for specific Topic. In the beginning part of the presentation it was said that if the message will be written in the Round Robin fasion (6:48). I understood that the message will be written only in one specific partition (not all of them). Than starting from (9:21) it is said that if the topic has multiple partitions, than messages would be written into multiple partitions evenly. Can someone please explain the concept in order to be sure how it would be really done ?

  • @mnfchen
    @mnfchen 2 роки тому

    12:32 Note that consumers no longer have to connect to the leader partition. They can now listen on a replica (for committed offsets).

  • @rohitsinha3876
    @rohitsinha3876 3 роки тому

    Amazing and well explained. Precise and to the point. @Finematics Can you also please explain the part if exactly once delivery and at least once delivery issue in kafka. Btw thanks for this video

  • @authhwang8774
    @authhwang8774 5 років тому +2

    good video for knowing kafka

  • @小号-m2y
    @小号-m2y 5 років тому +2

    nice video!

  • @floidcosta
    @floidcosta 3 роки тому +2

    good stuff.

  • @bp8730
    @bp8730 2 роки тому

    fantastic

  • @lindilebangose7667
    @lindilebangose7667 4 роки тому +2

    Can you please guys do zookeeper as well

  • @jamesburke7033
    @jamesburke7033 4 роки тому +1

    Great video and gave me a great understanding at a high level. It seems like Kafka can be a great solution in so many way, but I'm a little confused where and how. If I wanted to build Kafka into a web site (i.e. shopping car, a cloud based accounting system) as a broker and controller of a web site currently built on a LAMP stack would that be possible. How and why would I do this? Can somebody please point me into the right direction to find some answers?

    • @Finematics
      @Finematics  4 роки тому +2

      Thanks James.
      In the systems I built so far Kafka was used to deliver messages between internal services. As an example you can imagine a website that allows you to register a new user. A request to create a new user would go to a backend service usually via REST or Websocket. After that the backend endpoint would construct a message with the newly registered user and send it to Kafka so other services could pick it up and do something with it (for example another service could read it from Kafka to add it to the database).

    • @geolee76
      @geolee76 3 роки тому

      What about the reply response to user. User would be waiting for consumer to add into db and how it response back to user once done

  • @DontTakeCrack
    @DontTakeCrack 3 роки тому

    Thanks, i find this summary pretty useful.
    Not sure about that ending though, things like JMS + backpressure seemed pretty tacked on and im pretty sure JMS is not directly related to rabbitmq.

  • @Manolete919
    @Manolete919 4 роки тому +1

    Excellent

  • @sergeykotov4719
    @sergeykotov4719 4 роки тому

    It would be nice to hear when RabbitMQ is preferable to Kafka, in what use cases Kafka is not the best option as a message system.

  • @borisdavidov5
    @borisdavidov5 4 роки тому +1

    good stuff!

  • @mqtt07
    @mqtt07 2 роки тому

    How seriously should one consider the "deliver at least once" limitation of Kafka in a solutioning design. In other words how often messages are delivered more than once to become a problem in a solution?

  • @mariosergiosilva8820
    @mariosergiosilva8820 2 роки тому

    Amazing 😁

  • @nashram344
    @nashram344 4 роки тому +1

    DAM !!! excellent video

  • @arj123sub
    @arj123sub 4 роки тому +2

    Super ,

  • @justinnguyen3845
    @justinnguyen3845 3 роки тому

    hi, what tools did you use to create these doodle videos?

  • @windowcrystal4012
    @windowcrystal4012 4 роки тому

    Could you please share the slides? It is very good

  • @danielsonski
    @danielsonski 3 роки тому

    Nice... Nothings seems to be simplified. I, sometimes, felt a little backpressure myself :-p. (no worries, I can revisit this later on :-) )

  • @neyudn7896
    @neyudn7896 4 роки тому

    I'm wondering which tool did you use to make a full map of slides???

  • @surajmali3885
    @surajmali3885 4 роки тому +1

    Excellent explanation.. Thank you

  • @rahulbsadyanth8745
    @rahulbsadyanth8745 3 роки тому

    Does Kafka require coding?

  • @Snorlite
    @Snorlite 4 роки тому

    6:42 here, you say that if the partition is not specified, the partition will be chosen following a round-robin scheduling
    9:14 here, you say that if the partition is not specified, the producer will write the same message to every partition of the topic
    What's the truth? Or am I missing something?

    • @Finematics
      @Finematics  4 роки тому

      Hi Snorlite. What I meant there is that messages (multiple) will be written to each of the partitions evenly, so let's say we have 3 partitions and message 1 will go to partition 1, message 2 to partition 2, message 3 to partition 3, message 4 to partition 1 etc. After 99 messages each partition would have 33 messages each. Sorry if the explanation was not clear enough.

    • @Snorlite
      @Snorlite 4 роки тому +1

      @@Finematics Got it! Thank you for the reply.
      By the way, great video, it's very helpful.

  • @chudchadanstud
    @chudchadanstud Рік тому

    How large is a message? Millions of messages is meaningless unless you know the size of the message.

  • @gaurikesarwani2494
    @gaurikesarwani2494 3 роки тому

    Don't Shoot yourself in the Foot😉💁

  • @eugenmalatov5470
    @eugenmalatov5470 Рік тому

    Minute 2-3 just buzwords and advertisement without explanation

  • @Ikilledthebanks
    @Ikilledthebanks 2 роки тому

    Thank you yet again, I owe you.

  • @narsiktube
    @narsiktube 4 роки тому +2

    One of the best conceptual introductions to Apache Kafka. Thank you and keep up the great work !