A Simple Kafka and Python Walkthrough

Поділитися
Вставка
  • Опубліковано 9 січ 2025

КОМЕНТАРІ • 50

  • @alepel792
    @alepel792 4 дні тому +1

    No verbosity just simple and friendly. Thank you!

  • @mohammadthousif7439
    @mohammadthousif7439 День тому

    I have gone through ton of videos on how to get started with kafka and believe me this video was all i needed. Please make a full fledged project on apache kafka it would be really helpful. Thank you so much and keep up the great work. :))

  • @TheDriftingStig
    @TheDriftingStig День тому

    Between watching someone else's 3 minute video on the basics of Kafka to your hands-on video here, Kafka makes so much more sense now. Thank you so much! You've earned another subscriber. I'll also have to find out how to get those Python hints in Vim as well. I like VS Code too much for now though.

  • @akashhooda8000
    @akashhooda8000 Місяць тому +1

    I wish i had a teacher like you!! Things would have been far more better.

  • @arslanzahid4214
    @arslanzahid4214 3 місяці тому +4

    the best videos are usually the most underrated. This video is exactly what I needed. Learning micro servicing for real-time ML applications, and this is so helpful. Thanks a ton for this.

    • @QuixStreams
      @QuixStreams  3 місяці тому +1

      Thank fo watching. Please share our content on X and Twitter to spread the word!

  • @arisweedler4703
    @arisweedler4703 6 місяців тому +4

    I like how he formatted his code with a single space then a save at around 8:10.
    Had to fix the syntax error so the formatted could properly parse the Python. Dude is used to coding like this. Epic

    • @KyleReevesSci
      @KyleReevesSci 6 місяців тому +2

      It's true, they're so at ease programming in python, it's really enjoyable to watch. Their clear commentary at the same time is like effortless choreography.

  • @shehanreshin
    @shehanreshin 8 місяців тому +12

    Love your teaching style

  • @tonper
    @tonper 6 місяців тому +2

    I was wondering what Kafka is, I think we could apply this concept at work... A big thank you, you earned a new subscriber

  • @jesusjar11
    @jesusjar11 8 місяців тому +6

    Wonderful! I dont do any python nor kafka, but surely its entertaining watching setting up a project from the ground up : )

    • @QuixStreams
      @QuixStreams  8 місяців тому

      Thank you! Glad you enjoyed it.

  • @EndikaMT
    @EndikaMT 6 місяців тому +4

    The way you explain is awesome. You are really good at teaching and explaining :)

  • @Apex543
    @Apex543 4 місяці тому +3

    how come this video has only 1K likes. gotta appreciate the man's effort

    • @QuixStreams
      @QuixStreams  4 місяці тому +1

      Thanks @Apex543. Please share on socials to help boost the numbers!

  • @souravbarua3991
    @souravbarua3991 8 місяців тому +8

    Thank you🙏 for this video. Much needed. Please keeps coming this type of tutorial videos of kafka python with quixstreams. Please do make video on making dataframe with quixstreams (next level or say continuation of this video)

    • @QuixStreams
      @QuixStreams  8 місяців тому +4

      Will do! Stay tuned, there's a video like that planned for this month. :-)

  • @MaddyIndia
    @MaddyIndia 6 місяців тому +2

    So clean and easy explanation. Really like your style.

  • @zedzpan
    @zedzpan 6 місяців тому +3

    Thank you for this. It was incredibly easy to follow.

  • @chinyerenwigwe5166
    @chinyerenwigwe5166 7 місяців тому +5

    You just got a new subscriber!!! Simple andl understandable

  • @Ahmed.Abdalla.Mohamed
    @Ahmed.Abdalla.Mohamed 3 місяці тому +1

    Amazing style of teaching

  • @TheMrSnuSnu
    @TheMrSnuSnu 7 місяців тому +2

    Really good design patterns, thanks for the tutorial

  • @kushagrakumar-l4c
    @kushagrakumar-l4c 6 місяців тому +3

    Excellent video. Could you please provide some insights on how you configured your vim settings? If possible please make a video about Vim configuration for Python developers.

  • @TheAremoh
    @TheAremoh 6 місяців тому +4

    Subscribed, liked and notification turned on. Great video ❤

  • @steverosam1265
    @steverosam1265 8 місяців тому +6

    Thanks. Love this

  • @northjosh1
    @northjosh1 Місяць тому +1

    Wow amazing. Thanks a lot!

  • @rajkumar3433
    @rajkumar3433 6 місяців тому +3

    I was looking for streaming data for forecasting model. ❤

  • @lucasdelargy
    @lucasdelargy 2 місяці тому

    Thanks very much for the effort.

  • @florecista1
    @florecista1 6 місяців тому +2

    Brilliant! Bravo! 👏👏👏

  • @ipelezikis
    @ipelezikis 7 місяців тому +5

    Nice! I didnt know this library. Any advantages/disadvantages over confluent-kafka and kafka-python?

    • @krisajenkins
      @krisajenkins 7 місяців тому +2

      The big advantage is stream processing. All three libraries support producers and consumers, quixstreams also adds in Kafka Streams-style processing. If you ever need to write the kind of code that reads from one topic and writes to another, that's a huge addition.
      (There's a new video coming out later today that showcases the stream-processing part of the library. 🥳)
      For the producer/consumer side, quixstreams is actually using confluent-kafka under the hood, and exposes all the same options, so it's basically a superset of that library.
      Kafka-Python's big advantage is that it's native Python. Both quixstreams and confluent-kafka wrap the C client, librdkafka. That may be an important factor to you. Though given how good Python wheel support is these days, it's not as big a deal as it used to be. 🤷‍♂

  • @rajkumar3433
    @rajkumar3433 6 місяців тому +2

    ❤ learning python

  • @fanda10
    @fanda10 6 місяців тому +4

    Hi, nice tutorial! I know it is only an example app, but it’s ok to keep producer open? Would it be better if we open it only just at write time? Thanks. 🙂👍

    • @QuixStreams
      @QuixStreams  6 місяців тому +1

      Yes, that's fine. It's designed to be a long-running connection. 🙂

  • @dreamyangel1858
    @dreamyangel1858 6 місяців тому +4

    Neat video

  • @CrypticConsole
    @CrypticConsole 6 місяців тому +8

    why use this over kafka-python or confluent-kafka-python?

    • @QuixStreams
      @QuixStreams  6 місяців тому +3

      The big advantage is stream processing. All three libraries support producers and consumers, quixstreams also adds in Kafka Streams-style processing. If you ever need to write the kind of code that reads from one topic and writes to another, that's a huge addition.
      For the producer/consumer side, quixstreams is actually using confluent-kafka under the hood, and exposes all the same options, so it's basically a superset of that library.
      Kafka-Python's big advantage is that it's native Python. Both quixstreams and confluent-kafka wrap the C client, librdkafka. That may be an important factor to you. Though given how good Python wheel support is these days, it's not as big a deal as it used to be. 🤷‍♂

  • @SpringerJen
    @SpringerJen 6 місяців тому +2

    This is neat

  • @yifeitong
    @yifeitong 3 місяці тому +1

    Thanks for the video. I was following the step and got this error: KafkaException: KafkaError{code=_TRANSPORT,val=-195,str="Failed to get metadata: Local: Broker transport failure"}. Can anyone help with this ? Many thanks

    • @QuixStreams
      @QuixStreams  3 місяці тому +1

      There's a problem with the connection to the Kafka broker. This can be due to incorrect broker address, network issues, or broker unavailability.
      Check out the docs here: quix.io/docs/manage/troubleshooting.html#data-is-not-being-received-into-a-topic
      Or ask the community for help here join.slack.com/t/stream-processing/shared_invite/zt-2lxwg3a0l-6NIZuvkFVKrm6UTH_97iSA

  • @aleandromatteoni2462
    @aleandromatteoni2462 4 місяці тому +1

    What ide/text_editor are you using?

    • @QuixStreams
      @QuixStreams  4 місяці тому

      It's Neovim with some custom configuration. We recommend getting started with the Neovim Kickstart project and tailor to your preferences