Multiple Producer & Multiple Consumer in a Kafka Topic

Поділитися
Вставка
  • Опубліковано 16 гру 2024

КОМЕНТАРІ • 19

  • @nik7867
    @nik7867 Рік тому +1

    How can you say this is second consumer when you’ve typed the same command in another terminal , maybe that’s just the copy of first consumer ?

  • @BOSS-AI-20
    @BOSS-AI-20 11 місяців тому +1

    how can 2 consumers can read data from same topic ?
    I have read that 2 consumers can't read data from same topic if they are in the same consumer group.
    are both consumers in same group or different group

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  11 місяців тому

      Hello Basit, the consumers launched in this video are in diff consumer group , to launch consumers which are within same consumer group , you have to mention the consumer group explicitly , as it's not mentioned , so they are getting launched from diff groups ..

    • @BOSS-AI-20
      @BOSS-AI-20 11 місяців тому

      @@KnowledgeAmplifier1 Thanks Sir, I got it

  • @gurucharands
    @gurucharands Рік тому +1

    when you say 2 consumers , is it in the same consumer group or different consumer group ? My understanding is 1 consumer will listen to one partition and when it commits offset how can other consumer instance read the earlier offset ?

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  Рік тому +1

      Great question gurucharands! In the example shown in the video, the two consumers that were created actually belong to different consumer groups. If you take a closer look at the code used to set up these consumers, you'll notice that the "--group {group_name}" parameter was not provided. This omission means that the consumers were not part of the same group.
      We cover the concept of consumer groups in detail in a later topic within the Kafka playlist (ua-cam.com/play/PLjfRmoYoxpNrs0VmIq6mOTqXP52RfZdRf.html&si=B2HTHPfSRHrnUD88). Step by step, we delve into these topics to provide a comprehensive understanding.
      Feel free to explore the playlist for more insights, and if you have any more questions, don't hesitate to ask! 😊📚

  • @JanarthananSelvam-z1v
    @JanarthananSelvam-z1v Рік тому

    how can we manage this multiple consumer using php, for running multiple consumer parallelly to reduce waiting time

  • @avinashbasetty-r4d
    @avinashbasetty-r4d Рік тому +1

    Useful Information, Thanks for sharing. I would try this functionality by calling the same topic from multiple producers

  • @sachindubey4315
    @sachindubey4315 Рік тому +1

    your content is really very nice for doing practically , thankss

  • @gedeonnokbak760
    @gedeonnokbak760 Рік тому +1

    very good course, I definitely recommend it

  • @digitaltechconnect1318
    @digitaltechconnect1318 2 роки тому

    Please provide us the session for Confluent Kafka

  • @krishnakuraku6853
    @krishnakuraku6853 2 роки тому +1

    Can you please create one video on snowflake grant access to new users.

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  2 роки тому +1

      Hello Krishna , you can have a look in this video -- ua-cam.com/video/ol3Jg-ULneE/v-deo.html
      But in actual prod , the new users are not onboarded using user id , password , generally single sign on is used in industry ..

    • @krishnakuraku6853
      @krishnakuraku6853 2 роки тому +1

      @@KnowledgeAmplifier1 thank you bro..

  • @vikramsharmap2010
    @vikramsharmap2010 2 роки тому +1

    Thank you Bro