buffer.memory , max.block.ms & Producer IO Thread in kafka

Поділитися
Вставка
  • Опубліковано 17 гру 2024

КОМЕНТАРІ • 9

  • @robertgosz4281
    @robertgosz4281 Рік тому +1

    Thanks. That was actually good!

  • @naikmshweta
    @naikmshweta 6 місяців тому

    I am getting BufferExhaustedException, we are sending 60k request, what is best way to solve this

  • @shreyas-s5g
    @shreyas-s5g Рік тому

    sir, i would want to do a little correction in code , that producer.flush() should come inside for loop, other wise its of no use. Thankyou !!!

  • @AyushMandloi
    @AyushMandloi Рік тому +1

    Thanks Man. From where u have learned all this ?

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  Рік тому

      Hello Ayush Mandloi, I have learnt the basic concepts from Pluralsight courses & company's internal trainings , & eventually learnt the intermediate concepts while working on a real-project using Kafka & other Big Data Services for one of India's Largest Private Sector Bank ..

  • @namangarg8654
    @namangarg8654 2 роки тому

    How can we check if the buffer is getting full or not?

  • @olayoridickson
    @olayoridickson Рік тому

    Can you disable batching ? Is it required? Also Does is the buffer memory is on the client or server side?

    • @shreyas-s5g
      @shreyas-s5g Рік тому

      ITS ON THE CLIENT SIDE , BECAUSE IF LOADING TO SERVER FAILS THEN IT DOES A RETRY (THAT ALSO CAN BE CUSTOMIZED)IF EVEN AFTER TRYING FOR THOSE MANY TIMES IT FAILS , THEN ERROR IS POPPED ELSE ITS WRITTEN TO KAFKA CLUSTER