I have a doubt, as you have mentioned that if we are setting retry property to 5 in that scenario the max_in_flight_request_per_connection property should be set to 1 so that msg order in maintained. But setting max_in_flight_request_per_connection to 1 will make the whole msg publishing process a synchronous one. So that means whenever I am setting retry property i wont be able to achieve a Asynchronous send? Please let me know if this understanding is correct
@@akashchandra2223 for jobs , you can search in LinkedIn or Naukri.com , for getting knowledge in big data streaming technologies , you can check udemy , Pluralsight or LinkedIn Learning etc platforms , you should have idea bout kafka , flume , spark streaming etc ... I am also trying to cover kafka end-to-end in my channel , you can refer that too if it helps...not only doing courses , but you have to do production level pocs or personal projects for getting jobs ....
Thanks a lot for explanation... This is so helpful
Glad to know the video is helpful to you! Happy Learning
As per the new Kafka version, Max_in_flight_requests_per_connection can be set to 5 for idempotency.
I have a doubt, as you have mentioned that if we are setting retry property to 5 in that scenario the max_in_flight_request_per_connection property should be set to 1 so that msg order in maintained. But setting max_in_flight_request_per_connection to 1 will make the whole msg publishing process a synchronous one. So that means whenever I am setting retry property i wont be able to achieve a Asynchronous send? Please let me know if this understanding is correct
I have one doubt. Can we host multiple kafka producers in one ec2 instance?
Can you please help understand how to get a job in kafka?
How do get knowledge and getting big data streaming technologies
@@akashchandra2223 for jobs , you can search in LinkedIn or Naukri.com , for getting knowledge in big data streaming technologies , you can check udemy , Pluralsight or LinkedIn Learning etc platforms , you should have idea bout kafka , flume , spark streaming etc ... I am also trying to cover kafka end-to-end in my channel , you can refer that too if it helps...not only doing courses , but you have to do production level pocs or personal projects for getting jobs ....