Great tutorial, you explained with Security group configuration. Most of the videos on youtube have public access, which can be vulnerable. Thanks for sharing knowledge.
Hi @ATHARVA89, you can refer this video -- ua-cam.com/video/EVJm3aL7ftY/v-deo.htmlsi=ATOAHV5JO34xSO-C , for more testing related resources , you can refer medium.com/@samzamany/unit-testing-in-data-engineering-a-practical-guide-91196afdf32a
you r running loop for Provisioned in lambda can i do with serverless cluster for same i have tried by adding client property's and all but facing some issues (Address family not supported by protocol) and some more pls help me out on this And special thanks for this great video
I am not sure why it is coming "errorMessage": "Unable to import module 'lambda_function': No module named 'kafka'" ? I have tried with S3 and direct uploading .zip file to lambda layer
Nice video..I tried but getting error... "errorMessage": "NoBrokersAvailable", "errorType": "NoBrokersAvailable",when i run the producer code from cmd it works fine but not with lambda function
Nice tutorial, it would be really helpfull if you can create some tutorial on mutilple zookeeper and kafka broker using docker compose with scheme registy with avro in Python. Done research online but didn't find any solution, If you can do that reallly helpfull. keep creating wonderfull content @KnowledgeAmplifier1.
Great tutorial, you explained with Security group configuration. Most of the videos on youtube have public access, which can be vulnerable.
Thanks for sharing knowledge.
You are welcome Rushikesh Karkhanis! Happy Learning
hi @knowledge amplifier do you have any video related to testing in data engineering? if not could you suggest some resources
Hi @ATHARVA89, you can refer this video -- ua-cam.com/video/EVJm3aL7ftY/v-deo.htmlsi=ATOAHV5JO34xSO-C , for more testing related resources , you can refer medium.com/@samzamany/unit-testing-in-data-engineering-a-practical-guide-91196afdf32a
you r running loop for Provisioned in lambda can i do with serverless cluster for same i have tried by adding client property's and all but facing some issues (Address family not supported by protocol) and some more pls help me out on this
And special thanks for this great video
I am not sure why it is coming "errorMessage": "Unable to import module 'lambda_function': No module named 'kafka'" ?
I have tried with S3 and direct uploading .zip file to lambda layer
i creted msk cluster and how to use it in nodejs
Nice video..I tried but getting error... "errorMessage": "NoBrokersAvailable",
"errorType": "NoBrokersAvailable",when i run the producer code from cmd it works fine but not with lambda function
Even I am facing this issue, were u able to fix this?
add the api version argument in the KafkaProducer
KafkaProducer(
bootstrap_servers=[
.....
],
api_version = (2, 8, 1)
)
Nice tutorial, it would be really helpfull if you can create some tutorial on mutilple zookeeper and kafka broker using docker compose with scheme registy with avro in Python. Done research online but didn't find any solution, If you can do that reallly helpfull. keep creating wonderfull content @KnowledgeAmplifier1.