Spring Boot Kafka Microservices - Spring Boot Kafka Real-World Project Tutorial
Вставка
- Опубліковано 23 вер 2024
- In this tutorial, you will learn how to create a Spring boot Apache Kafka real-world project step by step. We will create two microservices and use Kafka as a messaging system to exchange messages between microservices.
My Top 10+ Udemy Courses (Bestseller Courses):
www.javaguides...
Java Guides blog: www.javaguides...
Company Website: rameshfadatare...
Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines.
GitHub link - github.com/Ram...
We will read a large amount of real-time stream data from the Wikimedia and then we will write that data to the MySQL database.
----- Lectures or Chapters --------
Lecture 1. Real-World Project Overview - 0:00:08
Lecture 2. Spring Boot Kafka Project Setup - 0:03:28
Lecture 3. Install and Setup Kafka - 0:04:30
Lecture 4. Wikimedia Producer Spring Boot Project Setup - 0:12:35
Lecture 5. Configure Wikimedia Producer and Create a Topic - 0:21:08
Lecture 6. Wikimedia Producer Implementation - 0:25:54
Lecture 7. Run Wikimedia Producer - 0:41:38
Lecture 8. Kafka Consumer Project Setup - 0:49:49
Lecture 9. Configure Kafka Consumer - 0:54:13
Lecture 10. Kafka Consumer Implementation - 0:57:44
Lecture 11 Configure MySQL Database - 1:04:10
Lecture 12. Save Wikimedia Data into MySQL Database - 1:11:18
#springboot #kafka #microservicios
For Windows Users - How to Install Apache Kafka on Windows at ua-cam.com/video/aKDWWICgfA0/v-deo.html
We are deploying springboot microservice in EKS cluster. We have new requirement to consume Kafka messages of other organisation. But is it required to configure in our AWS environment. Or can we consume with zookeeper broker instance.
Sir when in intellij Idea you want to create package and class in it you can choose create class and insert entity.WikimediaData. Intellij will create Wikimedia class inside an entity package. Hope it'll save you time in future. Thanks for your efforts, this tutorial is very useful.
Code the most inportance of code, then stick some Logger into then easy for learning, the way you code is from top -> bottom.
Iam from poor family..U have changed my Family's lifestyle.. I got a job just because of ur hard work and teaching
That's awesome. Congratulations!.
Congratulations on your new job!!
Congratulations, and all the best!
Congratulations
Congratulations 💐
That's a very informative hands-on session for getting started with Kafka on Spring-boot. I'd recommend this to my colleagues who want to get started with Kafka. Thanks for creating the tutorial and sharing it with the community.
Nice explains, thank you so much, may I know please why you have created parent and sub module of kafka producer project?
Precise and detailed tutorial on kafka integration with service. Thank you!
That was great even with spring boot 3 ! Thank you very much.
Thank you Ramesh for this tutorial on microservices.
A much needed tutorial on spring boot Kafka with example, thanks 🙌
Amazing quality content. Very well organized by lectures
Your Videos are extreme, Great lecture.. Please create a videos about the consumer issues and troubleshooting
Great project sir, want to see complete big project on microservice architecture using multiple services and Kafka
You are a genius. Thank you for the wonderful video 🙏🙏🙏
You nailed it. Thanks a ton for such a detailed tutorial.
I only Executed the KafkaConsumerDatabase without the producer running and I could see the application receiving messages and storing in database. how could that happen?
Wish you could explain more about EventSource and eventhandler , unable to understand the flow
Looking forward on Asynchronous Computation topics from your channel
Thanks man. It was very helpful course.
U deserve many more subscriber's
Very useful video. Thank you so much for sharing.
Very nice 👍👍👍...but subtitles blocking view...
hello java guides, i like very video. but i am Puzzled by port number of consumer server. you gave the port number of producer and consumer the same port. i assume that consumer server is different from producer server. Suppose the consumer server on another computer or on cloud, will you give it the same port? thanks
why OkHttp? is this needed? Have you investigated using other dependencies for events source?
Hi Java Guides/ Ramesh ji, very thanks for the nice lectures on spring boot kafka and event driven kafka videos.
I have followed your tutorial and created spring boot microservices for order and stocks use case. But I want to implement ***custom partitioning*** and consuming these partitions from stocks and email services particularly. I am trying these but got stuck. Can you please help me with the custom partitioning.
Hi awesome lecture, can you please let me know how to implement the ack when writing a message to the broker l?
16.50
Sir
Can please explain what is multi model maven projects
Wow this is so great!!!
Is it possible for you to make a tutorial by using aws msk and connect it from local machine?
I am following the guide line by line. But my streams messages are not getting printed. I am on mac. I tried debugging it. It never hit the onMessage breakpoint in Handler class. Also it is empty when I check the kafka logs through console.
okay I had missed eventsource.start. Fixed it.
Interesting, The problem is I don't know Java . Is there a way to make it easier
a great explanation . A very good learning
very helpful! thankyou for this tutorial
THANKS BRO do you have coupon of 5$ in your course of microservices?
Thanks for practical
i can't run kafka cmd is'nt working
can any one help my consumer is not working 1:03 hr in the video no showing llog - event message received
Same issue
why Kafka topic is hardcoded int the programs can't we read from the properties file?
Yes you can , for making the lecture simple hasn't shown this.
@@adamsharma thanks i checked..
Hi, U didnt face any issue at 46:01 while trying to run SpringBootProducerApplication?
I am facing App info kafka.admin.client for adminclient-1 unregistered , my server is stopping.
please help me if you have an idea
Hi Ramesh, please create a tutorial on Apache Camel
Thank you
Thanks
could not resolve symbol launchdarkly??
can you post some tutorials on java nio2 or any notes
Does java only for web application?
bro nice explanation
really helpful sir
Pls upload regarding typescript
other people not taking lecture handson
Very good, congrats!
Hi teacher, I'm your "Master Spring Data JPA with Hibernate" student on Udemy, I noticed that the course left the platform for a while and is now available again, but unfortunately the English subtitles are no longer available. I would like to ask you to make the subtitles available in English again because I am Brazilian and I would very much like to be able to buy one more time and complete the course. I am very grateful for all the knowledge that you pass on in this course because it is being very useful to me, thank you very much for these great classes. I would also like to apologize for asking this on UA-cam, but I don't have Facebook so I can contact you.
Sure. You can contact me on Udemy via DM. Message me on Udemy of you have any questions.
@@JavaGuides Right teacher, thank you very much.
bro can you please explain teraform
how to develop an api that depends on another api which is not developed yet. Anyone knows please answer?
i guess you have to mock the data using a mocking framework like Mockito
I am using Eclipse IDE how do i create Module in Eclipse?
got any answer?
Thx
TQ
anyone got benefited by this in interview time?
pl increase your speech pitch. maybe buy a better micro phone.
What is wrong with you? Seems like you are just reading code and then typing it in your IDE, Not explaining any functionality of the code. No hate but this is time waste.
Boss, just read others comments. They are appreciating my video content as they found it useful. If you are able to get the things then it’s your problem. Show me who are teaching this type of content for free.
Good explanation... but kindly split water from your mouth and speak...your voice feels like a sleepy teacher
sleep, wake up and watch. Can you show me how to split the water from mouth?
Caused by: java.lang.ClassNotFoundException: okhttp3.HttpUrl...facing above issue even though added dependancy
Thank you! It was very useful! :)
Update, I need some help. I followed along the tutorial, but in the last step, saving to the database I faced this issue:
***************************
APPLICATION FAILED TO START
***************************
Description:
Parameter 0 of constructor in com.whatever.kafkaconsumerdatabase.KafkaDatabaseConsumer required a bean of type 'com.whatever.kafkaconsumerdatabase.repository.WikimediaDataRepository' that could not be found.
Action:
Consider defining a bean of type 'com.whatever.kafkaconsumerdatabase.repository.WikimediaDataRepository' in your configuration.
What could be the solution and what could potentially cause this?
WikimediaDataRepository needs to be annotated with @Repository annotation for Spring to bind it correctly on runtime.
if someone face the issue "Data truncation: Data too long for column 'wiki_event_data' at row 1"
the soution is: spring.datasource.url=jdbc:mysql://localhost:3306/wikimedia?sessionVariables=sql_mode='NO_ENGINE_SUBSTITUTION'&jdbcCompliantTruncation=false
and it will work fine
Thank you 😊
Thank you
Just out of curiosity how did you find this?
Thank you so much for the solution. I had the same error.
Thank you so much for the solution.
thank you !
Thanks man. It was very helpful course.