Step by Step Basic Microservices System (3 NodeJS + 1 Load Balancer containers) with Docker Compose
Вставка
- Опубліковано 5 бер 2020
- In this video, you will learn how to build a small microservices system that has four services. We will spin up a load balancer container that will balance requests through and 3 identical node js containers.
Source Code github.com/hna...
🏭 Software Architecture Videos
• Software Architecture
💾 Database Engineering Videos
• Database Engineering
🛰 Network Engineering Videos
• Network Engineering
🏰 Load Balancing and Proxies Videos
• Proxies
🐘 Postgres Videos
• PostgresSQL
🚢Docker
• Docker
🧮 Programming Pattern Videos
• Programming Patterns
🛡 Web Security Videos
• Web Security
🦠 HTTP Videos
• HTTP
🐍 Python Videos
• Python by Example
🔆 Javascript Videos
• Javascript by Example
👾Discord Server / discord
Support me on PayPal
bit.ly/33ENps4
Become a Patreon
/ hnasr
Stay Awesome,
Hussein - Наука та технологія
![АЛАУДИНОВ у Скабеевой: эти их ВСУ нас НЕ ДОГОНЯТ 😁 [Пародия]](http://i.ytimg.com/vi/an0anqU4WGQ/mqdefault.jpg)
Get my Fundamentals of Networking for Effective Backends udemy course Head to network.husseinnasser.com for a discount coupon (link redirects to udemy with coupon applied)
Damn why does this only have one like? You know a lot about backend. I have a Udemy subscription, going to check the course out!
Now do one with RabbitMQ in the mix.
Love these "hands on" type of video
Nice! Seem like a fun person to be watching tutorials from :)
Keep getting this ridiculous error - Windows Machine. Any idea why this might be?
parsing [/usr/local/etc/haproxy/haproxy.cfg:12]: Missing LF on last line, file might have been truncated at position 31.
lb_1 | [ALERT] 344/180729 (1) : Error(s) found in configuration file : /usr/local/etc/haproxy/haproxy.cfg
Did you find a solution bro?
@@eeebeltran5445 unfortunately not, man. Still waiting :(
same error
use this in docker-compose.yaml
lb:
image: haproxy:1.8
ports:
- "8080:8080"
volumes:
- ./haproxy/:/usr/local/etc/haproxy/
I love this guy! He explains it so effectively and with fun!
You and Arpit Bhayani are the only two guys that I prefer learning from when it comes to Engineering!
You can click on the bottom empty part of the explorer window and then create a new file or folder it with it on root
I'm so excited about this, a hands-on microservices. I hope you continue this maybe some event sourcing, cqrs, kubernetes, anything related to microservices 🥰🎉 I hope you'll have a course of a project in microservice structure. ♥️ Thanks a lot.
Another one! 🔥🙏
You didn't have to flex on us with the singing skills too xD
This was excellent. Thanks, keep them coming
THE BEST TUTOR EVER!1!1!111
Love the practical and your love for code and networking. Respect Sir!
awesome dude
🙏
What about another version of the video where you use ngnix instead
Kerollos Magdy you read my mind! Coming next week
Cool video!
You are the real life version of Quagmire!
If you're fancy, use port 80. Love it!
John Lovell exactly not everyone got what it takes to use 80.. takes guts 😅
Cool, been waiting for this, thanks!
What a beautiful thumbnail man!
Dude this is literally the best channel about coding I've ever met dude
This one is the cooooooooooooooooolest tutorial I have ever never watched
thanks my dude
System Design is really beautiful topic
You are the best, man
What an amazing guy! hahah
I subscribe and liked , two seconds into the video, you seem fun😂😂😂
Thanks Joe!!!
Great video!
Done thanks 🙏
you were on a ton of coffee! hahahaa 🤣🤣
Great vid. Good info. Quick question, how would I modify this to balance across 2 actual servers with 2 ip addresses ?
@Hussein Nasser At the end of the video you had to stop and start the docker-compose in order to add a new nodeapp4, but doesn't that defeat the purpose? First issue is that you have to stop all instances (nodeapp* and the lb) instead of doing that dynamically and also adding a new nodeapp will run on the same physical machine, right?
Julian Lishev thanks Julian you make valid points. Two in facts. How do you update the configuration without down time and how do you split the containers on multiple physical machines.
I will have to do some research and get back to you on the first one and make a video on it. The second one is probably we need a container orchestrator like k8 or docker swarm.
Good points
@@hnasr brother did you created any video regarding this update?
Dude, I love you
One Video on recommendation system please.
Enjoyable video, thank you. I thought microservice architectur requires some sort of API Gateway to redirect requests? Is running the same app in multiple containers really considered a microservice, or is this just plain dockerizing a basic node app? Cheers
its micro services in the same server( inside docker composer instance which is running on your server). when you separate each apps and dbs etc into different machines you would need APIs to call them instead of communicating in your localhost you would communicate withing your network
You need to close haprocy folder ( click the arrow ) then create a new file, it will be created in the root. I might be late but I'm helping : )
,and thank you for all your efforts and the stuff you taught us.
Good one bro
6:44 To get back to the the root folder click on the empty space under your files
Thanks George that works ! 👍
Good funny man yet information rich, Keep it up man :-)
Great effort ! Thank you
Thanks Amine!!
Missing LF on last line, file might have been truncated at position
Please can you help me
Are there performance differences between
-> running haproxy/nginx as a docker container
vs
-> running them directly on the host ?
In terms of both processing performance & network performance.
thanks Hussein, amazing content! Binge watching them all! Keep going.
The Scientist none that I am aware of, if the container is assigned adequate memory/cpu it should be just as if running directly on the host.
That being said it I am assuming the container daemon is running directly on the host not on a VM.
but the other API endpoints does not work. like get('/fetch',..
it is still a monolothic application
i git a problem when i try to use depends_on: - mongo
it gives me this alert config : Failed to initialize server(s) addr.
can anyone help please ?
-t means tag
while Nginx provides full web server, HA proxy is only a proxy, and you go with HA proxy. So my question is that do we need a full web server in front of our backend?
this vid acc funny af lmfao.
Any recommendations for a api management gateway tool for usage and user management?
This video is for only load balancers not specifically for microservices. Can you make a video with microservices having different logic instead of just duplicating the same image?
the only difference would be how your API calls different services. you can run redis , postgres etc in the docer-composer and your apps will call them when needed. use only one app if you want and eliminate the load balancer
Thank you for this video not gonna lie clear my lot of doubts, you are the best BTW where is silver play button 🚀🙌
Glad it helped!
lol what a fun tutorial
you need a load balancer in your voice
what did you drink || eat before the video, because i need some
Zoom further please.. Is it 4444 or something else? 😂😂😂
Nice work man..
what is the difference between nodejs and haproxy
In the sidebar, right click and add any folder, remove that folder from sidebar... in this way, you can see folder view in vscode sidebar...
This video made me subscribe 😆
❤️❤️❤️
in vscode left side just right click up of OUTLINE to creak a file or folder on the root of the project
“God I hate YAML 🍠”
Me too, buddy - fortunately, Docker-compose supports JSON as well if you don’t feel like tearing your hair out ;)
What! I didn’t know that it supports JSON! Thanks Noah 👏👍
Hussein Nasser You’re welcome! Here is the source for that: docs.docker.com/compose/faq/
YAML is a superset of JSON so (theoretically) any valid JSON is also valid YAML. I bet a lot of other applications support it but just don’t advertise it too!
Thanks Hussain ('shukran') one more Good video !!
Quick question, How do you specify in docker-compose.yml an External MongoDB server Name (for an application which runs in container & trying to access?), would be very helpful (I believe it has something to do with docker network type of the docker container , since the DNS server inside Docker it is not aware of the external server (also directly editing /etc/hosts through edit command seems to be bit 'ugly' while starting container/ deployments), ANY Quick HELP greatly Appreciated
How to dynamcally scale backends without changing the config everytime
Hussein ,
Awesome explanation on haproxy, can you please tell us how to run haproxy on container with https . Creating certificate on host machine works great wen haproxy is also started on host machine , but wen haproxy is running as a docker container with certificates created on host machine does not work . I did not find a way to create cert from container itself .Your input is valuable , please respond.
correct me if i'm wrong. i think this is not microservices, microservices have a proxy and a registry and a load balancer to select the service required for an incoming request (payment, users...) which are not the same, every service has it's own logic and maybe his own database, whereas this is just duplicating the same service to multiple containers that it would scale
jasser saanoun thanks for your message. This is the simplest minimum basic building block of microservices. The proxies, sidecar pattern, security control plane, service discovery etc are additions to microservices architecture to make it actually manageable and maintainable and the final piece to add is kubernetes to manage all those containers.
jasser & nasser - make friendship now !
hey hussain i request you to please make some step by step tutorial on building a microservice with node, docker etc please
Hi, I'd like to ask you a question. If I have two microservices, how can I run them at the same port but in different paths? For example I want to config a microservice with the path localhost/microservice1/... and another microservice with the path localhost/microservice2/... Should I use an API Gateway? I have some difficulties to do this. Thanks.
I believe you can config it in nginx
@@EhSUN37 yes at the end I used Nginx
Nodejs microservice series with real app example
Aslamoalikum brother, great content, Excellent work, do you speak urdu? can you entertain urdu speakers with your skills? it will be great services my friend
What if each microservice is in separarte repos ? Do i need to have a docker compose on each repo ? Do i need to pull each microservice and run docker compose on each one ?
hi i know it's been 2 years already. But would you mind sharing how did you do it?
@@faridadli5984 I think i never did it jajaja
@@alxx736 🤣🤣
could you pls do the same with java ?
I thought I was doing something wrong but I cloned the whole Javascript playground and directly from git bash terminal went on the microservices docker build etc and the error is the same for haproxy. can not find the config file. The whole docker and redis community is a cancer to the society
I'm Having the same problem I think:
lb_1 | [ALERT] (1) : config : Cannot open configuration file/directory /usr/local/etc/haproxy/haproxy.cfg : No such file or directory
nodeapp1_1 | /bin/sh: 1: run: not found
nodeapp2_1 | /bin/sh: 1: run: not found
Hi Hussein, do you also have a tutorial on load-balancing remote containers ( containers located on different hosts )? That would be also helpful!
Yuxiang Zhang hello , it is the same concept just update the config to point to the right host. Of course you will need to orchestrate those hosts and containers if they got out of control
@@hnasr Thank you, this is already helpful! Looking forwards to your orchestration tutorials :D
i just right click on folder in tree and create file
It’s not microservices, it’s a monolith at horizontal scale.
you are hilarious
are you sure you know what microservices are?
zoom MOAR need closer!
its not a microservice ,i find it more like a monolithic with loadbalancing
please dude, behave as you want on your personal videos but it is gonna be perfect for you if you be little serious on your tutorial videos
Ahmet Buğra Çakıcı Thanks Ahmet 🙏
@@hnasr you are welcome my friend, you have really good knowledge thanks for videos
@@hnasr i like your funny stuff, but don't do them too much :D
I wish the tone was slightly more serious. Sadly, I stopped watching 2 mins into the video. You seem to have great knowledge of the subject though.
For people getting 502 ,just update nginx.conf to use
upstream all {
server host.docker.internal:portnumber;
}