Step by Step Basic Microservices System (3 NodeJS + 1 Load Balancer containers) with Docker Compose

Рет қаралды 64,036

4 жыл бұрын

In this video, you will learn how to build a small microservices system that has four services. We will spin up a load balancer container that will balance requests through and 3 identical node js containers.
Source Code github.com/hnasr/javascript_p...
🏭 Software Architecture Videos
• Software Architecture
💾 Database Engineering Videos
• Database Engineering
🛰 Network Engineering Videos
• Network Engineering
🏰 Load Balancing and Proxies Videos
• Proxies
🐘 Postgres Videos
• PostgresSQL
🚢Docker
• Docker
🧮 Programming Pattern Videos
• Programming Patterns
🛡 Web Security Videos
• Web Security
🦠 HTTP Videos
• HTTP
🐍 Python Videos
• Python by Example
🔆 Javascript Videos
• Javascript by Example
👾Discord Server / discord
Support me on PayPal
bit.ly/33ENps4
Become a Patreon
/ hnasr
Stay Awesome,
Hussein

Пікірлер: 115

@hnasr 2 жыл бұрын

Get my Fundamentals of Networking for Effective Backends udemy course Head to network.husseinnasser.com for a discount coupon (link redirects to udemy with coupon applied)

@lacascadaobregon Жыл бұрын

Damn why does this only have one like? You know a lot about backend. I have a Udemy subscription, going to check the course out!

@johnlovell8299 4 жыл бұрын

Now do one with RabbitMQ in the mix.

@TheDesvendador 4 жыл бұрын

Love these "hands on" type of video

@arvi8843 4 жыл бұрын

I'm so excited about this, a hands-on microservices. I hope you continue this maybe some event sourcing, cqrs, kubernetes, anything related to microservices 🥰🎉 I hope you'll have a course of a project in microservice structure. ♥️ Thanks a lot.

@benjaminlee9380 3 жыл бұрын

Nice! Seem like a fun person to be watching tutorials from :)

@shivarajbakale6261 3 жыл бұрын

This was excellent. Thanks, keep them coming

@luqmansen 4 жыл бұрын

Cool, been waiting for this, thanks!

@blissweb 3 жыл бұрын

Great vid. Good info. Quick question, how would I modify this to balance across 2 actual servers with 2 ip addresses ?

@harsiddhdave44 3 ай бұрын

I love this guy! He explains it so effectively and with fun! You and Arpit Bhayani are the only two guys that I prefer learning from when it comes to Engineering!

@wick12298 11 ай бұрын

Love the practical and your love for code and networking. Respect Sir!

@pjbcoetzer 3 жыл бұрын

Any recommendations for a api management gateway tool for usage and user management?

@harshitjain7673 3 жыл бұрын

You can click on the bottom empty part of the explorer window and then create a new file or folder it with it on root

@haq_se_dkp 3 жыл бұрын

Keep getting this ridiculous error - Windows Machine. Any idea why this might be? parsing [/usr/local/etc/haproxy/haproxy.cfg:12]: Missing LF on last line, file might have been truncated at position 31. lb_1 | [ALERT] 344/180729 (1) : Error(s) found in configuration file : /usr/local/etc/haproxy/haproxy.cfg

@eeebeltran5445 3 жыл бұрын

Did you find a solution bro?

@haq_se_dkp 3 жыл бұрын

@@eeebeltran5445 unfortunately not, man. Still waiting :(

@nutandevjoshi 3 жыл бұрын

same error

@ramlalyadav2286 2 жыл бұрын

use this in docker-compose.yaml lb: image: haproxy:1.8 ports: - "8080:8080" volumes: - ./haproxy/:/usr/local/etc/haproxy/

@johnlovell8299 4 жыл бұрын

If you're fancy, use port 80. Love it!

@hnasr 4 жыл бұрын

John Lovell exactly not everyone got what it takes to use 80.. takes guts 😅

@aminejadid2702 4 жыл бұрын

Great effort ! Thank you

@hnasr 4 жыл бұрын

Thanks Amine!!

@JulianBG 4 жыл бұрын

@Hussein Nasser At the end of the video you had to stop and start the docker-compose in order to add a new nodeapp4, but doesn't that defeat the purpose? First issue is that you have to stop all instances (nodeapp* and the lb) instead of doing that dynamically and also adding a new nodeapp will run on the same physical machine, right?

@hnasr 4 жыл бұрын

Julian Lishev thanks Julian you make valid points. Two in facts. How do you update the configuration without down time and how do you split the containers on multiple physical machines. I will have to do some research and get back to you on the first one and make a video on it. The second one is probably we need a container orchestrator like k8 or docker swarm. Good points

@hanzladev 3 жыл бұрын

@@hnasr brother did you created any video regarding this update?

@stellusctf6479 3 жыл бұрын

Thanks Hussain ('shukran') one more Good video !! Quick question, How do you specify in docker-compose.yml an External MongoDB server Name (for an application which runs in container & trying to access?), would be very helpful (I believe it has something to do with docker network type of the docker container , since the DNS server inside Docker it is not aware of the external server (also directly editing /etc/hosts through edit command seems to be bit 'ugly' while starting container/ deployments), ANY Quick HELP greatly Appreciated

@georgevinueza7249 2 жыл бұрын

You didn't have to flex on us with the singing skills too xD

@eugene1207 3 жыл бұрын

THE BEST TUTOR EVER!1!1!111

@Sheerrim 4 жыл бұрын

Dude, I love you

@adb86 3 жыл бұрын

Hussein , Awesome explanation on haproxy, can you please tell us how to run haproxy on container with https . Creating certificate on host machine works great wen haproxy is also started on host machine , but wen haproxy is running as a docker container with certificates created on host machine does not work . I did not find a way to create cert from container itself .Your input is valuable , please respond.

@krishm5116 3 жыл бұрын

Good funny man yet information rich, Keep it up man :-)

@AssFaceNFT 2 жыл бұрын

Another one! 🔥🙏

@aatifbangash 4 жыл бұрын

One Video on recommendation system please.

@basselturky4027 2 жыл бұрын

You need to close haprocy folder ( click the arrow ) then create a new file, it will be created in the root. I might be late but I'm helping : ) ,and thank you for all your efforts and the stuff you taught us.

@khayryazzez 3 жыл бұрын

what is the difference between nodejs and haproxy

@orhn 3 жыл бұрын

How to dynamcally scale backends without changing the config everytime

@AhmadEzzeir 4 жыл бұрын

Good one bro

@2011201120112013 Жыл бұрын

Cool video! You are the real life version of Quagmire!

@headlinerbeats 3 жыл бұрын

Enjoyable video, thank you. I thought microservice architectur requires some sort of API Gateway to redirect requests? Is running the same app in multiple containers really considered a microservice, or is this just plain dockerizing a basic node app? Cheers

@EhSUN37 2 жыл бұрын

its micro services in the same server( inside docker composer instance which is running on your server). when you separate each apps and dbs etc into different machines you would need APIs to call them instead of communicating in your localhost you would communicate withing your network

@kerolloz 4 жыл бұрын

What about another version of the video where you use ngnix instead

@hnasr 4 жыл бұрын

Kerollos Magdy you read my mind! Coming next week

@mechanical-bean 3 жыл бұрын

while Nginx provides full web server, HA proxy is only a proxy, and you go with HA proxy. So my question is that do we need a full web server in front of our backend?

@nifeneny 2 жыл бұрын

You are the best, man

@user-jr9wn8sx1m 6 ай бұрын

thanks my dude

@JaneDoe-od4ep 2 жыл бұрын

Dude this is literally the best channel about coding I've ever met dude

@rehamalbulushi520 Жыл бұрын

This one is the cooooooooooooooooolest tutorial I have ever never watched

@digvijayyamagekar7139 Жыл бұрын

System Design is really beautiful topic

@jamalallogie 3 жыл бұрын

Great video!

@hnasr 3 жыл бұрын

Done thanks 🙏

@diegoramos27 3 жыл бұрын

could you pls do the same with java ?

@rinodipaola761 2 жыл бұрын

Hi, I'd like to ask you a question. If I have two microservices, how can I run them at the same port but in different paths? For example I want to config a microservice with the path localhost/microservice1/... and another microservice with the path localhost/microservice2/... Should I use an API Gateway? I have some difficulties to do this. Thanks.

@EhSUN37 2 жыл бұрын

I believe you can config it in nginx

@rinodipaola761 2 жыл бұрын

@@EhSUN37 yes at the end I used Nginx

@MrStargazer777 2 жыл бұрын

awesome dude

@hnasr 2 жыл бұрын

🙏

@vibekdutta6539 4 жыл бұрын

hey hussain i request you to please make some step by step tutorial on building a microservice with node, docker etc please

@joe_navy_s3 3 жыл бұрын

I subscribe and liked , two seconds into the video, you seem fun😂😂😂

@hnasr 3 жыл бұрын

Thanks Joe!!!

@futurelabs3684 2 жыл бұрын

i git a problem when i try to use depends_on: - mongo it gives me this alert config : Failed to initialize server(s) addr. can anyone help please ?

@sahadevdahit Жыл бұрын

but the other API endpoints does not work. like get('/fetch',..

@vasujain2 15 күн бұрын

What a beautiful thumbnail man!

@arunteltia7888 3 жыл бұрын

Thank you for this video not gonna lie clear my lot of doubts, you are the best BTW where is silver play button 🚀🙌

@hnasr 3 жыл бұрын

Glad it helped!

@abdirahmann 2 жыл бұрын

you were on a ton of coffee! hahahaa 🤣🤣

@alxx736 3 жыл бұрын

What if each microservice is in separarte repos ? Do i need to have a docker compose on each repo ? Do i need to pull each microservice and run docker compose on each one ?

@faridadli5984 10 ай бұрын

hi i know it's been 2 years already. But would you mind sharing how did you do it?

@alxx736 10 ай бұрын

@@faridadli5984 I think i never did it jajaja

@faridadli5984 10 ай бұрын

@@alxx736 🤣🤣

@tharunrocky14 3 жыл бұрын

Are there performance differences between -> running haproxy/nginx as a docker container vs -> running them directly on the host ? In terms of both processing performance & network performance. thanks Hussein, amazing content! Binge watching them all! Keep going.

@hnasr 3 жыл бұрын

The Scientist none that I am aware of, if the container is assigned adequate memory/cpu it should be just as if running directly on the host. That being said it I am assuming the container daemon is running directly on the host not on a VM.

@tobykalema8945 2 жыл бұрын

What an amazing guy! hahah

@nageshwarreddy4530 3 жыл бұрын

In the sidebar, right click and add any folder, remove that folder from sidebar... in this way, you can see folder view in vscode sidebar...

@georgemilev9986 4 жыл бұрын

6:44 To get back to the the root folder click on the empty space under your files

@hnasr 4 жыл бұрын

Thanks George that works ! 👍

@liuchuanyuan4301 3 жыл бұрын

-t means tag

@fatube3698 3 жыл бұрын

what did you drink || eat before the video, because i need some

@eeebeltran5445 3 жыл бұрын

Missing LF on last line, file might have been truncated at position

@eeebeltran5445 3 жыл бұрын

Please can you help me

@SuperVladikk 3 жыл бұрын

This video made me subscribe 😆

@hnasr 3 жыл бұрын

❤️❤️❤️

@Antnix732 2 жыл бұрын

this vid acc funny af lmfao.

@yuxiangzhang2343 3 жыл бұрын

Hi Hussein, do you also have a tutorial on load-balancing remote containers ( containers located on different hosts )? That would be also helpful!

@hnasr 3 жыл бұрын

Yuxiang Zhang hello , it is the same concept just update the config to point to the right host. Of course you will need to orchestrate those hosts and containers if they got out of control

@yuxiangzhang2343 3 жыл бұрын

@@hnasr Thank you, this is already helpful! Looking forwards to your orchestration tutorials :D

@KabooM1067 2 жыл бұрын

lol what a fun tutorial

@jerrytab4276 4 жыл бұрын

Nodejs microservice series with real app example

@jassersaanoun9493 4 жыл бұрын

correct me if i'm wrong. i think this is not microservices, microservices have a proxy and a registry and a load balancer to select the service required for an incoming request (payment, users...) which are not the same, every service has it's own logic and maybe his own database, whereas this is just duplicating the same service to multiple containers that it would scale

@hnasr 4 жыл бұрын

jasser saanoun thanks for your message. This is the simplest minimum basic building block of microservices. The proxies, sidecar pattern, security control plane, service discovery etc are additions to microservices architecture to make it actually manageable and maintainable and the final piece to add is kubernetes to manage all those containers.

@evans8245 4 жыл бұрын

jasser & nasser - make friendship now !

@kosm4308 3 жыл бұрын

Zoom further please.. Is it 4444 or something else? 😂😂😂 Nice work man..

@binoysarker903 Жыл бұрын

in vscode left side just right click up of OUTLINE to creak a file or folder on the root of the project

@hanzladev 3 жыл бұрын

Aslamoalikum brother, great content, Excellent work, do you speak urdu? can you entertain urdu speakers with your skills? it will be great services my friend

@Muphet 3 жыл бұрын

i just right click on folder in tree and create file

@vivsh.1999 2 жыл бұрын

This video is for only load balancers not specifically for microservices. Can you make a video with microservices having different logic instead of just duplicating the same image?

@EhSUN37 2 жыл бұрын

the only difference would be how your API calls different services. you can run redis , postgres etc in the docer-composer and your apps will call them when needed. use only one app if you want and eliminate the load balancer

@noahwilliams8918 4 жыл бұрын

“God I hate YAML 🍠” Me too, buddy - fortunately, Docker-compose supports JSON as well if you don’t feel like tearing your hair out ;)

@hnasr 4 жыл бұрын

What! I didn’t know that it supports JSON! Thanks Noah 👏👍

@noahwilliams8918 4 жыл бұрын

Hussein Nasser You’re welcome! Here is the source for that: docs.docker.com/compose/faq/ YAML is a superset of JSON so (theoretically) any valid JSON is also valid YAML. I bet a lot of other applications support it but just don’t advertise it too!

@stefanosgiannakis7151 3 жыл бұрын

you need a load balancer in your voice

@amarvadlachannel 3 жыл бұрын

it is still a monolothic application

@gngn2973 3 жыл бұрын

zoom MOAR need closer!

@simomed5002 Жыл бұрын

are you sure you know what microservices are?

@fxstreamer238 2 жыл бұрын

I thought I was doing something wrong but I cloned the whole Javascript playground and directly from git bash terminal went on the microservices docker build etc and the error is the same for haproxy. can not find the config file. The whole docker and redis community is a cancer to the society

@patrickmojica6558 Жыл бұрын

I'm Having the same problem I think: lb_1 | [ALERT] (1) : config : Cannot open configuration file/directory /usr/local/etc/haproxy/haproxy.cfg : No such file or directory nodeapp1_1 | /bin/sh: 1: run: not found nodeapp2_1 | /bin/sh: 1: run: not found