ENTER TO WIN a custom Raspberry Pi (pre-built with K3s): bit.ly/2VHhfwt Learn more about SUSE Rancher: bit.ly/3rb8Ih0 Need help with Kubernetes?? (i did) Ask Boxboat for help: bit.ly/3izncVB 🔎🔎Links and Guide: bit.ly/3xIkQbV I built a Raspberry Pi SUPER COMPUTER using Kubernetes (k3s) and Rancher. This project was insanely fun and I want YOU to do it. Why? You will learn about clustering, Kubernetes, k3s and so much more. Basically, these are skills you can take with you into the enterprise. Get a Raspberry Pi: geni.us/aBeqAL
Good evening sir from the Philippines. I'm your follower on UA-cam and i badly need help 🙏 my girlfriend break up my relationship with her because of unknown reason. She changed her password on Facebook so that I can't see what she's doing or chatting with someone. I still have her Google Account connected to Facebook and i used it to log in but but i can't still log in because she used Code Generator so that i can't access her account to find evidence that she really cheated on me. Please sir 🥺🙏 I'm really depressed right now because i really love her more than my life but she broked up with me. I hope you can help me with my problem sir because i don't know what to do, I don't know what's the real reason of everything. Please help me, help me sir🙏 Please notice me sir 🙏 You're the only guy that i trust with this kind of problems. God bless you always and keep safe
@@Jimmy_Jones This video's like the 1-hour crash course. I love seeing more good guides to getting started in K3s/K8s on UA-cam. Plus, can't knock running it on Pis!
Thanks for the callouts Chuck, It was an absolute pleasure working with you on getting Rancher going and dealing with some of the wonderful quirks! I knew it'd be fun to work with a UA-camr, but you should've seen my face when I double-taked on the email on just WHO I was helping! ;)
Enabling ssh is actually an option in the Pi imager application. You can enter the ssh key for password-less login and even replace the pi user with another username.
They've changed the imager a couple times since this video got made. The new way it works almost guarantees you won't mess it up and miss out on all the advanced options, ssh included. It will throw a pop-up at you and give you ample opportunity to make sure the settings are right and that you want to use them for your new image.
That was a a splendid intro tutorial. Your hypercaffeinated schtick was kinda bugging me until I realized how almost necessary it is for presenting this stuff in a timely way. Kubernetes is no longer a mystery to me and I thank you!
I'm setting up a bare metal server in my remote office and this video was the best thing that could have happened to me. Thanks a lot man, you are seriously fun to watch. Cheers
That fact I sat here and watched this video knowing absolutely nothing about this, just shows that your energy and knowledge about this kept me here. This makes me want to buy on and go full send.
I'm 100% sure I don't need it, but now I just want to build it. JUST BECAUSE. Great stuff, I'm just blown away by your skills to teach in a very fun way. Not to mention the amount of work to put this together in your head to then shoot and edit... JUST WOW!!!!
We definitely need more of this especially things like connecting a cluster safely to the internet will increase the usage possibilities ten-fold. Thank you for making this!
If anyone is having issues when imaging the pi and logging in with SSH. Here is why. There is no longer a default user with a default password, you have to make one when first writing the image on the micro SD or on command line. It is easier to set one up by going to the settings before writing
"init=/bin/sh" lets the pi boot into bash and lets you put in your own username and password, granted you will need a way to connect it to a monitor and keyboard. ( from hours and hours of testing on my 12 pi cluster)
This was actually a pretty good lecture for me starting a new job as an automation engineer working with industrial digitalization. Edge devices are almost found in every new machine nowadays and we use K3S to integrate and manage those devices (working nodes).
Man, this video might have taken more than 80 hours of researching, deploying, testing, scripting, recording, editing, reviewing, copywriting and publishing. Thank you for that! I'm really glad to have discovered this channel while browsing on the Internet! New subscriber from Brazil!
Thank you so much Chuck! I can't stress enough how difficult it is to go and research, and figure this out yourself. Thanks for taking the time to make it easy.
WOW! That was BRILLIANT! I have chewed around the edges of Kubernets for a while. I have read a bunch and done a few tiny bits. But, this was the perfect balance of completeness and stripped down to make it VERY understandable and create a structure on which we can hang more detail. Brilliant!
One thing you forgot to mention... quite a big reason to go cluster anything (apart from the load balancing) is the auto healing ability. If you unplugged the PI that was running the minecraft server as it stands, it would automatically spin up another instance on another PI. Another thing to note when dealing with anything cluster is persistent storage. As it current stands, if that minecraft server were to move to another node, you'd lose your saved data. Maybe make a persistent data video to accompany this one
@Jay Dee because it only had the image. If you ever used containers, they have images, volumes, and persistent data. Images can be changed, updates etc; persistent data can be exposed from host to guest (containers). Persistent data or storage, can also be accessed by multiples containers at the same time. Edit: It's called persistent data, because data doesn't get lost after reboot or the container. Images on the other hand, if changed, they lose the changes after reboot. They are meant not to be changed.
However for persistent data to work on clusters, that app must be built based on 3-tier design. Otherwise it will just lock or kill each other out. Not all apps can be load balanced.
Managing multiple K8s clusters is my day job, so I can appreciate the amount of work and effort that went into this, nice one. P.s, I use k3s alongside k8s at work to test stuff without having to deploy k8s from scratch, the manifests are generally 100% compatible
Man I absolutely love the enthusiasm you have and the way you're teaching us. I am a frontend developer but i never skip a video from you, and i try almost everything you show us. I know that its just scratching the surface, but its crazy indeed how "easy" it becomes to manage your own bare metal server and have a cloud grade technology at the tip of your fingers. I will try that for sure once I buy 2-3 more raspberries cause the 5 i have are already full with web-servers, plex server, pi-hole, docker with (Portainer), NAS(OMV) and god knows what more :D. Thank you once again for showing us those great nerdy stuff and making them easier for us to assimilate as i know the Hussle of learning those stuff on your own just by using the documentation and the "try-error" pattern until you figure it out, but the feeling once you wrap your mind around it is great!.
Just started learning K8 for me job. After seeing what you built in this video i would like to build my own cluster at home. Thanks for the awesome video Chuck.
Thanks Chuck! I will never do this but I have just spent a happy hour watching you do it. I can't imagine how long it took you to prepare for this video, so thanks for that.
This is an awesome video! Unfortunately, it no longer works if you follow along. K3S has now progressed up to version v1.22.5. Rancher does not support version 1.22.5 and you end up stuck at the "Waiting for API to be available" message. No big deal - the kubectl/CLI parts still work great!
I just finished building this 8x rPi cluster using the same kit with the exception of the use of PoE hats to reduce desk clutter - a really great learning experience. I was dropped into the Minecraft server at night and was immediately blown up by an attacking creeper. 😊 Keep in mind that both Rancher and Ubuntu have versioned. Rancher no longer includes the experimental RancherD in its distribution. Pull down the the original versions mentioned in this tutorial and you'll be fine.
Hey I tried installing rancher from other websites but I am unable to enable rancher. I went through their website and did the whole thing of enabling docker and then installing rancher. Do you happen to have a breakdown of steps of how you installed rancher on your ubuntu VM?
@@123ftw1 Maybe! I did manage to get 3 rpi 4’s, but I’ve given them different tasks and set up my cluster on ubuntu virtual machines on a PC hypervisor.
I have 10 8GB RPi 4s and i bought them before covid but never used them at all. I am now doing this rancher, ansible, containers, k3s lot n lots n lots
I am so glad I finally set some time aside to watch this!!! Super excited to try this as my next project! You made learning this super easy to follow. Thank you!!!!
Bro you put in a lot of high end work in these videos on top of all the knowledge that im sure at times been painstaking in aquasition behind the scenes. Your straight up a pro and i appreciate you sharing this knowledge with all who seek it.
Nice video - a great intro into Kubernetes. I tried deploying it to 4x RPi 3B+, but the master almost died due to lack of memory. A quick rebuild later, and I now run the master on a vitual machine and the four Pi's is worker nodes. It works despite it running on both arm64 and x86 architecture :-) As someone else mentioned, I would love to see how to do load balancing correct, so we have no hardcoding to a specific node IP. I pulled one of the workers offline, and K3s rebuilt the pods on another worker, but I can not access it on the original IP.
19:53 Do NOT repeat the original direction 7 more times. Create an image of the first machine. Write the image to the other sd cards. Now you just need to manage the IP and hostname.
I was looking for this comment, I knew that if there n times nodes on the network, it will take n times to get it setup and I am like whaaat? why is he doing it, there should be better way. Then I found your comment along with another guy mentioning pxe server which I never thought it exsited.
@@brandonconway5286 Same as the video, 14:30. The custom image saves the step just before this. He had to cold boot every single SD card *before* editing this file. I'm suggesting instead that you make one SD exactly as he did. Then make a backup image. Burn that backup to the other cards. Then edit the file. Then boot the pi machine. So instead of n * 2 booting sequences, you deal with n + 1 booting sequences.
I just wanted to drop in and say thank you. I know this took a significant amount of time and research to just figure out how to do this, let alone taking the time to put this video together. Thank you, thank you!
Great, it reminds me of my early days in electronics, the introduction early days and the first microcontroller, Intel 4004. A bunch of us used it for controlling a vacuum messaging system around London airport, between the customs office and the individual freight hubs, BEA, BOAC, PanAm etc. We didn't have all the software and other gismos you have today, just teletypes for programming on paper tape? Your enthusiasm was similar to ours at the time, but we had at least ten teletypes, going off like a Gatling gun, making concentration difficult. You'd make a great enthusiastic educator, I've learnt a lot from you, Jeff and other engineers on UA-cam. I'm old but still learning. Thank you all and UA-cam
It's awesome to see how dedicated and excited you are to share the knowledge you gain to us instead of hoarding it and becoming a "dead end of information". Your work is extremely appreciated.
When configuring pi-2 -> pi-n please just copy the image from the first to the second (n)... then change the cmdline.txt to the new ip addresses. This should be quick
Valid, unless you've ever felt the pain of a corrupt SD card. Very much preferable to use the same starting point for everything and not risk having to re-do the whole lot because you ended up copying from a faulty card to everything else in your cluster.
This is really cool. I studied clustering back in the 90's.... Lobos and stuff like that. I'm glad it's gotten ever so much easier. I think this would be a fun project, but I'm really not sure what I would do with it once I had it working.
Great stuff, thank you, you managed to FINALLY open up my basic understanding of k3s! I'd LOVE to see a 2nd part where you maybe show how outages affect the cluster (pull the power off one of those raspi's) and which steps are involved to add additional servers to an existing and running k3s cluster (where the workers will automagically join the load).. Hope to see more of this on your channel!
love this deployment....I'm moving house soon, going from VERY rural to very urban and would love to use PI products and Linux to create a security camera system on an incredibly tight budget, maybe starting simple and adding additional cameras at a later stage, but utilizing the compute power and AI to identify friend v foe with respect to camera footage.
I'm working on having my cameras automatically track anyone they see. So anyone who comes around would be able to see the camera moving and following them. It's been tougher to do than I thought it would be, but it really freaks out the mail guy
The way chuck explains stuff makes me feel smart and talked down to at the same time, but i wouldnt be able to follow any of this without it. Thanks for nerdsplaning everything like im a casual. 👍
things must have come a long way since this video, i bought 5 rpi 3b for cheap recently, never owned or used one, and its all easier than you think, raspberry imager will set up hostname, ssh, user and pass (pass linked to ssh) and network if you give it the details you require in the settings button, however following the steps to the cmdline and config is the same,as i gave one away to a friend im setting up 4 pi3b with the main being gui desktop as its in my bedroom which i can still ssh into my other pis from, great vids btw
I work primarily with the Avaya stuff, but like Chuck I love all things IT!!! I heard a rumor that Avaya might be moving towards some sort of container type of infrastructure, it would be so cool to setup a PBX on one of these! No more high power bills ( :
I also work with Avaya equipment, mainly IP Office 👊. Avaya used to do a containerised solution but it was hosted by Avaya on Google cloud. They discontinued it when they partnered with ring central for avaya cloud office. You should watch Chucks video on setting up 3cx on a raspberry pi, if you're into Voip you'll find 3cx pretty cool if you haven't worked with it before.
@@chrisjreed88 Awesome! I'm on the Avaya Aura side myself, IP office is great too! We have a team of IPO guys, we'll be collaborating soon for cross training.
The question is is iptables-legacy still needed in Debian 11 aka bullseye, because I usually install it instead of Raspbian? I suppose yes, because Debian 11 uses nftables .However I know that you do not have to install iptables and perform this command: sudo iptables -F && sudo update-alternatives --set iptables /usr/sbin/iptables-legacy && sudo update-alternatives --set ip6tables /usr/sbin/ip6tables-legacy && sudo reboot
Here's a question: Why install k3s on a master and rancher on separate servers or install k3s at all? wouldn't installing rancher suffice since it creates its own cluster/master node where you can add your worker nodes to the master created by rancher or would that not work?
AFAIK RKE/RKE2 doesn’t yet support ARM. Rancher can manage K3s because it’s Kubernetes, but I don’t think Rancher can deploy it yet because it only deploys RKE/2. Also there’s no IaaS component for Rancher to create VMs with, if you’re using RPi bare metal.
@@jasonburgess7751 it’s great, but look at the release assets. Nothing for ARM. With this specifically being an RPi deployment, RKE2 doesn’t work here. I wish it did. I ended up just writing some Ansible roles to bootstrap K3s on Ubuntu ARM and configure all the needed prereqs and OS config. Would be nice to have a Rancher solution though.
I agree what Chuck did was a bit strange. A bit of Clarification - Rancher does not create it's own cluster. Rancher is installed in an existing cluster like any other app that would be a deployment such as redis or nginx. Technically Rancher could have been installed on the cluster of Pi's but Rancher is not officially supported on ARM from the docs at rancher.com/docs/rancher/v2.5/en/installation/requirements/ "All supported operating systems are 64-bit x86." (I have a cluster of the exact Pi's that Chuck is using and running 2.5.9 on it and it works flawlessly btw).
@@shady4tv agreed. I think to further clarify, Rancher and Kubernetes are not the same thing. Rancher is a management and deployment tool for Kubernetes clusters. It deploys RKE (Rancher Kubernetes Engine), which is a full K8s deployment. RKE is Rancher Labs’ brand of Kubernetes basically.
Looks like ARM support is experimental: This graphic suggests RKE2 will deploy on ARM64: rancherfederal.com/wp-content/uploads/2020/10/RKE-Table.png But as suggested above, I believe it is possibly experimental. As to the note that Rancher does not deploy it's own cluster: sometimes it does. :) But you can't really use it for anything IMO. I've seen Rancher install from a container that creates, in the container, its own K3S deployment to run containers of itself! :) Confused the hell out of me early on in my learning path because I could see a "cluster" sitting there but it didn't seem to be the one I created in K8S! :) Like in the video, you actually see "two" clusters... the one Rancher creates to run itself and the one you import that Chuck made on the Pis (so cool I love this video). :)
there an option to write the wireless connection onto the SD card with the rasberri pi imager.... just press ctrl + shft + x and a menu will come up before u write and you can add your wifi+ password before u write the image to the sd card
didn't know that, thanks!! another way to do so is to go into the wpa_supplicant.conf file. This is not on the boot partition, but rather the OS partition and is found in /etc/wpa_supplicant/. Use your favorite command line text editor and add network={ ssid="" psk="" } You can be more specific in this entry with security type, if it's hidden, etc. www.raspberrypi.org/documentation/configuration/wireless/wireless-cli.md
I love your videos. I’ve been having so much trouble getting my cluster set up so this will definitely help. I’ve spent many nights digging and making no progress. I also love how hemmed up on coffee you are. It is essential.
Just got this running on 4 Raspberry Pi 5s and it is pretty cool. Been wanting to try this for a while but could not find any Pis that were available, Now that the 5 is out I'm able to get them without paying outrageous prices. Thanks Chuck for sharing this!
@@Azmedon-AU sure, you could spend $1000 on them but you could also get the 4Gb ones for like 50 dollars. Also you can just run this cluster on as many as you can afford.
I really enjoy you videos🤩 Thank you for the great content! Have you considered to use PoE instead of all the power supplies? Will that work out of the box?
Itd be awesome to see an updated version of this with the Pi5. Just got my first Pi5 and going to make a sort of dedicated Minecraft gaming console for my nephew, so load balancing (and potentially multiple Pi5s) is going to be necessary 😅
i had big problems because of the 404 error in your documentation. but i think the right commands for minute 19:00 are: $ sudo iptables -F $ sudo update-alternatives --set iptables /usr/sbin/iptables-legacy $ sudo update-alternatives --set ip6tables /usr/sbin/ip6tables-legacy $ sudo reboot
This was so cool. Gonna do this as well. Makes me understand a lot more how our infrastructure in our data centers at work are built to make Kubernetes clusters. Of course, it’s more complex there, but at its core, it’s a version of this mini setup. So much confusion is unlocked!
why are you so interesting to listen to! You have just the right amount of energy. Just enough to keep my attention, but not overdoing it that it's annoying. Stop being so interesting! I can't stop watching.
Hey Chuck, I was always wondering if such a cluster could be used to do Data Analysis with Hadoop? That'd be awesome Great video btw, keep up the good work, thanks for all the great insights.
Wow! Amazing! I want to do it too! Btw, in simple cases, one pod has usually one container associated with it. A pod can have multiple containers - this normally comes in when you start considering envoys or sidecars.
Imagine having a few worker nodes with a GPU and then running a CUDA code on the cluster which distributes load in multiple threads. CUDA + Kubernates would litraly be insaane. Edit: If at all that's possible
It is very easy. Just make sure at least one of the nodes have the NVIDIA or AMD drivers, and install the appropriate kubernetes GPU plugin. (They don't come by default, but is a one-liner). Once that is done, you can tell any pod how many GPU cores can use with the resources option on the yaml file: resources: limits: nvidia.com/gpu: 1 # requesting 1 GPU or resources: limits: amd.com/gpu: 1 # requesting 1 GPU
great video!! have you ever thought about PXE booting the Pi workers with a PXE boot server on the master? you could get rid of all the sd card preparation by booting directly over the network and even dynamically add a bunch of Pis…
Bro the intro already got me interested and I loved the video Plus that some awesome thinking, sliding down the stairs and cooking some beautiful food, made me drool
I just wanted to say that I love your energy in the videos and the genuine excitement that you bring. Loved the video and I would really enjoy if you continued to pursue raspberry and k3s in future videos. Keep the coffee coming. Greetings from Portugal
Just ordered everything I need! Can't wait to start the build. I just learned the basics of docker and Kubernetes on my local machine and this is the perfect next step. I'll let you know when I finish the build 😄
@@TheBusenitz1 yes I'm currently at the rancher part, video doesn't tell how to setup the VM. According to the rancher docs it's needs to meet specific requirements. I'm going to try it anyway and see where I end up
You don’t actually say anything during the first 10 minutes! You just go around in circles saying, “so you want to build a cluster with kubernetes? So you will need an rpi to do it. What are we doing? We are going to build a cluster with kubernetes. What do you need? You will need an rpi.”
man i wish i had you as a teacher, i could learn from someone like you. My Computer Carreer failed me in the way it was dull. sitting watching a video for hours unable to ask and hardly any examples.
ENTER TO WIN a custom Raspberry Pi (pre-built with K3s): bit.ly/2VHhfwt
Learn more about SUSE Rancher: bit.ly/3rb8Ih0
Need help with Kubernetes?? (i did) Ask Boxboat for help: bit.ly/3izncVB
🔎🔎Links and Guide: bit.ly/3xIkQbV
I built a Raspberry Pi SUPER COMPUTER using Kubernetes (k3s) and Rancher. This project was insanely fun and I want YOU to do it. Why? You will learn about clustering, Kubernetes, k3s and so much more. Basically, these are skills you can take with you into the enterprise.
Get a Raspberry Pi: geni.us/aBeqAL
Hi
Thank you
What do you use to do the screen annotation?
Could you do that with an esp8266 or esp32 and do RTOS containers?
Good evening sir from the Philippines. I'm your follower on UA-cam and i badly need help 🙏 my girlfriend break up my relationship with her because of unknown reason. She changed her password on Facebook so that I can't see what she's doing or chatting with someone. I still have her Google Account connected to Facebook and i used it to log in but but i can't still log in because she used Code Generator so that i can't access her account to find evidence that she really cheated on me. Please sir 🥺🙏 I'm really depressed right now because i really love her more than my life but she broked up with me. I hope you can help me with my problem sir because i don't know what to do, I don't know what's the real reason of everything. Please help me, help me sir🙏 Please notice me sir 🙏 You're the only guy that i trust with this kind of problems. God bless you always and keep safe
0:28 - Needs more Pi!
Hi Jeff
me nemmeh jeff :D
I loved your series. Buy sadly I found this simpler to understand with the networking. I do like your in depth explanation of how it works though.
@@Jimmy_Jones This video's like the 1-hour crash course. I love seeing more good guides to getting started in K3s/K8s on UA-cam. Plus, can't knock running it on Pis!
Eyyy its jeff
Thanks for the callouts Chuck, It was an absolute pleasure working with you on getting Rancher going and dealing with some of the wonderful quirks! I knew it'd be fun to work with a UA-camr, but you should've seen my face when I double-taked on the email on just WHO I was helping! ;)
Pro-tip: You can enable SSH before imaging the Pi by hitting CTRL+Shift+X with the Pi Imager focused which will bring up a hidden menu.
Enabling ssh is actually an option in the Pi imager application. You can enter the ssh key for password-less login and even replace the pi user with another username.
They've changed the imager a couple times since this video got made. The new way it works almost guarantees you won't mess it up and miss out on all the advanced options, ssh included. It will throw a pop-up at you and give you ample opportunity to make sure the settings are right and that you want to use them for your new image.
Using these options in Pi Imager will save you tons of time
That was a a splendid intro tutorial. Your hypercaffeinated schtick was kinda bugging me until I realized how almost necessary it is for presenting this stuff in a timely way. Kubernetes is no longer a mystery to me and I thank you!
I'm setting up a bare metal server in my remote office and this video was the best thing that could have happened to me. Thanks a lot man, you are seriously fun to watch. Cheers
That fact I sat here and watched this video knowing absolutely nothing about this, just shows that your energy and knowledge about this kept me here. This makes me want to buy on and go full send.
the wheels, oh the wheels that spin in our minds... I think some people have round ones, some have square wheels
I'm 100% sure I don't need it, but now I just want to build it. JUST BECAUSE. Great stuff, I'm just blown away by your skills to teach in a very fun way. Not to mention the amount of work to put this together in your head to then shoot and edit... JUST WOW!!!!
I agree that he is a master in teaching in a fun way. And it has to be fun to remember it better for me. 🙏🏾
Put pihole in it.
I thought the same thing! Are we need it... no. But It will be really fun do that so let's go!
Same here, i already have one pi🤣
@@valzzu Lol 😂 I already have 3 I did went a different route though.
We definitely need more of this especially things like connecting a cluster safely to the internet will increase the usage possibilities ten-fold. Thank you for making this!
If anyone is having issues when imaging the pi and logging in with SSH. Here is why. There is no longer a default user with a default password, you have to make one when first writing the image on the micro SD or on command line. It is easier to set one up by going to the settings before writing
"init=/bin/sh" lets the pi boot into bash and lets you put in your own username and password, granted you will need a way to connect it to a monitor and keyboard. ( from hours and hours of testing on my 12 pi cluster)
This was actually a pretty good lecture for me starting a new job as an automation engineer working with industrial digitalization. Edge devices are almost found in every new machine nowadays and we use K3S to integrate and manage those devices (working nodes).
Man, this video might have taken more than 80 hours of researching, deploying, testing, scripting, recording, editing, reviewing, copywriting and publishing.
Thank you for that! I'm really glad to have discovered this channel while browsing on the Internet!
New subscriber from Brazil!
Thank you so much Chuck! I can't stress enough how difficult it is to go and research, and figure this out yourself. Thanks for taking the time to make it easy.
tiny tip, to start and enable on start with systemd you can use "enable --now" it will start it as the extra arg --now is provided!
Your walkthrough page isn't there anymore
Trying to figureout what I need to paste
Yea same I ran out of coffee
The video is three years old, I dont think a small walkthrough page survives that long. I just figured it out for myself, its not that complicated.
@@kalarianytcould you help me. I get the nodes working but cannot get rancher installed..
WOW! That was BRILLIANT! I have chewed around the edges of Kubernets for a while. I have read a bunch and done a few tiny bits. But, this was the perfect balance of completeness and stripped down to make it VERY understandable and create a structure on which we can hang more detail. Brilliant!
One thing you forgot to mention... quite a big reason to go cluster anything (apart from the load balancing) is the auto healing ability.
If you unplugged the PI that was running the minecraft server as it stands, it would automatically spin up another instance on another PI.
Another thing to note when dealing with anything cluster is persistent storage.
As it current stands, if that minecraft server were to move to another node, you'd lose your saved data.
Maybe make a persistent data video to accompany this one
@Jay Dee because it only had the image. If you ever used containers, they have images, volumes, and persistent data. Images can be changed, updates etc; persistent data can be exposed from host to guest (containers). Persistent data or storage, can also be accessed by multiples containers at the same time.
Edit:
It's called persistent data, because data doesn't get lost after reboot or the container. Images on the other hand, if changed, they lose the changes after reboot. They are meant not to be changed.
btw can you share something on how to add this persistent data?
Yep... PersistentVolumes, PVCs, etc - the final boss of k8s. How to do it right in a self hosted cluster? I'm still trying to figure that part out
However for persistent data to work on clusters, that app must be built based on 3-tier design. Otherwise it will just lock or kill each other out. Not all apps can be load balanced.
Managing multiple K8s clusters is my day job, so I can appreciate the amount of work and effort that went into this, nice one. P.s, I use k3s alongside k8s at work to test stuff without having to deploy k8s from scratch, the manifests are generally 100% compatible
Man I absolutely love the enthusiasm you have and the way you're teaching us. I am a frontend developer but i never skip a video from you, and i try almost everything you show us. I know that its just scratching the surface, but its crazy indeed how "easy" it becomes to manage your own bare metal server and have a cloud grade technology at the tip of your fingers. I will try that for sure once I buy 2-3 more raspberries cause the 5 i have are already full with web-servers, plex server, pi-hole, docker with (Portainer), NAS(OMV) and god knows what more :D. Thank you once again for showing us those great nerdy stuff and making them easier for us to assimilate as i know the Hussle of learning those stuff on your own just by using the documentation and the "try-error" pattern until you figure it out, but the feeling once you wrap your mind around it is great!.
I am trying to get the WALKTHROUGH documentation, but looks like the link doesn't work anymore. Is there a more updated link?
Just started learning K8 for me job. After seeing what you built in this video i would like to build my own cluster at home. Thanks for the awesome video Chuck.
Thanks Chuck! I will never do this but I have just spent a happy hour watching you do it. I can't imagine how long it took you to prepare for this video, so thanks for that.
This is the network chuck video of the year! Informative, educative, and damn cool! Keep it up Sir!
Exposing it to internet would be such an amazing PART 2 !
Keep up the good work.
Amazing quality on your videos Chuck ;)
This is an awesome video! Unfortunately, it no longer works if you follow along. K3S has now progressed up to version v1.22.5. Rancher does not support version 1.22.5 and you end up stuck at the "Waiting for API to be available" message. No big deal - the kubectl/CLI parts still work great!
Wish I read this before getting started 😂 Oh well - 3 Pi’s so far though!
how can i manage k3s cluster then is there other way like rancher or should I use lens
@@lt.kraken I can't send you a dm can you create a gist to share it.
@@lt.kraken I’m interested in what you found to get this working.
On install you can pick the lower package installer.
Some -command -version, etc
Hey Chuck.. where is the walkthrough? (Page Doesn't Exist). You lost me at the Pi image override statement, I can't see what you pasted in.
Love how much effort you put into your videos. I was always thinking about setting up my own cluster and now you got me to do it.
Awesome!
I just finished building this 8x rPi cluster using the same kit with the exception of the use of PoE hats to reduce desk clutter - a really great learning experience. I was dropped into the Minecraft server at night and was immediately blown up by an attacking creeper. 😊
Keep in mind that both Rancher and Ubuntu have versioned. Rancher no longer includes the experimental RancherD in its distribution. Pull down the the original versions mentioned in this tutorial and you'll be fine.
Where in the world did you find a place to buy 8 rpi's ? Every store that I checked is OOS , so scalpers are the only option.
Hey I tried installing rancher from other websites but I am unable to enable rancher. I went through their website and did the whole thing of enabling docker and then installing rancher. Do you happen to have a breakdown of steps of how you installed rancher on your ubuntu VM?
@@majorgear1021They started restocking them a few weeks ago in UK, maybe in US as well. Soon :)
@@123ftw1 Maybe! I did manage to get 3 rpi 4’s, but I’ve given them different tasks and set up my cluster on ubuntu virtual machines on a PC hypervisor.
I have 10 8GB RPi 4s and i bought them before covid but never used them at all. I am now doing this rancher, ansible, containers, k3s lot n lots n lots
I am so glad I finally set some time aside to watch this!!! Super excited to try this as my next project! You made learning this super easy to follow. Thank you!!!!
Bro you put in a lot of high end work in these videos on top of all the knowledge that im sure at times been painstaking in aquasition behind the scenes. Your straight up a pro and i appreciate you sharing this knowledge with all who seek it.
Why did I just assume his office was in the basement and not upstairs?
Because it would make sense to have a bunch of heat generating devices in the basement.
IDK, bcuz it looks like a full blown man cave!
It's the gamer beard and haircut
@@jelliott8424 Neckbeard syndrome, happens to the best of us.
cause you are in basement
Nice video - a great intro into Kubernetes.
I tried deploying it to 4x RPi 3B+, but the master almost died due to lack of memory.
A quick rebuild later, and I now run the master on a vitual machine and the four Pi's is worker nodes. It works despite it running on both arm64 and x86 architecture :-)
As someone else mentioned, I would love to see how to do load balancing correct, so we have no hardcoding to a specific node IP. I pulled one of the workers offline, and K3s rebuilt the pods on another worker, but I can not access it on the original IP.
19:53 Do NOT repeat the original direction 7 more times. Create an image of the first machine. Write the image to the other sd cards. Now you just need to manage the IP and hostname.
If inclined one could also set them all up to pxe boot and store the images on the pxe server. 👍
I was looking for this comment, I knew that if there n times nodes on the network, it will take n times to get it setup and I am like whaaat? why is he doing it, there should be better way. Then I found your comment along with another guy mentioning pxe server which I never thought it exsited.
@@SumanRoy.official Network booting a Pi cluster. Hmm short video?
@99codemister Where would one manage the IP and hostname? Are you saying you would log into each pi and change the hostname/IP of the device?
@@brandonconway5286 Same as the video, 14:30.
The custom image saves the step just before this. He had to cold boot every single SD card *before* editing this file.
I'm suggesting instead that you make one SD exactly as he did. Then make a backup image. Burn that backup to the other cards. Then edit the file. Then boot the pi machine.
So instead of n * 2 booting sequences, you deal with n + 1 booting sequences.
Yes to continuing this series and a video on exposing the cluster to the internet or any other cool things that you can do with the cluster.
I just wanted to drop in and say thank you. I know this took a significant amount of time and research to just figure out how to do this, let alone taking the time to put this video together. Thank you, thank you!
You are inspiring, I hope you know that
As a platform engineer amazing video sir! I love KUBERNETES!! It’s so amazing, I recommend anyone pick up the skill. Great video!
Life Goal : want a slide on top of stair
It's pretty cool!
My work has a slide between LVL 14-12.
@@NetworkChuck Hey, it would be the wrong place for as: what is the latest or newest supported version for windows 7?
I'll invent stair slide pants...
It isn't a thing....
Yet
my school has a slide from the 2nd floor down to base
Great, it reminds me of my early days in electronics, the introduction early days and the first microcontroller, Intel 4004.
A bunch of us used it for controlling a vacuum messaging system around London airport, between the customs office and the individual freight hubs, BEA, BOAC, PanAm etc.
We didn't have all the software and other gismos you have today, just teletypes for programming on paper tape?
Your enthusiasm was similar to ours at the time, but we had at least ten teletypes, going off like a Gatling gun, making concentration difficult.
You'd make a great enthusiastic educator, I've learnt a lot from you, Jeff and other engineers on UA-cam.
I'm old but still learning.
Thank you all and UA-cam
It's awesome to see how dedicated and excited you are to share the knowledge you gain to us instead of hoarding it and becoming a "dead end of information". Your work is extremely appreciated.
Just finished this video and never realized it was an hour long. Awesome.
When configuring pi-2 -> pi-n please just copy the image from the first to the second (n)... then change the cmdline.txt to the new ip addresses. This should be quick
This is what I was thinking.
Valid, unless you've ever felt the pain of a corrupt SD card. Very much preferable to use the same starting point for everything and not risk having to re-do the whole lot because you ended up copying from a faulty card to everything else in your cluster.
0:14 sliding in his DM's for a free pi be like
Man, this energy... I'm usually more a docs guy than a tutorial watching guy but i enjoyed the hell out of your videos.
This is really cool. I studied clustering back in the 90's.... Lobos and stuff like that. I'm glad it's gotten ever so much easier. I think this would be a fun project, but I'm really not sure what I would do with it once I had it working.
Great stuff, thank you, you managed to FINALLY open up my basic understanding of k3s! I'd LOVE to see a 2nd part where you maybe show how outages affect the cluster (pull the power off one of those raspi's) and which steps are involved to add additional servers to an existing and running k3s cluster (where the workers will automagically join the load).. Hope to see more of this on your channel!
The work you do with these tutorials is truly amazing. Everything works first try and is clearly explained! Thank you!
I'm guessing the guide that was attached to this is no longer available? Went to find it to type in the very long iptables string
did you have any luck finding it
I love how clean and energetic you are. You're a great dad and a humble person. Keep it up. ✝
Brother!! This is exactly what I have been looking for
yup me too
love this deployment....I'm moving house soon, going from VERY rural to very urban and would love to use PI products and Linux to create a security camera system on an incredibly tight budget, maybe starting simple and adding additional cameras at a later stage, but utilizing the compute power and AI to identify friend v foe with respect to camera footage.
I'm working on having my cameras automatically track anyone they see. So anyone who comes around would be able to see the camera moving and following them. It's been tougher to do than I thought it would be, but it really freaks out the mail guy
We need a new version of this!
The way chuck explains stuff makes me feel smart and talked down to at the same time, but i wouldnt be able to follow any of this without it. Thanks for nerdsplaning everything like im a casual. 👍
10/10, you have inspired me to build my own Kubernetes cluster.
Currently waiting on my 3 worker nodes to arrive!
things must have come a long way since this video, i bought 5 rpi 3b for cheap recently, never owned or used one, and its all easier than you think, raspberry imager will set up hostname, ssh, user and pass (pass linked to ssh) and network if you give it the details you require in the settings button, however following the steps to the cmdline and config is the same,as i gave one away to a friend im setting up 4 pi3b with the main being gui desktop as its in my bedroom which i can still ssh into my other pis from, great vids btw
I work primarily with the Avaya stuff, but like Chuck I love all things IT!!! I heard a rumor that Avaya might be moving towards some sort of container type of infrastructure, it would be so cool to setup a PBX on one of these! No more high power bills ( :
I also work with Avaya equipment, mainly IP Office 👊. Avaya used to do a containerised solution but it was hosted by Avaya on Google cloud. They discontinued it when they partnered with ring central for avaya cloud office. You should watch Chucks video on setting up 3cx on a raspberry pi, if you're into Voip you'll find 3cx pretty cool if you haven't worked with it before.
@@chrisjreed88 Awesome! I'm on the Avaya Aura side myself, IP office is great too! We have a team of IPO guys, we'll be collaborating soon for cross training.
That SUSE jumpscare at minute 40 😂
And another one at 1:02:50 lol
The question is is iptables-legacy still needed in Debian 11 aka bullseye, because I usually install it instead of Raspbian? I suppose yes, because Debian 11 uses nftables .However I know that you do not have to install iptables and perform this command:
sudo iptables -F && sudo update-alternatives --set iptables /usr/sbin/iptables-legacy && sudo update-alternatives --set ip6tables /usr/sbin/ip6tables-legacy && sudo reboot
Is it possible to use this to create a node for the pi network (crypto) and if yes how well would it work with this setup?
Here's a question: Why install k3s on a master and rancher on separate servers or install k3s at all? wouldn't installing rancher suffice since it creates its own cluster/master node where you can add your worker nodes to the master created by rancher or would that not work?
AFAIK RKE/RKE2 doesn’t yet support ARM. Rancher can manage K3s because it’s Kubernetes, but I don’t think Rancher can deploy it yet because it only deploys RKE/2. Also there’s no IaaS component for Rancher to create VMs with, if you’re using RPi bare metal.
@@jasonburgess7751 it’s great, but look at the release assets. Nothing for ARM. With this specifically being an RPi deployment, RKE2 doesn’t work here. I wish it did. I ended up just writing some Ansible roles to bootstrap K3s on Ubuntu ARM and configure all the needed prereqs and OS config. Would be nice to have a Rancher solution though.
I agree what Chuck did was a bit strange.
A bit of Clarification - Rancher does not create it's own cluster. Rancher is installed in an existing cluster like any other app that would be a deployment such as redis or nginx. Technically Rancher could have been installed on the cluster of Pi's but Rancher is not officially supported on ARM from the docs at rancher.com/docs/rancher/v2.5/en/installation/requirements/ "All supported operating systems are 64-bit x86."
(I have a cluster of the exact Pi's that Chuck is using and running 2.5.9 on it and it works flawlessly btw).
@@shady4tv agreed. I think to further clarify, Rancher and Kubernetes are not the same thing. Rancher is a management and deployment tool for Kubernetes clusters. It deploys RKE (Rancher Kubernetes Engine), which is a full K8s deployment. RKE is Rancher Labs’ brand of Kubernetes basically.
Looks like ARM support is experimental:
This graphic suggests RKE2 will deploy on ARM64:
rancherfederal.com/wp-content/uploads/2020/10/RKE-Table.png
But as suggested above, I believe it is possibly experimental.
As to the note that Rancher does not deploy it's own cluster: sometimes it does. :) But you can't really use it for anything IMO. I've seen Rancher install from a container that creates, in the container, its own K3S deployment to run containers of itself! :) Confused the hell out of me early on in my learning path because I could see a "cluster" sitting there but it didn't seem to be the one I created in K8S! :) Like in the video, you actually see "two" clusters... the one Rancher creates to run itself and the one you import that Chuck made on the Pis (so cool I love this video). :)
there an option to write the wireless connection onto the SD card with the rasberri pi imager.... just press ctrl + shft + x and a menu will come up before u write and you can add your wifi+ password before u write the image to the sd card
didn't know that, thanks!!
another way to do so is to go into the wpa_supplicant.conf file. This is not on the boot partition, but rather the OS partition and is found in /etc/wpa_supplicant/. Use your favorite command line text editor and add
network={
ssid=""
psk=""
}
You can be more specific in this entry with security type, if it's hidden, etc. www.raspberrypi.org/documentation/configuration/wireless/wireless-cli.md
Glad to know Chuck is also one of 10 people who say “what the junk”
I thought he said "What the Chuck!" lol
@@מנחםפיליפי 🤣
I love your videos. I’ve been having so much trouble getting my cluster set up so this will definitely help. I’ve spent many nights digging and making no progress. I also love how hemmed up on coffee you are. It is essential.
Just got this running on 4 Raspberry Pi 5s and it is pretty cool. Been wanting to try this for a while but could not find any Pis that were available, Now that the 5 is out I'm able to get them without paying outrageous prices. Thanks Chuck for sharing this!
“pretty much all you need, apart from about 1000$ in raspberry pi’s”
How much do you think raspberry pi's cost?
@@VladtheImpaler_99 $145 for a Raspberry Pi 4 8g
@@Azmedon-AU sure, you could spend $1000 on them but you could also get the 4Gb ones for like 50 dollars. Also you can just run this cluster on as many as you can afford.
@@VladtheImpaler_99 The 4g one is about $100 without any power supply, I just use my computer as a server.
@@VladtheImpaler_99 Oh forgot I'm talking Australian dollar and that's just for the card.
404 error for the guide
Same
I really enjoy you videos🤩 Thank you for the great content! Have you considered to use PoE instead of all the power supplies? Will that work out of the box?
Itd be awesome to see an updated version of this with the Pi5.
Just got my first Pi5 and going to make a sort of dedicated Minecraft gaming console for my nephew, so load balancing (and potentially multiple Pi5s) is going to be necessary 😅
i had big problems because of the 404 error in your documentation.
but i think the right commands for minute 19:00 are:
$ sudo iptables -F
$ sudo update-alternatives --set iptables /usr/sbin/iptables-legacy
$ sudo update-alternatives --set ip6tables /usr/sbin/ip6tables-legacy
$ sudo reboot
Highly underrated comment
This was so cool. Gonna do this as well. Makes me understand a lot more how our infrastructure in our data centers at work are built to make Kubernetes clusters. Of course, it’s more complex there, but at its core, it’s a version of this mini setup. So much confusion is unlocked!
Disappointed there wasn't a bookmark for every 8 seconds when a coffee break occurred.
New drinking game: You have to drink a shot every time Chuck says "Coffee".
@@king0770 But I like my liver!
this is pretty sweet. just curious, what are you using to show your screen and draw on it in real time?
YESSSS I'VE BEEN WAITING FOR THIS VIDEO
why are you so interesting to listen to! You have just the right amount of energy. Just enough to keep my attention, but not overdoing it that it's annoying. Stop being so interesting! I can't stop watching.
The effort is crazy ! 🔥
Thanks for going through all the steps , i also never used rancher and it seems too good!
18:53 How you gonna be a literal IT Ninja but misspell raspberry
Hey Chuck, I was always wondering if such a cluster could be used to do Data Analysis with Hadoop? That'd be awesome
Great video btw, keep up the good work, thanks for all the great insights.
Hi Chuck, I know this video is a year old, but I wanted to make you aware that your walkthrough on your website is coming up with page 404
i really enjoy watching a viking explain tech to me :D
Thank you for saying Kubernetes so many times so that I couldn't possibly forget it ever again!
Wow! Amazing! I want to do it too! Btw, in simple cases, one pod has usually one container associated with it. A pod can have multiple containers - this normally comes in when you start considering envoys or sidecars.
Imagine having a few worker nodes with a GPU and then running a CUDA code on the cluster which distributes load in multiple threads. CUDA + Kubernates would litraly be insaane.
Edit: If at all that's possible
It is possible, but it isn't trivial.
I got a brand new 3070 in the box 👀
It is very easy. Just make sure at least one of the nodes have the NVIDIA or AMD drivers, and install the appropriate kubernetes GPU plugin. (They don't come by default, but is a one-liner).
Once that is done, you can tell any pod how many GPU cores can use with the resources option on the yaml file:
resources:
limits:
nvidia.com/gpu: 1 # requesting 1 GPU
or
resources:
limits:
amd.com/gpu: 1 # requesting 1 GPU
great video!! have you ever thought about PXE booting the Pi workers with a PXE boot server on the master? you could get rid of all the sd card preparation by booting directly over the network and even dynamically add a bunch of Pis…
Bro the intro already got me interested and I loved the video
Plus that some awesome thinking, sliding down the stairs and cooking some beautiful food, made me drool
I just wanted to say that I love your energy in the videos and the genuine excitement that you bring. Loved the video and I would really enjoy if you continued to pursue raspberry and k3s in future videos. Keep the coffee coming.
Greetings from Portugal
Why did you not build K3S on K3OS?
It is build for it
Ps. Love your videos
Probably isn't arm compatible maybe
Start watching video while mid dump
Chuck: *sniff* "what's that smell"
Me:...uhhh
Just ordered everything I need! Can't wait to start the build. I just learned the basics of docker and Kubernetes on my local machine and this is the perfect next step. I'll let you know when I finish the build 😄
how many pi's ?
Just a heads up....these instructions are broken. You won't be able to install rancher the way he says you can.
@@GetOffMehBRA I now have 4. Just got them en going through the procedure now
@@TheBusenitz1 yes I'm currently at the rancher part, video doesn't tell how to setup the VM. According to the rancher docs it's needs to meet specific requirements. I'm going to try it anyway and see where I end up
I would just like to get one... They are so expensive now, damn.
You gotta love his energy.
You don’t actually say anything during the first 10 minutes! You just go around in circles saying, “so you want to build a cluster with kubernetes? So you will need an rpi to do it. What are we doing? We are going to build a cluster with kubernetes. What do you need? You will need an rpi.”
I thought the same thing bro. Annoying
Thanks!
That was a good walk through. You are the first I have seen that has run Minecraft on a Raspberry Pi - cool!
Chuck...ty for all your post! I have been enjoying your informational videos a lot (of course while sipping coffee!). Keep them coming.
man i wish i had you as a teacher, i could learn from someone like you. My Computer Carreer failed me in the way it was dull. sitting watching a video for hours unable to ask and hardly any examples.
Thanks
I can't believe that have never seen your channel before. So much excellent information and you are interesting to watch. Great stuff. 🤙🏽
Chuck, I'm interested in a follow-on to this by scaling up the cluster to include multi master for high availability.
the knowledge i just absorbed is immense. thanks for this!
NC:"isn't this crazy?"
Me: Yeep, This is crazy fun man, loving your content