HomeLab Services Tour Late 2021 - What am I Self-Hosting in my HomeLab?
Вставка
- Опубліковано 9 чер 2024
- After showing off my Home Lab hardware in my late 2021 tour, many of you asked what services are self-hosted in this stack. This is always a moving target so I decided it was time to share which services I am running here at home. Today, we walk through everything I am hosting including: Dashboard, Hypervisor, Virtualization, Containerization, Network Attached Storage (NAS), DNS, Network Management, Home Security, Kubernetes, Kubernetes Storage, Docker, Reverse Proxy, Certificates, Monitoring, Logging, Syncing Data, File Sharing, Self-Promotion (Contact Page), Link Shortening, Home Entertainment, Home Automation, Battery / UPS Monitoring, CMS, Static Site Generators, Dynamic DNS, CI/CD, and many, many others. Enjoy the virtual tour!
Worth mentioning, I have videos on almost every service mentioned in this video!
Video Notes: technotim.live/posts/homelab-...
Support me on Patreon: / technotim
Sponsor me on GitHub: github.com/sponsors/timothyst...
Subscribe on Twitch: / technotim
Become a UA-cam member: / @technotim
Merch Shop 🛍️: l.technotim.live/shop
Gear Recommendations: l.technotim.live/gear
Get Help in Our Discord Community: l.technotim.live/discord
2nd channel: / @technotimtalks
(Affiliate links may be included in this description. I may receive a small commission at no cost to you.)
00:00 - Intro
00:53 - Dashboard
01:20 - Hypervisor
03:18 - Network Attached Storage
05:31 - DNS
08:03 - Network Management
08:39 - Home Security
09:08 - Kubernetes
12:07 - Kubernetes Storage
13:05 - Docker
14:19 - Reverse Proxy
16:50 - Certificates
17:24 - Monitoring
18:21 - Discord Plug
18:52 - Logging
20:29 - Syncing Data
21:15 - File Sharing
21:46 - Self-Promotion (Contact Page)
22:27 - Link Shortening
24:01- Home Entertainment
24:29 - Home Automation
26:00 - Battery / UPS Monitoring
26:56 - CMS
27:38 - Static Site Generators
28:13 - Dynamic DNS
29:01 - CI/CD
30:26 - All the things
31:17 - What are you self-hosting?
31:29 - Stream Highlight - That time chat trolled me....
#TechnoTim #HomeLab #SelfHosted
"Leaving A Trail" is from Harris Heller's album Ignition.
l.technotim.live/sb-music-lic...
Thank you for watching! - Наука та технологія
What services are you self-hosting in your HomeLab?
How do you deal with ISP downtime? Do you have two (or more) uplinks? :)
Also. What is the name of the tool you used to create the dashboard?
@@joaopedroalbernaz Heimdall
@@eddster2309 thanks 😉👍
Ipfs attached to multiple private blochains providing different services
When you're an IT guy, half of your home lab tends to be a carry over of things you've put into production in the work place, simply because you can lol, but arguably even though it's more complexity then needed for home uses, I wouldn't have it any other way.
This is most definitely true. At work i'm implementing Microsoft/Azure Sentinel. Now I'm also working on getting my ubiquiti data to my own Azure Sentinel instance through a syslog/fluentd container, purely because it's fun and usefull for my work as well.
In my opinion this is the best way to rock at work and have good time in your spare time. It's just a shame that cloud homelabs can cost a bit if you're not carefull. Would be awesome if employers would stimulate this with some financial compensation or some Azure credits.
@@ijustwanttoeatcookie I agree, if you step back and look at what it can cost, it can rack up quite a bit in no time, but I do tend to make use of outdated hardware where it's considered outdated for the workplace but still plenty powerful at home😏
Well hey a license here or there …
I have a couple of servers at home so that I can try out things that would take about a month of paperwork and security reviews at work.
@@ijustwanttoeatcookie You have your own sentinel instance? for home stuff? Has that been valuable for what you're doing at work?
This channel is seriously underrated.
The level of knowledge responsibility is incredible.
(Being responsible about when you share something, that you know the subject and are responsible enough to disclose when you don't)
Then the structure of presenting it...
Man, I found this a while ago
I completly agree! Keep on @Techno Tim
Thank you all so much for the kind words! I'm just out here homelabbin', self-hostin', and sharing!
I absolutely love your videos. Some of the most concise and clear content I think I have ever seen. You inspired me to go all the way with home services and eventually my own home lab, which has boosted my application development to new highs.
Thanks very much for making the effort to help us along our way to computing mastery.
Yeah, he's really amazing.
Wow. Fantastic video. Pretty rare to get this high production quality, straight forward presentation, detailed information, and also come across as an everyday likeable guy. Instant subscribe. I'll be checking out the rest of your stuff.
Thank you for sharing this. Helps us all with our own projects as we wade through failures and success at home. It's all part of the learning processes and I appreciate your videos and insight into your HomeLab.
Hi Tim, I'm getting ready to build up my first virtualization and NAS servers your videos have been a huge help! Thanks Soo much!
Overwhelming me a little and deeply impressing me at the same time. Hundrets of hours go into stuff like this very easily.
Thank you!
Wow. Lot of good stuff very well explained, and lot of efforts behind this channel Tim, love it. I think it's a bit overkill for such a professional grade's home lab, but hey, if you have the time to maintain all this, it's just fantastic. I would be very interested in a more detailed vídeo about how you have setup all the networking config, and how to secure everything properly. Thanks a lot, and keep on this awesome work!
I host most these micro services on Raspberry Pi, with docker and portainer, it also daily backup into to [cloud] dropbox in case i lose SD card. Not as powerful as your rig but consume way less power and perfect for home and great for learning all these interfaces with less capital. Also attached to synology NAS that i use as datastore and compute [Virtualisation] on demand and only turn on when i need using WoL. Running great for few years now.
Thanks for this video. I run an ATX NAS with Ubuntu server. I have 40TB for Plex (eight 8TB HDDs in Z3) 2TB NVMe for nextcloud and the 1TB NVMe boot drive for everything else. I am preparing to move over to Proxmox. The biggest challenge for me is RAM. This is a regular desktop system with a Ryzen 5950X and 128GB of RAM. I'm always using 100GB of RAM, I'm maxed out, so I might need to deploy a mini PC as a spillover for my services. My server grows as I learn, it's really fun. This video helped me, I need NUT and Heimdall on my home server.
There is so much to unpack here. I'm so impressed with your lab setup!
Thank you!
Thank you for uploading such a mindblowing content! I admire your knowledge and speech! You just became one of my favorites ❤
Great video! Was awesome seeing a live full setup. Really gets the gears turning ⚙️
Your home lab is quite impressive. For those interested in a career in IT, this is a blueprint of topics, software and hardware you can learn to give you a head start and more importantly the experience to apply in real world applications. Thanks for sharing.
Yeep. I'm trying to pivot from software development to IT and cybersecurity and I've continued to build my lab and skills from basically this channel though I would have to disagree on Heimdall. I used it but found Homarr and love it. Those Servarr services are great
Thank you for making this video. It is a huge inspiration and I learned about a lot of cool services to self-host. I already host a few but I'll definitely look into some new ones after watching.
Thank you so much!
Holy moly you have some serious business running at home!
I'm running just 10 or so Docker containers, dedicated True NAS and dedicated Pfsense modem-router.
I'm creating my own version of Plex but I'm making it like Netflix, pre-transcoding and automatic optical ripping. 😁
Since you asked about running too *few* services :-) …
Back when DNS exploits were more common, a good mitigation was to use a “hidden primary” DNS server for a domain, and then publish (via NS records) one or more secondary DNS servers that the hidden primary updates. No one ever hits the hidden primary, and only the domain registrars know where it is. I set up my DNS this way for a few domains about 15 years ago, and it’s been rock solid ever since. And just to be completely paranoid, I have multiple sets of secondaries: One pair (one each on different hypervisors) that are authoritative for my domains, and another pair of recursive-only servers that DHCP etc. point to, plus two more additional secondaries at offsite locations in case my main location goes off the air.
later on I am doing a clip on my homeBUNKER, as you've totally helped me understand [new acronyms galore when you start I thought Kubernetes was a fatal ilness until I drank Smirnoff] , much more about modern networking, as I am hacking into ProxMox etc with pure joy, Im 71 and been in electronics and computers since 1978 commercially in my own companies and as a home hobby, old habits never die, so dude -- great Good clear pieces to camera no waffle and no incomprehensible american accents (I am a Brit) Some of these homelab/proxmox guys have no idea how bad they sound especially in an international multi-language viewer pool! You are succint clear and to the point, anyone who speaks basic english can fully understand you THANKS AGAIN from Siam by The Sea 🙂
Thanks Tim. I'm waiting for an old HPE DL380 G7 Server to arrive and your videos are giving me some many ideas on what I run on it!
this is just the right amount of stuff to host, props to you, looks like a adventure to manage all of that
Thank you! More coming every day!
What a super insightful video, thanks for sharing, subbed!
Heimdall - never had heard about it before but OMG - paused the video to install it... It's magnificent!
"1/4 Japaneese... 100% Awesome!" is what your little link should say! This was a great walk through!
haha, need to update that with new messaging 📝
@@TechnoTim so you run Pihole as their own severs vs running as a container? (No including the pi zero in this question)
I do now, yes. I thought about moving it back to docker. I moved it out of kubernetes when building my new cluster and my cluster needs DNS to start. I could move it back though to docker however I wanted to keep my DNS machines clean. So many options!
@@TechnoTim same… I have the compute to just run them in a VM but also just as easy to toss into docker / K8s.
Why do i feel emotion when i watch tech? Thank you Techno Tim!
thanks for the video, been a long time follower and glad to see a fellow mpls person doing great things. Keep it up.
Thank you! MPLS!
oh no. I am hyped again. I thought @WolfgangsChannel video on home server was enough but man now. why did you make it so fancy ? now my money will be spent more
This’s how my dream homelab setup will be one day @techno Tim .
Great work 👌👍
Thank you! Just start small and build up over time!
So much information...watching it for a second time....
Thx for this!
I found this channel searching for an answer at work, now I'm redesigning my home network...thanks a lot, Tim! lol
Glad to help!
Awesome! Great work with your home lab! greetings from Spain!
Excited for your future home assistant videos
Thank you for this. I found it both inspirational and informative. Impressive, too.
I will admit it was long but you held my attention 💯👍 as you explained everything so clearly and each reason for each decision in simple laymen's terms. I have been learning a lot about all the formats and setups, Etc., Etc., Etc., that defines Home Servers, NAS, security and privacy, and so much more than I realized originally existed, yet I TRULY feel I understood you MOST yet... It all made perfect sense to me! Thank you for enlightening and encouraging me to not give up before I even started! I'd love to ask your advice about a few things some time if you wouldn't mind? And no, I'm not trying to bug you about this, just your thoughts about career avenues and possibilities and such... All the best to you! 💯😎☀️👍
Thank you so much! What a nice note! If you want to chat and hang out with others check out our discord!
thats amazing and will start to build my own homelab i have some stuff like docker and others, but i will to use some of this info to get better on it, thanks Mr, Tim
Love the video! Turned me onto a few new things to run in my home server rack!
Great to hear!
Good lord that is quite the setup!.. excellently explained
You're a madman. Good stuff. I can't think of that many services to run. My CPU sits idle quite a bit.
At work I created our cluster with clusterapi and that's been soo amazing, first you need a cluster to start. It will provision it's crds and provisioner so that you can create clusters with it. Once that's done clusterctl (pretty funny name if you ask me) to create crds that you kann kubectl-apply. After that it will provision the cluster with anything but a network cni, which I appreciate since we like to run calico. It will even install and configure the appropriate ccm and CSI driver. It's fascinating. The creation only takes about 5-7 minutes. To let the cluster handle itself you'll need to transfer it from the bootstrap cluster. It's pretty awesome. When that's done you can just run kubectl scale controlplanenode --replicas=5 and it will go ahead and provision or delete the unused VMs
Thanks! Hope to see more setup explanation and probably some tutorial of setup!
I was amazed and terrified at the same time watching this. 😅
I would be really interested how you manage configuration and backups, how are you planning to restore most of the stuff if they gets lost in a disaster. I'm building my home setup with couple of Raspberrys and trying to document and manage all my setup in a versioned way, so if anything breaks down I can restore them as fast as I can. But it's often not as easy as it seems, what kind of data to store where, what to backup and how to do it (eg. without stopping services).
Just loved this video. Thanks for sharing!
You are so welcome!
Great as always. Would love to see more game server content!
Thanks! Will do!
very impressive, very inspiring and in a fairly clear video, congrats for all your projects
Glad you enjoyed it!
thanks, much appreciated travel through so much different but well chosen technologies... go on!
More to come! Thank you!
Amazing setup, impressive
Epic setup thanks for sharing
Nice, have you tought about disaster recovery? How much time would it take to be back up and running if you had to start from scratch?
Unreal man - really nice job, thanks for sharing!
Much appreciated!
That’s a bad ass setup you have. I’m running UnRAID with roughly 25 docker containers, and two VM’s. I also have a Pi3b+ and a Pi4 running PiHole. Like you, I’m running a UDM Pro as well as UniFi Protect.
This blew my mind! Great video!, but you are crazy!, I hope some day I have a Home Lab like yours, my respect...
You can do it! Thank you!
Thanks for sharing, It is more complicated than my lab but, is interesting and opens new ides.
Thanks for the demo and info, great tour
Thanks for watching!
Love your videos man - I'm learning alot especially for me just starting out in I.T. I also have to say at 7:12 when you said "if my entire home-lab went down, it would be served up --" then it cut to an add about stress eating. Dunno if that was intentional but that made me laugh 🤣🤣.
Lol! I stress eat too! Haha youtube ads.
Thanks, well done, fun to watch 🤙
Thanks 👍
Thank you!! This is seriously so cool.
New one coming tomorrow!
@@TechnoTim i'll watch; you're the truth
Would love to see a Shlink video! I've been a little bit intimidated by it but want to give it a try!
I've been running k3s on a raspberry pi cluster and it's been great! I used your guide to get Rancher set up on another server to manage that cluster, and then I used your other guide to get portainer set up for other docker nodes.... If you didn't tell me how to get this stuff set up I never would have been able to figure it out! I'm also interested in trying TrueNAS Scale, so I'd love to see something on that when you get around to testing it! I'm really just starting my NAS journey, so I guess it's time to go back and watch all of your TrueNAS videos again 😁
Thank you for sharing! Glad I could help!
Howlly cow, that's loads of info that needs to sync down there... Thanks for sharing all this.
Great video! I’ve been trying to learn python, but lack the creativity to think of ways to use it in a home lab. Can you create a video showing showing how to utilize python or any other language in your home lab? Thanks!
I cant wait to have the equipment to have a lab like this.
Awesome video. Could love to see one that dives into your VIP/floating IP setup
Coming soon!
Love this. Would you do a guide on your piHole setup with floating IPs. Master/Salve setup and gravity sync?
Yes, I'd like to also see this as well.
Meet keepalived - High Availability and Load Balancing in One
ua-cam.com/video/hPfk0qd4xEY/v-deo.html
Interesting! I'm very curious about your own system administration process/documentation! As my home lab grows also my work grows and becomes way more than a hobby (And more like having 3 children) at times so I kind of go nuts trying to organize and do basic administration. You know, domains, DNS, Cloud VPS, Physical servers and what they run...
Appreciate the tour, very insightful. Run a number of similar things in mine (including that 24 bay netapp shelf) but has given me a few more ideas.
A Q though. With ever increasing energy costs and our move towards energy efficiency, do you monitor the power usage of your homelab from a cost/wattage point of view? And, if so, how much does it roughly draw?
Thanks! I do! Check out my hardware tour, you can see the draw there!
Very informative and inspiring video 👍 Thanks for sharing‼️
Glad you enjoyed it!
I am going to watch this over and over - and try to figure out what you are on about. And here I thought I had a home server. You make me feel dumb :) thanks for this vid. Appreciated
Haha! You got this!
I dont understand half you saying but still watch all your videos. im using a nuc i7 with debian and docker and portainer all there!
Thank you!
Seeing the wow world & auth containers on your docker made me smile :-)
I guess it's AzerothCore? - Love to see how guys using this project for growing their skills in a fun way
I created the containers! They are on my GitHub! 335 with bots and dungeon finder for single player mode!
Bro, you are fkin crazy!! I mean WOW that is a freakin’ insane setup. Is it not a full time system admin job just looking after all that lot? Keeping it up to date and so on? Just WOW.
Haha! Thanks! “Hobbies”
great video!
The overhead master ❤️😂
Thank you for your time & information
You bet!
Solid video dude, and also super interesting. Id say as far as home labs go. Yours sits quite close to "enterprise" then some others. You got load balancers, clustered nodes, multiple redundant storage, heck even backup DNS.
Well played sir, well played.
Thank you! And thanks for making it all the way over from twitter!
@Techno Tim Great stuff. Love this video, and the way you present complicated stuff. Keep up the great work.
But why the Unifi gateway....?? I switched from USG 4 Pro to Pfsense a year ago and I will never ever ever look back. Will you explain that in a video some day?
Your channel is really good mate, well done, hey, do you have a video about what/how you do your CI/CD with Gitlab, it sounds really good. thanks for sharing your knowledge and your code.
Hey Tim, Wow! this content blew my mind….100% if i could implement 1/4 of this setup & understand the knowledge i would be very happy indeed… but just wanted to say thank you! Great content and delivery and i hope to learn, understand and apply your knowledge for this technology stack…SUBS!!!!! :-)
Thank you!
Awesome! A dream lab! 👍🏆
25:50 Thats how you sell.. fancy frontend of Broadlink Control and then the Battery monitoring contrast :D
If it's not too personal, could you describe the amount of time you spend on your personal, self-employment, and employment work-flows per week? (maybe a live stream topic?) It seems like you spend a lot of your waking hours learning and implementing various information technologies.
PS - Rock on!
I can't speak for Tim, but perhaps the efforts are for similar reasons, but yes alot of waking hours are spent learning and honing skills with these systems, packages, frameworks, etc.
If you're like me, some times you're devoting the time because learning the product tends to pay off for work related deployments, or its time spent to combat boredom, but after doing it for a while, your brain tends to become rewired where you find your self doing it like you're addicted to it much in the same way some people become addicted to other digital things such as social media, although I'm only saying this as a reference and so I personally try and balance out my time between tech based projects, and my home gym but this could be true for others.
Look what he does for a living… YT, so yes that’s why he’s doing all this
YT isn’t my job!
Hello Techno Tim, kindly do a series on how people can set up their own home lab
Maybe full tutorial for setting up everything? What to set first, what is for what.I was planing to set up my first Home lab, but there is so much options etc. :)
great stuff! i learned a lot from this, also, I have opted to instead of using pihole and traefik, to use Nginx Proxy Manager, to do both in one. Although i must admit, the other way seems to be a bit more professional. Plus the added benefit of adblocking network wide.
this so good as a general guide/idea for what services i need to run my home server... for my use case with the pihole, i would try to add dnscrypt on top of that to try and encrypt the dns traffic from my local isp as they block sites even though the local government has already allowed them now...
Wow amazing setup.
I really don't know where to start with self-hosting. All these terms and technologies is so overwhelming.
Just start from the beginning! Check out my video on self hosting ideas ua-cam.com/video/SVQmzaSabEQ/v-deo.html
"I know it's overkill, but I wanted to do it according to best practices so people didn't call me out on it" - the words of a man forged in the fires of social media. I could see the pain in your eyes, LOL
Ha! Exactly! I figure a little more infra and setup is better than being 🔥
XD
I'd love to see a Shlink video!
I love your humor and your jokes, don't stop.
I still don't really understand link shorteners, but I'll watch any video make.
Also. Is it worth making a video on your home automation as well?
Thank you!
Excellent video, thanks for sharing. How about a network IDS/IPS like Snort? Is this something you can set up and post a video on the back of it? Thanks again.
Im starting a HomeLab (and I am just intermediate), I am going to have to stalk your channel now, right from the start, to learn as much stuff as I can.
Thank you!
Loads of information in a small video, Wish i could give a like for every minute of it.
Just great!
Hey bro . Love all the content keep it coming..! I have learned and implemented so much stuff that I learned from you that I just want to say 'Thanks! ...A lil silly off-topic question as I been trying to locate the name for this plant for yeras now ....What is the name of the plant shown on the left side of you which has a very thin bark..? Let me know if you can. :)
Great video, I was wondering I would love to see a video on how your gitlab runners I had to work with them recently, and I gave up trying to set them up.
Great suggestion! I run them in kubernetes. The config was a pain to figure out, but installing was easy. I can put it on my github!
So what are you using for layer 4 load balancing? As far as I know the Unifi router doesn't do it, so does that mean you have something like an HAProxy somewhere on the network?
Are you planning to make updated version for this year? I am looking forward to it!
Great video, and impressive setup. You may want to consider some offsite backup since you seem to have all your eggs in one basket even though you have loads of redundancy.
Thanks! I certainly do! 321
That is awesome!
Hehe "so people don't call me out for it" 😂 glad you shared, impressive!
Truth!
Hi from Ukraine! ) Amazinly dude! So many cool stuff you create. What about photo management which app do you prefer?