Hot tip: If the Proxmox server is connected to the internet (because of system updates, it usually is), the more efficient way of getting ISOs onto the local storage is to paste the URL in to a form and download direct from the internet into the ISO folder. How to do? 8:57 - Copy the URL from ISO-file by right click on "download now"-link and select "copy link address" from the context menu, 9:39 - select "Download from URL" from the ISO images category, paste the URL you've copied before into the URL form and click on query, the system will create a file name, press download. The system will download the ISO file direct onto Proxmox without download to another computer and reuploading again. Very nice feature, I wish Unraid will it become one day too.
I've been using proxmox in my homelab and at work for a couple of years now, and I find this video to be extremely welcoming to new users. Great work Jeff!
Ventoy is a great ISO manager. I use it. Once you write ventoy to the USB stick you just copy/pasta your ISOs onto the USB drive where ever you want. It'll find your isos and put them into a nice list.
This is an awesome breakdown on the install, especially with the extra info on biso / cpu types / networking. Lots of videos will tell you to 'just pick this' but won't tell you *why*, and learning that is awesome.
I had already upgraded my Proxmox cluster to 8.0, but I decided to watch this video to see if I had missed something. Sure enough, new CPU types. I have a VM with Windows Insider Preview running on the Canary Channel. It had recently stopped taking updates because the CPU was not supported. I had given up on it and shut it down. Tried what I learned from this video and my VM is supported again! Thanks Jeff!
Proxmox with virtualized TrueNAS is exactly how my homelab is configured. Aside from TrueNAS I have VMs for PiHole, Unifi Controller, HomeBridge, HomeAssistant, and a random Windows VM because reasons.
I had TrueNAS Scale inside of Proxmox but I've been just using Ubuntu for samba and Plex for years now and kinda don't want to go to TrueNAS...maybe in the future I will with ZFS tho will see....and yea I had a Win Server 2022 Active Directory forest in my lab just with a few Win10 and a few Win11 VMs so that I could learn AD only to realize AD kinda sucks anyway....oooff
I had to move my pihole, nginx proxy, and VPN to a separate low power device so when I messed with my proxmox server I would still have reverse proxy and DNS available
For someone who is experienced in virtualization but new to Proxmox, this is truly an excellent video because of the level of detail that you go to. Thank you!
GPU passthrough is easy, but Igpu passthrough is very dependent on how your motherboard is layed out. For example, Igpu passthrough is completely broken on 500 series intel
Pci and usb pass through is very easy, it's just handled from the hardware tab on the vm. You can even pass through individual hard drives rather than an entire pci controller. My nas is just a zfs volume in a vm (it was originally a bare metal server for everything that I migrated into a vm) and you can pass through individual disks from the command line, even from an hba
@@WMartinNI Yes, but for example SMART is not passed through... ANd as I saw, you cannot start a SMART test in the Proxmox disk manager tab, only the results are shown (however I am also new to this so it is most likely, I did not find the way how to do it)
I liked your explanation of why you would choose a specific CPU type. I have been choosing Host as my option for a long time, but I hadn't considered how that might affect things down the line when/if I need to migrate the VM to another machine down the road. Something to consider for sure.
Glad you got that box all sorted out Jeff, it really does look great. Also, I've taken the Ventoy-pill for all my bootable iso needs. Really, really handy, and so far I haven't found anything it won't boot. I really wish proxmox would allow for at least initial DHCP, that way on a server with multiple nic's, it'd give you an available IP on the nic you have plugged in. That's bit me before. Also, it's me, I forgot the password I typed 5 seconds ago, can confirm, was boned. Very good, no BS tutorial though man. I really appreciate you making these. I don't necessarily need 100% of them, but man is it nice to have a quick reference if I need it. One small note I'd have is, while you can allocate more threads than you can simultaneously execute to a virtual machine, best practice is to not do that as there's a performance penalty of 10% or so with multithreaded workloads that exceed the number of threads available in the hypervisor. In practice, I've found this to be the case but usually just a few percent. If you do a 'deeper dive' video on this, it'd likely be good to touch on how to read the linux 0.01/0.10/1.0 load averages, the newbies always get confused with that. p.s. don't sleep on the turnkey LXC's, they're very, very handy in the homelab for spinning something up to test it out, and turnkeylinux does at least a quasi good job with their config defaults, so even if you want to use something exotic to run SAMBA or whatever, it's nice to have them as a reference.
When discovering a new UA-cam channel, you're not sure at first how well informed it is. Your explanation of CPU core, memory and disk space sharing convinced me this channel is the real deal: other videos gloss over this stuff. You're also packing the information densely: this is not wasting my time. My mental model of how this stuff works is getting more accurate rapidly. Thanks especially for the bridge explanation. I have a bare metal server with management interfaces on one VLAN and user facing stuff on another VLAN and subnet, and I'm going to want to replicate this when I make it virtual. You've got me started. But a video going over network setups in detail with examples would be welcome. If you've already made one I'll find it shortly!
A company I worked for for about seventeen years did have a monstrous system of physical servers when I started there as a developer but over time this was condensed down to just a few racks by VM Ware. I did use the free version of VM Ware both at work and in my home lab and it was really great firing up a virtual just for some specific task and then shut them down and create another if necessary. Since I retired, I haven't had much call for a VM but it is still a fascinating technology. Until today, I hadn't heard of Proxmox and it sounds very interesting particularly after watching this video which I found extremely well put together and presented. Now I've got the bug again so I think I've found some use for the box under my desk.
I’ve been running a 9 osd Ceph cluster on a 4 node PM cluster for about 3 months now. (3 nodes in HA). So far ceph clustering has been extremely awesome. I very much see why they’re including it now. After 3 months I can’t recommend it enough. Stores VMs and lxc’s beautifully. Very fast and reliable. And the ceph fs holds ISO’s. It’s the best setup I’ve ever run however it’s requiring me to upgrade switches. Ceph clusters are very chatty and I’m seeing dropped frames in my Win vm through my gigabit switch. Great explanation in this video btw. Clear and easy to understand.
Thanks so much for the breakdown of each of the items in the VM creation wizard. You made it crystal clear as to what each of the setting means and represents. Well done and thanks so much. Love your content
Long time subscriber. This is really exciting. Ive seen you grew in the past few years and I learn so much from you. Teaching more virtualization and other enterprise technologies is going to be amazing. Thank you.
@@LA-MJ Asmedia makes low quality controllers. My personal experience is they disconnect often in the external drive configuration. I had a motherboard from 2012 and it had two SATA controllers on it... an Intel and Asmedia controller. The Asmedia controller failed after 2 years, the Intel one works fine to this day.
I don't "like" videos often but this one earned it. This is exactly how to cover this topic. Perfect level of info provided, especially re: the divvying of resources bit.
You absolute darling! You actually cleared up the misconception that *I* was under about how cores and threads are handled by VMs ... I had presumed that you had to fit all your VMs into the total number of threads that your CPU has available... That's it - I now love you forever! 😀
Thank you for addressing the bad info out there from others on the ability to overprovision CPU and RAM resources. It is a pet peeve of mine when I watch these, or read guides, and they tell you to never overprovision. Overprovisioning has been a thing for the industry since virtually (see what I did there) the start. In nearly all cases, not every VM is going to use 100% of the given resources. To not overprovision is to just waste resources.
If your homelab only consists of a single PC, you should simply use CPU type 'host'. The generic CPU type are only relevant if you plan on doing live migration of your VMs from one machine to another that is not 100% identical (as in the same CPU).
Love the vibes and sarcasm. I am a VCP looking at proxmox for the first time after running vmware for 15 years. I tried KVM back around 2012 and ran it successfully for about 5 years before moving those machines to vmware as well. With all the stuff going on with broadcom and my lack of faith in hyper-v, i figured it was time to broaden the horizons again. Glad to see that much of this is very similar to vmware. Looking forward to the cluster video (once i find it). thanks for posting!
Great video as usual. For anyone wondering - once you have set up the server you actually can use it with a dhcp lease by editing the network interface config file directly, at least I've done it in version 7
@@LA-MJ I've never run more than once server to be fair. I assign static ips at my dhcp server so it is a static ip for all intents and purposes, it's just set up as dhcp on the server itself.
Thanks so much for describing most of those individual settings in detail! I've searched a lot but this seems to be the only video i found doing so for Proxmox 8 and actually describing WHY to choose which setting.
Jeff, thank you so much for renewing this whole concept. I've been struggling getting Proxmox+TrueNAS+docker containers setup in a way that's easy to create and maintain. Would love to see how to setup an all in one video touching on how to setup Docker on Proxmox, or if LXC containers could be used instead of, since that's the default.
I'm gonna watch this, build a server. Play around with it. Try to use it, lose confidence. And go back to something else.. As always, thank you Jeff. Looking forward to watching this.
Build one with 2 small cheap graphics cards. Make 2 VM's and use parsec to access them. I have a physical computer that has Parsec installed. I use a Raspberry Pi 3 hooked up to my tv in my bedroom. Where i can connect with parsec and game with a xbox controller.
13:45 TPM stands for Trusted Platform Module. It's for firmware-level encryption which is necessary for OS's like Windows 11. Tamper Protection Module isn't a thing. You might be thinking of a Chassis Intrusion Detector?
I tried many different solutions while setting up Home Assistant, and I can only say: "this is the way". Proxmox is the best, but Debian, not ubuntu would be my first choice for VM running docker etc. On top of everything, this video adds much more details I was aware of, highly recommended, thanks!
Man I love your content, I would like to see you do a video about Private networking for Isolated Homelabs. Thank you for sharing your knowledge and wish you nothing but the best.
well done, exactly what I was looking for... as an old VCP certified tech this was exactly what I needed to line up my knowledge with where proxmox was putting it all.
This is an exceptionally well written and presented tutorial. Thank you so much for taking the time to put this together. I clicked the 'bell' so as not to miss your future Proxmox VM content. Well done mate!
Glad you enjoyed the beer! Easily one of my top three beers in my best of the best list. Sadly the Original Brewer that made the beer has passed away and what is out there is all that is left. Fun fact the barrel used was a "William Larue Weller" that previously held maple syrup, if you know, you know. To make it more interesting, I believe you have an OG bottle unbarrel aged to show how good the base product is. Cheers!
Jeff I've been watching your videos for a while following hardware and cool projects, I have just built my own home server and this video was exactly what I needed, thank you!
Do a release where you use Terraform to create and manage your VMs. Definitely makes things easier, after the initial setup (which can be difficult for beginners).
Just when I was about to start my journey with Proxmox... you drop this amazing vid. Really useful, I'll come back once I'm battleling with the server, can't wait for the upcoming parts!
Been a networking hobbyist for a long time, but this is the video that finally inspired me to move my server from win 11 to proxmox. I may be a photographer by day, but a hypervisor and some vms *could* speed up my workloads, and that's all that matters lol
I have lot of experience with VMware and Windows server products, and I always wanted to learn about Proxmox and xcp-ng but I didn't want to spend time to learn it from scratch and analyze all technologies. Most of the people in my work circle just go either cloud, local with MS or VMware or hybrid, so I didn't have someone to explain me proxmox in 15-20 minutes. My next questions are how to create a RAID array consisting from multiple disks with different size (ZFS I guess?), backup and replication in Proxmox and a tutorial about the promising xcp-ng. Keep up the good work.
Kinda expected some basic stuff that should be done after proxmox install, like adding non subscription repo. Personally i go for "host" on cpu selection and had no issues migrating vms to other machines, but it was only linux vms, that probably would run fine on Pentium 4 instruction set...
This video could not have come at a better time! I am literally setting up the Proxmox installation today (day 3 of video upload) and shopping around for an HBA for vortualizing TrueNAS
Great video. I followed along and dealt with issues as they arose, but this was a great resource to reference when setting up for the first time as a complete beginner. Thanks for the help!
Love it! As you deep dive into virtualization, I'd love to see some exploration of virtual routing--especially vlans for isolated IoT networks and the like. Keep up the great work.
Thank you for this tutorial, Jeff. I finally took my first steps into Proxmox about a month ago after buying a second Intel NUC. Now I have both of them running in a Proxmox cluster. I was running Ubuntu Server bare metal previously. Anyways, I really appreciated the breakdown of the different options during the VM creation wizard. It was nice to have both confirmation on the things I did right and suggestions on the things to do differently next time.
Thank you. You go a little fast for my old brain, but the first couple minutes helped me clear up a couple of things about proxmox. For the first time I'm moving away from bare metal systems.
I am really looking forward to all your upcoming proxmox videos. I have been using your proxmox for a couple of years now, but I'm always eager to learn more.
Very enjoyable - i struggled with getting proxmox to boot from USB, sorted that using belina etcher, which worked great. I was able to follow your video clearly and easily, i've never used proxmox, and I'm really glad to add to my knowledge. Love the beer as well - you make it sound delicious !!!
I'm sure someone has mentioned it but Ventoy is game changing for booting, just drop your images on your drive and go! You can still use it as your regular thumb drive :)
Incredibly excellent video 👍 I have watched a lot of your videos. They're all clear and crisp but this one especially hits the enunciations and inflections brightly and vividly. Great content. Can't wait for your future, related virtualization videos. Big thank you. Kindest regards, neighbours and friends.
Doing a big re-haul right now I am a server guy I love the convivences of having sliding rails, multiple drives, IPMI, remote management, cheap ebay cost, etc So I was running a Dell R210ii as my Firewall (PFSense) Dell R710 as my Hypervisor (ESXi) Dell R510 as my dedicated NAS (UnRaid) On the R710 is a virtualized Freenas with HBA passthrough running RaidZ2 and all my other functional VM's (Home Assistant, Plex, etc) So the change up is this. The MinisForum MS--01 mini workstation is a micro pc with a laptop i9, 3 M2 slots, a PCI slot, and 10gb and 2.5gb networking built in for a fair price. I got one and rebuilt my firewall using one so I can now easily handle 10gb routing with all the works. I got a Dell R730 that I am building out to replace my R510 as my NAS (So far preliminary results show that maybe was not a big change, not much power savings or noise difference) And finally another MS-01 to run Proxmox and replace ESXi and all the VM's except TrueNAS. I have been happy with the performance of Unraid given what I need it to do and it uses less power because I only need to spin each disk up rather than an entire array, and I have piece of mind knowing I can pull a drive out and get data off it directly if needed. Watching this video because despite my enterprise experience as both a Network and Server Engineer some things just are not as intuitave as I had hoped. I dont see how to bond my interface from the GUI, I moved files to my datastore (ESXi term) via SFTP and I cant see my files from the GUI to convert my ESXi VM's, etc. I wish it ran on a USB stick like ESXi does I was thinking of a Raid 1 mirror for my 2x2TB NVMe SSD but I decided I'll use one disk for active, and one disk for storage of my snapshots and backups but I have not even figured out how to do that yet because the different storage type options. By the end of this day I will have it all figured out I hope.
A really cool Proxmox build I'm looking forward to building soon is mini PC based. The pricing on the Mini PC is very affordable You can find AMD 8 core with 32GB of ram with 1TB SSD for ~400 Buy 3 of them and you have a super power efficient 24c/48t cluster for sub 1500. The only way I know of linking everything would be via NIC/networking. But would be really cool to find a way to to do it via 40G USB / Thunderbolt.
Wendell at Level1 hinted that he had been working on releasing a video about this. Specifically, go to minute 6:24 of his July 27, 2023 video covering the Minisforum's UM790 Pro mini pc. Kindest regards, friends and neighbours.
Very nice overview! I would like to mention the ability to set the CPU to 'host', which will automatically set the client to use the same CPU the host has. As for migrating between hosts, I like to keep all my clustered host systems installed on identical hardware, so this works great for me.
Рік тому
I believe the option "host" equivalent to "cpu-core-passthrough"
Fantastic timing. Building a firewall/fukaround server with a $175 Beelink N100 EQ12 right now. The old Pi just isn't cutting it anymore, and dual 2.5Gbit!
ceph needs 3+ nodes with possibly SSD (best if NVME) storage to have any kind of performance. If you are not made of money it is better to stick with local ZFS pools and use replication jobs.
Nice video. Thanks. A Proxmox passthrough video would be nice, covering the mini pcs with ryzen 7940hs and the integrated 780M graphics. This would make a perfect home lab starting point. :)
Always with the appropriate amount of dry humor! Love it. I don't know what I don't know, but I do have a ProxMox server with 4 VMs. Still learning, so I look forward to seeing your future videos especially your content around VLAN techniques and strategies.
I recall the first time I tinkered with VMware Workstation back in 2003 or so. Very fascinating concept for the time to have a virtual “sub computer” with an OS that, for all intents and purposes, believes it’s on its own computer. Then add snapshots and copying etc it essentially introduced planned time travel
Very informative video! I'd love to see a home NAS setup walkthrough in ProxMox, explaining different options and common doubts that arise during its configuration.
Amazing video! I'd love to know about the best practices for Truenas, Proxmox, and a firewall. Should I opt for running each service natively on 3 separate PCs? Or would it be more effective to strike a balance by installing Proxmox on all 3, even if the PCs aren't identical, and then using the same software for redundancy? Also, I'm curious about making the most of an Intel network card with 4 gigabit ports. As for running LLMs (like in Nextcloud, where it can connect to LocalAI and a local LLM), is it currently recommended to virtualize Ubuntu on Proxmox? Or is it better to have a dedicated PC solely for Ubuntu? Liked and shared (already a subscriber).
To install proxmox, what I did: reset bios to default. Than There press the "e" key to edit a boot entry (e.g., the Graphical one, used advanced debug one) Use the arrow keys to navigate to the line that starts with linux, move to the right where the quiet parameter is, delete that (so we maybe get a bit more info) and add "nomodeset". Also remove "quiet" not silent parameter. Than press ctrl+D if it gets stuck try again ctrl+D to continue. I used ext4 instead of zfs because I was using only 1 nvme, and my nvme is not industrial one.
This is the best and most in depth tutorial I have seen so far! Would love if you could cover masquerading and DHCP for my Virtual Bridge, as I could not get it working despite following so many examples online and the offical documentation.
I have recently installed proxmox on a minipc to start my home lab journey. I would love to see how to interact with VMs the best way possible without using the browser noVNC client. Great video. Thank a lot.
Hello Jeff I am about to make the change from VMware ESXI 6.7 to ProxMox 8.1, I am waiting on hard drives and my second CPU cooler to arrive for my Dell R710 (I know it is an old server) I am going to virtualize my Firewall which I am using Sophos Home Firewall, I am probably going to have a video on how to setup the entire system, but mainly the WAN and LAN passthrough for the Sophos Firewall as I will have 2 of them running in HA, I love your content and thanks so much for the explanation of all of the hard drive interface types!
Thanks for a GREAT video! You make it much simpler than I thought! One small note: Ubuntu is pronounced oo-boon-too. It is a word from the isi-Zulu language, one of the 11 official languages of South Africa. Love from South Africa. :-)
@Jeff On the topic of CPU type selection, you mentioned that it makes it difficult to migrate a VM to a machine which lacks those features. One tip I'd like to mention is that YOU ARE ABLE TO CHANGE THE CPU TYPE AT ANY TIME AFTER CREATION. Simply do so prior to migrating the VM. If you're using Linux or BSD, remember that they have monolithic kernels, and this means that you can take the system disk out of the machine and place it into any other machine with hardware that is supported by the Linux/BSD kernel, and it will "just work". The only issue you might run into is if your software license doesn't permit the number of cores the new system has.
Able to change at any point, sure. But best practice is to use the most compatible generic CPU type, as you can then automate migrations, or even set up for high availability.
What is this "monolithic kernels" thing, you can pretty much do that with a Windows system too since Windows 7 and it will detect the hardware changed and reload drivers. For Windows 10 and 11 they integrate most network drivers so it can just re-download drivers for the new hardware
@@marcogenovesi8570 I wasn't talking about Windows, and so I don't know why you are bringing that into this discussion. Also, your statement is only partially true, since Windows requires a license (I know you are able to use it without one), and it might require a new license if Windows detects that the hardware changes too much.
@@TheChadXperience909 You were talking about VMs and "raw dog" hardware migrations of disks from one VM or physical system to another. Saying how Linux/BSD are somehow better because monolithic kernel. Which is simply not what "monolithic" means when talking about kernels, most Linux and BSD drivers are packaged as modules (and distributed as separate packages so you might not even have them installed) and only loaded when necessary to not waste resources. I never talked about license activation so not sure how that makes my statement "partially true". FYI Windows isn't the only OS with licenses. Also RedHat, Unraid, SUSE or other paid linux/unix distros and appliances will have the same issues if you change the hardware they link the license to. But the OS itself would probably work fine
amazing video , i will love you do more videos about network setting and vlans including having internet access but limited the VMs to access just local network.
Great "how to get up and running" tutorial. The only thing I'd add, since you showed the advanced options and mentioned ballooning, is that if you turn ballooning off for a resource then you *do* have to treat that resource like a doled out pie slice. It isn't a major issue for drive space -- you'll just get disk size warnings/errors when trying to create the virtual drives -- but can be a serious stability/resource problem with RAM. One example: you have 16GB of physical RAM and create 2 VMs that each use 8GB non-ballooning RAM. If you run them simultaneously, your system _will_ crash at some point. Because you neglected to leave any RAM for Proxmox itself (it needs a min of around 2GB to run stably). Ask me how I know. 😬 But, as you said, unless you have a situation where you need to guarantee a certain amount of RAM to a specific VM, it makes sense to just leave the RAM as ballooning and let Proxmox manage it.
Hot tip:
If the Proxmox server is connected to the internet (because of system updates, it usually is), the more efficient way of getting ISOs onto the local storage is to paste the URL in to a form and download direct from the internet into the ISO folder. How to do? 8:57 - Copy the URL from ISO-file by right click on "download now"-link and select "copy link address" from the context menu, 9:39 - select "Download from URL" from the ISO images category, paste the URL you've copied before into the URL form and click on query, the system will create a file name, press download. The system will download the ISO file direct onto Proxmox without download to another computer and reuploading again. Very nice feature, I wish Unraid will it become one day too.
I've been using proxmox in my homelab and at work for a couple of years now, and I find this video to be extremely welcoming to new users. Great work Jeff!
Ventoy is a great ISO manager. I use it. Once you write ventoy to the USB stick you just copy/pasta your ISOs onto the USB drive where ever you want. It'll find your isos and put them into a nice list.
What's a Ventoy? 😜
@@CraftComputinga very cool software 😁
@@CraftComputing Google it... you will like it.
I found it while trying to create a windows USB stick from a linux machine once. Make a ventoy drive, drop the ISOs on there. done. boot. profit.
Oh wow. Some people really do miss sarcasm
This is an awesome breakdown on the install, especially with the extra info on biso / cpu types / networking. Lots of videos will tell you to 'just pick this' but won't tell you *why*, and learning that is awesome.
I had already upgraded my Proxmox cluster to 8.0, but I decided to watch this video to see if I had missed something. Sure enough, new CPU types. I have a VM with Windows Insider Preview running on the Canary Channel. It had recently stopped taking updates because the CPU was not supported. I had given up on it and shut it down. Tried what I learned from this video and my VM is supported again! Thanks Jeff!
Proxmox with virtualized TrueNAS is exactly how my homelab is configured. Aside from TrueNAS I have VMs for PiHole, Unifi Controller, HomeBridge, HomeAssistant, and a random Windows VM because reasons.
| Random Windows VM |
Gotta download those Linux ISOs somehow.
Yarrrrr
I had TrueNAS Scale inside of Proxmox but I've been just using Ubuntu for samba and Plex for years now and kinda don't want to go to TrueNAS...maybe in the future I will with ZFS tho will see....and yea I had a Win Server 2022 Active Directory forest in my lab just with a few Win10 and a few Win11 VMs so that I could learn AD only to realize AD kinda sucks anyway....oooff
I had to move my pihole, nginx proxy, and VPN to a separate low power device so when I messed with my proxmox server I would still have reverse proxy and DNS available
@@CraftComputing And use your tax software...
For someone who is experienced in virtualization but new to Proxmox, this is truly an excellent video because of the level of detail that you go to. Thank you!
I think a video on Proxmox passthrough would be great.
Passing through GPUs, but also things like Intel QuickSync. And iGPU sharing.
lol its not that easy.
GPU passthrough is easy, but Igpu passthrough is very dependent on how your motherboard is layed out. For example, Igpu passthrough is completely broken on 500 series intel
Pci and usb pass through is very easy, it's just handled from the hardware tab on the vm.
You can even pass through individual hard drives rather than an entire pci controller. My nas is just a zfs volume in a vm (it was originally a bare metal server for everything that I migrated into a vm) and you can pass through individual disks from the command line, even from an hba
A video on passthrough would be great, as someone who's thinking about going to Proxmox it'd be really informative
@@WMartinNI Yes, but for example SMART is not passed through... ANd as I saw, you cannot start a SMART test in the Proxmox disk manager tab, only the results are shown (however I am also new to this so it is most likely, I did not find the way how to do it)
I don't watch your videos all the time... but when i do, i forget how much i appreciate your humor. Remembering why i subscribed in the first place.
I liked your explanation of why you would choose a specific CPU type. I have been choosing Host as my option for a long time, but I hadn't considered how that might affect things down the line when/if I need to migrate the VM to another machine down the road. Something to consider for sure.
A standalone video on virtual networking would be a great addition. It's a huge hurdle for new users. It definitely was for me anyways.
Love your sense of humor, especially when covering deeper subjects.
Glad you got that box all sorted out Jeff, it really does look great.
Also, I've taken the Ventoy-pill for all my bootable iso needs. Really, really handy, and so far I haven't found anything it won't boot.
I really wish proxmox would allow for at least initial DHCP, that way on a server with multiple nic's, it'd give you an available IP on the nic you have plugged in. That's bit me before. Also, it's me, I forgot the password I typed 5 seconds ago, can confirm, was boned.
Very good, no BS tutorial though man. I really appreciate you making these. I don't necessarily need 100% of them, but man is it nice to have a quick reference if I need it. One small note I'd have is, while you can allocate more threads than you can simultaneously execute to a virtual machine, best practice is to not do that as there's a performance penalty of 10% or so with multithreaded workloads that exceed the number of threads available in the hypervisor. In practice, I've found this to be the case but usually just a few percent.
If you do a 'deeper dive' video on this, it'd likely be good to touch on how to read the linux 0.01/0.10/1.0 load averages, the newbies always get confused with that.
p.s. don't sleep on the turnkey LXC's, they're very, very handy in the homelab for spinning something up to test it out, and turnkeylinux does at least a quasi good job with their config defaults, so even if you want to use something exotic to run SAMBA or whatever, it's nice to have them as a reference.
+1 for Ventoy. I love it.
When discovering a new UA-cam channel, you're not sure at first how well informed it is. Your explanation of CPU core, memory and disk space sharing convinced me this channel is the real deal: other videos gloss over this stuff.
You're also packing the information densely: this is not wasting my time. My mental model of how this stuff works is getting more accurate rapidly.
Thanks especially for the bridge explanation. I have a bare metal server with management interfaces on one VLAN and user facing stuff on another VLAN and subnet, and I'm going to want to replicate this when I make it virtual. You've got me started.
But a video going over network setups in detail with examples would be welcome. If you've already made one I'll find it shortly!
A company I worked for for about seventeen years did have a monstrous system of physical servers when I started there as a developer but over time this was condensed down to just a few racks by VM Ware. I did use the free version of VM Ware both at work and in my home lab and it was really great firing up a virtual just for some specific task and then shut them down and create another if necessary. Since I retired, I haven't had much call for a VM but it is still a fascinating technology. Until today, I hadn't heard of Proxmox and it sounds very interesting particularly after watching this video which I found extremely well put together and presented. Now I've got the bug again so I think I've found some use for the box under my desk.
I’ve been running a 9 osd Ceph cluster on a 4 node PM cluster for about 3 months now. (3 nodes in HA). So far ceph clustering has been extremely awesome. I very much see why they’re including it now. After 3 months I can’t recommend it enough. Stores VMs and lxc’s beautifully. Very fast and reliable. And the ceph fs holds ISO’s. It’s the best setup I’ve ever run however it’s requiring me to upgrade switches. Ceph clusters are very chatty and I’m seeing dropped frames in my Win vm through my gigabit switch.
Great explanation in this video btw. Clear and easy to understand.
Thanks so much for the breakdown of each of the items in the VM creation wizard. You made it crystal clear as to what each of the setting means and represents.
Well done and thanks so much.
Love your content
Long time subscriber. This is really exciting. Ive seen you grew in the past few years and I learn so much from you. Teaching more virtualization and other enterprise technologies is going to be amazing. Thank you.
Asmedia controller.
I know. ASS-media controller
They are cheap. That's their thing 🙂
Pls explain the reaction
@@LA-MJ ? What is to be explained?
@@LA-MJ Asmedia makes low quality controllers. My personal experience is they disconnect often in the external drive configuration. I had a motherboard from 2012 and it had two SATA controllers on it... an Intel and Asmedia controller. The Asmedia controller failed after 2 years, the Intel one works fine to this day.
I don't "like" videos often but this one earned it. This is exactly how to cover this topic. Perfect level of info provided, especially re: the divvying of resources bit.
I've been running proxmox home server for about a year now and still ... i learned new things watching this video
Thank you !
You absolute darling!
You actually cleared up the misconception that *I* was under about how cores and threads are handled by VMs ... I had presumed that you had to fit all your VMs into the total number of threads that your CPU has available...
That's it - I now love you forever! 😀
Thank you for addressing the bad info out there from others on the ability to overprovision CPU and RAM resources. It is a pet peeve of mine when I watch these, or read guides, and they tell you to never overprovision. Overprovisioning has been a thing for the industry since virtually (see what I did there) the start. In nearly all cases, not every VM is going to use 100% of the given resources. To not overprovision is to just waste resources.
If your homelab only consists of a single PC, you should simply use CPU type 'host'. The generic CPU type are only relevant if you plan on doing live migration of your VMs from one machine to another that is not 100% identical (as in the same CPU).
Love the vibes and sarcasm. I am a VCP looking at proxmox for the first time after running vmware for 15 years. I tried KVM back around 2012 and ran it successfully for about 5 years before moving those machines to vmware as well. With all the stuff going on with broadcom and my lack of faith in hyper-v, i figured it was time to broaden the horizons again. Glad to see that much of this is very similar to vmware. Looking forward to the cluster video (once i find it). thanks for posting!
Great video as usual.
For anyone wondering - once you have set up the server you actually can use it with a dhcp lease by editing the network interface config file directly, at least I've done it in version 7
If you have one server in the cluster, maybe
@@LA-MJ I've never run more than once server to be fair. I assign static ips at my dhcp server so it is a static ip for all intents and purposes, it's just set up as dhcp on the server itself.
Thanks so much for describing most of those individual settings in detail!
I've searched a lot but this seems to be the only video i found doing so for Proxmox 8 and actually describing WHY to choose which setting.
Jeff, thank you so much for renewing this whole concept. I've been struggling getting Proxmox+TrueNAS+docker containers setup in a way that's easy to create and maintain. Would love to see how to setup an all in one video touching on how to setup Docker on Proxmox, or if LXC containers could be used instead of, since that's the default.
+1
I'm gonna watch this, build a server. Play around with it. Try to use it, lose confidence. And go back to something else..
As always, thank you Jeff. Looking forward to watching this.
lol!
I relate to this a little too much, haha.
Build one with 2 small cheap graphics cards. Make 2 VM's and use parsec to access them. I have a physical computer that has Parsec installed. I use a Raspberry Pi 3 hooked up to my tv in my bedroom. Where i can connect with parsec and game with a xbox controller.
Not with this attitude, you won't
13:45 TPM stands for Trusted Platform Module. It's for firmware-level encryption which is necessary for OS's like Windows 11.
Tamper Protection Module isn't a thing. You might be thinking of a Chassis Intrusion Detector?
I was researching copyright and DMCA issues lately, so Tamper Protection Measure was on my mind :-D
Glad you enjoyed the beer. A little inebriation is a wonderful thing! I learned some thing from your overview of Proxmox as well.
I tried many different solutions while setting up Home Assistant, and I can only say: "this is the way". Proxmox is the best, but Debian, not ubuntu would be my first choice for VM running docker etc.
On top of everything, this video adds much more details I was aware of, highly recommended, thanks!
Man I love your content, I would like to see you do a video about Private networking for Isolated Homelabs. Thank you for sharing your knowledge and wish you nothing but the best.
well done, exactly what I was looking for... as an old VCP certified tech this was exactly what I needed to line up my knowledge with where proxmox was putting it all.
This is an exceptionally well written and presented tutorial. Thank you so much for taking the time to put this together. I clicked the 'bell' so as not to miss your future Proxmox VM content. Well done mate!
Thanks!
I am new to Proxmox. Fantastic tutorial. Excellent from start to finish. You really deserved that beer!
I really appreciate the way you present this stuff! Looking forward to seeing this one grow.
Glad you enjoyed the beer! Easily one of my top three beers in my best of the best list. Sadly the Original Brewer that made the beer has passed away and what is out there is all that is left. Fun fact the barrel used was a "William Larue Weller" that previously held maple syrup, if you know, you know. To make it more interesting, I believe you have an OG bottle unbarrel aged to show how good the base product is. Cheers!
Jeff I've been watching your videos for a while following hardware and cool projects, I have just built my own home server and this video was exactly what I needed, thank you!
Do a release where you use Terraform to create and manage your VMs. Definitely makes things easier, after the initial setup (which can be difficult for beginners).
Has the proxmox provider for terraform improved? Last I checked it was a bit barren, but interested to check it out again
New on Proxmox, and one of the things I struggle hard is on GPU passthrough, love the content
Just when I was about to start my journey with Proxmox... you drop this amazing vid. Really useful, I'll come back once I'm battleling with the server, can't wait for the upcoming parts!
Been a networking hobbyist for a long time, but this is the video that finally inspired me to move my server from win 11 to proxmox.
I may be a photographer by day, but a hypervisor and some vms *could* speed up my workloads, and that's all that matters lol
I have lot of experience with VMware and Windows server products, and I always wanted to learn about Proxmox and xcp-ng but I didn't want to spend time to learn it from scratch and analyze all technologies.
Most of the people in my work circle just go either cloud, local with MS or VMware or hybrid, so I didn't have someone to explain me proxmox in 15-20 minutes.
My next questions are how to create a RAID array consisting from multiple disks with different size (ZFS I guess?), backup and replication in Proxmox and a tutorial about the promising xcp-ng.
Keep up the good work.
Kinda expected some basic stuff that should be done after proxmox install, like adding non subscription repo.
Personally i go for "host" on cpu selection and had no issues migrating vms to other machines, but it was only linux vms, that probably would run fine on Pentium 4 instruction set...
Linux and FreeBSD will have no issues switching different CPUs. Windows, well...being Windows it don't want to play. 😁
whatever it is, linode isn't paying you enough for that EPIC funny sponsor spot :D
This video could not have come at a better time! I am literally setting up the Proxmox installation today (day 3 of video upload) and shopping around for an HBA for vortualizing TrueNAS
Great video. I followed along and dealt with issues as they arose, but this was a great resource to reference when setting up for the first time as a complete beginner. Thanks for the help!
Love it! As you deep dive into virtualization, I'd love to see some exploration of virtual routing--especially vlans for isolated IoT networks and the like. Keep up the great work.
Thank you for this tutorial, Jeff. I finally took my first steps into Proxmox about a month ago after buying a second Intel NUC. Now I have both of them running in a Proxmox cluster. I was running Ubuntu Server bare metal previously.
Anyways, I really appreciated the breakdown of the different options during the VM creation wizard. It was nice to have both confirmation on the things I did right and suggestions on the things to do differently next time.
I’ve been running Proxmox for a year and I learned something new. Thanks Jeff
Thank you. You go a little fast for my old brain, but the first couple minutes helped me clear up a couple of things about proxmox. For the first time I'm moving away from bare metal systems.
Your timing with this was spot on im just about to setup v8 on a test box
I am really looking forward to all your upcoming proxmox videos. I have been using your proxmox for a couple of years now, but I'm always eager to learn more.
Very enjoyable - i struggled with getting proxmox to boot from USB, sorted that using belina etcher, which worked great. I was able to follow your video clearly and easily, i've never used proxmox, and I'm really glad to add to my knowledge. Love the beer as well - you make it sound delicious !!!
I'm sure someone has mentioned it but Ventoy is game changing for booting, just drop your images on your drive and go! You can still use it as your regular thumb drive :)
Bad ass! I have my first Proxmox server now and running Ubuntu Server. I am so proud. Thanks, man. Awesome video.
Incredibly excellent video 👍
I have watched a lot of your videos. They're all clear and crisp but this one especially hits the enunciations and inflections brightly and vividly.
Great content. Can't wait for your future, related virtualization videos.
Big thank you.
Kindest regards, neighbours and friends.
Doing a big re-haul right now
I am a server guy I love the convivences of having sliding rails, multiple drives, IPMI, remote management, cheap ebay cost, etc
So I was running a Dell R210ii as my Firewall (PFSense)
Dell R710 as my Hypervisor (ESXi)
Dell R510 as my dedicated NAS (UnRaid)
On the R710 is a virtualized Freenas with HBA passthrough running RaidZ2 and all my other functional VM's (Home Assistant, Plex, etc)
So the change up is this.
The MinisForum MS--01 mini workstation is a micro pc with a laptop i9, 3 M2 slots, a PCI slot, and 10gb and 2.5gb networking built in for a fair price.
I got one and rebuilt my firewall using one so I can now easily handle 10gb routing with all the works.
I got a Dell R730 that I am building out to replace my R510 as my NAS (So far preliminary results show that maybe was not a big change, not much power savings or noise difference)
And finally
another MS-01 to run Proxmox and replace ESXi and all the VM's except TrueNAS.
I have been happy with the performance of Unraid given what I need it to do and it uses less power because I only need to spin each disk up rather than an entire array, and I have piece of mind knowing I can pull a drive out and get data off it directly if needed.
Watching this video because despite my enterprise experience as both a Network and Server Engineer some things just are not as intuitave as I had hoped.
I dont see how to bond my interface from the GUI, I moved files to my datastore (ESXi term) via SFTP and I cant see my files from the GUI to convert my ESXi VM's, etc.
I wish it ran on a USB stick like ESXi does I was thinking of a Raid 1 mirror for my 2x2TB NVMe SSD but I decided I'll use one disk for active, and one disk for storage of my snapshots and backups but I have not even figured out how to do that yet because the different storage type options.
By the end of this day I will have it all figured out I hope.
Loved the explanation of Linux bridge. Great video. Would love to see "storage" in proxmox and lxc / vms, like cifs disk volumes etc
Great! Please continiue your wonderfull work. Can't wait for installation of TrueNas and Windows
The intro was better than any of the new Star Trek series es.
A really cool Proxmox build I'm looking forward to building soon is mini PC based. The pricing on the Mini PC is very affordable You can find AMD 8 core with 32GB of ram with 1TB SSD for ~400 Buy 3 of them and you have a super power efficient 24c/48t cluster for sub 1500. The only way I know of linking everything would be via NIC/networking. But would be really cool to find a way to to do it via 40G USB / Thunderbolt.
Wendell at Level1 hinted that he had been working on releasing a video about this. Specifically, go to minute 6:24 of his July 27, 2023 video covering the Minisforum's UM790 Pro mini pc.
Kindest regards, friends and neighbours.
Wendell's video "What the NUC Kind of Cluster is This???" was released today, Aug. 31.
Very nice overview! I would like to mention the ability to set the CPU to 'host', which will automatically set the client to use the same CPU the host has. As for migrating between hosts, I like to keep all my clustered host systems installed on identical hardware, so this works great for me.
I believe the option "host" equivalent to "cpu-core-passthrough"
Fantastic timing. Building a firewall/fukaround server with a $175 Beelink N100 EQ12 right now. The old Pi just isn't cutting it anymore, and dual 2.5Gbit!
The last 3:30 of this video was perfect. You need a beer review channel. The Proxmox stuff was good too. I may give it a whirl some day.
This video educated me about virtualisation more than anything before. Thank You.
This is one of the best tutorials of proxmox I have found, thanks.
This is the best clear proxmox explanation video ive seen very well made
A tutorial on how to create a high available ceph cluster in proxmox 8 would be awesome.
ceph needs 3+ nodes with possibly SSD (best if NVME) storage to have any kind of performance. If you are not made of money it is better to stick with local ZFS pools and use replication jobs.
Great video about details on proxmox. You don't see this level of detail on such a short format. Very well done.
It would be nice to see a Virtualized TrueNas Environment and in your opinion the best configuration for it.
I can’t help but anticipate the day you spill your beer… with all that hand waving within just a few inches away. 😎
Thanks for explaning that you can configure more resources that you physically have among VMs. I learned alot about virtualization!
Nice video. Thanks.
A Proxmox passthrough video would be nice, covering the mini pcs with ryzen 7940hs and the integrated 780M graphics. This would make a perfect home lab starting point. :)
Always with the appropriate amount of dry humor! Love it. I don't know what I don't know, but I do have a ProxMox server with 4 VMs. Still learning, so I look forward to seeing your future videos especially your content around VLAN techniques and strategies.
I recall the first time I tinkered with VMware Workstation back in 2003 or so. Very fascinating concept for the time to have a virtual “sub computer” with an OS that, for all intents and purposes, believes it’s on its own computer. Then add snapshots and copying etc it essentially introduced planned time travel
After realizing I can install proxmox on a dell micro for a docker container + ubuntu + scrypted and then run windows vm's separately I'm sold!
Very informative video! I'd love to see a home NAS setup walkthrough in ProxMox, explaining different options and common doubts that arise during its configuration.
Amazing video! I'd love to know about the best practices for Truenas, Proxmox, and a firewall. Should I opt for running each service natively on 3 separate PCs? Or would it be more effective to strike a balance by installing Proxmox on all 3, even if the PCs aren't identical, and then using the same software for redundancy? Also, I'm curious about making the most of an Intel network card with 4 gigabit ports. As for running LLMs (like in Nextcloud, where it can connect to LocalAI and a local LLM), is it currently recommended to virtualize Ubuntu on Proxmox? Or is it better to have a dedicated PC solely for Ubuntu? Liked and shared (already a subscriber).
I've mainly stuck with ESXi (Vmware Hypervisor) on my home network; but would like to see a tutorial on virtualizing OPNSense in Proxmox.
To install proxmox, what I did: reset bios to default. Than There press the "e" key to edit a boot entry (e.g., the Graphical one, used advanced debug one)
Use the arrow keys to navigate to the line that starts with linux, move to the right where the quiet parameter is, delete that (so we maybe get a bit more info) and add "nomodeset". Also remove "quiet" not silent parameter. Than press ctrl+D if it gets stuck try again ctrl+D to continue. I used ext4 instead of zfs because I was using only 1 nvme, and my nvme is not industrial one.
This is the best and most in depth tutorial I have seen so far! Would love if you could cover masquerading and DHCP for my Virtual Bridge, as I could not get it working despite following so many examples online and the offical documentation.
I have recently installed proxmox on a minipc to start my home lab journey. I would love to see how to interact with VMs the best way possible without using the browser noVNC client. Great video. Thank a lot.
Good video. One correction: TPM= Trusted Platform Module. it does not protect tampering.
Should I pin a comment or add an asterisk?
@@CraftComputing Add an asterisk is a better option IMO. People normally don't read comments. I know that's a bit more work.
This is true, but I will point out that when using true antitamper mechanisms, they can use the TPM, even if that's not a "standard" use case for it.
@@CraftComputing make a full blown apology video
@@marcogenovesi8570 A wild Steve appears...
Hello Jeff I am about to make the change from VMware ESXI 6.7 to ProxMox 8.1, I am waiting on hard drives and my second CPU cooler to arrive for my Dell R710 (I know it is an old server) I am going to virtualize my Firewall which I am using Sophos Home Firewall, I am probably going to have a video on how to setup the entire system, but mainly the WAN and LAN passthrough for the Sophos Firewall as I will have 2 of them running in HA, I love your content and thanks so much for the explanation of all of the hard drive interface types!
Thank you for being so exhaustive, exactly what I needed. Subscribed and looking forward to your other tutorials
I just received the floppy disk coasters.. They are awesome. Thank you for your Videos and quality of the merchandise.
Thanks! Glad you like them 🤘
great video that addresses all of the most common pitfalls and misconceptions
Thank you for sharing and I'm looking forward to the PCI pass-through video. I've learned (and implemented) a lot from watching your series of videos.
I'd be interested in a future video where you use the Proxmox Container Toolkit for theoretically lower overhead versus a full VM.
Thanks for a GREAT video! You make it much simpler than I thought!
One small note:
Ubuntu is pronounced oo-boon-too. It is a word from the isi-Zulu language, one of the 11 official languages of South Africa.
Love from South Africa. :-)
@Jeff On the topic of CPU type selection, you mentioned that it makes it difficult to migrate a VM to a machine which lacks those features. One tip I'd like to mention is that YOU ARE ABLE TO CHANGE THE CPU TYPE AT ANY TIME AFTER CREATION. Simply do so prior to migrating the VM. If you're using Linux or BSD, remember that they have monolithic kernels, and this means that you can take the system disk out of the machine and place it into any other machine with hardware that is supported by the Linux/BSD kernel, and it will "just work". The only issue you might run into is if your software license doesn't permit the number of cores the new system has.
Able to change at any point, sure.
But best practice is to use the most compatible generic CPU type, as you can then automate migrations, or even set up for high availability.
What is this "monolithic kernels" thing, you can pretty much do that with a Windows system too since Windows 7 and it will detect the hardware changed and reload drivers. For Windows 10 and 11 they integrate most network drivers so it can just re-download drivers for the new hardware
@@marcogenovesi8570 I wasn't talking about Windows, and so I don't know why you are bringing that into this discussion. Also, your statement is only partially true, since Windows requires a license (I know you are able to use it without one), and it might require a new license if Windows detects that the hardware changes too much.
@@TheChadXperience909 You were talking about VMs and "raw dog" hardware migrations of disks from one VM or physical system to another. Saying how Linux/BSD are somehow better because monolithic kernel. Which is simply not what "monolithic" means when talking about kernels, most Linux and BSD drivers are packaged as modules (and distributed as separate packages so you might not even have them installed) and only loaded when necessary to not waste resources.
I never talked about license activation so not sure how that makes my statement "partially true". FYI Windows isn't the only OS with licenses. Also RedHat, Unraid, SUSE or other paid linux/unix distros and appliances will have the same issues if you change the hardware they link the license to.
But the OS itself would probably work fine
amazing video , i will love you do more videos about network setting and vlans including having internet access but limited the VMs to access just local network.
I live for the way he says "virtual".
I'm second-guessing my decision to take advice from someone who is unable to pronounce the name of the technology he is schooling me on.
This was a fantastic video for a beginner like myself, liked and subscribed, thanks so much man!
Superb Jeff, this is good stuff, and you're good at explaining.
Great "how to get up and running" tutorial.
The only thing I'd add, since you showed the advanced options and mentioned ballooning, is that if you turn ballooning off for a resource then you *do* have to treat that resource like a doled out pie slice.
It isn't a major issue for drive space -- you'll just get disk size warnings/errors when trying to create the virtual drives -- but can be a serious stability/resource problem with RAM.
One example: you have 16GB of physical RAM and create 2 VMs that each use 8GB non-ballooning RAM. If you run them simultaneously, your system _will_ crash at some point. Because you neglected to leave any RAM for Proxmox itself (it needs a min of around 2GB to run stably). Ask me how I know. 😬
But, as you said, unless you have a situation where you need to guarantee a certain amount of RAM to a specific VM, it makes sense to just leave the RAM as ballooning and let Proxmox manage it.
Awesome video. Thanks for the detailed explanation of all the options. Please continue the series.
Thanks, you helped me switch over from Hyper V and get some hardware passthrough going ..