Nah not really, :) During Summer - $350-400. Winter is $260-340s. I havent turned on my gas furnace so I offset all my costs. The DC heats up the house easily. Usually gas is $200+ since it is more expensive
@@Virtualbytes1 It really is. I have a rack at home myself and only pay 30-40€ per month for electricity (as well as +100€ for fiber internet 😢), which would probably cost +500€ per month if it was running in the cloud. Also, I haven't had to turn the heat on once this year and last, even when it was -10°C / 14 °F. :D
It's always good to see you posting-definitely enjoying your content! I'm also running mini datacenters, starting from home, and now expanded to two other locations. Mostly running Dell hardware (14th and 15th gen AMD with Tesla P40s) and 100G (Mellanox) networking for Ceph, NVMe over Fabric, etc. Keep up the awesome work!
Always enjoy seeing what you have running. Dell released an update to iDRAC 9 a couple of weeks ago that changes the fan curve and potentially quiets these machines down. It had no effect on my R740, but my R750 is now livable, where it was almost never in operation before due to its volume. Significant change.
Thank you! Yeah i agree haha, before the 740s use to be really loud in the early days of their life time now they are nice and quieter, mainly in my DC is my HVAC blower making the noise moving the hot air into the house
Hey long time follower here! Always happy to see an update :) Does the fan and duct isolate the noise from the rack when pushing the air into the house? Also does this push the air into your HVAC air distribution or is there a single point where the air exits?
Hi! Awesome to see you again! And yes the hot air gets forced into the hvac system, I keep the main furnace off but in certain areas of the house I have additional AC infinity in duct air movers that keep pulling the hot air. House is currently sitting at a nice 72f during winter time!
Hi, can you explain your backbone comment in the description section. When you say quad 40g backbone is that between the two 40g arista switches? and then quad 10g is that between the 10g arista and one of the 40g arista switches?
Hello! Both Arista switches are lagged sharing a port channel trunk - 80Gb total, each of the R740's have 2x40Gb uplinks, split apart between both switches for fail over. For NSX, each host has 4x10Gb NDC, which they are the TEPs providing uplink to the NSX Overlay, so each host has 4x10Gb of throughput within the overlay network. These are not lagged due to NSX and vDS having a very efficient algorithm on load balancing and providing fail over if needed. Soon I will be doing diagrams of what is setup but check out more info about all the networking on my site - www.virtualbytes.io/home-data-center-2024/
how do you hook up the old powervault? i tryed to connect to mine via rj45 or Sff8088 but both doesnt show up in truenas scale for me any suggestions? i tryed also the Dell EMC PowerVault Modular Disk Storage Manager but no luck with that.
Hi, like do you mean to gain access to update the firmware's? If so, I used the serial cable and reset the backend IP that was hardcoded and all and then was able to get it added to my iSCSI, mine is the iSCSI Powervault, not the SAS based on where you can connect via a HBA card and cables. I know FreeNAS which now truenas had specific cards that worked really well for external shelfs. I use to have the Dell EMC VNX DAE shelfs that i had hooked up to a R620 running freenas back in the days.
@@Virtualbytes1 no not rly acces to update but have acces to storage in general. l dont see nothing at all no disks no raids nothing. but you mention serial cable for reset that could be a way to config it. that i can see at least something. thx for your response!
How much do you pay in licenses? Do you plan on migrating to something more open? Linbit just posted a blog post where they showed of their new installer for it's Cloudstack deployment. It's pretty nice and Cloudstack all the features one needs.
Hello, I pay 0 and not really open stack and all those are dying away since other competitors are coming in but solutions that are new and recently created are not seasoned well many issues and so on so it would take years to get what VMware software has become but I have played and tested many open source solutions for fun! Cloud stack seems more like a UI overlay that consumes VMware , AWS, and so on?
@Virtualbytes1 Not sure what you mean by your first couple of sentences, but OpenStack is definately not dying. Far from it, it has a pretty big comeback r8n. We run an OpenStack cloud for example. While the docs definitely feel antiquated, it's progressing along fine, it is just now a bit more focused on the core parts and doesn't anymore have that many different projects for everything that nobody needs or maintains. (Apache) Cloudstack on the other end is a competitor to OS and does most things OS can, but comes as a Monolith, which makes it a lot more easy to maintain and keep running. It also won't die, it's a smaller project, but has been around for a long time now. It's not a pretty UI for the serviced mentioned, it can integrate with xcpng and VMware, but it wants to manage all for the resources itself. By default it uses KVM directly and completely takes control of the Linux host
Usually get lucky when i buy them off ebay haha! But if you have a awesome friend that works at PA could get a lab license. But without a active license, it runs as a layer 4 firewall but also can use GP and APP ID filtering, and so on just wont get the latest feeds unless you update them your self manually.
@@j.r._7416 if you get a Palo off ebay, it will work but if you get the bigger appliances make sure the OS disks are included if not, then its a big door stopper haha, the little PA 850s and all have the OS with them.
I have currently 1Gb symmetrical Lumen connection, going to possibly get a second fiber connection from a different provider. I have multiple Site - to - Site VPNs but no eBPG or anything like that. There is BGP utilized internally within the core networking and nsx and palo alto.
your electricity bill must be huge
With great power comes great electricity bills
Nah not really, :)
During Summer - $350-400. Winter is $260-340s. I havent turned on my gas furnace so I offset all my costs. The DC heats up the house easily. Usually gas is $200+ since it is more expensive
@@Virtualbytes1 a month?
Yep! cheaper than any cloud provider, aws, azure, gcp! If i wanted to run what I have on my environment in a cloud, easily $10k +
@@Virtualbytes1 It really is. I have a rack at home myself and only pay 30-40€ per month for electricity (as well as +100€ for fiber internet 😢), which would probably cost +500€ per month if it was running in the cloud.
Also, I haven't had to turn the heat on once this year and last, even when it was -10°C / 14 °F. :D
It's always good to see you posting-definitely enjoying your content! I'm also running mini datacenters, starting from home, and now expanded to two other locations. Mostly running Dell hardware (14th and 15th gen AMD with Tesla P40s) and 100G (Mellanox) networking for Ceph, NVMe over Fabric, etc. Keep up the awesome work!
Thank you! Yeah there will be more content now in the upcoming year. Oh nice, yeah I will be upgrading network and so much next year! :)
Always enjoy seeing what you have running. Dell released an update to iDRAC 9 a couple of weeks ago that changes the fan curve and potentially quiets these machines down. It had no effect on my R740, but my R750 is now livable, where it was almost never in operation before due to its volume. Significant change.
Thank you! Yeah i agree haha, before the 740s use to be really loud in the early days of their life time now they are nice and quieter, mainly in my DC is my HVAC blower making the noise moving the hot air into the house
very very cool
Impressive!
Thank you!
Hey long time follower here! Always happy to see an update :)
Does the fan and duct isolate the noise from the rack when pushing the air into the house? Also does this push the air into your HVAC air distribution or is there a single point where the air exits?
Hi! Awesome to see you again! And yes the hot air gets forced into the hvac system, I keep the main furnace off but in certain areas of the house I have additional AC infinity in duct air movers that keep pulling the hot air. House is currently sitting at a nice 72f during winter time!
Just subscribed, i work in DC's for a couple years. Question; what do you usually use yours for? Id imagine its amazing for training and practice
Awesome thank you and I host everything my self so no cloud or web hosting plus education and prototyping work! :)
@@Virtualbytes1 Thats whats up. i feel like a lot of peeps/businesses will soon move to on prem
Hi, can you explain your backbone comment in the description section. When you say quad 40g backbone is that between the two 40g arista switches? and then quad 10g is that between the 10g arista and one of the 40g arista switches?
Hello!
Both Arista switches are lagged sharing a port channel trunk - 80Gb total, each of the R740's have 2x40Gb uplinks, split apart between both switches for fail over.
For NSX, each host has 4x10Gb NDC, which they are the TEPs providing uplink to the NSX Overlay, so each host has 4x10Gb of throughput within the overlay network. These are not lagged due to NSX and vDS having a very efficient algorithm on load balancing and providing fail over if needed.
Soon I will be doing diagrams of what is setup but check out more info about all the networking on my site - www.virtualbytes.io/home-data-center-2024/
how do you hook up the old powervault? i tryed to connect to mine via rj45 or Sff8088 but both doesnt show up in truenas scale for me any suggestions? i tryed also the Dell EMC PowerVault Modular Disk Storage Manager but no luck with that.
Hi, like do you mean to gain access to update the firmware's? If so, I used the serial cable and reset the backend IP that was hardcoded and all and then was able to get it added to my iSCSI, mine is the iSCSI Powervault, not the SAS based on where you can connect via a HBA card and cables. I know FreeNAS which now truenas had specific cards that worked really well for external shelfs. I use to have the Dell EMC VNX DAE shelfs that i had hooked up to a R620 running freenas back in the days.
@@Virtualbytes1 no not rly acces to update but have acces to storage in general.
l dont see nothing at all no disks no raids nothing. but you mention serial cable for reset that could be a way to config it. that i can see at least something. thx for your response!
i have both versions the iscsi and the hba modules i tryed both to get acces but i still have to try it just started. anyway thank you. nice videos!
How much do you pay in licenses? Do you plan on migrating to something more open? Linbit just posted a blog post where they showed of their new installer for it's Cloudstack deployment. It's pretty nice and Cloudstack all the features one needs.
Hello, I pay 0 and not really open stack and all those are dying away since other competitors are coming in but solutions that are new and recently created are not seasoned well many issues and so on so it would take years to get what VMware software has become but I have played and tested many open source solutions for fun! Cloud stack seems more like a UI overlay that consumes VMware , AWS, and so on?
@Virtualbytes1 Not sure what you mean by your first couple of sentences, but OpenStack is definately not dying. Far from it, it has a pretty big comeback r8n. We run an OpenStack cloud for example. While the docs definitely feel antiquated, it's progressing along fine, it is just now a bit more focused on the core parts and doesn't anymore have that many different projects for everything that nobody needs or maintains. (Apache) Cloudstack on the other end is a competitor to OS and does most things OS can, but comes as a Monolith, which makes it a lot more easy to maintain and keep running. It also won't die, it's a smaller project, but has been around for a long time now. It's not a pretty UI for the serviced mentioned, it can integrate with xcpng and VMware, but it wants to manage all for the resources itself. By default it uses KVM directly and completely takes control of the Linux host
Where do you get the Palo Alto licenses for the firewalls?
Usually get lucky when i buy them off ebay haha! But if you have a awesome friend that works at PA could get a lab license. But without a active license, it runs as a layer 4 firewall but also can use GP and APP ID filtering, and so on just wont get the latest feeds unless you update them your self manually.
@Virtualbytes1 got it! I would like to learn more about PA firewalls in my lab but have never found a lab license or trial to purchase.
@@j.r._7416 if you get a Palo off ebay, it will work but if you get the bigger appliances make sure the OS disks are included if not, then its a big door stopper haha, the little PA 850s and all have the OS with them.
what's the wan like? do you peer w/ anything?
I have currently 1Gb symmetrical Lumen connection, going to possibly get a second fiber connection from a different provider. I have multiple Site - to - Site VPNs but no eBPG or anything like that.
There is BGP utilized internally within the core networking and nsx and palo alto.
@@Virtualbytes1 That's awesome man, such a sick setup there.
Why, just why?
Why not.
It's fun! That's why 😂