VMware vSAN Cluster Project - Part 1
Вставка
- Опубліковано 2 тра 2021
- Dell PowerEdge R730XD - Production Host
2 x Intel Xeon E5-2680 v4 @ 2.40GHz (256GB RAM) - 8TB SAS SSD Storage
VMware ESXi 7.0 U2
Quad Mellanox ConnectX-3 Pro 40Gb/s (Data, vSAN)
Dell PowerEdge R730XD - Production Host
2 x Intel Xeon E5-2680 v4 @ 2.40GHz (256GB RAM) 2TB - SATA SSD Storage
VMware ESXi 7.0 U2
Quad Mellanox ConnectX-3 Pro 40Gb/s (Data, vSAN)
Dell PowerEdge R730XD - Production Host
2 x Intel Xeon E5-2680 v4 @ 2.40GHz (256GB RAM) 2TB - SATA SSD Storage
VMware ESXi 7.0 U2
Quad Mellanox ConnectX-3 Pro 40Gb/s (Data, vSAN)
Dell PowerEdge R740XD - Storage Server
1 x Intel Scalable Bronze 6 Core - 32GB RAM - 95TB Storage ( iSCSI, NFS, SMB)
Networking Infrastructure
1 x Arista DCS-7050QX-35-F 40GbE Switch
1 x Dell Networking 5524
1 x Eaton 5PX1500
---------------------------------------------------------------------------------------------
I purchase Servers from:
Express Computer Systems
www.expresscomputersystems.com/
1733 Kaiser Avenue
Irvine CA 92614
800-327-0730
info@ecsunix.com - Наука та технологія
This is the most underrated video on Vsan deployment, I have an interview tomorrow and although I managed Vsphere, I actually never saw the physical connection. It helped me to visualize a lot.
Hello! Goodluck on the interview! and thank you, I try to show the lowest level of certain requirements for vSAN.
Bro, what a nice setup! Tidy and really good hardware.
i envy 40G link SO MUCH
Thank you! Lots of goodies! There will update two coming here in few days!
Yes please post more of these kind of video's. I am always watching what others are doing in there homelabs
looks really neat i love it :D
It’s so Purdy! Thank you 😊
Nice job! Always great to see what expansions you are doing. Would love to see the VSAN set up from the VMWare side of things. Not so much a tutorial, just an overview of the config for the vSAN you have just connected.
2
Yes, please more simple hardware tinkering videos. The quality is fine. We (r/homelab) just enjoy watching and hearing like minded people :)
Awesome I appreciate it! Well then I will show more things as I work on in my home datacenter / lab! 😊
Nice job . Thank you
Very impressive home lab.
Thank you! Check out the latest new video and see it’s current state! 😎
Nice, I'm looking into getting one of those Arista switches, looking at the DCS-7050QX-32 which often goes for very good prices on eBay. I'm used to MikroTik switches with a web GUI. Does the Arista switches have a GUI or is it all CLI based? I think you should do a video on how to setup the Arista switch.
Thank you and this Arista Datacenter switch is awesome, I’ll get another one soon but the command line is so easy to use it is 95% similar to Cisco NXOS and some IOS. I can do a video of setting up my new connections to the vSAN network for sure.
which DAC cables did you use for compatibility between arista and mellanox nic?
Very nice your home lab :)
Thanks for your awesome videos!
If you still need to know: DACs are usually pretty much just compatible with anything. I use many 10GbE DACs between TP-Link, QLogic and even Intel NICs (which are known to be picky on compatibility.)
I would be very interested to know whether additional licenses for DCB or MLAG or active ports are required for the Arista switches. Is everything already enabled here by default?
Thanks
nice
If you don't mind me asking, how much were the R730"s? Was looking at doing something similar but its like $3k per host lol
Yeah they are pretty pricey I got much lower than that but I’ll get back to you to see if someone might be able to help out on pricing!
Reach out to Parker at pware@ecsunix.com he can hook you up with some lower costs than $3k! 😊
how are you going from your internet service provider , and what speed into your Arista ? Also from your arista to your 3 servers you are using 40gb/40gbe to each server and your new project is and additional 40/40 Gbe to each server for vsan correct. I am confused as to how you are able to get your internet service provider into your arista. I am trying the same project just that i don't have an arista. I am using a dell s6100-ON. I am an it guy but i never really swam with the network stuff so i am a bit lost in getting this project started. Thank you
Hi! - The newest video i uploaded has more updated content, but yeah I have a Dell PowerEdge R330 with pfSense it is the Edge for the internet, then i have a SFP+ 10Gb/s fiber run going to Eth1/1 on my arista, my has the 4 10Gb SFP+ port on top of the QSFP+ ports. So what i have going on is a static route going from my arista to my pfsense via eth1/1, then i have arista running eBGP for NSX-T.
My version of the Arista DCS-7050QX-32S-F
@@Virtualbytes1 Thank you for your fast reply
@@Virtualbytes1 When you have some time can you show a picture of your home internet service input going into your arista ? Thank you
I have R720s with H710 Controllers. I’m trying to figure out if flashing to IT Mode will be good for vSAN or if I should purchase another controller.
Any recommendations?
Also, Are 10GB interfaces for vSAN good enough or should I upgrade to 40GB? What was your decision / logic?
Hi!
You can flash them to IT mode but vSAN will scream in the health check saying that the card is not apart of HCL ( Hardware Compatibly List)
I’ve done all kinds of vSAN implementations best one is to do all flash vSAN either with SATA or SAS Disks, SAS are better in reliability and performance.
10Gbit back bone is required for all flash vSAN, but 10Gbit is more then plenty but for the cost of a Arista 7050c series 40Gbit the cost is sp much cheaper due to the SFP+ nics and fiber or twinax. I got my two Arista switches for 550-
/600 bucks each. Plus the qsfp dac cables are like $20 and the 40Gig qsfp+ nics are 50-80$ each rather than 100+ for a 10Gig nic
@@Virtualbytes1 Really appreciate the insight. Any recommendations as far as controller to go with?
Anytime! The HBA330 is a great one and you can get the PCIe version of it. This one is the most used and well documented hba if you encounter any issues.
nice video, but better you should make a clear topology before implementing it. For anyone who doesn't keep focus on the video, so hard to completely understand what you do all the video.
Can you do a video of what you have equipment wise
Hi I sure can! I’ll be doing an update here soon!
@@Virtualbytes1 thank you so much, i truly enjoy your videos
What i am i missing ? I added the card and i dont see it appear in the dell side? Also if i add to cards like you have done the server starts booting and half way shuts off ? LOL
Hello! Did you enable them via idrac ? They need to be enabled and set to mirror mode. Haha
@@Virtualbytes1 Ok i don't see them in the dell bios at all , i do see them inside Esxi7 i couldn't go further because my switch and cables has not arrived. I forgot to mention that the issue with the server shutting done was on a R730xd. Ill try again maybe i was a bit tired. Ill update you next week. Thank you for the reply
What’s the best way to contact you?
Hi, what are you inquiring about?
Thank you 😊
@@Virtualbytes1 I like to know how you did your website, and other stuff. I'm recently getting into home lab stuff and just made another channel for my Videos, I recently landed as a sys admin for a college so this helping me a lot. We use VMware heavily so I been creating VDI and etc so I thought about doing videos. But I need some help on what I should do with the hardware I have. I don't mind paying for the time if I can afford it. But I really like your website design ( I can pay for that )
Vsan sucks . In a 3 node cluster each server had 32GB ram and vsan took 33GB total RAM just to run vsan. That’s 11GB ram off each server meaning fewer vms could be hosted per node. Instead I went with FREENAS on a single node and had 2 nodes for VM. A better overall so,union IMHO.
Doesn’t mean it sucks… each deployment is different. 33GB is nothing, if you are limited on ram. Recommendation is to up your hosts with more memory to overcome the limitations. iSCSi is good for tier 2 storage. Tier 1 is still vSAN.
@@Virtualbytes1 what if your server max is 32GB? Then vSAN sucks. Enter to give your VM more memory or have more VMs and use the vSAN flash on the server itself. Duh!