$223 Dual Xeon Chinese X99 Motherboard (with RAM + CPU) | Proxmox + TrueNAS
Вставка
- Опубліковано 9 чер 2024
- In this video I'm going to review a dual socket x99 motherboard from AliExpress.
I paid $223 for motherboard plus 2x CPUs and 4xRAM sticks.
I will install Proxmox and do GPU and HDD passthrough to guest VMs and some benchmarking.
(NOT AFFILIATED): www.aliexpress.us/item/325680...
#xeon #dualsocket #x99motherboard #proxmox #techreview #motherboardreview #dualsocket #x99 #aliexpress #aliexpressfinds #budgettech #techdeals #hardwarereview #proxmox #gpupassthrough #hddpassthrough #virtualmachines #vmsetup #techbenchmarks #cpubenchmark #rambenchmark #serversetup #homelab #techtesting #techexperiment #pcbuild #diypc #pchardware #techunboxing #techsetup #pcupgrade #techtutorial #performancetest #techcommunity #techenthusiast - Наука та технологія
I got one but I installed Linx mint on it all works great. I am using it for some video editing but mostly graphics design that make up animated movies. What was taking me on average 9 hours, now takes me 3 hours, for a 20m short animation. I fitted it with 2x AIOs I had to make my own brackets out of sheet aluminium to fit them but no problems. I have it set up in my old Cooler master X1 Server case from 2012 they are massive I needed that because it already has my 1200w APU fitted and an 8 bay HDD caribe each having 2Tb storage space all holding files from past jobs and uncompleted jobs I'm still working on. I'm happy with it its much faster than my older setup.
I've read in some threads that RAM that looks identical from the same brand, but with memory chips made in S. Korea doesn't work on these boards, but if the mem. chips are Chinese, then there is no issue.
Fortunately, I found an MSI motherboard for X99 so I didn't have to rely on one of these Chinese boards.
I'm using the E5-2696 v3, with the all-core turbo unlock, and unlike the 2699 v3 that has a turbo of 3.6GHz, the 2696 v3, which was an OEM part only, has a turbo of 3.8GHz.
Not running dual CPU, because I do play games occasionally, but with 18 cores and 36 threads at 3.8GHz with water cooling, it really chews through anything I do. Edit, render, 3D, it is a workhorse. Quad channel ECC makes up for the 2133MHz speeds. I love it.
It uses a lot of power, but any chip with this many cores is going to have a high power draw. Forget the TDP it says on the box. Read the power coming out of the wall.
It's a very solid performer, and zero latency when clicking through projects with big files. The CPU has a 45Mb L3 cache, and the RAM timings are tight. Soooo smooth....
What's your power usage with the all turbo? Cant be much more than then 14900k that eats nearly 400ws😂
I got lucky and when I got my X99 setup, I got the Asrock Taichi. 256GB registered ECC (with the ecc actually functional - pretty rare on the consumer boards) with the E5-1660 V3 OC to 4.2ghz. I will likely switch to a 16 or 18 core core when I can finally upgrade my desktop and get to move the X99 to NAS/LAB.
I've got 2 of the same CPUs, the E5-2696(v3)s for exactly the same reason 😁 although they are currently sitting in a drawer 🙄
Unfortunately, until next weekend, that drawer is several hundred miles away from the motherboard they are intended for.
The drawer also has 4 x V100 SXM2 GPUs in it, but the daughterboard is right beside the motherboard.
Hoping that I can introduce them all to each other next weekend
How did you run 18 cores at 3.8 ghz? I have a similar build but a chinese mobo instead but only able to reach 3.8 with 10 cores enabled since it limits by 145w max tdp? Or did you bypass the power limit
@adamdurrani1071 I haven't got to this stage myself but I think you (may) have to undervolt the CPUs to get there(?)
If someone can port coreboot to this will be amazing :)) very nice video !
Picked up a H800 yesterday, dual Xeon. Ill keep you updated
Thermalright xp90 (92mm) cooler might go on sale, or any workstation 2011 tower fan might work too. Swap the cards, could use the airflow. Also put the SATA drives on the desk to the left to avoid the wires being crazy.
Cheap CPU Cooler that fits* is a PCCOOLER Paladin EX400. I tested it and standard height RAM fits in all 8 slots, I can even remove and install the closest RAM sticks with the cooler installed! That right there is a win in my book.
* I used the Orange 'AM4' bushings, Only needed to clearance one at the bottom where the CPU levers meet. I used four M4 - 12mm screws, and I did have to use a needle file on the "2011" holes in the brackets because they are actually sized for an M3 or smaller screw. When they go on sale you can get 2x for less than 30 bucks.
It might also be possible to add 2 fans per tower cooler for 4 fans total. You will need extra clips, but the Tower itself has provision for fans both sides. I haven't got the overclocking BIOS yet so I haven't looked into that.
I have one of these boards. One of the DIMM slots are dead. Other problems: BIOS has not setting for state after power loss. I have installed 4x2TB SATA drives I had laying around and use ProxMox to assign to a TrueNAS VM. I installed an Intel Arc 300 series GPU for a Plex/Jellyfin install. I have a dual 2.5Gbit card installed. Besides the mentioned issues this runs well. I have a k3s cluster set up across VMs to give me a homelab to play with. I love having 128GB of RAM and 28 cores to play with.
Do these boards have full quad channel support for the sockets?
I have this exact mobo with 2x xeon 2760 v3 and its Rock solid so far
This would maybe be interesting as DAW server/workstation, basically an audio pc to host plug-ins, always need lots of cores and RAM, VERY INTERESTING!
Would love to see it's Cinebench score
Do you have any recommendations for a dual socket x99 motherboard?
NIce, 28 Cores, 56 Threads! for $223 and 64GB of RAM is quite the deal
Shop around. There are better deals (pick up CPU and RAM from a local marketplace). I did the same board from Ali, but it was 65 shipped. CPU 2698v3 16 cores one was 20, one was 7. RAM was 20 ea for 32GB sticks. The 2680v4 shown here are worth 14 each btw.
@@milescarter7803 Actually my plan was to buy just the board, I have 40 x 16GB ECC ram that was thrown out at work and pick up a pair of 2560L's to popular it
I would go for such a solution when i would live in the USA.
But with the high electricity prices in the netherlands, I prefer something more low power. My nas now runs idle at around 50w. That saves around 100 usd in electricty prices per year vs a dual xeon setup.
I'm watching this on a HP z640 with an x99 CPU running KDE Neon
same here got dual E5-2660's w 64GB DDR4 @ Quad Channel AMD Radeon Pro W5700 WS Card
Too bad the X99 board only has PCIe Gen 3.0
It's holding back the W5700's potential
You would be surprised how little gen 3 affects a gen 4 card. The only card today that needs gen 4 is 4090 and thats barely needs it. I was running a rx 5700 on gen 3 and gen 4 and saw no difference except maybe a slighlty better(3-5frames) perf in some titles.
Your biggest bottlenecks are the cpu's clocks for gaming.
And if you doing work station tasks you should have no issues
@esra_erimez Did you installed the chinese motherboard into the HP z640 case?
@@jnchacon No, stock motherboard but upgraded CPU to E5-2699
3.3 isn't wrong, if Performance mode is enabled, it will always run on Full turbo mode.
I use the same processors for Monero mining in Proxmox on a Lenovo x3550 M5 Server, so you definitely want performance mode then, I've installed 512GB of ram, because I also run Xpenology, Kali, Ghost Spectre, Home Assistant, Frigate, and Odoo on that server.
I also use NetApp FAS and Disk Shells for the storage on the Xpenology. To get 9.2Pb as total storage for my NAS.
Off Course run a few more servers in the cluster for networking operations, and Local LLM.
PLEASE tell me you used thermal paste on the CPU before putting on the heatsyncs? The Xeons really do need it to keep them max cool. Artic Brand or Thermal Grizzly Kryonaut Extreme (preferred). It's a cheap way to keep it cooler. These old X99 boards are normally very good IFF you find one from a reputable maker which discloses all of the shortcomings. A UA-cam channel from a chap in AU does these a lot. For gaming if you can believe that LOL. But Proxmox and XCP-ng loves these boards.
I am pretty sure that there was thermal already applied on the fans when he installed them.
Hopefully those stock Intel coolers had pre applied paste or thermal pads... He definitely didn't add any... 😮😢
Right but will it run Crysis?
I learn a LOT from watching this channel. That was impressive.
Great video and a success story. I found this video very helpful. 💯
Hi there!
May I ask what cooler would you recommend for this rig? I cannot seem to find a proper LGA2011-3 cooler online.
Thermalright AK90 is a great choice.
I used this one for 2 of my different builds for 2011-3. It's great.
Biraz tuhaf buldum. Ama ise yarar gibi görünüyor. Bios biraz eski gibi geldi. Soğutma yetersiz kaldı. Tam bir kasa kurulumu yapıp oyun testlerinde render testlerinde görmek isterdim. Başarılar diliyorum ❤🎉😂😊
The power consumption must be crazy
At this price it is better to buy a used Supermicro board even though you'll likely have to pay a little more. These Chinese boards also tend to be a fire hazard with the higher spec SKUs. I used an e5-2640 for my NAS on a Jginuye board.
Could fit a USB card or a NVMe adapter with an inexpensive but large NVMe drive in the top PCIe slot. Could run it in raid with an identical drive in the 2.0x4 NVMe slot. PCIe 3.0x1 will limit transfer speeds to 1 GBps so something like a Teamgroup MP33 would be perfect for this solution and you would have redundant NVMe storage for not a lot of money. Still twice as fast as a SATA SSD.
Would suggest getting a couple of Thermalright Assassin X 120 R SE coolers for this board. Will fit better and cool better for not much money.
我跟你說 這些主板前生本來就是美國伺服器公司的 他們被中國廣東省的公司大量收購 然後分解加工重製 他們的工廠設備同員工技術員都是專業的 因為老闆都是從1線大廠出來的例如華碩 微星 索泰 技嘉 索泰 等等
Good price question ist the Motherboard AMD Crossfire Support have two AMD 580 Radeon 8gb
please include in the future videos also a test for Plex transcoding test without the nvidia gpu + power consumption
Buy them separately. These processors and RAM are not good value. You are paying more than what dual 16 core and 32GB DIMMs go for. You don't need to unload their stock for them.
That was a ballsy move bro!! this is a weird kind of e-sports
What I dont understand: Why would I need AUDIO on this? I would want a second NIC rather than audio.
And yes it is just 1GBit. This board should have like 4x NICs so you can bond them.
I have one of these boards with 2 x 2699v3 in it. I used Thermalright low profile coolers (AXP120-X67). It required a bit of futzing around, but they fit without interfering with each other. They keep the CPUs running around 30C, though I haven't stressed them at all.
What adapter kit did you buy to make it fit LGA 2011?
It fit out of the box. No adapter kit required.
@@icmann4296 did you buy it recently? I’m looking into purchasing it, but it only notes LGA 1200/1700.
Also, you can orient them so that the fans blow over the VRM mosfets as well as the CPU. I think this helps too. I think for them to fit you HAVE to orient them this way. It's been 4 months since I did the setup and it's at my ex's house, so I'm working from memory.
I just looked it up. The processors are 14 each, motherboard is 75. So that is 103 dollars. The ram is not worth 120. Get LRDIMM 32GB for 30 each and its 128GB for same price. But you can also get 32GB DIMM for 20-25 if you shop. Not sure to recommend this bundle.
Great video. Sorry, English is not my mother language. The two nvme drives doesn't work at same time?
Yes, correct. One slot worked without issues. The other one is pcie gen2 and couldn't make it to work with my nvme SSD, but honestly didn't research this much and didn't tweak with bios settings etc
@@TechnicallyUnsure You Just need to adjust a jumper and both nvme Will work . 😀
When doing GPU passtrough, remember to passtrough all devices with the same ID, meaning the .1 and .2 etc (HDMI audio etc).
I can tell a Persian accent from a mile away. Nice board.
Just built a dual E5 2699 with SuperMicro server. for $250. The shiny is nice Was there a model number? E5 2680 max ram 1.5T , nice.
more details on this build would be really appreciated.
This board won't support that much RAM. It only has half the memory channels per socket that it should.
Your BIOS is newer than Mine, Can you share your BIOS dump with us , im doing some bugfixes in my Github repo jwagnervaz, your BIOS looks like be 2024 version.
Thanks since now
Unfortunately I did the dump + patch + flashing in a live Linux, didn't save the original copy. I will see what I can do, but no promises
@@TechnicallyUnsure No problem, send me the dump u did in the video, with or without the patch. Please, it also can be in linux. This way we can help a lot of others who did buy this model.
@@TechnicallyUnsure Now i have theses bios for the same board, they can change somethimes just BIOS CHIP.
(03/21/2023)ZX-DU99D4 V1.3 DU994301
(05/06/2023)ZX-DU99D4 V1.3 DU994304
(10/30/2023) ZX-DU99D4 V1.3 DU994305
your is
(03/06/2024)ZX-DU99D4 V1.3 DU994306
@TechnicallyUnsure Please help the comunity!
There's a different version of this board that has more PCIe slots, wonder how the allocations are on the lanes with that because it would be a decent upgrade for core counts and power savings (using a PowerEdge T610 ATM so yes, it would be less power) and I got a ton of parts laying around to build out an entire system.
Is it the same board, or are you thinking of the Huananzhi F8D or F8D Plus? They have the same colour scheme, which is why I'm asking. The F8D is double the price of this board.
@@icmann4296 I think it's the F8D Plus.
i wish these boards didnt have so few pcie lanes. these CPUs are capable of so many more, which seriously reduces the usefulness of boards like this to me
Get a SuperMicro board. Even with 1 dead memory channel it's still got more than these boards.
Could you provide the actual link on Aliexpress to buy this motherboard combo? Thanks
www.aliexpress.us/item/3256804883464369.html
The X99 chipset only has 8 PCIe lanes at gen2. That x4 NVME slot is most likely from it. Each E5-2680 v4 has 40 PCIe Gen3 lanes, but it's hard to say how many are lost for interconnect between CPUs and how many are available at the board that you can use. As per the x1 PCIe slots, they should be plenty for 10GbE if they're Gen3 (2 GB/s. 10GbE is 1.12 GB/s).
Pcie 3.0 x1 is 1GBs not 2GBs. That's pcie gen 4. But either way it should be enough for 8gbe
@@not_so_native_native Even if you assume half duplex speeds, it's still enough for 10GbE, as you're not gonna hit that full 1.12 GBs because of overheads in the network stack.
The interconnect doesn't count toward the lanes. And yes the board is missing connect. But its available routinely for $60-70. Cheap.
@@milescarter7803 My main curiosity is if the PCIe x1 and x16 is duplicated because each of those two is for each CPU.
Hmm... so requires a pcie 10 gb network card to really take advantage of it for proxmox.
How many total PCI-E lanes are there on your system??
2xPCI-E X16
2xPCI-E X1
@@TechnicallyUnsure Not PCI-E slots but Lanes.
Well, no idea, there is no info from motherboard manufacturer, no manual.
But based on some math:
16 (first x16 slot) + 8 (second x16 slot) + 2 (two x1 slots) + 8 (two NVMe SSDs) = 34 lanes in total?
Neither that mobo nor that Xeon can support DDR4 3200. Maybe you could reach 2666 by overclocking if you are lucky. Also you didn't made any memory settings in BIOS so I seriously doubt it even operates at 2400 right now. Probably it's at 2133 by default.
Careful with this board .. very easy to brick it when performing bios updates. Also doesn’t play nice with unraid 😂
The PCIe slot count is an absolute joke that should be funny to no one. This platform has considerable PCIe connectivity that's being utterly wasted. Find a used Supermicro or other server board and get the connectivity you're due.
I agree with you, stay tuned for the upcoming video. I'll be covering a similar board from Supermicro that I bought from eBay
I literally was just looking at this combo like 20 minutes before the video came across my feed
got this MB, excepted the 1Gb network , I'm happy with it.
Can anyone recommend a cooler for this board. I'm toying with the idea of getting one but I'm stuck on what cooler(s) to get?
Thanks
Any cooler that lists socket 2011 compatibility. Like Thermalright 120mm. If you are willing to work a little PCCooler has one that needs an M5 screw but regularly goes on sale for less than 15$ and has a coupon if you buy 2 at a time.
@@milescarter7803 My concern was as noted in the video that because the CPU's were so close together it was necessary to cut the edge off one to get them to fit. Thank you for clarifying for me
Why did you remove the Intel ME? Is there some benefit for doing so?
I'm wondering too
Well, when I did the first Xeon Chinese motherboard review on this channel, some viewers complained that these boards come with "Chinese malware" in Intel ME etc, and viewers asked if I can remove Intel ME, so I did that in follow up video for that motherboard among other things. So since then, all Chinese motherboards I review, I also try to show if Intel ME is removable on that board
OH! Thank you for the heads up. I wasn't aware of this, but it makes total sense. 👍
Remove Intel ME Will make the board lose thermal control and get really hot VRM, test by me. I have mod this bios at my github.
@WagnerVaz Can you please share the github repo link?
can you post the link where you found this awesome deal, I can buy the board, a single cpu and like 32 gb ram, but I can't find the exact thing you did, I'd be very happy building a triple proxmox cluster for HA home labs or something equally similar. To the OP that mentioned the Huananzhi x99 motherboard, do you know if it will support a V4 xeon ??? it does have more pci slots...but lacks onboard nvme from the look of it, although that could probably be overcome with a PCI addon card adapter.
(Not affiliated): www.aliexpress.us/item/3256804883464369.html
You can save like 80 picking up the parts yourself. They are unloading the RAM and processors this way.
@@TechnicallyUnsure THANK you sooooo much thats awesome. I think several of these need to join my homelab.
@@milescarter7803 do you know what the max ram is for this motherboard? I'm guessing its higher then 64 gig
Here in Europe those build are DONE!
I build a 2670 single one in 2018 and thankfully could sell it early 2019!
One can buy an AMD xyz, depending on budget, up to threadripper with unlimited cores and it will be faster in all belongings. + faster RAM of course.
Here we pay 40 Euro ct per KWh + 12€/month. Do the math.
I don’t know if I read your comment incorrectly however I wonder that in the rest of the Central/West Europe you would pay such an abysmal price for a Kilowatt per hour.
@@bagrus8065 Yes. Between 28 and 48Ct/Kw, plus a monthly feed of roughly 10€/ month.
The US ist just extremely cheap in global comparison! It is not that Europe is expensive.
Same on fuel - as we all know.
Why exactly are you removing Intel ME from the bios? Is it for security reasons?
Well... when I did the first Xeon Chinese motherboard review on this channel, some viewers complained that these boards come with "Chinese malware" in Intel ME etc, and viewers asked if I can remove Intel ME, so I did that in follow up video for that motherboard among other things. So since then, all Chinese motherboards I review, I also try to show if Intel ME is removable on that board
Anyone know if you can enable Secureboot or Tpm on this thing?
You will need an external TPM, the board doesn't have one.
@@TechnicallyUnsure Thank you for answering man, this thing suck. Do you happen to know of any sort of method to bypass both of these?
@@raksan4972 Unfortunately, no. There are no X99 compatible CPUs that are supported by Windows 11. Oldest is 8th gen Intel, or 2nd gen Ryzen. So you have TPM and CPU issues to install Windows 11 on these motherboards. You have to either go with Linux, FreeBSD or with Windows 10
just but DELL T7910 PC you will get more for less
Missing AliExpress in India 😅
i hate these boards because bo quad channel support
You didnt forget the thermal paste right?
No, the cooler comes with thermal paste
Please provide the purchase link on Ali Express
(Not affiliated): www.aliexpress.us/item/3256804883464369.html
I have one of these!
If you look on Intel Ark you'll see those CPUs go up to 3.3 GHz -- it's their turbo frequency. If you can keep them cool, you can run at that speed all day long. -- Honestly for a 28-core/56-thread system @ 3.3 GHz with 64 GB of RAM, that's a really good deal. -- You could build a good emulation and gaming machine out of that. -- Obviously you need a GPU, Xeons don't have a GPU built-in. -- Also, if you're not going to use the on board ethernet, you should disable it in the BIOS. -- Also, some systems have the BIOS image twice as a safety precation, in case a flash of the BIOS fails, it will restore the backup from the second chip.
I really dont trust those chinese boards... I just bought Dell T5810 with 1620v3 no ram and hdds for 120$ with warranty . I swapped the cpu with 2698v3 and bought 128gigs of ddr4 for another 200.
32GB LRDIMM are less than $30 each, overpaid by about $80. Assuming the Dell takes LRDIMM.
@@milescarter7803 I also dont live in the US bought RDIMMS ECC from china 2400 mhz total cost with the cpu was 200$ for 128 gigs and 16/32 core cpu.
Does the ECC memory recognized by the motherboard?
it is but is only dual channel. if you want a good mbo get the Huananzi F8D Plus.
It does, am running one of these with 2x64Gb EEC DIMMs (think is max RAM it supports) on each CPU
@@jelliott3604 Each Xeon supports a theoretical max RAM of 1.5 TB and they have 4 memory channels. If this board was designed correctly, each slot should be 1 channel.
@@BrunodeSouzaLino that's the most I could get the board to POST with
I used LRDIMM because it was cheaper. ~$20-25 per 32GB stick.
Link
(Not affiliated): www.aliexpress.us/item/3256804883464369.html
man, E5-2680v4 are super cheap right now.. like $15-20!
2698v3 are only $22
2x 120w tdp cpus? lets watch... so far big NO for emo IT dudes
137w idle? this is basicly trash
Very nice video about me cleaner))
all of these X99 boards are Broadwell, aren't they? that's a *lot* of power consumption for not a whole lot of performance!
Depends if you are spinning a lot of virtual machines. It is 64 threads if you get 2698v3 for example.
ebay has the supermicro 2011v3 cheap as hell these chinese motherboard now will last forever like a supermicro will do.
Thanks for letting me know. I ordered one, will probably make a video with one of those boards soon
Not a good option.
the problem is you will have zero warranty
Intel discontinued the X99 chipset in 2014 and support for this Xeon SKU for the broad audience in 2016. You're not getting warranty either way.
@@BrunodeSouzaLino Since when you can't for discontinued tech?
@@stephenxs8354 Since it got discontinued.
I keep getting calls offering to renew the warranty on my car... I drive a 1973 Jeep CJ-5.
I bought an single Socket chinese MoBo with real X99 Server chipset and real Quad Channel ( 8 Memory slots ) for ~ 230 Euro with 128 GB DDR42133 ECC RAM ( 4 x 32 GB ) + 2680 v4 and i use it as a NAS . I wanted the 40 PCIe Lanes of the Xeon because i wanted to use a 4xNVME PCIe Card and Bifurcation works , i have now 6 NVME in my NAS together with a 40 GBIT QSFP+ NIC and 7 SATA HDDS . Sadly it seems that the Xeon E5 is only able to use ECC if there is only 1 Dimm/ Channel thats why i opted for 4 x 32 GB Dimms , more Memory = faster TrueNAS ua-cam.com/video/GBNy7sIi0CM/v-deo.html NVME ( 4 x 2 TB ) Backup Performance SATA SSDs (write) ua-cam.com/video/JJBPMSWJM-I/v-deo.html
Besides , there are better Chinese Dual Socket MoBos , the HUANANZHI X99 F8D PLUS with 6 PCIe Slots 3 x 16 Lanes , 3 x 8 Lanes + 2 NVME and Quad Channel for each CPU , but i am not sure if it runs with V4 Xeons , its mostly bundeled with the E5 2696 V3