I Bought 64 CPU Cores From eBay For $400...
Вставка
- Опубліковано 28 вер 2024
- This was a complete waste of more than a week of my life.
Get some AWESOME Dawid T-shirts, Mouse pads and more here: dawiddoesmerch...
Play some Minecraft on the Dawid Does Minecraft server courtesy of our friends at Linode!
Dawid Does Minecraft Name: Mctenthiddy, server IP: mc.tenthiddy.com
It works on Java version 1.19.3
Support the channel on Patreon: / dawiddoestechstuff
Follow me on whichever Social media you don't hate
Discord: / discord
Twitch: / dawiddoestechstuff
Twitch bits on UA-cam: / @dawiddoestwitchstuff1128
Thanks for all the suggestions about the torque on the socket. The seller didn’t send me a torque wrench with my purchase. It is eBay after all. 😂 I do think I accidentally got the pressure right for the final mount considering that I got it to power up. However I will get an appropriate torque wrench for the follow up video.
what's the model of motherboard?
(copy pasta from another comment string) the early epic's were extremely sensitive to mounting pressures. Even mounting the heatsink could wind up screwing up memory channels etc. There's a pretty specific way you need to install the processors and hsf's. And yes, it can take a longgggg time to do memory training...like i seem to remember it could take upwards of 10-15 min or more sometimes (although you probably would have seen some signs of life if you got to the memory training phase). Anyway....looking forward to seeing you figure it out 👍
(Edit-you should send Wendell a message from "level 1 techs"...he lives and breathes this stuff. I'm sure he'd be happy to help you out)
yeah go ask Lius for one. He has like 10 of them.
I would also check what pcie lanes are assigned to what slots, it may not be able to boot a video card off of the second CPUs pcie link
please release touching cpu cooler video
These CPU retention brackets need to be torqued to a specific spec. if that's not the case you could get bad contact on the pins of the socket to the CPU and that can end in a no-boot scenario. Usually, if you buy these CPUs ne, there is a tool included. That is missing in you case, Dawid. I suggest getting your hands on one of those tools ans try again.
Thanks for the suggestion. Will definitely get an appropriate torque wrench for the follow up video.
Yeah they even give you that specially clicking, orange, T-shaped, torx screwdriver with Threadripper! I remember it when I built a 1950X workstation back in the day.
It honestly should still power on with NO heat sinks. It would just overheat and power off in 60 seconds.
Also remember that server hardware takes a LONG time to fire up properly. I noticed at the front there was a little green light flashing? Did that give you an error code of some type? Did you try plugging a monitor into the onboard VGA to see if that gave you an output? I'm not sure if it was AMD CPUS but at some point they (HP or Dell I think) started locking CPUS to specific motherboards so that they would only work in that specific combination. Thank you for such entertaining videos good sir 🫡
@@the_wiki9408He's talking about the retention bracket screw, not the heatsink ones
Keep in mind that you have to use the VGA out. It might be different now, but for my Supermicro board, the VGA is the only way to get into bios. In all of its 640x480 glory. A GPU will work fine in windows, but until windows boots, it doesn't show anything for me.
He didnt read this comment. He spent weeks trying to figure this out. Then made new video on it. Only if he saw your comment,man 😅
Ah yes, supermicro.
When I started getting back into PCs right before the dark period between rx4-500, I started out with free trash 771 workstations as my younger coworker was really into XP - 7 era stuff. For years he was always pushing supermicro for compatibility. I had a couple over the years but they were never more than 2 memory slots and were basic boards. The one supermicro board I kept was an mATX 1150 board for a NAS that i wanted more than just 1 x16 and 2-3 x1 as I was running sas cards and wanted at least x4 on two. I also already had a shit ton of various DDR3. The board claimed to work with the i3, celerons and E3 xeons, but not the i5-i7s. The single 1150 i5 I had came before the xeon and wouldn't post, but i had another 1150 board coming for my kid's PC at the time (hence the i5 while i waited for the xeon in the mail). His board had a couple of pins smashed down I was able to re-articulate with micro tweezers. Put in the 'tested' i5. No post. Start the process for returning the motherboard, seller is fine with taking it back, the e3-1230v3 arrives. Before I ship the bad pin board I put it in. Posts immediately. I end up getting another i5 that comes up later.
So in the meantime my kid has my nas cpu and my coworker insists that supermicros limited ram compatibility for my particular board is near imaginary. I get the i5 in and swap it into his PC. I put my generic 1333 ecc dell memory that usually works with everything else, no post. I try some matched crucial, no post. I try my all of my 1600 sticks individually, only one stick of random 2GB works. I sell it off to my coworker as he swears he'll get it with his sticks. He ends up going through several sets with the similar results with memory from his server and workstation stash. I end up buying it back to give it another go. The listed sets that were supported were hard to find secondhand except for one set. I bit the bullet and bought the RAM, but then put my nas off until I found a 4 U case I liked and gathered SFP+ equipment. Time passes, I swap the i5 out for another i7 equivalent xeon and pair it with my old rx580 to my kids pc during a case upgrade. For fun I put the i5 in the supermicro with random non ecc memory. Forums, cpu support and bios update documentation all claim the i5-i7 aren't supported. Fucking thing posts. I still have it to this very day, I doubt I'll ever get rid of it willingly, even though I low key hate it lol Only supermicro board I've ever had issues like that with, but damn was it a bad taste compared to their 2011 and 1156-55 boards I'd used prior.
Those epyc need specific torque on each screw to seat properly. You need to find it or get the driver that would have come with the cpu.
did you try mounting the cpu by torquing the screws in the right order to the right torque value? ya know, like you're supposed to?
i love dawid doing the stupid stuf im to broke to do its super interesting and he does the kinds of things i know i would.
this is pretty much overkill science project but it's hilarious that he is trying to get this thing working 😂😂
what build a server 😂
Didn't those Epic CPUs come with a torque wrench. For installation
Nah, it wasn’t in the box. Can’t expect much from eBay sellers. 😂 I’ll get a wrench for the follow up video.
this is 100% mounting issue, normally amd gives you a torque wrench that helps you with the correct force you need to give it
I like the fact that Dawid shows the failures. As any of us who have been immersed in the PC sphere knows, sh*t happens.
I think his failures make for his funniest videos. They're why we are still watching his content.
His channel could be named the idiot with PC parts. It's part of the show.
@@ilichio I would still watch. I'm glad that he hasn't become obnoxious like so many smaller you tubers that think behaving outrageously works just as well and is much easier to accomplish.
The socket specific torque wrench tool wasn't included with your mobo. Ask the seller for it as that is going to most likely be your issue. Notice the tightening order for the screws printed on the cpu bracket? Thats the order you torque them in.
THIS
I'm so incredibly disappointed that it didn't work. I was on the edge of my seat... Glad that you aren't giving up. You are a real hero!
It could be the IPMI needs time to boot before the system powers on. Not sure but the blinking light beside the Aspeed IPMI chip is an indicator. Also, you should torque town those CPUs with the AMD Thread ripper/epyc tool.
Yup. I've a supermicro board and if you power it in immediately after plugging it in, it'll sit there for a minute waiting for the BMC to boot up. I think it even outputs "waiting for IPMI" to the screen.
@@b127_1 Usually fans will already spin up when the IPMI is initializing. But yes, it can mean you'll nervously wait minutes until anything comes on screen.
Those CPUs need to be correctly torqued like the threadripper or they won't work.
Seems like torx bit that you used for tightening down CPU to the socket, was little to big. Might be that you didn't tighten those three torx screws enough.
It could be the fact the mobo doesn’t like not having a power switch, I had this issue with my old 5000psl mobo until I got a power switch from Amazon and tried all the configurations on the panel pins. After that if powered on.
It could be a pressure issue, the three retaining screws on EPYC and Threadripper sockets must be torqued down to a fairly specific amount - if you get the torque wrong (and yes, too high is also wrong!) some or all of the memory channels and/or PCI channels often won't work so that's another possible reason though usually at least ThreadRippers tends to get to the BIOS screen. But since it's a server they MAY have decided you're supposed to check the BMC information for that instead.... The ASPEED Baseboard Management Controller runs completely independent of everything else and you connect to it via the dedicated (third) network port. That should be your first place to check.
All Threadripper retail packages includes a yellow bespoke torque-controlled torx screwdriver that goes "click" when you hit the right amount so they're fairly easy and cheap to get on the second-hand market. I've seen blue ones that presumably comes with at least some EPYC processors (matches the 7xx1 carrier board color) but a EPYC one should work. It's NOT impossible to do this without a torque wrench but it's definitely not trivial even if you've done it many times!
Looking at SuperMicros memory list I'll note that it's VERY small but also that all the few 16GB sticks it does list are 1Rx8 models, not 2Rx4 like the ones you bought.
It does have some larger 2Rx4 sticks so it clearly supports x4 chips which means those memory sticks MIGHT be supported but... risky. From any of the other large vendors the manual would spell out exactly what memory is supported but not with SuperMicro... The other source is various memory vendor memory configurators - Crucial only show 1Rx8 models for 16GB but that might be because the memory chips required for 2Rx4 is, well, long since out of production and they're selling new memory. Kingston's Memory Configurator usually has a side-bar telling you what the hardware supports (in addition to "these current server memory sticks will work) which is really neat but... their entire site is down for maintenance Sigh. The manual does say how to officially run it just one memory stick and one CPU (and 2/4/8) but two cpus officially needs all 16 memory slots populated, I expect this is completely bogus.
1 yes you need the torque wrench
and 2. the memory training takes LOOONG so just give it a solid 2 to 3 minutes once you got it torqued right
These chips are tremendous! Did you get it to work? Ive helped build several for people and always managed to resolve any issue.
Those are torx bit screws, very common anymore at the hardware store for things like deck screws and drywall screws. Make sure to get the right size, there are about 6 sizes all pretty close. They don't slip and cam out under high load like Phillips bits do.
Don't know if it applies to this build or not, but some server boards require some kind of memory cooling shrouds in order to work properly. Guess cause the memory sticks can get a little toasty, but I don't know about these things all that much if at all.
Hi, on my server mainboard, i need to close a contact for open chassis. On a other Mainboard (HP) all FAN Slots need to be connected. is there any clue in the manuel?
I work in data centers, POST time on these types of systems con be stupidly long. I've seen them take up to 45 minutes to come up after a hardware swap, so make sure you're giving it plenty of time.
have servers.... can confirm. To counter my own post I have this setup myself these supermicro boards are not that bad for post time even with whack tons of ram.
Those CPUs are not even suspiciously cheap actually, just a little while back I sold 2 of them BNIB for $130 or 140 each iirc (USD).
Ive seen these combos on ebay and they were very interesting. Thanks for taking the plunge on one of these.
I really dislike this video as it gives the wrong impression. With some thought into part selection you can easily get amazing systems up and running. I have a ebay sourced amd server and had none of these issues.
For first boots use internal GPU from IPMI (to use different one you still must set it in BIOS anyway) and just connect monitor thru VGA, you can also look to IPMI what happening during boot (aka 15 mins boot is normal)
Funny how I for years have made builds from trash picked hardware literally, I can't see a PC next to a trash bin without having to open it and check out what's in it! So watching your channel is strangely satisfying. Guess making a youtube channel is kind of brilliant. Thank you for letting me know I'm not the only weirdo out there.
If this was run in a server, you might need to set up a console via the management port and tell it to turn on. It could be that it's just waiting for the command to start up. Turning on a server board just starts to initialise the management subsystem, think of it as turning on the computer that will turn on the computer.
Zen 1 cores, so no official Windows 11 support hence why it is inexpensive
did any one look at the blinking green led maybe thats telling u a post code i would start their
Those Supermicro motherboards turn on without cpu and ram. Try connecting the network cable to the IPMI port, look at your router if give an IPADDR then try this IP on your web browser.
Motherboard SDCard: in servers it is sometimes used as a boot device for a lightweight hyper visor such as VMWare.
4:06 bro was really amazed a screwdriver set had torx bits
might not be torqued down correctly for the cpu(s) though , had similar issues before (using a 2990wx).
It likely works. You just don't have the torque wrench that is normally included with the cpu's. And they are VERY sensitive to torque. If you are even 1 Nm out of spec they can just refuse to work.
5:23 not enough thermal paste, that is ~50% of what you really need.
The torque on the cpu and heatsink needs to be 1.4 Nm.(just use a t15 bit and electric screw machine)
Also if you connect by ipmi you can check sel log ( useful if you get errors) can check sensors and more. (you can use a serial cable for it it believe)
Another thing that could be the issue, (i dont have experience with server hardware) it could be the fact that both cpus werent populated and also like most of the comments say that the cpus werent torqued to spec. just looking at something that could also be a potential issue
I kept screaming at the screen "You need the correct amount of torque!"
EPYC doesn't have a southbridge/chipset. The CPU is an SOC.
A couple years back I sold a quad-socket opteron 6386 SE system, it was fun to tinker with, but it used an excessive amount of power.
4:30 That entire section was incredibly satisfying to watch. :3
4:10 though
This is me, but with vintage hardware (i.e. anything older than Core 2 Duo).
Server hardware is notoriously fussy about memory, CPU compatibility, et cetera. Good job engaging your local community to try and find out what was going on with it.
Also, I'm pretty sure those slots on board are SAS cable slots, but without looking at the manual I can't be for sure.
It's funny to see somebody who's never seen server hardware look at the special ports or features that usually don't find their way into the consumer space. I'm pretty sure that one of those RJ-45 ports is for ipmi since this is a server board. Also be aware that the mounting pressure for those chips is rather precise. They usually come with a special key that only allows you to tighten it as much as it is required.
We have some Eipc Server at work. the System needs about 2min to POST and a GPU is not needet. graphics runs over the MegaRack IPMI software. In the web interface you can also see debug infos like RAM, Speed, Channels, CPUs ect... An you can boot it up from there. i recommend to connect a screen and keyboard/mouse to the IPMI Ports.
edit: you need nothing in the board to enter the IPMI Interface ^^
imagine its just the cpu power connector not receiving the correct power specifications.
I love it when Dawid Does Tech Stuff!
I got the same combo but one CPU socket and you can run the cpu with 1 or 2 memory slots just fine, look at the memory bank population map. Probably A1 and C1 is paired.
It's server hardware and you don't have a CMOS battery installed, even in the clip where you're resetting it.
I've seen consumer grade hardware that refused to boot with a bad one before.
Should try that if you haven't!
Exactly, I would not be surprised if the board would come to life as soon as there is a battery installed :)
Epyc has a security feature that will require you to run in a specific vendors motherboard. So it could be vendor locked.
as soon as is saw him putting in those cpus i knew the contact would be terrible. im sure hell be fine in the follow up
Usually you need some really strong coolers for those cpus. Also power consomption and some lets just say different standart power connectors are thing on server mobos.
The stronger coolers are a LGA 3647 thing not AMD tr4/SP3 the cpu hold down is just fine as long as the cpu is clicked in by the rails or if the socket screws havent gotten lose
The fans on those coolers will SCREAM, they will do the job.
This is server stuff, designed to not be around people.
We're gonna need to call in backup from Wendell
Just got a similar setup to work after wasting a day on it... the torque is important, but after all else failed... it ended up being a jumper for vga.. it will not run with vga jumper disabled and a pci-e graphics card. It will boot fine if both are present and that jumper is enabled, but the primary will be the VGA out until you get to BIOS and select offboard. Leave the VGA jumper enabled. Might not be your issue, but that was my entire problem. It looks like the same board I have, same CPUs and cooler. Once it's running, you could also use the IPMI to diagnose further (that's the blinking led telling you that part is ready to go), but it most likely has stored passkeys you'll need to reset with a DOS usb boot drive. Fun fun! EDIT: Once it's running.. to use that NVMe as a boot drive, there's a section in bios where you need to set it to AMI Native instead of vendor. It will show up during installs, but will NOT boot from it with that set.
I love the 1980s self realization comedy movie soundtrack you always use.
Shenzhen is the guang dong-iest place for products. I've gotten some happy lasers from that region for about 1/3 the price of other sellers. Of course, there's the 1 month of waiting for the delivery, from some parcel carrier called Yanwen, but it's all good.
I hope you enjoy your underwater time with the 64th Marine Corps, because I don't watch the video, I just read the title and make a comment like a humongous Guang Dong.
hell yeah lets gooo the next videos on this server stuff will be so freakin awesome
I NEED to do Dawid with a silly machine doing dastardly things to it. That is all. Love the channel.
"Okay, so. Big problem, I didn't do enough research going into this video. Which is quite normal..." Dawid is rocking that self-awareness.
that scream LMAO, that is me after being frustrated with computers also 🤣🤣
0:10 : **dying Arnold Schwarzenegger noises**
The LED was flashing, did you look to see if it is an error code? Server boards do that kind of thing.
I recently bought an EPYC CPU and Motherboard from who im guessing is the same seller, packaging was identical with the same blue tape on the box. Mine is working great! I didn't have the torque wrench so I messaged the seller and he installed the CPU for me before shipping.
I am in the same troubleshooting situation with a t7810 mb and a Xeon. I don't know which pins to short to jumpstart it and at one point the GPU fan spun but nothing else. The partners of Dell I wrote a letter to asking for the pinout just gousted me. If somebody here has experience with server boards, please respond to me. I know this isn't the place to write about these problems, but nobody on the forums knows how to figure it out. Also, can't wait for the follow-up video.
8:33 The RAM came as soon as "Prime"
check the cmos jumper sometimes it gets left on clear cmos
i just built a mining rig from one of these, i couldnt get it to boot from the sata, had to run a usb to ssd and it worked
i caught your vids on and off for the past couple years now. dont know why ive never subbed till now... great stuff
Love your vids!
1:19 No? First thing that punches MY face is missing CMOS battery.
I knew right away that that wasn't nearly enough thermal paste. I believe those CPUs have multiple dies, so the dies are not actually in the center, making it even more important to get good coverage with the thermal paste.
I just watched your video again and noticed your motherboard is a Supermicro H11DSi. This changes things. If it’s a rev1 then it’s more likely you have vendor locked CPUs. If it’s a rev2 then is very likely you have a Rome bios and need a Naples bios
Don't forget your TR4 torque wrench. The mounting pressure has to be so exact that they have a special tool in order to mount it properly
you need specify dynamometric screwdriver for epyc socket.. each screw needs 14.2 in/lbs of force :) ( a and locked CPU with motherboard .. )
I havent played with server spec hardware in a LOOOONG time; but back when I did - the PSU connections LOOKED like ATX, but werent, you could plug in an ATX PSU - but it would kill the mobo as all the feeds were in the wrong pins.
Ditto plugging a server PSU into a normal mobo.
My ebay Xeons work great, but I did have some problems with them initially, because the CPUs weren't settled in the sockets perfectly correct on the ebay Asus workstation board
even with the torque set correctly these cpus are super bad at having all the pins contact, mounting pressure on the heatsink matters aswell, its a nightmare
Since it has build in VGA, you don't need a dedicated GPUsimply for boot up testing.
Boot sequence LEDs might be of use here. If the board is working, it would indicate some error code.
ok so one of the network ports if for ipmi and i think the microsd is for iso storage so you can remotely install the operating system. i have the 7551p wich is the single socket variant wich is pretty good. my front io connectors on my supermicro motherboard where kinda funky. it worked when shorting to the pin below for me but not with the pin to the side wich was listed in the manual. you should also be able to reach the ipmi even if the system isnt powered on
I wish I could get my hands on those server components for that price. What a bargain (assuming you will get it to work).
Those are amazing for virtualization.
We have one of those at work and they kicked the living crap out of the old xeons we had before.
So good luck to you getting them running! And if you do, enjoy this great system!
Damn I was excited to see this running. Guess I'm just gonna have to wait :)
I was actually thinking to get a double-cpu workstation from dell or hp. Turns out you need a special OS too.
I didnt get as far as actually gaming, but i am not sure if games can even utilize two CPUs.
Didn't realise supermicro did mini-SAS connectors directly on the board, I might actually look at getting a supermicro board (probably not epyc based tho lol) for a home server setup. Great vid :)!
i also think is CPU pressure related, but you can also take a look at the IPMI errors
you need Register-ECC Ram (RDIMM) modules for Epyc CPUs.
Wish I knew this before using that old DDR4 RAM I I had sitting around lol, extra 100 dollars now. RIP me.
You need the orange ryzen torque screwdriver, to seat the cpus.
Else they wont work
Just good to know that kinda stuff exists, thanks, Stefan
9:04 I would say it is too expensive in terms of power budget, but looking at all air-cooled servers blasting their fans at 100% to barely keep thermals in check (while consuming up to 30% of total server power).... Yeah, maybe some RGB wouldn't hurt.
Also, servers with water-cooling for the whole rack consume only 2-3% for the cooling, while managing to run with freecooled water (simple water-to-air heat exchanger outside, without chillers) at lower temperatures
"once I see that not working" lolol Don't give up!
Lol, I immediately saw the lack of torque wrench and cringed. I'm not even 5 minutes in
getting a used epyc is not a bad idea - yeah you ran into some issues but do a followup and add a big gpu to do some ai - it should work great and this is the type of systems people will want going forward just for the prolific pci lane count - it matters when you want a couple gpu and a bunch of nvme for a server or virt host -and ai - gaming may not be the best but pc and gaming is in a major depression until next gen parts which is 18 mos away for wide availability - maybe you can just go with one socket sp3 next time - lack of reading the manual and proper tools hampered the effort here but at least you made some educational content
it should have an IPMI with a separate interface no ? it could say what is not working since the IPMI usually has its own hardware to run separetly
Random thought does this motherboard have a case intrusion lock out?
EPYC cpu retention brackets need to be torqued to specific spec, thats why they come with a tool that auto torques them to required torque. could be you didnt tighten them enough and not all pins are making contact.Or you did it too tight and broke it lol
Are you 100% sure that the motherboard supports the version of EPYC you are putting in it? Might need a BIOS update.
are you using registered ECC or unbuffered ECC?
You sound like Arnold Schwarzenegger when you yelled lol
LOL, aw no way, I was just looking at the same board and epic processors not more than half an hr ago....only I was wishing had the extra 400 or so laying around to go for it....crazy little coincidence.
Nice Arnold Schwarzenegger impression. It was dead on.
A lot of server hardware won't power up without a CMOS battery.
I would of reset the BIOS, because the last owner could of had remote networking control on, eg on and off capabilities via network. Sick video