Takes like 10 years max. I myself have a dual socket serverboard from Supermicro as well, bought 2 Xeon E5 2697v2 which had a 2013 release price of 2.600$ and bought them for 60€ each
Kudos to Jake and team to actually shoot the whole video in almost 1 hour (based on the start time 12.06 to 1.11 at the end in Jake's watch) It's mind-blowing scene changes have happened in matter of minutes, attaching monitor and booting it, etc, too little time in every step very efficient guys
I did desktop support for an oil and gas energy company (before the lockdown) that specialized in deep water exploration. The geologists there processed seismic data to find oil deposits. They had monster workstations with crazy Quaddro graphics at every desk. I could definitely see this type of machine going in to some of their homes.
I actually studied some of the algorithms used for calculating interface boundaries in seismic data in my Simulation Science major and it was pretty damn interesting... But damn the math was hard xD
Hope the sponsor is not mad cause that line made me actually watch the entire thing, which I usually always skip, I'm sure others did the same. 9001 IQ marketing
Really. What was gained by unplugging water lines or trying to remove a graphics card? Maybe the next video is Linus getting invoiced for the computer if he left one of the waterlines unhooked. lol.
@@the_omg3242 Showing how easy they were and that they don't leak when disconnected? Dry breaks are pretty cool. Pointing at hardware and handling it is very different content.
Well done Jake! You totally owned this video, your excitement is infectious! It kept me engaged, I went into this video thinking ok I'll click to see without the intention of watching the whole thing. Keep it up bro!
I used to work for an SI. I got a phone call from some lovely people at Google who needed help fixing their $60,000 Desktop that was a lot like this. It was a Thelio Massive workstation with a couple of Platinum 8280 CPUs and 3 NVIDIA A6000 GPUs. It's not quite this but it came close to it. Those guys were using it for machine learning experimentation. which would be the same application as this system. It was a stressful phone call. I know nothing about machine learning. Fortunately those Google peeps were so hyper focused in their profession that the problem was their system stopped booting because their experiments filled up all of the storage in their system so fast that they didn't even know what hit them and they needed help booting into a Live disk and clearing some of their crap out of the storage.. These super desktops are incredible, and incredibly stressful when they aren't working as expected. Imagine doing an RMA for a $60,000 to $80,000 computer. No thanks. That won't be fun for any party involved.
@@prashanthb6521Just because you know how to build AI models does not mean you know how to build a PC. My friend who works in ML couldn't boot a live USB
@@prashanthb6521most developers can't reinstall their own os Basically because web developers never really had to? (And we web developers are definitely the _most_ developers by headcount)
@@danielthedoc It really depends a lot on how you got into data science. I started my career in computational physics and built several simulation rigs from scratch--including working directly with Dell to spec and set up a $50k Beowulf cluster. This was back in the days before there were dedicated data science degree programs. Meanwhile a lot of my colleagues got masters in data science and have worked exclusively through cloud computing, where you have neither direct hardware access nor any reason not to use Windows or macOS.
I know Jake has hosted various things before but... I think he's done exceptionally well at CES. His presenting has been spot on and his video's are really engaging. Well done that man 👏
@RandomUser So people showcasing techs' latest products is boring to you? I would suggest you're watching the wrong channel and your time is being severely wasted. Try a Mukban or sewing channel, they maybe more relevant to you.
@RandomUser The whole point of attending CES and filming in hotel rooms is so they can bring us the latest tech as fast as possible. So just because of the surroundings and video production, you would prefer to wait until just before a product is released to hear/see the details of it? I would think that 99.9% of people are grateful that companies/creator's such as LTT, Paul's Hardware and many others travel to Vegas to get us the latest information on upcoming products. I know I am.
@@katrinabryce Depending on the game, it could be stellar; it wouldn't be a dog, in any case. But for five grand, you can have something that will run any game at full chat anyway. (I do have a dual-processor Xeon box a few feet away, it's a data handler, not a gamer.)
@@Blooest dog if the computers off with all variables ignored like a silent room you could hear your sisters panties dropthen you wouldnt need to refer to a None running computer outputting 0 decibels Like nigguh wat Refer to it Idling compared to it under full load
IBM, Dell etc. To be honest it's been a while since I've dealt with servers directly. But Super micro were always good. We had Dell and Tyan servers back then too.
@@isaacbejjani5116 HP Enterprise has revenue that's 5 times larger than Supermicro. Lenovo is even bigger. Yes, Supermicro isn't small, but it's hardly the largest.
I wouldn't say HOME USE but for lab use this is awesome! It's waaay faster than some supercomputers available on universities. Als as a single system is easier to upgrade and maitaing if you don't have datacenter like infrastructure! Only a 30A outlet and it's flying
Remember the regular blade servers are 1RU (1.75") high. To get air across that area in that confined a space with a small fan/blower you need high RPM. This tower can house large fans and thus run slower for the same airflow. The 12V bus bars are classic server rack. It would be very cool if Supermicro advocated a move to 40 or 60V for distribution. Much thinner wires and its the standard voltage in rack systems. It can also be less regulated as long as its clean.
I’m the target customer for this system, and I’m very impressed. I’ve built an AI deep learning workstation and know the industry options and this is a very compelling prebuilt workstation option.
@@Rynnakkosampyla He just told you, like Jake on the video. Its used to train AI's (Deep Neural Networks or other algo). Those algorithms are very hard to train correctly and most of them can only be trained well in machines like these or else would take years on regular hardware...
@@Rynnakkosampyla I wanna know how much Horsey this thing can spit !?! That's a $#!T LOAD of Power in 1 Box ! Like a mini Sever Farm on your Desktop. I see Intel is "ALMOST"close,(cause that is ONLY 56 cores)up to catching AMD in to the core counts. Took them LONG enough ! They had to steal 1/2 of AMD's engineers to get the job done,especially working on 10nm,i wonder if they still got that right? If you ever looked in your bug log,it would scare you. It happens ALL the time.Intel,AMD or ANY others. BUGS in Hardware & Software are SO common,it's like fleas in your backyard. You just don't notice them. The OS handles them,unless you get the the 1 nasty screen,and you know what i'm talking about,the blue or old black screen of death. Everyone JUMPED when the BIG bugs Meltdown and Spectre hit the scene. 😱 If you look back in history on both sides of the fence,them bugs crop ALL the time! They need to catch them before 1rst rollout,but that doesn't happen. More testing should be done in 3rd party,but that would negate their tight @$$ Security procedures. Just look at the burning NVIDIA plugs as an example. Sure they had alot of R&D with the consortium,but then they put the MEAT to it! I just think that's too much power for that plug,simple! As a retired EE,i call it as i see it. If it smells,it stinks! 😎
@@jonathanthomas2449 it's about as suspicious as not knowing why a door moved on it's own, there are about 1000 boring explanations none of which are as entertaining as a falsehood
@Soyel if using a plumbing fitting for plumbing is “repurposing” then I must need to brush up on my English. To be clear there were no automotive fuel rails in the PC in the video.
@Soyel what I’m saying is that using a pipe thread to barb fitting to connect a hose to a threaded port when the system is designed for exactly that is not repurposing anything. It’s using the stuff for its original purpose. Another way to put it: if that company pulled washer fluid reservoirs out of junkyard Toyotas and put them into an $80k PC, then yeah, that’s repurposed. But all I saw was general-purpose fittings and hoses, and building things like cooling loops is what they were originally intended for. Anyway, I’ll give up first on the semantics argument, because that’s all this is.
As someone that has been assigned with a similar workstation recently, I really hope for Jake's confidence in removing those tubes scrub onto me somehow.
We need to see them do a side-by-side comparison with this monster, the million dollar server, and just any high-end hardware and do some machine learning stuff just to show us how powerful these things are!
Jake is one of my favorite people from this channel, he talks about everything with a clear passion. He loves what he does and it makes me love watching it even more
Same! I want to see how fast this beast able to do, when it runs all the benchmarks on Blender, VRay, Octane Render, Cinebench, etc. 😃 A $80000 USD Machine should be blazing fast! ⚡
My 8 year old daughter just took a polaroid of me sitting at my desk bc she got one for christmas, and jake is in the background. forever in my family photobook jake
@@mikwit I still have free access to more powerful GPU servers (4x MI250) via university. Lamda are quite expensive. I hope the A100's will show up on ebay for a couple hundred bucks in a decade or so :)
@@ProjectPhysX You can get a P100 on eBay cheap as chips ($300) and for none AI work they are ~60-70% the speed of an A100. We just brought a whole bunch because the A100's were being tied up with MD work causing issues for those wanting to do AI work. Yes we benchmarked it before get the P100's in (we had a single P100 for available for that). The V100's are still too pricey.
@@jonathanbuzzard1376 yep I've seen them on ebay :) For my purpose, I actually don't need FP64, but large VRAM capacity instead. There is loads of Tesla M40/P40 24GB for ~140/230 Euro on ebay right now, which is super cheap. I just don't have a server to put in 8 of these :D
Makes a lot of sense for something like structural biology. You can run Teams on Linux (and I do), but you'd probably have a system like this maxed out with real work and have a second computer for things like email and calls.
I couldn't hear the cooling on this thing over the sound of my WFH laptop, which I use to connect to an equally expensive server which is nowhere near as powerful. Actually impressive.
The red coolant is the same color as what my truck uses. I started to use it for my DIY cooling in my system. I dilute it down a bit more due to the smaller pump I use, but the diesel coolant is the best one can use. Great wetting, freeze, metal compatibly, and anti-alga. Also is warranted for three or more years. Unlike car motors, commercial truck motors need good cooling and manufactures can not skimp out on QA due to large fleets have the power to switch coolant if one causes breakdowns that cost $$$$$.
I thought that remote working would be internet oriented but it *is* possible that the next major iteration of computers will be more akin to a furnace or more likely a water heater.. you get it with the house and replace it when it needs to be but every place is expected to have one and you can just plug in a monitor (which is where you will connect your mouse/keyboard) anywhere and go from there.
Central computing will definitely be a thing, no doubt about it. Linus' setup seems ridiculous, and it is to some degree, but even a lower end system to automate your house from a centralized location would be pretty affordable and could easily be left with the house for running the automation for the next owner.
Caveman discovers thin clients. Jokes aside, are thin clients not exactly the use case that you're describing? For 2k you could build a server to meet the general purpose needs of a family of 4 as a permanent installation, not 80k. There is neither a technical nor cost obstacle. For now, people care as much for such a central computing system as a central vacuum system - the obstacle is demand!
@@chatboss000 Thin clients don't work for gaming, especially not with a 2k server. While it's kinda possible, you need a dedicated GPU per client, and won't be able to play games that use anti cheat. Additionally, you'd likely need fibre to all the clients with the video signal, and the kind of boxes that send video over fibre (or thunderbolt) are rather expensive. You could use wifi streaming, but then you get compression artefacts and jitter. Of course, if you're not gaming then it might be okay. Except people have phones and/or chromebooks. Why pay $2k + extra (clients & network infrastructure) when everyone has a phone anyway. One use case is for software development or something similar, but that's hardly for a family. Thin clients have a use, but it's not for families. The overhead is too high, and they don't support the one use that requires high performance (gaming).
When I saw the rear fans I laughed. They remind me of the loud-ass fans that were in my first computer: A 386!! It's great that they kept the noise down!
Seems like Supermicro had some spare 2U rack systems and some clever clogs was like "hang on... they'll run stood on their side, right?" This feels very much like a stealthy beta test of closed loop AIO for enterprise ML/Tensor rigs, it's basically a third-party take on an NVidia DGX pod. Very interesting. I'll be glad to see more AIO/rad loop cooling for enterprise and high performance server stuff like this, our apps rooms are full of tiny turbines crammed into Dell and HP server chassis and I'm fed up with going deaf from working around them.
Gotta love needing 3 dedicated 240v circuit for your office one for your ai server/workstation one of the air conditioning and one for your workstation plus just normal stff you have in an office
As a mechanical engineer, this workstation is wonderful. This would make running COMSOL Multiphysics simulations actually viable at either an individual engineers desk or at their home (if they're working remotely) without having to load the small jobs onto a compute cluster at work like you do for large jobs - time on the big compute cluster at work is a premium so currently small jobs don't get much time so designs don't get optimised anywhere near as much as would be ideal. This is a game changer.
Fascinating. I imagine equipment like this would change AI and simulation workloads from a labor based model where engineers and scientists are constantly waiting for servertime (history sure rhymes a lot, doesn't it?) and companies have to pay many engineers a good salary, to a capital intensive model where large incumbent corporations with capital backing can afford to invest heavily in poaching the most productive engineers and scientists and giving them capital intensive home AI deeplearning workstations that rival the capabilities of midlevel businesses. Maybe this might spell a mass layoff of AI engineers in the future as AI research gets consolidated into the companies that can all 100 engineers one of these and do the work of 100,000?
@@RagingAura I doubt it would change much regarding AI deep learning workloads as basically anyone with an average machine can already utilise most gaming computers for that as currently one can buy or lease a dataset, so training either isn't required or is only required to fine tune the AI. To be honest as a mechanical engineer I do very little with AI - it has zero relevance or place in mechanical engineering. In Australia, engineers get paid poorly just like all top-talent. Basically in Australia businesses only want people who'll accept garbage wages whilst being top-talent. This is why many people, myself included are moving abroad where better pay and opportunities exist - a colleague and I are going to start our own engineering business / consultancy once out of Australia. As mentioned in my initial comment, this machine would be amazing as it would mean I'd be able to setup and run one multiphysics simulation every two days (runtime is about two days for meaningful results) unlike the current situation where I have to book time on the main compute cluster at work (one week of waiting) and then get results in 4 hours. Multiphysics isn't something that can be done by AI as it requires a human who understands the intent behind the design to configure and setup the simulation. The time consuming part is the actual calculation which is multi-threaded for as many CPU's as you have a licence for (the licence only cares about sockets, not individual threads as it uses as many threads as are available). There isn't any such job as AI engineer, only programmers who setup AI. Engineering is a strictly regulated industry with only a few fields (Mechanical, Civil, Chemical, Electrical and Biomedical) - beyond that people are illegally using the title engineer as there are no other legally recognised fields of engineering. The term engineer can't just be applied to any other term or role as that would be completely illegal. Currently, proportionately only a handful of people in general are employed by most large businesses (compared to pre-1980 employment statistics), pre-AI servers with automation software eliminated 98% of common jobs in the early 2000's. AI has only eliminated all remaining "office" jobs where automation software couldn't. I can tell you for a fact that one server racks worth of equipment, two mechanical engineers and one person to do the accounts and phones is all that is needed to do serious work in the space and defence industry - teams of people are no longer needed and are only found on projects that require 24/7 work to be done - i.e. rotation of teams such as a day team and a night team.
Can't wait to get one of these at a garage sale in 50 years
Dang your comment was reposted by a bot
I dont think it ll take 50 years
Takes like 10 years max.
I myself have a dual socket serverboard from Supermicro as well, bought 2 Xeon E5 2697v2 which had a 2013 release price of 2.600$ and bought them for 60€ each
It'll be a lot less than that.
nah, 5-10 max before this becomes 'affordable' for us plebs.
Kudos to Jake and team to actually shoot the whole video in almost 1 hour (based on the start time 12.06 to 1.11 at the end in Jake's watch)
It's mind-blowing scene changes have happened in matter of minutes, attaching monitor and booting it, etc, too little time in every step
very efficient guys
Experienced crew, Jake has his talking points together, Linus isn't there. Yup, makes shooting very smooth.
Nice observation!
Start your day at 12:00, log the whole day and go 🍻 at 1:15.
I did desktop support for an oil and gas energy company (before the lockdown) that specialized in deep water exploration. The geologists there processed seismic data to find oil deposits. They had monster workstations with crazy Quaddro graphics at every desk. I could definitely see this type of machine going in to some of their homes.
I actually studied some of the algorithms used for calculating interface boundaries in seismic data in my Simulation Science major and it was pretty damn interesting... But damn the math was hard xD
What specs had that machine and what software ran the seismic data?
@Teluric2 it's been a while. I dont recall the software. Most of the pcs were from the HP line with multi Xenon processors.
Honestly, I believe this was the best segue to a sponsor you guys have ever produced. Congrats! The award goes to Jake!
Yeah! So funny! And, ironically, not as $H!T as he said it was! 😂
Hope the sponsor is not mad cause that line made me actually watch the entire thing, which I usually always skip, I'm sure others did the same. 9001 IQ marketing
Ah yes, a computer made for my house that's more expensive than it.
@Sarika Gaming no
@Sarika Gaming spam
@@harmonic5107 this seems to be the new scam, it's creative at least lmao
@@GOPACKERSJT they are probably going to send anyone who tries to help a bad TeamViewer link or something. Gross, but at least it's new 🤣
@Sarika Gaming I love the video you posted of that Minecraft gameplay. Can you teach me how to play it?
The computer's cooling might be quiet but I imagine the necessary room cooling would add to that noise floor
A heat pump doesnt make that much noise. Thats why people live with them in their homes
maybe if you live in a small apartment. i have central AC so for me it wouldn't make any difference. the AC units are outside
Winter only computer
@@solomonshv but even im small apartments if you keep it outside you don't hear it
When will 4060 graphics card be launched please tell me guys
5 years from now, this will be in an ebay listing for $500.
Sadly I think it might be closer to 10 years
just like the dual xenon super stations...
bought one myself for 550 and it screams:)
Stellar job hosting this one u seem alot more natural, at ease and genuine. Amazing content Thanks yous guys
Was that a sneak diss at Linus😂
not my intention but it guess it speaks for itself... I love Linus, he sounds like Steve Carell and acts a little like Michael Scott.@@bandito241
I've been loving all of these CES videos. Each time I think "And that was the last time the LTT crew were invited to a demo room."
Really. What was gained by unplugging water lines or trying to remove a graphics card?
Maybe the next video is Linus getting invoiced for the computer if he left one of the waterlines unhooked. lol.
@@the_omg3242 Showing how easy they were and that they don't leak when disconnected? Dry breaks are pretty cool. Pointing at hardware and handling it is very different content.
@@--_DJ_-- and it's very good marketing for their product to show that it's a nice dry break as well.
@@the_omg3242 It's likely that Supermicro had the no-leak quick disconnects as a marketing bullet point and they wanted to show it off.
Oh boy you should see the CES coverage from several years ago that started the LinusDropTips meme. The man was a tornado.
they oughta make one optimized for use as a local VFX/CG/video render farm while they're at it.
Agree
Already do. 10 GPUs in 6U.
@⚠️Don't visit my channel bot.
it is optimised for AI use
ROFLMAO, they do.
Well done Jake! You totally owned this video, your excitement is infectious! It kept me engaged, I went into this video thinking ok I'll click to see without the intention of watching the whole thing. Keep it up bro!
This was so cool, I love when you do server or dedicate machines' stuff
I used to work for an SI. I got a phone call from some lovely people at Google who needed help fixing their $60,000 Desktop that was a lot like this. It was a Thelio Massive workstation with a couple of Platinum 8280 CPUs and 3 NVIDIA A6000 GPUs. It's not quite this but it came close to it. Those guys were using it for machine learning experimentation. which would be the same application as this system. It was a stressful phone call. I know nothing about machine learning. Fortunately those Google peeps were so hyper focused in their profession that the problem was their system stopped booting because their experiments filled up all of the storage in their system so fast that they didn't even know what hit them and they needed help booting into a Live disk and clearing some of their crap out of the storage.. These super desktops are incredible, and incredibly stressful when they aren't working as expected. Imagine doing an RMA for a $60,000 to $80,000 computer. No thanks. That won't be fun for any party involved.
threading the fine line of a NDA with this info xD
This is unlikely but .... Are you saying they didnt know how to boot into a Linux Live USB ? Were they adept at only Windows ?
@@prashanthb6521Just because you know how to build AI models does not mean you know how to build a PC. My friend who works in ML couldn't boot a live USB
@@prashanthb6521most developers can't reinstall their own os
Basically because web developers never really had to? (And we web developers are definitely the _most_ developers by headcount)
@@danielthedoc It really depends a lot on how you got into data science. I started my career in computational physics and built several simulation rigs from scratch--including working directly with Dell to spec and set up a $50k Beowulf cluster. This was back in the days before there were dedicated data science degree programs.
Meanwhile a lot of my colleagues got masters in data science and have worked exclusively through cloud computing, where you have neither direct hardware access nor any reason not to use Windows or macOS.
I know Jake has hosted various things before but... I think he's done exceptionally well at CES. His presenting has been spot on and his video's are really engaging.
Well done that man 👏
@user-kn8ks2vj2q Yes it is.
when is this CES hotel room video BS finally over and we can go back to quality content and interesting videos?
@RandomUser So people showcasing techs' latest products is boring to you?
I would suggest you're watching the wrong channel and your time is being severely wasted.
Try a Mukban or sewing channel, they maybe more relevant to you.
@@jaytee444444 no I like showcasing new tech. But in a properly produced video and not some hotel room smartphone video.
@RandomUser The whole point of attending CES and filming in hotel rooms is so they can bring us the latest tech as fast as possible.
So just because of the surroundings and video production, you would prefer to wait until just before a product is released to hear/see the details of it?
I would think that 99.9% of people are grateful that companies/creator's such as LTT, Paul's Hardware and many others travel to Vegas to get us the latest information on upcoming products. I know I am.
The thermal and acoustic design on this is bloody impressive.
Really enjoy seeing neat enterprise equipment on LTT
I love that you sent Jake, Alex and the rest of the team to report on those.. epic coverage so far.
Ah yes, this is exactly what I need at my house, who needs a gaming pc?
soon games will be driven by neural networks so these computers will be your gaming pc.
imagine watching UA-cam on this bad boy
Bring ALL the homies round for game night
This probably won't actually be that good at playing games.
@@katrinabryce Depending on the game, it could be stellar; it wouldn't be a dog, in any case. But for five grand, you can have something that will run any game at full chat anyway. (I do have a dual-processor Xeon box a few feet away, it's a data handler, not a gamer.)
I LOVE the idea of a tower case you can rack mount. Keep showing more of that!
This does look like a very capable server, in a home form factor.
For future reference, I don't think I'm alone when I say I'd love to see a decibel test on the computer's noise on vs. off!
Great video as always
pretty suer a computer thats off makes no noise lmfao
@@DahSkinniestKEECAT Even though the system is off the cameras/lights/background will all make noises..
@@DahSkinniestKEECAT That's the point. Metering with the computer off as a reference point for how loud the computer is when it is on.
they probably didn't bring sound level meters with them when they traveled to CES lol
@@Blooest dog if the computers off with all variables ignored like a silent room you could hear your sisters panties dropthen you wouldnt need to refer to a None running computer outputting 0 decibels Like nigguh wat Refer to it Idling compared to it under full load
I've always been impressed with the Supermicro servers. For the price, they are well spec'ed compared to bigger names and are pretty reliable.
There aren't really brands bigger than supermicro. They just haven't sold stuff under their own name historically
IBM, Dell etc. To be honest it's been a while since I've dealt with servers directly. But Super micro were always good. We had Dell and Tyan servers back then too.
@@isaacbejjani5116 HP Enterprise has revenue that's 5 times larger than Supermicro. Lenovo is even bigger.
Yes, Supermicro isn't small, but it's hardly the largest.
this thing gives me the chills, I love workstations like you wouldn't understand
Very impressive Workstation! Nice video! Thanks!
Can't wait for "can it train an AI to run Crysis" to be a reality.
Nice Idea, I will be working on it.
I wouldn't say HOME USE but for lab use this is awesome! It's waaay faster than some supercomputers available on universities. Als as a single system is easier to upgrade and maitaing if you don't have datacenter like infrastructure! Only a 30A outlet and it's flying
Ah. That answers my question as to what this thing plugs into. Thank you.
@@NoirpoolSea Standard EU outlet.
@@NoirpoolSea in brazil ee have a standard for 20A plugs that run on ordinary circuits. This plug in 220v can supply all the power
One of the best segues to your sponsor in a hot minute.
Remember the regular blade servers are 1RU (1.75") high. To get air across that area in that confined a space with a small fan/blower you need high RPM. This tower can house large fans and thus run slower for the same airflow. The 12V bus bars are classic server rack.
It would be very cool if Supermicro advocated a move to 40 or 60V for distribution. Much thinner wires and its the standard voltage in rack systems. It can also be less regulated as long as its clean.
Finally, a computer that meets Windows Vista's minimum requirements.
But can it run Crysis?
Better stick with Linux , just to be safe.
@@Decipher13 only on mid settings.
It just gets 7.8 in windows experience index
I ran vista on a 500mhz celeron
I’m glad there’s lots of good CES content this year. Would be nice to have a look at some more obscure stuff as well next year.
One of the best PC-based reviews out of Jake from LTT courtesy of Supermicro's ingenuity with this SuperWorkstation.
When he pulled on the tubing / quick disconnect my heart sank.
I’m the target customer for this system, and I’m very impressed. I’ve built an AI deep learning workstation and know the industry options and this is a very compelling prebuilt workstation option.
Could you clarify: What are some of the practical applications for a workstation like this?
@@Rynnakkosampyla He just told you, like Jake on the video. Its used to train AI's (Deep Neural Networks or other algo). Those algorithms are very hard to train correctly and most of them can only be trained well in machines like these or else would take years on regular hardware...
@@Rynnakkosampyla I wanna know how much Horsey this thing can spit !?! That's a $#!T LOAD of Power in 1 Box ! Like a mini Sever Farm on your Desktop. I see Intel is "ALMOST"close,(cause that is ONLY 56 cores)up to catching AMD in to the core counts. Took them LONG enough ! They had to steal 1/2 of AMD's engineers to get the job done,especially working on 10nm,i wonder if they still got that right?
If you ever looked in your bug log,it would scare you. It happens ALL the time.Intel,AMD or ANY others. BUGS in Hardware & Software are SO common,it's like fleas in your backyard. You just don't notice them. The OS handles them,unless you get the the 1 nasty screen,and you know what i'm talking about,the blue or old black screen of death.
Everyone JUMPED when the BIG bugs Meltdown and Spectre hit the scene. 😱 If you look back in history on both sides of the fence,them bugs crop ALL the time! They need to catch them before 1rst rollout,but that doesn't happen. More testing should be done in 3rd party,but that would negate their tight @$$ Security procedures. Just look at the burning NVIDIA plugs as an example. Sure they had alot of R&D with the consortium,but then they put the MEAT to it! I just think that's too much power for that plug,simple! As a retired EE,i call it as i see it. If it smells,it stinks! 😎
I'd be very interested in this if it didn't cost 4X my yearly income lol
@@jonathanthomas2449 it's about as suspicious as not knowing why a door moved on it's own, there are about 1000 boring explanations none of which are as entertaining as a falsehood
I think the 3-month design window might be the most impressive part about this workstation!
Great engineering. Nice to see supermicro thriving.
Loving the hardware store hose clamps on those cpu lines. Screams budget back yard build.
Repurposing fuel rails and industrial fittings for water-cooling is pretty awesome.
I wouldn't call it repurposing lol. That's what they were made for in the first place.
@Soyel a plumbing fitting is a plumbing fitting, no?
@Soyel if using a plumbing fitting for plumbing is “repurposing” then I must need to brush up on my English. To be clear there were no automotive fuel rails in the PC in the video.
@Soyel what I’m saying is that using a pipe thread to barb fitting to connect a hose to a threaded port when the system is designed for exactly that is not repurposing anything. It’s using the stuff for its original purpose. Another way to put it: if that company pulled washer fluid reservoirs out of junkyard Toyotas and put them into an $80k PC, then yeah, that’s repurposed. But all I saw was general-purpose fittings and hoses, and building things like cooling loops is what they were originally intended for. Anyway, I’ll give up first on the semantics argument, because that’s all this is.
In finding a way to call your sponcer segway "shit", you made it actually made it exceptionally delightful.
learn to spell sponsor lol
Learn to spell segue
@@gatecrasher1970 I have sponcer block lolol
@@gatecrasher1970 ... and segue.
get Sponsor Block or keep crying
It feels like Jake has got his add meds correct in this video, just quiet calm and collected which is a bit of nice change
I never wanted Linus to carry a radiator as much as this one
Jake should host way more videos than he already does. His excitement about these products is infectious
Yeah dude, he's great.
Please cover more network stuff because due to your previous videos I have learned so much, cheers
I nearly choked on my lunch with that first sponsor segue, good job Jake.
This is the level of density I want for my next workstation
I have a newfound respect for Jake. The guy knows his shit and it's always fun geeking out over awesome tech.
Also a master of segues.
I always like watching content with Jake, but something about how excited you seem this time make it so nice to watch!
I think that was my favorite sponsor segue so far :D
As someone that has been assigned with a similar workstation recently, I really hope for Jake's confidence in removing those tubes scrub onto me somehow.
I'm getting ready for Linus to drop this soon
@UCA8n3Cjr2XDWJUut5wp1aDA Scammer alert⛔
@sarikakumari4047 Scammer ⛔
@@TheBebe666 Report them silently and move on dude. The more you engage with them, the more they adapt.
We could manage a whole lot of privacy-based projects with that server oO
it can run J.A.R.V.I.S. to help u building your onwn flying armor
Okay this is a good argument, because I thought it still wont break even if compared to rental servers
@Ching Chong Tor, I2P, & Crypto Nodes. Soon we will be into hidden service & eepsite hosting.
@@MASB29 something similar ob Google cloud cost 13k$/month.. Cheaper is to lease this machine for a year and buy it out for next 2-3 years od use.
best sponsorship segue in an LTT vid so far!! XD
That segue to the sponsor was the best in ltt history.
Such a relaxing video without all the shouting you usually get with supercomputer videos.
finally a desktop thats good enough to run code as inefficient as I write who needs competence when I can replace it with power
There is literally nothing I could ever feasibly need this for... I want it
lmao .. my feelings exactly!
Probably best segue I've seen yet
We need to see them do a side-by-side comparison with this monster, the million dollar server, and just any high-end hardware and do some machine learning stuff just to show us how powerful these things are!
I would love to hear how this would compare with the Cray Deskside computers advertised for a while!
You can tell they’re e true enthusiasts, because they’re enjoying every little thing about the case, even the nice clicking sound the pipes make :P
I wish consumer oriented custom PC water cooling solutions were this elegant. Those quick disconnect fittings are amazing.
Can't wait to get these on Ebay in a decade!
You guys always seem to deliver top tier information and still make it entertaining. Thank you!
@Monica Gaming💖 could you please stop spamming this f**k*ng video to all users?
is this THE cory Sellers ?
I'd totally get that for my 3D work when I ever get to that level of needing this amount of horse power from home.
That segue was amazing. 😂
Jake is one of my favorite people from this channel, he talks about everything with a clear passion. He loves what he does and it makes me love watching it even more
I was hoping there would be more discussion about using this for 3d content creation and rendering.
Same! I want to see how fast this beast able to do, when it runs all the benchmarks on Blender, VRay, Octane Render, Cinebench, etc. 😃
A $80000 USD Machine should be blazing fast! ⚡
Very cool, very insane, very compact
Wow. That's amazing build for allowing your engineers to work from home.
The Supermicro engineer finding out that the film they were planning on satisfyingly pulling of later was pulled off by a tech journalist...
I hope every unit comes with a watt meter so you can charge your employer directly for heating your house.
Not even Linus could've conjured up such a magnificent segue
My 8 year old daughter just took a polaroid of me sitting at my desk bc she got one for christmas, and jake is in the background. forever in my family photobook jake
My fluid dynamics software would fly on this beast, with 320GB VRAM at 8TB/s. If these A100's just wouldn't be so expensive :/
Have you played around with lambda labs? I bounce between them and spot aws instances depending on how long runs will be.
@@mikwit I still have free access to more powerful GPU servers (4x MI250) via university. Lamda are quite expensive. I hope the A100's will show up on ebay for a couple hundred bucks in a decade or so :)
@@ProjectPhysX You can get a P100 on eBay cheap as chips ($300) and for none AI work they are ~60-70% the speed of an A100. We just brought a whole bunch because the A100's were being tied up with MD work causing issues for those wanting to do AI work. Yes we benchmarked it before get the P100's in (we had a single P100 for available for that). The V100's are still too pricey.
@@jonathanbuzzard1376 wtf are you doing with a.i
@@jonathanbuzzard1376 yep I've seen them on ebay :)
For my purpose, I actually don't need FP64, but large VRAM capacity instead. There is loads of Tesla M40/P40 24GB for ~140/230 Euro on ebay right now, which is super cheap. I just don't have a server to put in 8 of these :D
Best sponsor segue I've ever seen. 👏
fr
Makes a lot of sense for something like structural biology. You can run Teams on Linux (and I do), but you'd probably have a system like this maxed out with real work and have a second computer for things like email and calls.
I couldn't hear the cooling on this thing over the sound of my WFH laptop, which I use to connect to an equally expensive server which is nowhere near as powerful. Actually impressive.
The red coolant is the same color as what my truck uses. I started to use it for my DIY cooling in my system. I dilute it down a bit more due to the smaller pump I use, but the diesel coolant is the best one can use. Great wetting, freeze, metal compatibly, and anti-alga. Also is warranted for three or more years. Unlike car motors, commercial truck motors need good cooling and manufactures can not skimp out on QA due to large fleets have the power to switch coolant if one causes breakdowns that cost $$$$$.
I can't believe how quiet it is. 😶
@user-ui9ni4nf5z you tryna make a buck 😭😭
Goddamn Jake, that was _THE BEST_ seque ever, literally sprayed soda on my desk. (The first one, I mean.)
I’m one of the people who would like to have such a budget system at my home, for sure!
I’m glad he’s getting more screen time, his enthusiasm is infectious as hell
Love the engineering. I would actually rather a gaming rig with that industrial build quality and aesthetic.
Man thats a lot of hardware in one box. Dude thats awesome
All that AI super computing hardware and the most interesting part is the water radiator lol
Jake is always a joy to have in any video!
I thought that remote working would be internet oriented but it *is* possible that the next major iteration of computers will be more akin to a furnace or more likely a water heater.. you get it with the house and replace it when it needs to be but every place is expected to have one and you can just plug in a monitor (which is where you will connect your mouse/keyboard) anywhere and go from there.
Central computing will definitely be a thing, no doubt about it. Linus' setup seems ridiculous, and it is to some degree, but even a lower end system to automate your house from a centralized location would be pretty affordable and could easily be left with the house for running the automation for the next owner.
Caveman discovers thin clients.
Jokes aside, are thin clients not exactly the use case that you're describing? For 2k you could build a server to meet the general purpose needs of a family of 4 as a permanent installation, not 80k. There is neither a technical nor cost obstacle. For now, people care as much for such a central computing system as a central vacuum system - the obstacle is demand!
This has been a fad for the past 40 years. Every 10 years it is thin clients hype, then the next 10 years fat servers hype. Rinse and repeat.
@@chatboss000 Thin clients don't work for gaming, especially not with a 2k server. While it's kinda possible, you need a dedicated GPU per client, and won't be able to play games that use anti cheat. Additionally, you'd likely need fibre to all the clients with the video signal, and the kind of boxes that send video over fibre (or thunderbolt) are rather expensive. You could use wifi streaming, but then you get compression artefacts and jitter.
Of course, if you're not gaming then it might be okay. Except people have phones and/or chromebooks. Why pay $2k + extra (clients & network infrastructure) when everyone has a phone anyway. One use case is for software development or something similar, but that's hardly for a family.
Thin clients have a use, but it's not for families. The overhead is too high, and they don't support the one use that requires high performance (gaming).
Those disconnects were sick… now to find their exact name and buy some.
When I saw the rear fans I laughed. They remind me of the loud-ass fans that were in my first computer: A 386!! It's great that they kept the noise down!
Seems like Supermicro had some spare 2U rack systems and some clever clogs was like "hang on... they'll run stood on their side, right?" This feels very much like a stealthy beta test of closed loop AIO for enterprise ML/Tensor rigs, it's basically a third-party take on an NVidia DGX pod. Very interesting.
I'll be glad to see more AIO/rad loop cooling for enterprise and high performance server stuff like this, our apps rooms are full of tiny turbines crammed into Dell and HP server chassis and I'm fed up with going deaf from working around them.
One LTT and one ShortCircuit with Jake on the same day?? I LOVE IT
Four to six of these in a Beowulf cluster!!! Oh, the fun!
I would LOVE to see a video putting that cooling system on a gaming pc
What is the lifespan of this piece of art 🔥
Linus boutta benchmark games on 20k resolution 💀
But can it run Crysis at 4k? I have my doubts.
Kudos to Jake few years back people were giving him a hard time. He really is a great host. Good job jake and LTT team !
Gotta love needing 3 dedicated 240v circuit for your office one for your ai server/workstation one of the air conditioning and one for your workstation plus just normal stff you have in an office
0:56 " but not as holy or as shit as this segue to our sponsor " poor acer being called shit even after paying for this segue !
Yeah, but does it have RGB lighting?
Nah, that would push the wattage over 9000
i bet them peels where left on so they could resell xD nice one jake
As a mechanical engineer, this workstation is wonderful. This would make running COMSOL Multiphysics simulations actually viable at either an individual engineers desk or at their home (if they're working remotely) without having to load the small jobs onto a compute cluster at work like you do for large jobs - time on the big compute cluster at work is a premium so currently small jobs don't get much time so designs don't get optimised anywhere near as much as would be ideal. This is a game changer.
Fascinating. I imagine equipment like this would change AI and simulation workloads from a labor based model where engineers and scientists are constantly waiting for servertime (history sure rhymes a lot, doesn't it?) and companies have to pay many engineers a good salary, to a capital intensive model where large incumbent corporations with capital backing can afford to invest heavily in poaching the most productive engineers and scientists and giving them capital intensive home AI deeplearning workstations that rival the capabilities of midlevel businesses. Maybe this might spell a mass layoff of AI engineers in the future as AI research gets consolidated into the companies that can all 100 engineers one of these and do the work of 100,000?
@@RagingAura I doubt it would change much regarding AI deep learning workloads as basically anyone with an average machine can already utilise most gaming computers for that as currently one can buy or lease a dataset, so training either isn't required or is only required to fine tune the AI.
To be honest as a mechanical engineer I do very little with AI - it has zero relevance or place in mechanical engineering.
In Australia, engineers get paid poorly just like all top-talent. Basically in Australia businesses only want people who'll accept garbage wages whilst being top-talent. This is why many people, myself included are moving abroad where better pay and opportunities exist - a colleague and I are going to start our own engineering business / consultancy once out of Australia.
As mentioned in my initial comment, this machine would be amazing as it would mean I'd be able to setup and run one multiphysics simulation every two days (runtime is about two days for meaningful results) unlike the current situation where I have to book time on the main compute cluster at work (one week of waiting) and then get results in 4 hours.
Multiphysics isn't something that can be done by AI as it requires a human who understands the intent behind the design to configure and setup the simulation. The time consuming part is the actual calculation which is multi-threaded for as many CPU's as you have a licence for (the licence only cares about sockets, not individual threads as it uses as many threads as are available).
There isn't any such job as AI engineer, only programmers who setup AI. Engineering is a strictly regulated industry with only a few fields (Mechanical, Civil, Chemical, Electrical and Biomedical) - beyond that people are illegally using the title engineer as there are no other legally recognised fields of engineering. The term engineer can't just be applied to any other term or role as that would be completely illegal.
Currently, proportionately only a handful of people in general are employed by most large businesses (compared to pre-1980 employment statistics), pre-AI servers with automation software eliminated 98% of common jobs in the early 2000's. AI has only eliminated all remaining "office" jobs where automation software couldn't.
I can tell you for a fact that one server racks worth of equipment, two mechanical engineers and one person to do the accounts and phones is all that is needed to do serious work in the space and defence industry - teams of people are no longer needed and are only found on projects that require 24/7 work to be done - i.e. rotation of teams such as a day team and a night team.