I'm finally listening to you - Server Room Update 2023
Вставка
- Опубліковано 28 тра 2024
- You’ll be amazed at what you can do with GrammarlyGO. Sign up at grammarly.com/linustechtips and get 20% off Grammarly Premium.
Save 10% and Free Worldwide Shipping at Ridge by using offer code LINUS at www.ridge.com/LINUS
You folks have, with good reason, complained a lot about the way we manage our infrastructure, but we've made a ton of changes for the better and today we're gonna show you all of it! It's server room(s) update time baby!
Discuss on the forum: linustechtips.com/topic/15034...
Buy a Supermicro GrandTwin AS-2115GT-HNTR: lmg.gg/16S7a
Buy a Supermicro SYS-5019D-4C-FN8TP SuperServer: lmg.gg/1rHAD
Buy a Supermicro SYS-110D-20C-FRAN8TP SuperServer: lmg.gg/AvZJc
Buy a Supermicro 2024US-TRT A+ Server: lmg.gg/nP0aJ
Buy a Supermicro 947HE1C-R2K05JBOD SuperChassis: lmg.gg/Hz113
Buy a Ubiquiti Switch Enterprise XG 24: geni.us/Pwc1
Buy a Ubiquiti Switch Pro 48 PoE: geni.us/5WKy1
Buy a Ubiquiti Switch Enterprise 48 PoE: geni.us/GnLPni
Buy a Ubiquiti UniFi U6 Enterprise Access Point: geni.us/dYfe
Buy a Ubiquiti Switch Flex XG: geni.us/MFl4A
Buy a Sabrent Rocket NVMe M.2 SSDs: geni.us/vHdUvZ
Buy Kioxia Enterprise CM6 SSDs on Newegg: geni.us/uKAzL0R
Buy Seagate EXOS Hard Drives on Newegg: geni.us/NxqfD
Buy AMD EPYC Server Processors on Newegg: geni.us/TXYfWyh
Buy an Infinite Cables Cat6a UTP 10G Ultra-Thin Patch Cable: lmg.gg/GBnay
Buy an Infinite Cables HD Mini-SAS to HD Mini-SAS 12G Cable: lmg.gg/fnd4e
Check out the Eaton 9PXM UPS: lmg.gg/T83ZS
Check out the Tripp Lite Single-Phase Switched PDU: lmg.gg/GcQbS
Check out SONOpan Soundproofing Panels: lmg.gg/7qCZm
Purchases made through some store links may provide some compensation to Linus Media Group.
► GET MERCH: lttstore.com
► LTX 2023 TICKETS AVAILABLE NOW: lmg.gg/ltx23
► GET EXCLUSIVE CONTENT ON FLOATPLANE: lmg.gg/lttfloatplane
► SPONSORS, AFFILIATES, AND PARTNERS: lmg.gg/partners
► OUR WAN PODCAST GEAR: lmg.gg/wanset
FOLLOW US
---------------------------------------------------
Twitter: / linustech
Facebook: / linustech
Instagram: / linustech
TikTok: / linustech
Twitch: / linustech
MUSIC CREDIT
---------------------------------------------------
Intro: Laszlo - Supernova
Video Link: • [Electro] - Laszlo - S...
iTunes Download Link: itunes.apple.com/us/album/sup...
Artist Link: / laszlomusic
Outro: Approaching Nirvana - Sugar High
Video Link: • Sugar High - Approachi...
Listen on Spotify: spoti.fi/UxWkUw
Artist Link: / approachingnirvana
Intro animation by MBarek Abdelwassaa / mbarek_abdel
Monitor And Keyboard by vadimmihalkevich / CC BY 4.0 geni.us/PgGWp
Mechanical RGB Keyboard by BigBrotherECE / CC BY 4.0 geni.us/mj6pHk4
Mouse Gamer free Model By Oscar Creativo / CC BY 4.0 geni.us/Ps3XfE
CHAPTERS
---------------------------------------------------
0:00 Intro
0:53 Studio Server Room Networking
4:28 Power & Battery Backup
5:44 The Mother Vault (Archive Server)
6:45 Clover Server (Old Hypervisor)
6:58 Clayton Server (New Hypervisor)
7:36 More Vault Stuff
8:18 Whonnock Server (Active Project NAS)
10:30 101 Rack is GONE
12:19 The Lab Server Room
15:01 Anniedale Server (Backup Target)
15:34 The coolest machine in the building
17:18 Power Stuff Round 2
18:20 10Gig EVERYTHING
18:57 The New Harry Potter Closet - Наука та технологія
my favorite type of videos LTT does is the server videos. Honestly the hardware and software behind servers became so interesting to me that I am persuing a career in servers
its that untouchable and most extreme feeling with no compromises
I've been interested in IT for a long time and LTT has been a huge influence on that with their server videos
great, serve me a beer then :D
E
💯
Shout out to the editor who came up with the idea to make a graphic of the server. Makes the video more digestible and relatable. Also, looking at a bundle of wires is boring and looking at a graphic is interesting!
I agree! It's an awesome touch
After they just got hacked, isn't that somewhat of a security risk if you tell the world exactly what kind of equipment you're running? Seems to make it a lot easier to narrow down known exploits
@@feinschmegga if they get that far into your network you're already fucked anyway. The hack was just hijacking a session cookie from the browser
Probably done in the writing phase rather than editing
@@feinschmegga a server is most vulnerable to physical hacking. If somehow someone gains physical access to it, it's already over. Showing the physical server doesn't matter.
Linus finding out stuff on camera as he reads ahead on the teleprompter is golden 😂
Jake is such a gem. I love how he vibes chaotic energy with Linus
Quick warning about the Dell S4048F. If it uses an Intel Atom C2000, it could be hit by a bug that kills the switch the next time it reboots. Dell will replace it if it's under warranty, but if it's your head switch, you'll be out of commission for at least a day while they get someone to drive it out to you. I currently have a Dell S4048T that got hit with it about 6 months after the warranty ended, so it's sitting on a shelf now.
Bump
In my old shop, we avoided Dell in the server room.
And please please please always have backup configs for networking gear like this. It is all fun and games till you have to rebuild an entire ToR fabric by hand after a hardware failure.
@@utubepunk Went away from Dell in favor of Aruba and Fortigate infrastructure a few years ago and haven’t looked back. Unfortunately Dell has pretty much cornered the market with professional laptops and workstations. Not a lot of people offering the same service contracts so we consistently go with them year after year.
I CAN make good hardware all over the map including monitors, laptops, servers, etc. But I've also learned Dell recycles it's brand to sell garbage products and pushes clients around regarding warranties and upgrades. I have no idea as a business why you'd use Dell. Sure some of their consumer products if you do your research.
I'm glad that Linus is still trying to add "new" to the front of Whonnock's name, and Jake still rolls his eyes and just increases the number.
nintendo has all the reason to sue them for this naming
after getting their hands on the classified dev kits.
@@TheHammerGuy94 Fuck Nintendo. Terrible company need to burn.
new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new new whonnock
@@TheHammerGuy94 no they don't own "new" they just slap it in front of every fucking game. And the only guy getting sued should be the dude that got that dev kit out of Nintendo's headquarters
@@TheHammerGuy94 receiving stolen property
Seeing Linus read the script and finding out Jake’s plans is hilarious to watch unfold 😂
Jake and Linus in a video together always makes me happy - and I'm always amazed by Jake's casual demeanor, even though what he's doing is pretty epic.
5:45 In terms of PSU efficiency with 230V, don't forget that for every watt of power saved, you're actually saving more like 2 or maybe even 3 watts, because you have to condition the power and condition the air.
They said they have 208v. That's from a 3 phase system. So it's not actually as efficient as they think. Maybe I'm missing something here.
Lower voltage = more current. The efficiency is gained by having less heat for the same power.
@@alienrenders It's not 3 phase, it's combined 2 phases for single phase 208V output. The PSU's get 208V input voltage which makes the PSU itself operate more efficiently. It won't really change the operating efficiency of the UPS or anything else back from the PDUs which are doing the phase combining.
@@timothymatthews1653 It IS 3 phase. It's 2 phase from a 3 phase system. Apartments buildings and many buildings use this system.
@@alienrenders 2 phase, you can't combine 3 phases like this, it isn't a motor, it only works on 2 input wires, hence 2 phase
there should be 3rd phase, or might not be even done (it isn't necessary, in some places you can literally have 3 phases in front of the house, but only 2 inside, one not being routed in at all), because if you don't have some very special equipment that can actually use all 3, 2 is the most you will use
Linus and his work spouse, always entertaining.
his adopted man!
Hehe. Love the phrase ‘work spouse’ :)
"Unwitting slave"
that's his illegitimate son
@@Serpher1 Illegitimate adopted work spouse slave son
I'm so jealous. You're getting so much fun drives and here I am wondering if HDDs I'm going to buy in a year or 3 are going to be used or new.
Love to see you guys playing around with it and hope you'll make more self hosting related stuff, especially for people just starting out in this space, it's super fun!
As a guy who works in low voltage and network infrastructure, it makes me happy to see you guys getting all this really cool tech to step up your game!
Being in the cloud and Data Center business, I can say you are more advanced, organized, and self aware than 60% of most full enterprise IT departments.
But also way more Jank 😂
@@saulgoodman2018 no I said “more organized than”. I bet they read though
Compared to the MDF rack in my 400,000 sq ft factory, I can confirm lol
I think my favorite server I've seen was an old desktop Dell computer the business next to us left plugged in with a sign to not unplug in an unlocked building for like a week while they were moving out, coulda just unplugged it and walked away with it if I wanted to screw them over cause none of their employees were ever at the new building just the people doing repairs for whoever rented it next
@@saulgoodman2018 based on the server rooms ive had to diagnose in the last 25 years, yes their stuff is WAY better than probably 2/3 of what ive run into. too many IT departments arent paid to give a crap, so they just patch, test, and go. im a wiring freak, so my own stuff is all patched and bundled nicely whenever i do a setup
@@ghomerhust Confirmed, I've seen many in various companies over that same timeframe, though would only have seen some of the stuff like that High Availability in a datacenter. Most office buildings I've worked don't tend to have to need for such high end, even if there are 10x the employees.
A nice upside that I did notice though is that the wiring has gotten so much better in the last few years as companies upgraded for IP phones etc.
Watched LTT since I was a teenager. Now that I’m a 27 year old OT Engineer, these videos are my favorite. I really wish you guys would put out more Network centered content for Non-gamers like me.
Linus Network Tips!
I call shenanigans if you are saying you are an engineer and think these videos are more than worth a laugh.
@@lordgarth1Feel free to call all the “Bravo Sierra” you want to boss. if it means anything I’m working with all Cisco equipment anyway. I’m just saying that I prefer watching networking related videos rather than seeing TombRaider Benchmarks 🤷♂️
@@katedenverYTthe 10% you mean
watching since I was 14, now 26. I think he should just use AWS (for data archival at least).
a news show about networking? interesting. maybe they could call it netlinked!
I think it’s fun that this stuff for offices that need it is also in your local stores and fast food restaurants. Especially now that everyplace has ship from store and pickup online orders they have serious fiber connections between IDFs and MDF. Also multiple internet connections connected simultaneously that they just keep upgrading as available.
I'd love to come over and basically lay out the network 'properly' for you, including cable management. Being in datacentres most days, this has me looking through my hands.
You can see how starting with a small closet of servers would grow into a mess like their original 'server room' is now. But to start with a clean sheet in the new building and instantly have a complete mess is just unforgivable.
Big bundles of mostly loose network cables coming in through the side of the cabinet? check (should have been in a cable tray and entered through the cabinet roof)
Vertical mounting profiles too far forward so switches are almost right up against the front door? check (fiber and thick copper cables have quite large bend radius' and the front door may impinge on that)
Narrow server type cabinet instead of network cabinet? check (extra 3 or 4 inches each side = much much easier to route and tidy cables)
Network gear and server in same cabinet? check (lots of reasons to seperate them out - except for a few top of rack switches in server cabinets)
In a functional and busy environment unfortunately cable spaghetti is something that happens
Every time you guys do these videos, it's a reminder of how insane the Internet is. Just getting LMG set up between two buildings that aren't even that far apart is this difficult and complex... scaling that up to the entire Internet is completely unimaginable. Shout-out to all the sysops and network engineers and installers and everyone else who keeps the little blinky light working on my Ethernet jack. Amazing.
It's really not that hard, they just insists on pointlessly feature proofing everything only to replace it with something even newer 5 years before the old bleeding edge features would have been useful. As others have mentioned, hiring a few actually competent tech workers and not just UA-cam personalities who like tech would make these jobs much easier, but then it wouldn't triple as an upgrade, BC tax depreciation benefits, and free content I guess... They can claim 30% of the cost for these upgrades a year through depreciation, so basically they don't need to pay much if any business taxes as long as the upgrades cost enough, and they get free content. Better still, the more expensive it is, and the less competent they are in setting it up, the more content they get out of it. And if it's jank enough, even more content when it brakes, and a documented excuse to do another upgrade and repeat the cycle
same here, mad respect for everyone keeping my game servers online
@@John-ul6rt They also use their networking for content which means things will continually change with their setup. It makes sense when you take that into consideration. Also, much of their equipment costs are offset by the fact that sponsors just send them $1000s worth of product. LMG gets views and sponsors know that sending free product for a potential mention in a video is far cheaper than actual ad placement. It's a win-win for everyone. I'd say it isn't for Jake due to the amount of extra work he has to do to keep up with changes, but he seems to enjoy it to an extent. I imagine any network engineer they hire is going to need to fully understand that they will be working a lot more than is typical of people in their field.
@@John-ul6rt Maybe I'm just too tired and grumpy from the dentist, but this makes no sense to me. It seems self-contradictory and also kind of mean. Don't try to ruin my sense of wonderment about the Internet, one of humanity's crowning technological achievements, just because you are also having a tired grumpy day. Hatewatching isn't healthy and I hope you find something less self-destructive to cheer you up.
@@crystalsoulslayer He's not wrong.
I do this for a living. I have for 20 years. It isn't the black magic everyone thinks it is. I explain this stuff to non-technical people (management) on a daily basis, so given their extremely short attention span I have to make it interesting and not let their eyes gloss over.
It is seriously extremely simple. I currently oversee a network with about 100 buildings. This stuff is not hard, magical, or worthy of wonder.
Properly set up, the equipment basically runs itself and should be designed in a way that it can take care of itself. There are loads of documents out there that describe how to set up networks. The fact is if a network is properly set up and maintained, the people overseeing the network should be able to watch cat videos all day and not have much to worry about. The fact that they seem to always need to jack with something for whatever reason tells me their network is designed for crap.
If there's anything to wonder about here, wonder how LMG's network manages to stay up long enough for them to upload a video.
I love how I can watch an LTT video about something I absolutely have no understanding of but the way Linus and the crew explain it makes it extremely informative and entertaining :D
TLDR: Linus data go brrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr and that's about all you need to know haha
You should use 2 sheets of 5/8" drywall for the walls on each side hanging off of hat channel sitting in specialty brackets with roxul rockwool in the walls for insulation and properly seal off the door with a semi mortised seal etc. If you're actually worried about soundproofing that server room from everything else.
I did not skip a second of this video. I have silently been wanting to see it for years too, now we just need a weekly server update :)
Man that is so weird, I did not realize it has been 8.5 years or more. From the house to the warehouse to all the major changes, I feel so old now. This is awesome to see.
Time is a myth.
You may consider replacing the gray door to the other server room with full on balcony doors with acoistic glass inserts, thick profiles etc - that will insulate sound much better than the normal doors, especially if you're going to sound treat that room.
Also probably a good idea to add some (probably mostly) decorative acoustic panels in the social media office next door.
Come a long way! Great to see, and to hopefully see in person on the LTX tours in July!
It'll be interesting to see what cooling solution you guys go with for the lab server room. In my time I've seen everything from ceiling-mounted cassettes to old school window units bolted into the wall.
I would love to see an hour long video where you go in-depth on each of the servers and what components/software/purposes they have.
Yes, please, this ^
That sounds like a Floatplane Exclusive video if I ever heard of one
They've already done videos like that on a lot of them, though probably not every single one.
@@VeshSneaks Sounds like a great idea for a FP Exclusive video
Linus plus Jake is always fun, especially as Linus goes around and learns of all the networking jank that's been happening.
Linus learning the janky plans from the teleprompter was entertaining
Please keep doing the server room updates, i love them!
Great upgrades and planning. Next level cleanup for airflow would be Slim CAT6A, Snagless Non-Booted. The snagless is clip over clip and requires half the effort to remove, super clean look. Color coding by length, purpose also great org like using 2 color power cords to easily recognize power via 2 PDU's/ UPSs/ and Grid (as the ultimate). Example part ADD-0-5FSLCAT6ASN-BE If you want to check some out... send me 4 lengths and 4 colors (Blue, Black, Green, Pink, Orange, Red, Yellow) and I'll get you half dozen each. 6" and up.
I work in IT now at least partially because of watching LTT for the last 10 years since I was 13, I’ve been having a really tough time at work recently getting burnt out from too many projects going at once but this has helped remind me why I do the job I do I still just love the technology. Thanks LTT for being awesome ❤
I'm guessing you are from or work in the US? Just about anywhere else in the world, you'd not be allowed to get to a burnout stage by responsible employers (which are not really found in the good ole USA). Good luck Pal.
@@Thurgosh_OG I am in the US but tbh it’s not entirely my employers fault, our IT department was properly sized for day to day operations but the last month has been rebuilding after a pretty nasty ransomeware attack so as the only network engineer it’s just been a lot of work. Has been like a steroid injection for my resume though.
I watched your videos back in 2011 to help me build my first computer. Fast forward to now and im working in commercial network infrastructure and still watching your videos. I love how your channel has grown along side myself and i imagine many others. I dont know if id be where i am today (still never went to college) if you didnt first spark that passion in me and kept it going. So from myself and many others, thank you.
i dropped out of IT college when the masters level instructors were asking me to fix their computer and networking issues. 45 grand in loans and i already knew more than the instructors did. skip the classes, just find a nerdy friend with some recycled hardware and learn it the fun way. that sort of experience is worth 10x in the real world
@@ghomerhust It's the same on the software development side. Incredibly sad. Plenty of employers still value this junk.
cool story bro who asked?
@@bubisha229 I asked.
Same here, I didn't have much knowledge in IT at that time. This channel (and others) are the reason why I managed to get a job related to IT even if I only had a marketing degree.
I'm working with servers and cameras all day.
Coooooooooool! So much stuff in this video!
I don't know if such a thing already exists, but have you ever though about editing a "Guide for dummies" about all the system you've set up? From hardware and its uses and the OS used etc etc? I know there are several videos you guys made about this and I think I've watched them all, but still, I could need some similar stuff included in this system of yours for my work and I find it really difficult to figure out the entire framework in my head in order to select what's needed and what's not (mainly because I don't know enough about these things, I know, but I follow you also to try to get some knowledge ahahah) and since you are making such a great job with this, it would be awesome to have a written down manual wrapping up everything.
Thanks for any answer!
5:25
The greater efficiency is due to lower amperage causing less I2R losses in the circuitry and wiring.
2% is pretty common at higher load levels, like above 10 amps.
Also applies to 80Plus power supplies, SAME reason.
As a network engineer with 10 years of experience, you guys are getting better
But all these improvements could’ve been solved with a good part time network engineer
I hear you, but as befits a UA-cam channel, they obviously prefer camera-ready personalities rather than raw competence (see also: Alex the "mechanical engineer").
@@rherydrevins good point
@@rherydrevins I guess that lends itself to content. It's entertaining to see them make mistakes and then learn from them.
Also keyword is good. In my previous company, we went through a few part time network engineer, and their work was… umm… the opposite of good
@@rherydrevins nitpick: camera-competent, not camera-ready.
Guys like Jake are so valuable and at the same time so underrated.
Hipsters are a dime a dozen.
@@gregpenismith1248 Hipsters who can more or less single-handedly spec out, configure, and manage three buildings' worth of network and server infrastructure, and are charismatic enough to stick in front of a camera? Please tell me which direction to chuck my dimes, in that case.
Lol he’s been doing it for ages and you think he’s not qualified still?
@@JPK1337 lol
@@MrNaufan ^
I love that you're so excited about high availability servers. I design and develop high availability game services, and it's so fun seeing someone else getting so excited about it. ❤ It's very very cool.
For some reason, I always imagine Linus is explaining all this as if expecting most of us to take notes on how to build a server room to compete with LTT UA-cam channel... and it makes me giggle every time I think about it!
Definitely wish we got more infrastructure and server videos.
Exactly the reason why sysadmins love to watch episodes like this one, its such a mess, but it's a lovely mess and very entertaining :D
We know the mess an hope that others are messier so that the own mess isn't as bad
@@siedenburg1 Fair enough xD
I refer to our server racks as “The Mullet” because all the mess is in the back lol
It's fucking awful... I'd be embarrassed to show it, based on the revenue LTT has these days LOL...
Still love you LTT crew
@@siedenburg1 lol right. It's like "see mines not that bad" haha
0:45 THE INTRO!!!!! I'm so happy it's back!!!
Love seeing this evolve, just looks like you are all moving to a data center infrastructure. Its so weird seeing Linus' videos evolve naturally with my career and understanding of network infrastructures. Big shout out to Linus and the team, I would not be where I am today in this industry without the creative and fun approach you took on the tech world.
P.S you could use that UDM pro as a cloud controller, way more powerful and reliable than the separate cloud key
I actually really like how this video was recorded/edited. It feels very calm compared to some other videos of you guys. I like it! :)
Graphics/illustrations to explain how things are connected really helps too
I'm a bit sad that they did not cover all these upgrades in more detail/separate vlogs
This video feels like the change I experienced from when I started being de facto in-person IT for my office (we had outsourced it during that time) until now with me running the whole IT show, seeing how you just kinda stumbled your way onto a good setup is exactly how I just stumbled into becoming an IT professional 🤣
It's really fun watching this particular video when I work for a major Data Center operator.
adding a doorknob and weather stripping to the door to improve the seal between rooms will have 100x more impact on sound isolation than installing panels on the wall
That clip of Wendel saying "Hey!" will never get old.
I binged all of the server related content a few months ago waiting for an update. I appreciate the detailed walkthrough of everything you have currently. I’m not a networking professional or anything, but seeing what’s out there and being implemented gives me a range of ideas for changes down the road.
Daisy chained switches, while not ideal, can be made to work if you at least loop it back in on itself and allow spanning tree to block on one of the ports. The fact that this was done in the first place does indicate a possible lack of understanding of the spanning tree protocol (STP), as well as the hierarchical design. Might I suggest starting with the Cisco CCNA 200-301 premium eBook! Also, make sure you have STP enabled, and preferable rapid spanning tree, to help reduce convergence times. And if you have the ability to configure it on the root bridge, make sure the main switch is a priority of 0, or at least lower than the default 32768, so that your downstream switches don't become the root bridge. And consider adjusting your hello timers from 2 seconds to 1 second, etc.
Otherwise, looks amazing!
I have absolutely no idea what are you guys talking about but awesome!
Just deployed ceph myself, and other than performance being a bit difficult to achieve(but a fun challenge), it's basically been a distributed ZFS to run so far, highly recommend it, just make sure it's aware of your rack/building layout so data is distributed across failure domains and you don't have two copies in the same blade chassis!
I know you will never read this, Linus. But seeing where you came from and what you have done with your business, is just unreal to fathom to someone like me. It is humbling, inspiring and downright insane to think that you were operating out of a home to something like this in such a short time. You are my Superman. I enjoy nearly every video yall produce even though i do not game, build PCs anymore, or network. Its amazing what a genuine person who CARES about their business can accomplish. Thanks for all of the content that i can use to decompress from being an aircraft electrician by trade. Please stay involved, nobody could take your place directly but you can set your staff up for it if done properly and trained consistently. Training is ALWAYS underrated.
Inspirational they are at LTT
They went downhill since their move from the ltt house. It was such an interesting and innovative channel then. Nowadays it's just another dumbed down tech review channel, like literally dozens or hundreds on youtube. I wish they went back to the style of content they had 5-8 years ago.
Cool to see all the new equipment, my biggest gripe is just the cable management.. It doesn't take THAT much extra time to use some velcro and come up with some cabling standards.
The mish mash of cables and disorganization just screams instability.
its a mess
Hey Linus and team, it's nice to see Eaton playing the grease the palms game with you. But keep in mind the following. What might be there end game. Free sponsering, direct control of the most critical aspect of your infrastructure. It might be a good thing to occasionally look at how others do stuff. Just to be sure you don't get stuck on one thing.
Been getting more into homelab and rewatched a few server related videos of yours recently. So cool to see the excitement on each little upgrade along the way and the immense magnitude of your network scaling.
Here's a tech tip for ya: If you leave an air gap between materials, you'll get better sound isolation; you won't have sound transferring through the wall as much if there's an air gap.
"love doing work twice" man, i feel that.
First off we need some cable management across the rack - panduit makes some good stuff. By doing this you are able to remove and upgrade hardware easily since the wires are not in the way of removing the equipment. Next I would try to utilize servers that are identical as much as possible this allows stock piling of spare parts such as power supplies, drives, fans. Lastly use larger racks this allows more space for cable along the sides and room for server cable management arms and power cord routing. Also a keyboard management tray in the middle of the rack with kvm to all servers makes it fast and easy for any management that needs to be done locally.
7:43 I missed that, "Hey!" everytime they mention Wendell lol
Also the HA stuff would be cool if you split it across the two different buildings too! Btw, can you cover your inter-building networking more in depth and maybe also how you organize the different networks (subnets, vlans, etc.)? Would be super-cool to know.
Latency is the killer for HA so they have to account for that.
This is way more detail than I'd be comfortable divulging publicly about my company's infrastructure
It's content, it makes them money and they know it. This video has 1.2 million views in less than a day they are not going to stop because we love these kinds of update videos.
Being in Ireland and having 240vac on a single phase is nice I must say. However my work colleague had a mad notion at one point and got his electricity upgraded to 3ph 480vac on a 30amp service for his home. Absolute mad man.
I would recommend using STP or variant for the core networking switches. That way if there is a port failure your networking device can take a different path instead of having all the connections drop.
This is a massive step up in quality! The racks look amazing. Great work Jake and everyone who worked on them.
I'm learning so much just by watching this video and reading the comments, thanks you guys.
i am really gad you added and redid everything but o my god that cable management is making me nuts, great work
Whoo! I love your videos on your servers haha.
Thanks linus for all the great content and thanks to the whole lmg team!
I just got my first IT job i start next week. I owe it to the years of learning from you!
congrats man! hope you will like your new job 😁
I'm happy to adopt these sad little server bays along with their content if you don't like them...
Love it. Also great to see some large rollouts of U6 Enterprise. I have 130 rolled out at once campus, great wireless coverage!
I’m using exactly the same Startech m2 to u2 adapter on my unraid server, works perfectly !
Going full pro install this time with tray and everything, fancy. With well planned dressing you can keep crossover minimal even when splitting off to multiple locations, would love to see some pics when that’s done
As a former Data Center Engineer, I really appreciate these videos from LTT! 😸
As a former Data Center Engineer you have to admit that this is quite messy solution ;)
@@ch3vr0n123 lol for sure man. But still better off than what they had previously. A lot of our installations used to be below floor level ones. Data center cable management is extremely organized and even sub-contracted often.
"The database corrupted so we couldn't adopt it properly". Oh I feel that pain. I worked in a company that had about 80APs in a datacenter environment (reasons, I promise), and our VM corrupted and stopped adopting, and I *hated* the remediation.
11:00 center of mass - guess if you put those closer to the wall in the rack, there would be less stress on the installation in the wall
At this scale, I think it would serve your well to have a backup generator instead of chaining UPS
Yeah I wouldn't be relying on batteries. 😂
Probably due to noise, but UPS with fail-over generator would generally be the route most would take.
Battery systems have gotten substantially cheaper over the last few years though, so if can guarantee that power will come back within a few hours, the maintenance etc. often makes it worth going that route instead.
Generator of course if heavy machinery.
Server room videos, how the company works, behind the scenes etc are the only videos I enjoy. Loved it
Whoever made the graph deserves a huge raise. It makes it easy to see!
Was very surprised (pleasently) to see a Mikrotik router. I usually work with CCR1009 and RB3011 and i love them!
I'd love to see an episode where they have a pentester come in like from Black Hills Information Security and do a before and after on all this.
There's no way you'd want to publish that type of information, there would be bad actors keen to knock out LTT. To be honest though, it would be a push over, there's no way they have got good controls at this point, Luke only just started.
It’s been a while since we saw a server video for the office. Does this mean that the home server will also be upgraded?
Lets goo love this update series couse I get a bunch of ideas to do my self for my home setup:)
That Eaton 9pxm is insane, would love to have those at all the country schools with power issues, theyre sooo much lighter than the older lead acid ones my gosh so light and so much longer lifetime on the batteries drives me nuts when people buy the lead acid ones when lithium ion is available 😂
These videos always make me want to upgrade my own server room, then I remember about the whole inflation thing and the fact that my bank account is empty. :P
Same here, except I don't have a server room, but could definitely use one. I have a handful of VMs, lots of backups scattered on hard drives and USB drives that could definitely live on a NAS instead, and I also need a Tailscale exit node and subnet router (which is currently accomplished by a mini PC in my bedroom drawer), but zero cash to actually make it real.
I'll also need a couple of web servers soon... yay
Imagining having a personal server room..I'm terrified to imagine the power bill costs for that.
Since you're looking into high availability, you should look into clustering your Proxmox setup. I believe you need three servers for a Proxmox cluster. You might want to have them pulling the VMs off shared redundant storage like a mirrored TrueNAS cluster.
They want to use the storage of each node for VMs instead of relying on a storage server.
I'm so happy that LTT decided to name their server after me! Thanks for the shoutout Linus! 😆
Glad to see the rock solid dell switches!!! I have a force 10 and love it!
One of my top comments on a LTT video was about how bad their cable management was in one of their videos. It still ain't perfect but at the very least they've made a considerable effort to tidy it up. Well done!
as much as i like the reviews and fun they have, the best content in my opinion is them nerding out about how cool their servers are and doing sysadmin groaning about maintainence. its infinitely more entertaining than anything else
so much of the rest of the sector is covered by most of the other outlets, like new launches and such. but when it comes to complete bat-crap crazy enterprise stuff, he's about the only one really doing it. i love seeing the sheer insanity when it comes to the horsepower this hardware is capable of. that one 2u box, 512 threads of genoa goodness, that is flipping nuts! makes you want to cinebench it just for kicks
As a user of those Ubiquiti UNVR's keep an eye out on them, for some insane reason some models use a bog standard, cheap USB drive to store the UNIFI Protect app. If it dies, the unit goes down, its easy to replace it and get it back online, but make *absolutely* sure you take out the hardrives first, or else youll have to reassociate every damn camera by physically resetting it. (You can rescue the protect backup files, which are different from the Unifi backup files that get uploaded online, from the USB, but only if youre really lucky and it hasn't fully died)
Source : me, dealing with each and every damn one of the 10 in my stores going down near simultaneously
Good to see Linus actually knows what's going on and how all his hardware works.
It really makes a difference when the people in charge understand the technology too.
As someone that's been doing networking for 15 years professionally and holds several industry recognized certs, you're getting better with the network stuff. I can't count how many videos I've watched where networking is involved, like VLANs and how much you guys struggle to do basic networking. I get you're a small shop, but the benefit of having an actual architect and engineer available to you for the projects where networking is critical, would save y'all a TON of headaches. I cringe anytime networking is involved, cuz y'all are gamers and systems guys. But the one thing that is central to all of the cool stuff you deploy is the network and you've put the least amount of effort in needed to get where you need to be. Hate to be harsh, but it's the truth. I doubt this comment will be seen, but there's WAY better ways to do stuff than you piecemealing your network together. Just my .02 cents worth.
Agree 100%
Jip, i agree and have been cringing every Linus server video i have seen. This takes DIY to new lows.
@@vlaktorbb Kind of shows you the path most non-professionals and small businesses would take.
@@brodriguez11000 True, I regularly clean that mess up for clients that we onboard 😁
I agree , hire a Network Engi please.
Switched PDUs are amazing in a lights-out data center and agreed, 208 is the way to go for efficiency and density. Thanks for the Infra update.
Speaking of servers, has LTT thought of doing a video on cloud computing, going over the main players. Oracle OCI, Amazon AWS, Google Cloud and Microsoft Azure. Talk about the strengths and weaknesses of cloud computing vs bare metal. And how one can get started in experimenting with cloud computing.
Bare metal = you own the content and are solely responsible for storage. The main talking points of cloud are: scalability, built-in redundancy and a 3rd party to defer liability to. Linus has outlined his "anti-cloud" stance several times. It's also important to note the servers are for the employee and internal functions of what we see, we are watching on a cloud-based platform called you-tube. All of LTT sites and services are 'cloud' based in the sense that they are hosted off-prem. Experimentation is easy, Amazon AWS has free tiers to try stuff out.
@@calebkz Thank you for sharing, I know this already and now fans who read the comments will too. However, my point was to make a suggestion for a video about this
. :)
There’s way too much to cover with these services. Way way too much with concepts that many would not understand
I think you should consider some sort of physical security for those patch panels. even if it's an enclosure.
"it's there to help you write, not replace you" Famous last words....
I’ll admit, I do love these videos, buuut….as someone who works for a data center provider with enterprise clients, the LMG servers/networks scream novice design that look like a gamer just stuffed a bunch of hardware together (almost like a home user with more money). Also, in our industry, those cables are a HUGE issue.
And those are called blades…😐
It doesn’t happen that often, but these are the videos I really look forward to.
its just crazy, how much support you get and need from big tech-companies in order to grow as fast as you are doing right now.
As someone who admins a really small office, I find these videos inspirational :D
As a IT infrastructure engineer manager who worked as network engineer/ systems this is fun. I do think you could manage the cables alot more. Ive rebuilt few huge companies
What terrifies you the most about this setup, the fact his 100 million dollar company runs on a PFsense box, and his infrastructure has literally no redundancy?
I appreciate that you show how cable management looks like in real life prod environment. I've been in companies that either demand unrealistic hyper clean cable management even for temp installments to ones that just dgaf and use a giant gordian knot of cables and tell you "you'll figure it out".
would love to see more homelab and server oriented content.
A reasonable method of sound proofing is to leave a bit of space and build a secondary wall and also sound proof it.