Data Center Rebuild
Вставка
- Опубліковано 27 лип 2024
- Decommission of a pair of 6509's. The environment was broken up to Nexus 7004's for the cores, Catalyst 3750's for the end user edge, and Nexus 5k/2k for the server edge.
(update 1/2/2019)
Answering some of my most common critiques up front:
· "That's not a data center" - Not all data centers look like they're in a co-lo space. That room contains all the servers, networking, and other essential gear necessary to run the organization. Because of the equipment it housed we called it the data center.
· "The job isn't finished" - I agree. Unfortunately my career took me elsewhere before I could make more progress.
· "You should have done X instead of Y" - Possibly. The goal of the project was to decommission the old equipment and bring in new equipment. My approach was to bring in different equipment that allowed the environment to be managed more naturally through shorter cables.
I'm certain there are some other critiques. I'll update this over time.
(/update 1/2/2019)
Here is what I was doing at roughly when I was doing it:
00:00 - 01:01 Configuration documentation
01:02 - 02:20 Prepping racks for new user edge switches
02:21 - 04:09 Installing new switches
04:10 - 04:21 Unwrapping new cables
04:22 - 06:56 Cutting over to new switches
06:57 - 09:17 Removing old cables (user edge)
09:18 - 09:41 Removing old cables (server edge)
09:42 - 09:51 Prepping racks for new core
09:52 - 10:27 Relocating new core to new home
10:28 - 11:50 Recabling new core
11:51 - 15:26 Cutting service over to new core
15:27 - 16:31 Prepping to remove old core
16:32 - 16:36 Removing old core
16:37 - 19:14 General cable cleaning
19:15 - 19:39 SAN cut over - Фільми й анімація
It may not have ended up pristine, but as someone who often goes into rooms like this, it’s a hell of a lot better. I can appreciate the work for sure.
Appreciate the kind words!
I do this for a living. As a data contractor the worlds greatest invention of all time - the 1 foot patch cord !
What’s the pay range
pry off the insulation, peel back the silver foily thing, carefully remove a tad of the inner silicone insulation to expose the copper soul, attach COAX plug, do the same at the other side, throw cable in box cut another 100 cm length, repeat process about 20 times /hour for 8 hours, no less than 120 lengths/day for 3 months
My summer job in 1984....
I too, did this for a living, except all router and switch ports were PERMANENTLY wired to 110 blocks on a backboard, all work stations and PBX/phone jack wired to backboard, when changes needed, just change or add a cat5 twisted pair cross connect. Never ever had a rats nest like this again once we started doing this. The data center was very large, several 7000 series Cisco switches and routers. Patch cords not allowed....ever! Our data center had more that one main frame computer, and several hundred file servers.
@@henrythompson7595 cat5? In a data center?
If it was one foot total, then it would have been out of spec. Those short blue cables you see are connected to the 110 block, which I'm assuming lead somewhere else that is longer than 2 feet.
Oh the challenges we all face in networking. Too often the wrong lengths of cables are purchased, available and used. Too often there is not enough smart cable management trays both horizontal and vertical. Too often almost anyone is granted access to the room to "just run one patch cable" to connect "X" device. If feel your pain and have spent many long hours doing exactly what this video demonstrates. The best environment I have been inside is an IBM "lights out" datacener. All of the racks where 4 post secure cabinets controlled by RFID card readers and numeric touch pad. If you were not granted access to the cabinet you couldn't open it. If you were granted access it was time controlled and you had to use coloured cables they provided. You were required to labled each end with a number and the number had to be recorded on a chart that told the next person in what exactly that number was for and where it was connected. If you didn't follow those rules all of your work was removed and you had to schedule it again.
Nothing more annoying than "Just one patch cable"
> If you didn't follow those rules all of your work was removed and you had to schedule it again.
But but that cable was for the CEO's new personal laser printer, it can't have downtime. The company's very existence depends on those documents being printed and posted on time! (/s)
So satisfying watching someone else doing it! Good video
I love work like this. Normally a job like this we would do over a weekend and do first day of service just in case a few things aren't up monday.
At first I thought this was a video of a Italian restaurant showing how they hang dry their homemade noodles.
I'll admit...
It looks like the Italian restaurant next door had a "accident"
ah, yes. the mystical blue, red, and green spaghet noodles, just like mama mia used to make.
BWAHAHAHAHAHAAHHA -thank you bro -fukin IT humor made my day better
Do Italian restaurants have noodles? In italy we hate them
Glad I read your post skiiiiiiiiiip!
Well Chuck Kelly and Rob Windsor, you did a stellar job for us back in 1997 with something that looked this bad (or worse) and added up-time and stability along the way. Thanks for letting me help as your manager.
Someone would say, Ethernet cables don’t matter what interfaces you use. But with these many, there are Mac tables, which could be so many entries por the table to collapse and causing a failure in network, truly experts these fellas
When the video started I thought it was going to be cleaned up by the end, glad I skipped most of the video, it was quit disappointing.
Me too.
This comment should be pinned.
Typical half assed job, likely at a school district. See it every day. Plan accordingly, schedule the maintenance window accordingly and do the job right or gtfo. Don't get me wrong, its a good start but why spend all that effort and not finish. And god, people putting their cores on the floor rubs me the wrong way.
No pride, just looking for the check. What a way to display your talent. Don't apply for a job in my department. I don't hire slackers
No one would ever watch this shit without skipping...
I own a Data Center .. this is a Server Room.
Here's a quote from one of Amazon's engineers, so if for some reason you disagree take it up with them. "A data center is a facility where the entire structure’s function is primarily to house network equipment.
A large server room inside a corporate building may have all the same equipment, right down to cooling and electrical, but the purpose of the building is something different and has a large server room inside of it."
So This Is A Data-Center Type Server-Room, Essentially A Mini-Data-Center?
Okay, I missed the part where its standard to build rats nests.
Every time I eat spaghetti, I arrange it in straight lines because I am inspired by this video.
me 2
Fantastic job! Looks way better!
Wooo...very talented skillfull tehnician, able to fix messy cable in very fast movement 😀😀😀
before you guys did the cable management and equipment upgrades, this rack looked like
"Explosion at the spaghetti factory"
great work guys! 😀👍
Una tarea de mucho tiempo y mas que nada mucha paciencia y empeño, TI de Centro de de Datos ya veo que no es nada fácil, buen trabajo mi estimado.
Technicians work hard in the data center congratulations
Every time I need inspiration I come to this video
Yes, I did read the FAQ's. Assuming they do use labels ... I hope that there usage is at the opposite end of the quality scale as compared to cable management. I'm guessing this is a colo cage where the actual client visits buts once a year (if that) and simply has vendors and contractors (that both have a high turnover rates) do all of manual work. If it's the onsite data center team "magic hands" crew doing the work, I'm speechless!
Not a colo. On prem at their site. All staff that touched it were direct full time employees.
That paper flapping around on the cabinet side drove me nuts!!!!
... moms spaghetti, but on the surface he looks calm and ready.
Underrated comment
Looks better than the previous cabling. ❤️
My back sores just by looking at it. This guy must have a heavy duty spine.
This guy needs a medal!
This must be one of the most fascinating jobs that a human being can do!!!
Its really not. Looking at the old cables is depressing for many reasons if you actually take the time to consider how it got to that state, one cable at a time and how that was allowed. And then there is a video of a person "fixing" the problem using pretty much the same paradigms as what started the problem. Its almost impossible to believe people get paid for work like this but they do...
Yeah its not fascinating, its like saying wiring all the fuses in a car yourself must be fascinating'
this is who we are and this what we do... you should see telecom termination panels in India. great job... for the people who think it can done better its not so easy as we speak. apparently this person did it without any down time and thats very important otherwise we may require down time of 2 to 3 days.
Exactly!!
Legend has it that the guy's still working on it.
No commentary, just perfect
Cara, esse aí conseguiu fazer mais gambiarra do que eu!🤩
A master at work.
my impression is that it looks to be a real mess with cables instead of putting all equipments side by side. what kind of work is that?
Holy Cable Monsters!
You forgot to end with, “Batman!”
May the force be with you......
I have had to deal with similar monsters like this, and I still have one rack that, while I would love to re-cable the lower half of it, we cannot justify the cost of doing so. The problem with that rack is that the guy that installed the cabling used 5m infiniband cables where 1m and 2m cables would have been sufficient, so there is a ton of extra cable just sort of stuffed wherever. Unfortunately the cost of replacing those cables for just sixteen nodes is in the range of $1-2k, and it just isn't worth it.
Jon Akers I've never understood the logic of such long cables. If it's being lazy when ordering it really makes the job far longer and harder during install.
It was a case of a decision to move the servers to a different rack after we had already received them, and using what we had on hand to wire them up. The distances changed, and the cost for getting the right cables was a bit steep. Since we were able to keep the cables contained within the rack doors, we have basically said it will be there until we retire those nodes.
Is it not possible to just cut the ends and put new connectors on? Or is that not allowed? While it would be a bit tedious. The cost for a box of RJ-45 connectors is pretty cheap and the crimpers aren't to bad either. Surely alot cheaper than $1-2k
its infiniband, they`re not rj-45 connectors
FYI: I ordered my IB cables from a store in Rotterdam (major shipping port for north europe?) and they ran like $40 a piece. Cutting out a few intermediaries seems to have helped. Would still leave you at a few $$$ but better. also, the cable routing matters. one place I was at initially had HVD SCSI cables, 25m long, and thicker than IB. There was many dozen of those, and _zero_ mess nonetheless, it was set up by some good techs by EMC^2 and they just spiralled them in the right place.
Awards for that type of show room's.
Roy? Moss? 😂🤣👏🏼👏🏼👏🏼
Beautiful Job
I wish there were many more of these.
Well done guys. It's always satisfying to see a cable monster tamed... At least for a while :) How long did it stay tidy!
Hard to say for sure. I actually left that position before I was totally finished with the clean-up job. The far left rack still had more work to be done. That was supposed to be the internet zone but there were a few other devices in there that I wanted to relocate to the server row, which would have been to my back. A few more months and I would have had that area totally cleaned but sometimes you go where the jobs take you.
When your parents tell you to clean your room so you make a path through the mess from the door to your bed.
How I spent 1993-2003. Doing EXACTLY what's in this video. Intel, HP, Weyerhauser, Boeing, General Dynamics, LANL, LLNL, Pacificorp, USBank, and MANY more........
Tanto exforço, o video acaba e ainda não tem um fim satisfatório.
Wow that cable managment do 🤯🤯💥💥💥💥
very satisfying
It looks much better. However, it is not done. That would not fly in my MDF...
Sadly I left the company before I was able to truly finish it up. I was able to clean a few more things up after the end of this video, but nothing as large as the initial clean-up.
stunod7
Fired for changing the cables from yellow to blue?
guessing from initial state it was probably for the wiser to just leave than try fighting windmills :-)
Reminded me of the haricut I had after college.
this video with Benny Hills theme song in the background would have been the bomb xD
LOL
open this in another tab and enjoy XD ua-cam.com/video/JxoUmh2FCX4/v-deo.html
The Network Masters!
*Looks like somebody's having spaghetti for dinner in the server room!*
Y Proto HW & Tec mira bro, y tú quejandote por los del gabinete jeje saludos. Excelente gestión de cables.
Excelente? No terminó
Woooooow wonderful your video guys
wtf it's not finish
thats what i was thinking
they left. resigned.
When this was "done", I think it still needed a lot more wire routing cleanup.
I don't disagree with you. A few more months with the company and I would have been able to polish it up a bit more.
What is that tool that you are using on each of the cables during the configuration documentation portion?
Pastafarian school of cable management.
I want to ask a question , is that the final build of essential server ? if yes , I'm really hate this shape of cables unarranged because it suppose to have with container for every cell, it's really very ugly Synapse cables without arranged, and also it should to hide every cell on it's own container.
Getting really worked with upgrades
Ho gawd! I will no longer complain about the state of our server room after having seen this disgusting mess.
The giant spaghetti monster is real folks.
Some hedge trimmers would have been good.
Respect! Professional! But normal people never knows.
give a medal to that man
This DC makes me feel so comfortable with my out of norm DC
Yeah. If you scroll around you'll see some people giving me a fair amount of hell for this "data center" not being a perfect co-lo environment with properly raised floors, or tidy hidden cables, or any other thing you'd have in a "real data center". Not every environment is ready to appear in advertisements, but they still gotta house equipment.
That piece of paper flapping in the wind would have pissed me off in the first 5 minutes. Stick it down! :)
Ha. You know what, it was so loud in there I didn't even notice it except for when I would be walking past.
Exactly stunod7, In most data centers you have great big Liebert AC unit(s) roaring, as well as a bunch of blade servers running (sound like jet engines almost), so you can't hear squat.
Root password
How does one get into the field? I do server desk IT but I’ve grown an interest and curiosity of cable management for servers
I would like to know how does one go down this path?
Thank you
It is a shame that this room was this way. I have seen and worked with several functioning disasters like this. I certainly appreciate the cleanup. Thanks for the video.
What a turnaround
Would have been nice to see it clean and finished
Espero um dia trabalhar com isso :D
Nailed it!
This is my kind of ASMR
How many days will take complete this process
If hell exists, it looks like this. And when you're done and look back, the mess comes back and you have to clean up again. (FOREVER)
That spaghetti was physically painful to witness. And such a relief to see it disappear...
One, not knowing what are they doing, at the beginning could think they are fighting with rack or they are being shocked by elektricity.
we were working on it once.9 persons pulled 2 days and nights efforts on 27 IDF, 4509 x12, 6513 x2. only slept for 6 hours.
Lol that spaghetti monster looks like our network closets at my work.
There's nothing like not being able to live 100lbs of patch cables high enough to see if port 34 on blade 7 is active or not.
I think that at the beginning the tag on the right top should say "horrortronic" or something like that! 😂😂😂
Nice really nice team's.
I thought that was all SM fibre... Wow good job
Looks like the cable management in my pc.
Which one?
Oh nvm
An ex co-worker I had used to cable EVERYTHING with 7' patch cables. Upon asking why, he responded "because that's what we've always done."
Thinking was not his strong point...
you are here to work, not to think! god damned jimmy, learn that already....
Lol. I don't even discuss with the clients anymore how they want the layout in the rack. I just install patch panel, space for switch, patch panel, repeat. Leave a box of 300 6 inch patch cables for the IT person. Leave slack in the rack management in case they want to change the layout. Everyone just goes with my plan in the end. It makes to much sense.
Thats culture, tha all ways done...
Try 10'. I have about 120 of them that I need to RIP apart
Master!
Can I come apprentice under you guys? I'm a CCNA, and have a degree in applied science
Gotta love still having to wear "business casual" while doing essentially manual work inside a data center.
looks like fun
Oh they changed the yellow cable to blue??? But why? Are all yellow cables are damaged?(
what' that stuff that they holding in their hands?
Que bien ordenados. Exelente
Saw the comment from 4y ago w/ 1k likes, as the title states... REBUILD.. and not cable management aesthetic video... but clearly the ones who made that comment have no idea what goes around the data center and thats fine... if they only knew what the IT section has to go through even if one switch has to be replaced with a new one.. but yk, no one knows it all, nor anyone is perfect... gotta love it tho, working all those hours and allat, thumbs up and kudos to you!!
Good job
Good job 👍
Even at the end, there is some mess to deal with!!
Certainly cleaner. Been there done that.
With clean design
Wooww.. Amazing.. 😯😯😯
Oh~ pasta! I like it!
هذا أفضل فيديو على الإطلاق
From spaghetti bowl, to mostly clean server rack
My question is, how long did it actually take to get it cleaned up as much as what he did. I wish he would have finished it as I was going to show this to my students. I will have to find a better video for that. Still, he is to be commended for getting it cleaned up some. You know, that extra slack should be tied off in the ceiling if they are cross connects. If they are just patch cords, cut them to length. You did all this work, why not finish the job?
is there a part 2 cause it still looks bad but way better
When your bed room looks like that but your the only one in the house who uses computers
Five star recruiters nice recruitment a couple of days later good morning good working with you