Most data centres don't advertise their presence. The NYSE Data Centre in Mahwah, NJ might be a comparison. However, I do know of a card-processing data centre disguised as a dairy farm.
The Mastercard data center in suburban St Louis, through which travels the data from every Mastercad swipe on the planet, is unmarked and has no signage.
@@situation_zero because there is no need to. If they advertised “Mastercard” on the front you can guarantee every grandma with a fraud charge would be turning up looking for customer service.
Couple of fun facts...the building has its own version of a "swat team" and it goes 5 stories down. I was allowed to tour the facility back in 2003. Back then it had 5 generators and enough diesel to last several days. Myspace main servers were located in the facility.
@@eustab.anas-mann9510 It's been ages since I've been in there but I have a sense of the scale of the place and I've also installed equipment in other data centers that does the kind of work they would need. So an educated guess... They likely do but they probably only fool with the submarine cables or whatever else is coming there that they don't have access to otherwise. The main issue is space in the building. Fiber taps take up space, as does the equipment that receives the output of those taps. So my bet is that the TLAs are only accessing there if that's the only practical place to do so. Because the sheer scale of tapping what goes through One Wilshire would take up more space than what's available at One Wilshire.
@@davewood406 Lol the NSA have their own access accounts to any and all machines in the building. "Wiretap" implies that the NSA aren't already authorized to access.
I remember years ago they were loading air conditioning units onto the roof via helicopter. I knew that One Wilshire was essentially a switchboard for the internet. Great video. I would love to see more content about LA skyscrapers.
Yeah... I'm a retired cubicle rat these days (Navy, Bechtel, JPL, Toshiba, etc.). But wayyy back in the late '60's, when I was a teenager, I used to drive my mom to the old AT&T building downtown at Fourth and Grand (9:58) where those microwave towers sit and where she worked. Back then, the phone company microwave tower had an unobstructed view to Mt. Wilson's mountaintop antenna farm about 20-odd miles away as the crow flies. Later, I had a tour of one of MCI's early facilities a couple blocks away in an older building when we were learning about that company's plans for expansion. I passed One Wilshire many times over the decades since it was built in 1966, until I moved north. Fascinating video! Thanks.
Due to its lack of coolers and small number of diesel generators, this building is mostly office space. The heart of the building is the 4th floor Meet Me Room with its network of fiber optic trunk lines to the outside world. The actual computing resources, the servers and disk storage, are located elsewhere. The cooling units on the roof is enough for a few floors of servers. But not a skyscraper filled with computers. The building probably started out as one of the original CIX or Commercial Internet eXchanges built in the late 1980's. This led to most of the long haul carriers installing fiber trunks to the building. As the Internet started to take off and different companies wanting to exchange data with each other, more fiber was installed. These fibers connect the MMR with the actual data centers of the different companies.
It's been 20 years since I've been in there, at the time the hotel floors were 15th and lower. It's 30 stories IIRC so about half. So yeah it's the meet me room then whatever provider has a suite or a floor that houses the transport equipment. There are "real" data centers dotted around the the area doing the rest. I did a battery plant upgrade there, this company had basically a quarter of the floor they were on but like a block away they had a couple floors(at least) of another building.
A lot of downtown areas across the country are suffering from an exodus of companies and people leaving a whole lot of empty buildings after the pandemic. I think reimagining what and how buildings serve in the future is going to be key, this is a great example of positive re-use.
I maintained a bunch of servers in datacenters once, some where old phone switchboards/central rooms in the middle of the city. Since people were using land lines less and the equipment had shrunk in size, the phone companies rented it out for businesses in the city. Some where in anonymous factory buildings. They made a point of making them look anonymous, in fact, they kept the external old factory building and built the datacenters within the building. So from the outside it looked like a dirty factory building, but inside it was very clean and you had to wear plastic covering on our shoes, walk over sticky paper before entering.
@@boomergames8094 Because at that rate, the actual peering sizes and even TCP's overhead and other shit comes to play. Such a huge amount is not all supposed to be use by a "single thing", rather is aggregated traffic. Seriously, you can find "100Gbit" almost anywhere. It just depends which point are you actually looking at
Every major city has a carrier hotel. And there are 2 major aspects needed: floor strenght and cooling. For instance, in the case of Toronto, 151 Front Street was the former telegraph building purpose built to support heavy switching equipment. It is also located next to the main railway line which provides the path to intercity fibre trunks. It makes heavy use of Enwave, a company that draws cold water from depth of Lake Ontario and distributes it to nearby buildings, including 151 Front, so every air conditioning unit in building uses the cold water as heat sink and the hot water returned to Enwave. In this case, 151 is entirely carrier hotel. If One Wilshire is mixed use and still has offices with humans, it would provide for interesting challenges for security, fire code (securing fire stairwells) etc.
Counterpoint: It's NOT the most connected building in the world. That would be Fort Meade, the NSA headquarters. The sheer amount of bandwidth flowing through that place makes One Wilshire look like a homelab.
The Utah Data Center built by the NSA. The National Security Agency, operational in May 2014. The 2013 estimate of the UDC having the capability of storing 3 to 12 exabytes. In thoes 10 years, at a rate of increased growth, the UDC now stores between 33 and 133 exabytes, an 11 fold increase According to Kryder's Law is the assumption that disk drive density, also known as areal density, will double every thirteen months. Therefore the estimated storage is now between 6 and 24 zetabytes. Zeta is the prefix for 10^21.
There's a proverb from ancient times which says one stick could be easily broken but not when three sticks band together. King Baratheon said something similar too. LA is a mess but at least it's a useful military decoy for enemy's prime spot for first strike. I wouldn't invest in LA if I were you.
I can't be the only one who loves visiting these out-of-sight places that frame, support, and power our lives. I've been to powerplants, ports, dams, and rail yards, but somehow I've never heard of this building!
I was a regional datacenter and PAIX engineer for Akamai for a few years … you would be surprised where we have color’s and data centers are sited, as well as buildings, where 22 of 30 floors are various data service providers and peering exchanges
A lot of centurylink or Lumens buildings are not occupied. When i did fire alarm testing there a lot of the facility was designed for switchboard operation. When those jobs became obsolete the buildings now just host servers.
One CenturyLink building near me only has five parking spots for a 10,000 square foot building. Most of the parking lot was sold to a business next door. I suspect it has servers now.
@@serafinacosta7118 CTL, Level 3, TWTC, Qwest. You have a point you're trying to make? CTL, and Qwest are the only two that had traditional POTS. TWTC had some limited COLO server space... that Level 3 made sure to fuck up post acquisition.
I worked for a big multinational telco (not in the U.S.), and our primary carrier hotel for the country was attached to our headquarters high-rise. It was the most secure building I've ever visited. Despite my position in the company, I had to get a government security clearance to enter, and I was given a tour. Since the building is on the government terror protection list, it has incredible security, both in staffing and physical features. From mantrap doors to guards, to tracking devices we all had to wear, to endless corridors with layer after layer of security checkpoints, it really made me understand how blowing up that building would take out the entire country's communications system. I was only allowed the one visit inside, but it was fascinating to see what went on behind a very bland (albeit foreboding) building casually located across the street from a Fairmont Hotel. Looking at it, you'd never guess what was inside and how well it was protected, just like One Wilshire. Thanks for the interesting video! I just subscribed after watching this. Looking forward to more videos. ✌️
151 front street sure is a secure building! a unanimously shared secret among the downtown Toronto IT folk, as it is very often an exchange point for many of those in the small-medium size (the big 5 obviously have their own lines), many refuse to speak of the untold horrors of what happens if you look at another company's cage, the guards, all carrying AR-15 style weapons, that escort you throughout the facility, one wrong step and you are barred forever. alas, the uninteresting nature of the building is a very purposeful, speaking from experience, a certain Montreal based bank has a datacenter in Barrie that from the road, looks about 1/10th the size, but is incredibly secure, even for those who work within senior positions in the company. i remember the tales of blocked roads and airways as the helicopters brought in replacement generators and cooling units during 151's refit not that many years ago!
Love the content, Stewart! As someone who did his undergrad in architecture, but worked in telecom and now software, and teaches IT to business and MIS undergrads, this stuff is my jam. Other interesting examples of carrier hotels are 60 Hudson Street in New York and the Dallas Infomart, which is an homage to the Crystal Palace built in London in 1851. Thing is, most people never realize that some of the nondescript tilt-up warehouses they drive past every day are in fact colocation data centers that house the edge sites for things like Facebook, Google and Amazon. That has to do with physical security and "security through obscurity."
Be it a nondescript tilt-up warehoue or a highrise steel frame converted to other uses, owners and operators ought to have taken measures to assure that their structures would ride out severe/sustained seismic jolting. The L A Times has recently broken the issue of steel frame reliability on pre-'94 constructions. Other major newspapers had gotten into the matter years ago.
I'm sorry, but their is no 'security through obscurity' of these buildings, they are all clearly marked on websites selling these services, because technical people need to know where to go.
@@johncrandell7339 I think it's important to keep in mind that every building is theoretically designed to the relevant building codes of the day. It's a lot like technical order for a weapon system; e.g. the B-52--the warnings in the TO are written in someone's blood, as we used to say.
@@johnyoung5820 * There remains the issue of the reliability of steel frame welds accomplished with a now famous brand of welding material. If you check into the matter you will find that the result of such welds is/was such that they are too brittle to withstand severe/sustained seismic shaking. The extent of use of said brand of welding material circa 1960 to 1994 is a MAJOR question in California. Broken welds that occurred in the 1994 Northridge earthquake are/were one thing, what will happen in a much more severe quake?
Four blocks away from 60 Hudson is 32 Avenue of the Americas (aka 6th Ave). I think literally the entire world's networks go through 32 Avenue of the Americas. Even North Korea has a peering point in that building. A few more blocks up from there is 111 8th Ave. It's owned by Google, is 15 floors high and takes up the ENTIRE city block. NYC has 5 or 6 huge carrier hotels.
A "sister building" in NYC is the ATT Longlines Building in Manhattan's Tribeca area. Unlike One Wilshire, the Longlines Building was originally designed to house telecommunications equipment and is or close to windowless and built to withstand a serious bombing attack on the city.
33 Thomas Street. It still houses telecommunications systems too: There’s still at least a couple of long distance switches operating there (4ESS’s). The “other” long lines building at 32 Sixth Ave is now a data center too if I remember correctly. A lot of AT&T’s and New York Telephone’s (now Verizon) old buildings are now data centers or internet exchange points.
AT&T thought their center in downtown Nashville was bomb proof, but some lone guy with a homemade RV born explosive device took it offline. It shut down the 911 systems over a large area as well as many other systems. ATT said the building was bomb proof and all 911 systems were redundantly backed up by other centers in the area. Both were lies or proved wrong. The 911 systems that went off line who had been promised seemless redundant back up raked ATT over the coals after the failure. I know people who were present at the meeting following the center failure and ATT engineers and executives were unmercifully hammered by 911 system directors. AT&T's failure could have caused catastrophic loss of life if the event would have been part of a larger plot. The whole incident was swept under the rug so the general public didn't get to fully understand what a snowballing cluster f##$ it was and how bad it could have been if a larger attack had unfolded.
It was designed to withstand an indirect nuclear blast. Technology has advanced and now hypothetically a nation could directly hit it, but given the state of a few of them, it's extremely unlikely for the missile to even leave the tube.
60 Hudson in NYC and 56 Marietta in Atlanta are other major examples of buildings you wouldn't expect to have such significant importance based on their look, but they have a rich history that lends to their importance. Being from the East Coast I don't know much about LA, but being an old-school network geek I've definitely heard of One Wilshire. Thanks for the deep dive!
History? As in what the human clones I summon think is real about their past when I just created them? Lemme guess. You rewrite it every year to make the trap of made up nonsense continue to deceive gods?
In Atlanta , the facility by Swanee, north of Atlanta , houses more servers , I recall it was run by Qtech. Not far from the mall. Google used to run its servers there , occupying 1/3 of the floor. They eventually bought land in Lenoir , NC and installed their own IDC.
When I first started using the internet in 1988 via modem and text screens only (no browsers or web yet) there were only 2 MAE switches that connected large networks to make the internet. MAE east in NY and MAE west in San Francisco. Now ONE Wiltshire has 3 last I was there. in 2013 there were 319 suppliers of internet contentions competing for connections from co locators. I had two suppliers. One on 18th floor of 1 wilshireq and one on 6th floor with a fiber ran through a wall connecting direct to one wilshire. A old train station not far from One Wilshire has direct fiber to one wilshire so other than a few hundred feet the connections were the same as O.W. I miss that place.
Another thing you should have looked into when in LA is the hidden oil derricks that are still operational around the city but are hidden in plain sight. It's amazing how many derricks there were in the past, they were all over SoCal.
@@asdfssdfghgdfy5940 Yep the there are two on Pico blvd, with 5733 pico being the most famous one. There is or was one on the campus of beverly hills high school.
@Asdfssdfghgdfy Kind of. There are batteries of wells with permanent re-work rigs, either gantry systems hidden in buildings or mobil rigs on rails. There's on carved out of the west side of the Beverly Center along San Vicente, one at Pico & Doheny, Pico & Spaulding, Adams & Gramercy, Jefferson & Van Buren, between Broadway & Hill north if 14th St, Belmont & Beverly, Alvardo north of Miramar, the Wilahire Country Club, and a few more. There are still a few actual derricks left in Brea where the hills are too steep for the rework rigs to access the wells, and one north of the 91fwy near Long Beach that's now used as a communications tower.
Some of the most powerful companies in the world. I get the feeling if you stare at it for longer than 30 seconds you get flagged as a threat and hunted down.
Starting a datacenter isn't crazy hard, but it is very, very, expensive, go somewhere near good hub, get good connectivity through them, build out all the proper expensive core equipment and it's possible. Building a major internet exchange or carrier hotel with a large meet me room, that's hard, there is huge network effects where the more networks there the more networks want to be there, getting critical mass is incredibly difficult.
Many of these buildings in cities were telecommunications AT&T or western union. NYC has a few 60 Hudson, 32 Avenue of the Americas, and 111 8th ave. 111 8th is an entire city block. Google famously purchased this building in 2010.
When i saw the title I thought you'd be talking about 350 E Cermak here in Chicago (which I might say I find more interesting visually than One Wilshire) but the scale and proximity to the interconnect between continents certainly makes Wilshire a cool building on its own
Yeah, Chicago is in and of itself a massive interconnect point for networking, given its location in east/central North America. This, of course, is in part a direct result of its previous (and current) life as a hub for the movement of physical goods and people-you want long, direct, and accessible rights of way when you’re running cable, and you know who already has those? Railroads. To wit: the SPR in Sprint stands for Southern Pacific Railroad.
@@PaulFisher and even more interesting is that 350 E Cermak was the biggest printing plant in the nation (ran jobs such as the Sears catalogs, Time, Life) and used the rail lines it sat next to to distribute the information it printed. It was exporting information on those some lines, just the same thing they're doing at a radically faster speed today.
I worked there in 2002, I upgraded and secured over 800 servers there in the basement over a 4 month period. A lot of the servers were for the Entertainment division, websites for movies and such. It was a fun job. That building is insane.
Working in the fiber optics industry, I loved working in a main hub, and it was always well ventilated and ice-cold, and the sounds of the computer vans blowing and running always gave me hospital vibes.
In London, strategic industrial land in certain places in west London and near the Docklands is in increasing demand for data centres. However, what surprised me is when I learned that these data centres are up to 12 storeys high, which is far taller than what might typically be sited in these industrial locations. (They are sometimes classed as being in the B8 use class - "storage and distribution" - even though that is more typically applied to places such as Amazon warehouses that store and distribute physical articles rather than data - and therefore they can be built in what were until recently relatively cheap sites "zoned" for industrial use that are still close to the main power lines, financial centres, and data cables). One of the things that is being explored is connecting data centres to district heat networks - this effectively provides cheap cooling for the data centres while providing heat to new residential development as well as large customers such as hospitals and prisons.
Luckily with these mega server buildings, they can sit on a single lot and not have to cut through hundreds of peoples homes and destroy communities like those highways did lol.
Luckily every building will be a data centre so I can stream the entirety of human entertainment in the comfort of my dank dwelling without ever having to step outside.
They don’t cut through eminent domain. They reuse and repurpose. Most IDC’s tend to converge in areas with strong power grids. Which is the opposite of what requires to power a residential track. So, by default , they go after industrial sites , granted it is on elevated terrain, way above flood plains.
I wonder if the orange is just the outer cladding on underground cables or if he really means old OM1/OM2. I would assume at a facility like this, most internal cables would be Yellow which is commonly used for Single Mode fiber which can travel much greater distances. ISPs and Telcos often standardize on Single Mode even for relatively short runs, so they don't have to stock multiple types of equipment. MultiMode (Orange, Aqua, Blue, Purple) are used for up to ~300 meters. SingleMode (Yellow) can easily do 10,000 meters, and some variations can do 40km
Agreed.. the Telecom Provider in me had some nit-picky issues with the video such at the fiber color, but it's overall pretty solid and completely fine for the larger audience.
In most places, these aren't build in office buildings, but purpose build datacenters for colocation. Lots of carrier hotels like these in the US used to be where telephony companies were housed.
I’ve spent a lot of time in that building. Pretty cool to see this because people always look at me like I’m crazy when I try to explain what’s happening there.
Many data centers are 2 million square feet plus. (The building on Wilshire is considerably less than that). These data centers have to be sited between two separate discrete power stations. They have a need for 200+ watts AC per sf. This building’s volume would barely have sufficient volume to house the AC units required for a large data farm. Most are located far from urban areas.
I would say the carrier hotels mostly house routers and other network equipment, not servers. They exist to inter-connect aka inter-networking aka peering and transit.
In 2005 while I was for the Union Pacific Railroad Telecom Department in LA my foreman, I and one of our other techs had to remove all the equipment from suite 1520 which was the old Southern Pacific Railroad Telecom center for Southern California. We spent several week removing the equipment from the equipment racks plus dismantling the racks themselves and arranged on a Saturday to have a large box truck park in front of the doors of One Wilshire while a small crew of our techs from LA and West Colton cart the equipment down to the truck and load it up. I got a bunch of cool trinquetes from the place including several prints done by famous railroad artist Howard Fogg. Definitely a cool incident to be sure. The door was labeled Sprint because SP had actually start Sprint because the SP in Sprint stood for Southern Pacific.
@@serafinacosta7118 My foreman was originally with the Southern Pacific and spent some time working out of that office during his career with the railroad and supposedly SPrint started there operations out of that suite in the One Wilshire Building.
Jimenez Lai is right, we are becoming more like machines, at a time when machines are becoming more like humans. This idea is reflected in our architecture - One Wilshire Boulevard. We need to reclaim our humanity and remake our towns and cities to reflect our humanity. They can be more walkable, and more sociable - parks not parking lots.
Oh hey, I use to work there as an entry level technician doing cable mining and auditing. Fancy way of saying that I took out unused copper and fiber connections. Pretty decent for a first job, especially on a resume lol
Great video ! Can you please elaborate on the same topic with other datacenters from Microsoft, Google, and so on ? Could be a video about the way datacenters sites are choosen, most of the times for a bunch of reasons : ecologic, fiscals, technicals, and so on. Some places like Dublin are perfectly suited because of the very small difference of temperature between the low ones and the high ones, meaning that the amount of energy needed to cool a datacenter there is quite easy compared to other locations. And the cold and wet air coming from the coast is perfect to cool the datacenter down without the need of lots of AC (compared to other locations, once again). That's a complete science, and a world per se. And BTW, what a great channel you have ! Thanks for all the good work you and your team do.
Dublin is primarily chosen for the taxes. If you want an example of a datacenter that makes perfect sense ecologically and economically, Google's DC in Hamina comes to mind.
Well, they started building these facilities in land bought out by rural areas. Chief reason being cheap power, lower cost of grazing land , plentiful available water ( data centers consume of cooling water instead of running power hungry HVAC ), and tax breaks. They could afford to string fiber to these outer reaches at their own dime , so it was a non issue. Google , for a while , ran dark fiber all over the US to support its own scattered data centers. As soon as they built one idc , they would cut loose from leasing up colo,space.
i work in la. i've been in there. its a freakin fortress. lots of security. cant go into areas without credentials. that building is hardened... and primary fiber is under wilshire from the bay and east.
"It isn't a building for people, but a building for cables. And the fact that it doesn't look like much means that it can hide in plain sight." 11:55 This is actually an important thing to consider. Now, another term for buildings like these are "internet interchanges", and a lot of these are actually not flaunting their location to the general masses. Most internet interchanges are intentionally hard to find. It is often regarded as highly important infrastructure and is therefor often hidden. Rarely is it a large noticeable building like we see here, or like the windowless skyscraper of Manhattan. But most of these interchanges are just in a random basement.
The strangest thing about One Wilshire is that if you sat down to design a building for the functions it now has you would not arrive at this model. Perhaps you might get something like New York's 33 Thomas Street (formerly the AT&T Long Lines Building), but really for all the mechanical and resilience needs of this sort of infrastructure you just wouldn't put it in a city centre at all and you wouldn't build in the vulnerabilities inherent to a sky-scraper into something so critical. The two things that lead to this sort of utility are firstly the slow agglutination of functions. One day one carrier moved in with a small server room and thereafter development wasn't planned, it just snowballed. The second is that no single business wants to make the investment in such a facility but many dozens of them can become the tenants or clients of a development for significantly less individual cost. But that's cost to the business. When you add in the building owners profits the costs to us as users ends up being more than it might have been were a purpose built facility to be erected. The re-use, adapt, repurpose endeavours the minimise stresses on the environment are positives, but come freighted with many other, perhaps less noticed negatives.
Once you have some people meet at the place where everyone meets, everyone else wants to meet there too. The whole point of downtown, and of a giant telco exchange. DTLA is vulnerable but it's also so important that a lot of effort, manpower, money, and infrastructure goes into protecting the whole area. For data centers Vegas is now quite the place, with basically no major environmental risks for a hands-off tech building other than an earthquake.
Fascinating. I've known that building all my life (one of the most boring visually). And when I lived in LA I used to give historic building tours with The Conservancy that began near the exact spot you are standing in Pershing Square. I had no idea it had such interesting functionality within. Another story layer to the evolving city. Really love your videos.
There's actually quite a few other data centers like it in DTLA such as another CoreSite owned facility next to Union Station (the one with all the glass right across from Phillipe's), one pretty much across the street from One Wilshire(the entrance is right next to Sugarfish)...you would have never know as they're indeed built to blend in
@@bakedpatato all “carrier hotels” should be labelled “ ⚠️ D A T A C E N T R E ⚠️” in huge letters on top of the building so the planes know what to hit 😂
How do i tell the fake humans I summon clones of from the others? They always tell me they have these lives an stuff an i just summoned them. So its not like they say "hey I was born last hour in a 80 year old rotting flesh sack"
@@bakedpatato - That used to be the Terminal Annex Post Office, which was built to process mail coming in on the trains as a distribution center. Also has a large 34.5 kV electrical service as do all the data centers in DTLA, including One Wilshire. Data centers in DT include Barker Bros on Fig and Robinson's Department store just down the block.
The internet uses BGP, a protocol to automatically find the best route. If this building goes, the routers find a way around it. The internet was deliberately very hard to kill.
When I worked for telco companies I frequent a large exchange in San Jose, California that served the same purpose. It's a inconspicuous building made to not arouse any attention, but somehow people still know about its existence, and they often get bomb threats and the staff have to evacuate the building.
My 1st job as an inspector of a trench crew running fiber in NYC they accidentally cut a high voltage power line. It actually happens more then you think. In my situation the foreman said there was no marking (spray paint) or a steel plate (to prevent this from happening). So Con Ed (power company) came in and blocked the manhole and then it became a "blame game". So they filed lawsuits agaist each other in court and like i said, this happens a lot so there is multiple suits. Nobody wants to be the one truly at fault on 100k plus trech jobs. On top of them cutting the power line, this was near Madison and 5th ave during Trump's presidency. So we had police, fire, & secret service there trying to dissolve the situation. 😅
I may have missed some important points in this video, so please bear with me. This building started its life as your typical office space complex, then overtime it became a critical telecommunications hub ? The question I have is telecommunications equipment comes with a weight factor that you’d think wasn’t intended in the original design for a building that was build as an office complex. I recall in the 1980s we hosted a telephone switching model (Ericsson AXE) on the 11th floor of an office building, and even though it was only four racks (admittedly way heavier than anything equivalent today) it had to be positioned next the the internal pylons on the floor). This building I’d imagine has every floor packed with equipment, so I’m somewhat surprised.
Basically just like "Cyber Tower" in Jakarta - Indonesia, the entire building basically just a supercomputer and data servers in all but 2 floors, 1st floor for Lobby and some offices, and top floor basically a dormitory for maintenance and engineer officer who maintaining those servers 24/7
Every city has a few non-descript telco hotels and data centers. I helped build 18 of them once. And worked in many more. Additionally most cities have a number of less hidden radio sites that do important work also. People really don’t pay much attention to the things that make their modern lives possible. The days of convincing someone to cross connect your circuit before others with a case of beer are probably over though. Grin.
Nice job on the Video. I worked in OW upgrading the power and cooling capacity of the building. It was challenging working there because you had to worry if your team screwed up it could take out a chunk of the internet, I would joke we didn't want to piss off the teens because they couldn't get their Tik Tok. From a MEP standpoint it was a pretty cool project that you don't get to see often.
A bit of a semantic difference of opinion here. The meet me room is the point of this building. The heavy lifting of the internet takes massive facilities. This is "just" a convergence of backhaul. a common connection point. Not that there aren't webservers etc in the colo areas but The important part of this building is it's job as a cross connection point between the carriers.
Thanks! I live in this 'hood. I thought the almost-windowless AT&T building a few blocks east on Olive Street was the telecom (and rumoured spying) hub for the region. It's akin to 33 Thomas Street in Manhattan. I didn't know there was an internet-specific building, as well.
As a former network admin that worked for a bank and a stock market, isn't it dangerous to point the building's very existence out? Yes, it's interesting but now more people worldwide know about it. Personally, it's better and safer for the country if it's ignored by the general public. I'm sure I'm in the minority in my views.
Critical infrastructure should be as secret and anonymous as possible. One Wilshire resembles an unsecured billboard beckoning terrorists. No card key system is going to keep a dedicated and resourceful terrorist organization from disrupting its mission. Look to Beirut, Lebanon to see what an unexpected explosion can do to a city.
I see an opportunity for a new style of building for servers in city centers. It would focus on physical security, power security, cooling, and aesthetics. Human occupancy would be a minor consideration. It seems like this type of internet hub is too important to allow compromises from reusing an old office building.
See Matthew Malthouse's great comment here, that the repurposing happens over time as more and more carriers connect. And many commeners have noticed how ohone switch buildings, already big boxy windowless machine rooms to underground main phone lines, are getting repurposed for colo's and data as switches moved from electromechanical relays to all computers.
They reuse old office buildings more than you can fathom. Underscript, good structural integrity. Location is key. If there is a convergence of power grid , fed by separate substations , you can bet your bottom dollar it will be scouted by folks in the data center industry.
Worked there for a decade, never work inside a data center full time. The office spaces are probably okay, but inside the actual data center is asking for an early death (lost three coworkers who were all healthy and under 35) with others getting serious illnesses and cancer (including me.)
Incredibly fascinating! Thank you for a great video - wild to think this comment will pass through One Wilshire before ultimately making it to your inbox, Stewart!
The magic of One Wiltshire is in its many basement levels underground. That is where the “carrier hotel” portion is actually located and is done so for communications security and robustness/resiliency from external threats.
From an architectural standpoint, I love the creative reuse of old office space. But from a security perspective, centralized carrier hotels or or data centers are a nightmare. And I don't mean the daily ins & outs of the building type security or even cyber security. I mean in the event of real hostilities, command & control are your primary targets. Anyone who war games scenarios with the U.S. has to have One Wilshire and places like it, high on their target list. And the more we move to "the internet of things", the more things you can disable by simply taking out one building. It's like having all your battleships lined up in Pearl Harbor or having all your aircraft lined up wingtip to wingtip on Hickam Field.
Imagine how grand this building would have been if it was built in the victorian or early skyscraper era. It would be such a well known landmark. I think it does indicate an issue with modernist architecture it no longer speaks to people engages people.
I worked Night Security at Pacific Bell at 2nd & Folsom in San Francisco in the 90's. I patrolled the upper floors and they looked almost like a library except instead of books on the shelves they had electro-mechanical switches. The clatter was something.
I like that you mentioned the Matrix--all the references to place in the movie (eg. the addresses of phone booths) are non-existing Chicago intersections.
It's funny, even though really close to that international line, that it would be all housed in the middle of a city, "most" data centers are in the middle of nowhere, where its secure, eiser to cool, etc. but at the same time, being in the middle of it all does help. its a catch 22, where do they actualy belong. my question is, what happens during an earthquake, how sturdy is it, and what will happen if it fails?
Now you're talking network architecture 😉 and resiliency. But seriously, One Wishire and similar urban colos are, in part, located for legacy reasons. Amazon cloud infrastructure for example is greenfield development with fewer constraints. (Would make a good, topical bookend.)
Unexpected plot twist: Architects and zoning officials in L.A. have heard of earthquakes, and spend a few minutes a day thinking what to do about them.
You briefly mentioned contingencies for buildings like this, but the more I learned about this place the more interested in the topic I am. I'd enjoy a deep dive into what a building like this does to make sure it stays up and running even in the worst of disasters!
There's dozens of undersea cables that land on the western cost of the US. If anything happens to this building, it would be an inconvenience at worst. Traffic would traverse another path. Do you think the companies mentioned in this video have a single point of failure on their network?
Switch SUPERNAP in Las Vegas is also a "highly connected" colocation facility, they leaned-in heavily with the Bond villain aesthetic throughout. The building has a ton of history having been an asset of Enron prior to their bankruptcy
We take the power of the internet for granted but stuff like this reminds me of two things One being the old fotos of the electricity era where cables runned around buildings like a web to connect people to electricity And two being Simon Stalenhag art book of massive towers that at first look like buildings where people live in but are actually mega houses for servers and computers We are surprisingly going in a direction where mega towers are going to be build but nobody lives or works there aside from the servers and the technicians ho maintain them. Not saying is good or bad just an observation.
Most data centres don't advertise their presence. The NYSE Data Centre in Mahwah, NJ might be a comparison. However, I do know of a card-processing data centre disguised as a dairy farm.
For good reason!
I’ve see a dry cleaning business disguised as a meth lab.😂
Yeah but did you know of the FBI surveillance vans disguised as taco trucks??
TACO: Tactical Analytics Centre of Operations.
Wake up sheeple!!
The Mastercard data center in suburban St Louis, through which travels the data from every Mastercad swipe on the planet, is unmarked and has no signage.
@@situation_zero because there is no need to. If they advertised “Mastercard” on the front you can guarantee every grandma with a fraud charge would be turning up looking for customer service.
Couple of fun facts...the building has its own version of a "swat team" and it goes 5 stories down. I was allowed to tour the facility back in 2003. Back then it had 5 generators and enough diesel to last several days. Myspace main servers were located in the facility.
Does the NSA have access to this building?
@@eustab.anas-mann9510 It's been ages since I've been in there but I have a sense of the scale of the place and I've also installed equipment in other data centers that does the kind of work they would need. So an educated guess... They likely do but they probably only fool with the submarine cables or whatever else is coming there that they don't have access to otherwise. The main issue is space in the building. Fiber taps take up space, as does the equipment that receives the output of those taps. So my bet is that the TLAs are only accessing there if that's the only practical place to do so. Because the sheer scale of tapping what goes through One Wilshire would take up more space than what's available at One Wilshire.
hehe myspace =)
Myspace was such a gem
@@davewood406 Lol the NSA have their own access accounts to any and all machines in the building. "Wiretap" implies that the NSA aren't already authorized to access.
I remember years ago they were loading air conditioning units onto the roof via helicopter. I knew that One Wilshire was essentially a switchboard for the internet. Great video. I would love to see more content about LA skyscrapers.
I remember being there when that happened haha.
Yeah... I'm a retired cubicle rat these days (Navy, Bechtel, JPL, Toshiba, etc.). But wayyy back in the late '60's, when I was a teenager, I used to drive my mom to the old AT&T building downtown at Fourth and Grand (9:58) where those microwave towers sit and where she worked. Back then, the phone company microwave tower had an unobstructed view to Mt. Wilson's mountaintop antenna farm about 20-odd miles away as the crow flies. Later, I had a tour of one of MCI's early facilities a couple blocks away in an older building when we were learning about that company's plans for expansion. I passed One Wilshire many times over the decades since it was built in 1966, until I moved north. Fascinating video! Thanks.
The 420 Grand microwave tower was designed by Bill Braswell of John Parkinson’s office, Bill was Head of Design.
Due to its lack of coolers and small number of diesel generators, this building is mostly office space. The heart of the building is the 4th floor Meet Me Room with its network of fiber optic trunk lines to the outside world. The actual computing resources, the servers and disk storage, are located elsewhere. The cooling units on the roof is enough for a few floors of servers. But not a skyscraper filled with computers.
The building probably started out as one of the original CIX or Commercial Internet eXchanges built in the late 1980's. This led to most of the long haul carriers installing fiber trunks to the building. As the Internet started to take off and different companies wanting to exchange data with each other, more fiber was installed. These fibers connect the MMR with the actual data centers of the different companies.
Yeah not being a purpose built facility, I am sure it has lots of limitations, and there would be buildings in Virginia with far more connectivity.
It's been 20 years since I've been in there, at the time the hotel floors were 15th and lower. It's 30 stories IIRC so about half. So yeah it's the meet me room then whatever provider has a suite or a floor that houses the transport equipment. There are "real" data centers dotted around the the area doing the rest. I did a battery plant upgrade there, this company had basically a quarter of the floor they were on but like a block away they had a couple floors(at least) of another building.
A lot of downtown areas across the country are suffering from an exodus of companies and people leaving a whole lot of empty buildings after the pandemic. I think reimagining what and how buildings serve in the future is going to be key, this is a great example of positive re-use.
The Twin Towers were actually data centres for the Beast. /s
Stewart actually made a video about this about a month ago.
I maintained a bunch of servers in datacenters once, some where old phone switchboards/central rooms in the middle of the city. Since people were using land lines less and the equipment had shrunk in size, the phone companies rented it out for businesses in the city. Some where in anonymous factory buildings. They made a point of making them look anonymous, in fact, they kept the external old factory building and built the datacenters within the building. So from the outside it looked like a dirty factory building, but inside it was very clean and you had to wear plastic covering on our shoes, walk over sticky paper before entering.
I work for AT&T in a similar building in my city. The internet speed in my office is insane!
What is it?
Have you tried to play gta online? lol
I worked at an office with 100Gbit. I had a virtual server on 10Gbit. I could not find a speedtest site that would rate more than 1GBit.
@@boomergames8094 Because at that rate, the actual peering sizes and even TCP's overhead and other shit comes to play. Such a huge amount is not all supposed to be use by a "single thing", rather is aggregated traffic. Seriously, you can find "100Gbit" almost anywhere. It just depends which point are you actually looking at
@@hariranormal5584 Yep. That is one reason why there are large packet options for local networks.
Every major city has a carrier hotel. And there are 2 major aspects needed: floor strenght and cooling. For instance, in the case of Toronto, 151 Front Street was the former telegraph building purpose built to support heavy switching equipment. It is also located next to the main railway line which provides the path to intercity fibre trunks. It makes heavy use of Enwave, a company that draws cold water from depth of Lake Ontario and distributes it to nearby buildings, including 151 Front, so every air conditioning unit in building uses the cold water as heat sink and the hot water returned to Enwave. In this case, 151 is entirely carrier hotel. If One Wilshire is mixed use and still has offices with humans, it would provide for interesting challenges for security, fire code (securing fire stairwells) etc.
Spent some time in 151 Front 😂. And a few others.
I would imagine old telco switching offices might be a good venue as well - built to take the weight.
This is very cool to know
I end up down at 151 almost once a month. Glad to see it mentioned.
It does not have offices any longer
Counterpoint: It's NOT the most connected building in the world. That would be Fort Meade, the NSA headquarters. The sheer amount of bandwidth flowing through that place makes One Wilshire look like a homelab.
The Utah Data Center built by the NSA. The National Security Agency, operational in May 2014. The 2013 estimate of the UDC having the capability of storing 3 to 12 exabytes. In thoes 10 years, at a rate of increased growth, the UDC now stores between 33 and 133 exabytes, an 11 fold increase
According to Kryder's Law is the assumption that disk drive density, also known as areal density, will double every thirteen months.
Therefore the estimated storage is now between 6 and 24 zetabytes. Zeta is the prefix for 10^21.
@@jamesfrankel7827Amount of storage is not the same thing as network bandwidth.
@@jamesfrankel7827What are you saying?
There's a proverb from ancient times which says one stick could be easily broken but not when three sticks band together. King Baratheon said something similar too. LA is a mess but at least it's a useful military decoy for enemy's prime spot for first strike. I wouldn't invest in LA if I were you.
Wow
That poor serial port at 1:41. Ouch.
how can someone be so observent?
rofl i caught it too. supermicro servers always the first to get beat up lol
I'm glad I'm not the only one who saw that jacked port.
first memorable thing I noticed on the video as well....
Mf how did you catch it? Also i accidentally passed exactly at 1:41 to read comments
I can't be the only one who loves visiting these out-of-sight places that frame, support, and power our lives. I've been to powerplants, ports, dams, and rail yards, but somehow I've never heard of this building!
I was a regional datacenter and PAIX engineer for Akamai for a few years … you would be surprised where we have color’s and data centers are sited, as well as buildings, where 22 of 30 floors are various data service providers and peering exchanges
Racks of servers?
Like stacks in a library?
I used to live across the street from this building and the internet connection was amazing, one of the first us locales with gigabit fiber
Bullshit
A lot of centurylink or Lumens buildings are not occupied. When i did fire alarm testing there a lot of the facility was designed for switchboard operation. When those jobs became obsolete the buildings now just host servers.
There are still staff in the building, but the one is sioux falls hasn't been occupied since 2004ish
One CenturyLink building near me only has five parking spots for a 10,000 square foot building. Most of the parking lot was sold to a business next door. I suspect it has servers now.
@@bdykes7316 based on your description this seems very likely.
You meant Century Link the Carrier, aka Level 3 , right ?
@@serafinacosta7118 CTL, Level 3, TWTC, Qwest. You have a point you're trying to make? CTL, and Qwest are the only two that had traditional POTS. TWTC had some limited COLO server space... that Level 3 made sure to fuck up post acquisition.
I worked for a big multinational telco (not in the U.S.), and our primary carrier hotel for the country was attached to our headquarters high-rise.
It was the most secure building I've ever visited. Despite my position in the company, I had to get a government security clearance to enter, and I was given a tour. Since the building is on the government terror protection list, it has incredible security, both in staffing and physical features. From mantrap doors to guards, to tracking devices we all had to wear, to endless corridors with layer after layer of security checkpoints, it really made me understand how blowing up that building would take out the entire country's communications system.
I was only allowed the one visit inside, but it was fascinating to see what went on behind a very bland (albeit foreboding) building casually located across the street from a Fairmont Hotel. Looking at it, you'd never guess what was inside and how well it was protected, just like One Wilshire.
Thanks for the interesting video! I just subscribed after watching this. Looking forward to more videos. ✌️
151 front street sure is a secure building! a unanimously shared secret among the downtown Toronto IT folk, as it is very often an exchange point for many of those in the small-medium size (the big 5 obviously have their own lines), many refuse to speak of the untold horrors of what happens if you look at another company's cage, the guards, all carrying AR-15 style weapons, that escort you throughout the facility, one wrong step and you are barred forever. alas, the uninteresting nature of the building is a very purposeful, speaking from experience, a certain Montreal based bank has a datacenter in Barrie that from the road, looks about 1/10th the size, but is incredibly secure, even for those who work within senior positions in the company. i remember the tales of blocked roads and airways as the helicopters brought in replacement generators and cooling units during 151's refit not that many years ago!
Love the content, Stewart! As someone who did his undergrad in architecture, but worked in telecom and now software, and teaches IT to business and MIS undergrads, this stuff is my jam. Other interesting examples of carrier hotels are 60 Hudson Street in New York and the Dallas Infomart, which is an homage to the Crystal Palace built in London in 1851. Thing is, most people never realize that some of the nondescript tilt-up warehouses they drive past every day are in fact colocation data centers that house the edge sites for things like Facebook, Google and Amazon. That has to do with physical security and "security through obscurity."
Be it a nondescript tilt-up warehoue or a highrise steel frame converted to other uses, owners and operators ought to have taken measures to assure that their structures would ride out severe/sustained seismic jolting. The L A Times has recently broken the issue of steel frame reliability on pre-'94 constructions. Other major newspapers had gotten into the matter years ago.
I'm sorry, but their is no 'security through obscurity' of these buildings, they are all clearly marked on websites selling these services, because technical people need to know where to go.
@@johncrandell7339 I think it's important to keep in mind that every building is theoretically designed to the relevant building codes of the day. It's a lot like technical order for a weapon system; e.g. the B-52--the warnings in the TO are written in someone's blood, as we used to say.
@@johnyoung5820 * There remains the issue of the reliability of steel frame welds accomplished with a now famous brand of welding material. If you check into the matter you will find that the result of such welds is/was such that they are too brittle to withstand severe/sustained seismic shaking. The extent of use of said brand of welding material circa 1960 to 1994 is a MAJOR question in California. Broken welds that occurred in the 1994 Northridge earthquake are/were one thing, what will happen in a much more severe quake?
Four blocks away from 60 Hudson is 32 Avenue of the Americas (aka 6th Ave). I think literally the entire world's networks go through 32 Avenue of the Americas. Even North Korea has a peering point in that building. A few more blocks up from there is 111 8th Ave. It's owned by Google, is 15 floors high and takes up the ENTIRE city block. NYC has 5 or 6 huge carrier hotels.
A "sister building" in NYC is the ATT Longlines Building in Manhattan's Tribeca area. Unlike One Wilshire, the Longlines Building was originally designed to house telecommunications equipment and is or close to windowless and built to withstand a serious bombing attack on the city.
Low airflow hah
33 Thomas Street. It still houses telecommunications systems too: There’s still at least a couple of long distance switches operating there (4ESS’s). The “other” long lines building at 32 Sixth Ave is now a data center too if I remember correctly. A lot of AT&T’s and New York Telephone’s (now Verizon) old buildings are now data centers or internet exchange points.
AT&T thought their center in downtown Nashville was bomb proof, but some lone guy with a homemade RV born explosive device took it offline. It shut down the 911 systems over a large area as well as many other systems. ATT said the building was bomb proof and all 911 systems were redundantly backed up by other centers in the area. Both were lies or proved wrong. The 911 systems that went off line who had been promised seemless redundant back up raked ATT over the coals after the failure. I know people who were present at the meeting following the center failure and ATT engineers and executives were unmercifully hammered by 911 system directors. AT&T's failure could have caused catastrophic loss of life if the event would have been part of a larger plot. The whole incident was swept under the rug so the general public didn't get to fully understand what a snowballing cluster f##$ it was and how bad it could have been if a larger attack had unfolded.
It was designed to withstand an indirect nuclear blast. Technology has advanced and now hypothetically a nation could directly hit it, but given the state of a few of them, it's extremely unlikely for the missile to even leave the tube.
60 Hudson in NYC and 56 Marietta in Atlanta are other major examples of buildings you wouldn't expect to have such significant importance based on their look, but they have a rich history that lends to their importance. Being from the East Coast I don't know much about LA, but being an old-school network geek I've definitely heard of One Wilshire. Thanks for the deep dive!
History? As in what the human clones I summon think is real about their past when I just created them? Lemme guess. You rewrite it every year to make the trap of made up nonsense continue to deceive gods?
In Atlanta , the facility by Swanee, north of Atlanta , houses more servers , I recall it was run by Qtech. Not far from the mall. Google used to run its servers there , occupying 1/3 of the floor. They eventually bought land in Lenoir , NC and installed their own IDC.
Anyone else notice the bent pins on the DB9 connector at 1:44
When I first started using the internet in 1988 via modem and text screens only (no browsers or web yet) there were only 2 MAE switches that connected large networks to make the internet. MAE east in NY and MAE west in San Francisco. Now ONE Wiltshire has 3 last I was there. in 2013 there were 319 suppliers of internet contentions competing for connections from co locators. I had two suppliers. One on 18th floor of 1 wilshireq and one on 6th floor with a fiber ran through a wall connecting direct to one wilshire. A old train station not far from One Wilshire has direct fiber to one wilshire so other than a few hundred feet the connections were the same as O.W. I miss that place.
MAE West was actually in San Jose at 55 S. Market.
Another thing you should have looked into when in LA is the hidden oil derricks that are still operational around the city but are hidden in plain sight. It's amazing how many derricks there were in the past, they were all over SoCal.
Wait are they actually derricks? Or just wells operating under some other method of extraction?
@@asdfssdfghgdfy5940 Yep the there are two on Pico blvd, with 5733 pico being the most famous one. There is or was one on the campus of beverly hills high school.
@Asdfssdfghgdfy Kind of. There are batteries of wells with permanent re-work rigs, either gantry systems hidden in buildings or mobil rigs on rails. There's on carved out of the west side of the Beverly Center along San Vicente, one at Pico & Doheny, Pico & Spaulding, Adams & Gramercy, Jefferson & Van Buren, between Broadway & Hill north if 14th St, Belmont & Beverly, Alvardo north of Miramar, the Wilahire Country Club, and a few more. There are still a few actual derricks left in Brea where the hills are too steep for the rework rigs to access the wells, and one north of the 91fwy near Long Beach that's now used as a communications tower.
Some of the most powerful companies in the world. I get the feeling if you stare at it for longer than 30 seconds you get flagged as a threat and hunted down.
I'm sure there's nothing that could go wrong with having so many important connections in one building!
Starting a datacenter isn't crazy hard, but it is very, very, expensive, go somewhere near good hub, get good connectivity through them, build out all the proper expensive core equipment and it's possible. Building a major internet exchange or carrier hotel with a large meet me room, that's hard, there is huge network effects where the more networks there the more networks want to be there, getting critical mass is incredibly difficult.
is it plausible for someone to start from scratch to into server buildings?
No, impossible. These companies are like safe investments for the mega rich.
@@jarvusff7726😂 lmfao went from lemonade stand to server centers
Many of these buildings in cities were telecommunications AT&T or western union.
NYC has a few 60 Hudson, 32 Avenue of the Americas, and 111 8th ave. 111 8th is an entire city block. Google famously purchased this building in 2010.
Quick note: the beach you labeled as "Hermosa Beach" in the video at ~2:50 is actually Venice Beach.
came here to post that
🏆 good job
Fascinating. I worked as a messenger for a law firm in DTLA after high school and was in this building a lot. Thanks!
The irony lol
When i saw the title I thought you'd be talking about 350 E Cermak here in Chicago (which I might say I find more interesting visually than One Wilshire) but the scale and proximity to the interconnect between continents certainly makes Wilshire a cool building on its own
I (my company) was a tenant at Cermak, but never have I ever seen or visited.
@@timgerk3262 My boss says he's visited and it sounds really cool to see as someone semi in that industry
Yeah, Chicago is in and of itself a massive interconnect point for networking, given its location in east/central North America. This, of course, is in part a direct result of its previous (and current) life as a hub for the movement of physical goods and people-you want long, direct, and accessible rights of way when you’re running cable, and you know who already has those? Railroads. To wit: the SPR in Sprint stands for Southern Pacific Railroad.
@@PaulFisher and even more interesting is that 350 E Cermak was the biggest printing plant in the nation (ran jobs such as the Sears catalogs, Time, Life) and used the rail lines it sat next to to distribute the information it printed. It was exporting information on those some lines, just the same thing they're doing at a radically faster speed today.
I worked there in 2002, I upgraded and secured over 800 servers there in the basement over a 4 month period. A lot of the servers were for the Entertainment division, websites for movies and such. It was a fun job. That building is insane.
Working in the fiber optics industry, I loved working in a main hub, and it was always well ventilated and ice-cold, and the sounds of the computer vans blowing and running always gave me hospital vibes.
In London, strategic industrial land in certain places in west London and near the Docklands is in increasing demand for data centres. However, what surprised me is when I learned that these data centres are up to 12 storeys high, which is far taller than what might typically be sited in these industrial locations. (They are sometimes classed as being in the B8 use class - "storage and distribution" - even though that is more typically applied to places such as Amazon warehouses that store and distribute physical articles rather than data - and therefore they can be built in what were until recently relatively cheap sites "zoned" for industrial use that are still close to the main power lines, financial centres, and data cables). One of the things that is being explored is connecting data centres to district heat networks - this effectively provides cheap cooling for the data centres while providing heat to new residential development as well as large customers such as hospitals and prisons.
Is Thames water used for cooling?
Shouldn't this building be protected by a dedicated police force?
It is
Luckily with these mega server buildings, they can sit on a single lot and not have to cut through hundreds of peoples homes and destroy communities like those highways did lol.
Luckily every building will be a data centre so I can stream the entirety of human entertainment in the comfort of my dank dwelling without ever having to step outside.
DTLA historically wasn't much residential. Some SROs in the past, some trendy wildly expensive condos now. Still mostly business and government.
They don’t cut through eminent domain. They reuse and repurpose.
Most IDC’s tend to converge in areas with strong power grids. Which is the opposite of what requires to power a residential track. So, by default , they go after industrial sites , granted it is on elevated terrain, way above flood plains.
I wonder if the orange is just the outer cladding on underground cables or if he really means old OM1/OM2.
I would assume at a facility like this, most internal cables would be Yellow which is commonly used for Single Mode fiber which can travel much greater distances.
ISPs and Telcos often standardize on Single Mode even for relatively short runs, so they don't have to stock multiple types of equipment.
MultiMode (Orange, Aqua, Blue, Purple) are used for up to ~300 meters.
SingleMode (Yellow) can easily do 10,000 meters, and some variations can do 40km
I’m guessing there’s a lot more yellow fiber patch cables in that building than orange ones.
Telecom uses all single-mode - yellow fiber. Great video otherwise!
Agreed.. the Telecom Provider in me had some nit-picky issues with the video such at the fiber color, but it's overall pretty solid and completely fine for the larger audience.
Pretty crazy how it went from a small California company developing the PIX to giant buildings for data interconnect.
In most places, these aren't build in office buildings, but purpose build datacenters for colocation.
Lots of carrier hotels like these in the US used to be where telephony companies were housed.
Correct. De commissioned central office switching centers.
I’ve spent a lot of time in that building. Pretty cool to see this because people always look at me like I’m crazy when I try to explain what’s happening there.
I could listen to that guy you interviewed for hours
Many data centers are 2 million square feet plus. (The building on Wilshire is considerably less than that).
These data centers have to be sited between two separate discrete power stations. They have a need for 200+ watts AC per sf. This building’s volume would barely have sufficient volume to house the AC units required for a large data farm. Most are located far from urban areas.
I would say the carrier hotels mostly house routers and other network equipment, not servers. They exist to inter-connect aka inter-networking aka peering and transit.
These buildings don't provide compute other than edge caches, just interconnect. Full of 400g Juniper switches and DWDM gear.
Yes, this building doesn't exist, and everything you say is correct.
In 2005 while I was for the Union Pacific Railroad Telecom Department in LA my foreman, I and one of our other techs had to remove all the equipment from suite 1520 which was the old Southern Pacific Railroad Telecom center for Southern California. We spent several week removing the equipment from the equipment racks plus dismantling the racks themselves and arranged on a Saturday to have a large box truck park in front of the doors of One Wilshire while a small crew of our techs from LA and West Colton cart the equipment down to the truck and load it up. I got a bunch of cool trinquetes from the place including several prints done by famous railroad artist Howard Fogg. Definitely a cool incident to be sure. The door was labeled Sprint because SP had actually start Sprint because the SP in Sprint stood for Southern Pacific.
That is neat. Oddly enough, Sprint HQ is in Lenexa , KS.
@@serafinacosta7118 My foreman was originally with the Southern Pacific and spent some time working out of that office during his career with the railroad and supposedly SPrint started there operations out of that suite in the One Wilshire Building.
Jimenez Lai is right, we are becoming more like machines, at a time when machines are becoming more like humans. This idea is reflected in our architecture - One Wilshire Boulevard.
We need to reclaim our humanity and remake our towns and cities to reflect our humanity. They can be more walkable, and more sociable - parks not parking lots.
Thanks telling the public about critical infrastructure locations.
Very well done.
IKR
@ 1:43 - the most jacked up Serial/USB ports i have ever seen. SHEESH.
Oh hey, I use to work there as an entry level technician doing cable mining and auditing. Fancy way of saying that I took out unused copper and fiber connections. Pretty decent for a first job, especially on a resume lol
Lucky you honestly
Great video ! Can you please elaborate on the same topic with other datacenters from Microsoft, Google, and so on ? Could be a video about the way datacenters sites are choosen, most of the times for a bunch of reasons : ecologic, fiscals, technicals, and so on. Some places like Dublin are perfectly suited because of the very small difference of temperature between the low ones and the high ones, meaning that the amount of energy needed to cool a datacenter there is quite easy compared to other locations. And the cold and wet air coming from the coast is perfect to cool the datacenter down without the need of lots of AC (compared to other locations, once again). That's a complete science, and a world per se. And BTW, what a great channel you have ! Thanks for all the good work you and your team do.
Dublin is primarily chosen for the taxes. If you want an example of a datacenter that makes perfect sense ecologically and economically, Google's DC in Hamina comes to mind.
DCs I know are mostly built into old factories or even old powerplant, afaik primary reason is existing power infra
Datacenter spaces (not in cities) are chosen mainly for cheap power and tax benefits. Actual location for physical cooling isn't much of a factor.
Well, they started building these facilities in land bought out by rural areas. Chief reason being cheap power, lower cost of grazing land , plentiful available water ( data centers consume of cooling water instead of running power hungry HVAC ), and tax breaks. They could afford to string fiber to these outer reaches at their own dime , so it was a non issue.
Google , for a while , ran dark fiber all over the US to support its own scattered data centers. As soon as they built one idc , they would cut loose from leasing up colo,space.
i work in la. i've been in there. its a freakin fortress. lots of security. cant go into areas without credentials. that building is hardened... and primary fiber is under wilshire from the bay and east.
I may be wrong, but I think they used One Wilshire as a model for one of the skyscrapers in Sim City.
"It isn't a building for people, but a building for cables. And the fact that it doesn't look like much means that it can hide in plain sight." 11:55
This is actually an important thing to consider.
Now, another term for buildings like these are "internet interchanges", and a lot of these are actually not flaunting their location to the general masses. Most internet interchanges are intentionally hard to find. It is often regarded as highly important infrastructure and is therefor often hidden. Rarely is it a large noticeable building like we see here, or like the windowless skyscraper of Manhattan. But most of these interchanges are just in a random basement.
The strangest thing about One Wilshire is that if you sat down to design a building for the functions it now has you would not arrive at this model. Perhaps you might get something like New York's 33 Thomas Street (formerly the AT&T Long Lines Building), but really for all the mechanical and resilience needs of this sort of infrastructure you just wouldn't put it in a city centre at all and you wouldn't build in the vulnerabilities inherent to a sky-scraper into something so critical.
The two things that lead to this sort of utility are firstly the slow agglutination of functions. One day one carrier moved in with a small server room and thereafter development wasn't planned, it just snowballed. The second is that no single business wants to make the investment in such a facility but many dozens of them can become the tenants or clients of a development for significantly less individual cost. But that's cost to the business. When you add in the building owners profits the costs to us as users ends up being more than it might have been were a purpose built facility to be erected.
The re-use, adapt, repurpose endeavours the minimise stresses on the environment are positives, but come freighted with many other, perhaps less noticed negatives.
Once you have some people meet at the place where everyone meets, everyone else wants to meet there too. The whole point of downtown, and of a giant telco exchange. DTLA is vulnerable but it's also so important that a lot of effort, manpower, money, and infrastructure goes into protecting the whole area. For data centers Vegas is now quite the place, with basically no major environmental risks for a hands-off tech building other than an earthquake.
Fascinating. I've known that building all my life (one of the most boring visually). And when I lived in LA I used to give historic building tours with The Conservancy that began near the exact spot you are standing in Pershing Square. I had no idea it had such interesting functionality within. Another story layer to the evolving city. Really love your videos.
There's actually quite a few other data centers like it in DTLA such as another CoreSite owned facility next to Union Station (the one with all the glass right across from Phillipe's), one pretty much across the street from One Wilshire(the entrance is right next to Sugarfish)...you would have never know as they're indeed built to blend in
@@bakedpatato all “carrier hotels” should be labelled “ ⚠️ D A T A
C E N T R E ⚠️” in huge letters on top of the building so the planes know what to hit 😂
How do i tell the fake humans I summon clones of from the others? They always tell me they have these lives an stuff an i just summoned them. So its not like they say "hey I was born last hour in a 80 year old rotting flesh sack"
@@bakedpatato - That used to be the Terminal Annex Post Office, which was built to process mail coming in on the trains as a distribution center. Also has a large 34.5 kV electrical service as do all the data centers in DTLA, including One Wilshire. Data centers in DT include Barker Bros on Fig and Robinson's Department store just down the block.
I tell people about One Wilshire all the time, this is great!
1:00 the real ones know
This building is one hell of a target. That's quite scary.
Yeah, and he just painted a bullseye on it. Hopefully this video is just misdirection. If not, it's blatant stupidity.
@@woodhonky3890 It's public knowledge. The security at the building is insane.
The internet uses BGP, a protocol to automatically find the best route. If this building goes, the routers find a way around it. The internet was deliberately very hard to kill.
@@deepspacecow2644 I wasn't meaning it would take out the internet - simply that a great deal of capacity would go down in one stroke.
When I worked for telco companies I frequent a large exchange in San Jose, California that served the same purpose. It's a inconspicuous building made to not arouse any attention, but somehow people still know about its existence, and they often get bomb threats and the staff have to evacuate the building.
It seems so tempting for a screenwriter to use it as a plot device in a high tech action film
That's where the NSA has their tap into the backbone, too, for "national security" reasons.
1:43 can't unsee the bent RS232 pins on that connector
I'm on the 10 freeway driving past downtown LA looking right at the building as he's talking about it😂
My 1st job as an inspector of a trench crew running fiber in NYC they accidentally cut a high voltage power line. It actually happens more then you think.
In my situation the foreman said there was no marking (spray paint) or a steel plate (to prevent this from happening). So Con Ed (power company) came in and blocked the manhole and then it became a "blame game". So they filed lawsuits agaist each other in court and like i said, this happens a lot so there is multiple suits. Nobody wants to be the one truly at fault on 100k plus trech jobs.
On top of them cutting the power line, this was near Madison and 5th ave during Trump's presidency. So we had police, fire, & secret service there trying to dissolve the situation. 😅
This is the place where everyone is an expert or comedian!
I work in a similar building in Brazil. People around have no idea about its importance... Also the HVAC system is insane
I may have missed some important points in this video, so please bear with me. This building started its life as your typical office space complex, then overtime it became a critical telecommunications hub ? The question I have is telecommunications equipment comes with a weight factor that you’d think wasn’t intended in the original design for a building that was build as an office complex.
I recall in the 1980s we hosted a telephone switching model (Ericsson AXE) on the 11th floor of an office building, and even though it was only four racks (admittedly way heavier than anything equivalent today) it had to be positioned next the the internal pylons on the floor). This building I’d imagine has every floor packed with equipment, so I’m somewhat surprised.
I think it IS very limited in what it can house.
The cables aren’t orange anymore. They are blue or other colors indicating their higher speed.
9:58 The AT&T/PacBell building is at 420 S Grand Ave, not 400
Basically just like "Cyber Tower" in Jakarta - Indonesia, the entire building basically just a supercomputer and data servers in all but 2 floors, 1st floor for Lobby and some offices, and top floor basically a dormitory for maintenance and engineer officer who maintaining those servers 24/7
I'm sure it's stock footage, but what happened to that poor DE-09 socket at 1:41 ?
Every city has a few non-descript telco hotels and data centers. I helped build 18 of them once. And worked in many more. Additionally most cities have a number of less hidden radio sites that do important work also.
People really don’t pay much attention to the things that make their modern lives possible.
The days of convincing someone to cross connect your circuit before others with a case of beer are probably over though. Grin.
Nice job on the Video. I worked in OW upgrading the power and cooling capacity of the building. It was challenging working there because you had to worry if your team screwed up it could take out a chunk of the internet, I would joke we didn't want to piss off the teens because they couldn't get their Tik Tok. From a MEP standpoint it was a pretty cool project that you don't get to see often.
A bit of a semantic difference of opinion here. The meet me room is the point of this building. The heavy lifting of the internet takes massive facilities. This is "just" a convergence of backhaul. a common connection point. Not that there aren't webservers etc in the colo areas but The important part of this building is it's job as a cross connection point between the carriers.
Thanks! I live in this 'hood. I thought the almost-windowless AT&T building a few blocks east on Olive Street was the telecom (and rumoured spying) hub for the region. It's akin to 33 Thomas Street in Manhattan. I didn't know there was an internet-specific building, as well.
As a former network admin that worked for a bank and a stock market, isn't it dangerous to point the building's very existence out? Yes, it's interesting but now more people worldwide know about it. Personally, it's better and safer for the country if it's ignored by the general public. I'm sure I'm in the minority in my views.
Critical infrastructure should be as secret and anonymous as possible. One Wilshire resembles an unsecured billboard beckoning terrorists. No card key system is going to keep a dedicated and resourceful terrorist organization from disrupting its mission. Look to Beirut, Lebanon to see what an unexpected explosion can do to a city.
Boston has a similar (but smaller) colo in the same building as Macy's in Downtown Crossing.
Correct. One Summer Street. Above the store. Very non descript.
I see an opportunity for a new style of building for servers in city centers. It would focus on physical security, power security, cooling, and aesthetics. Human occupancy would be a minor consideration.
It seems like this type of internet hub is too important to allow compromises from reusing an old office building.
See Matthew Malthouse's great comment here, that the repurposing happens over time as more and more carriers connect. And many commeners have noticed how ohone switch buildings, already big boxy windowless machine rooms to underground main phone lines, are getting repurposed for colo's and data as switches moved from electromechanical relays to all computers.
They reuse old office buildings more than you can fathom.
Underscript, good structural integrity.
Location is key. If there is a convergence of power grid , fed by separate substations , you can bet your bottom dollar it will be scouted by folks in the data center industry.
A Stewart Hicks video is always worth watching.
Worked there for a decade, never work inside a data center full time. The office spaces are probably okay, but inside the actual data center is asking for an early death (lost three coworkers who were all healthy and under 35) with others getting serious illnesses and cancer (including me.)
Incredibly fascinating! Thank you for a great video - wild to think this comment will pass through One Wilshire before ultimately making it to your inbox, Stewart!
The magic of One Wiltshire is in its many basement levels underground. That is where the “carrier hotel” portion is actually located and is done so for communications security and robustness/resiliency from external threats.
From an architectural standpoint, I love the creative reuse of old office space. But from a security perspective, centralized carrier hotels or or data centers are a nightmare. And I don't mean the daily ins & outs of the building type security or even cyber security. I mean in the event of real hostilities, command & control are your primary targets. Anyone who war games scenarios with the U.S. has to have One Wilshire and places like it, high on their target list. And the more we move to "the internet of things", the more things you can disable by simply taking out one building. It's like having all your battleships lined up in Pearl Harbor or having all your aircraft lined up wingtip to wingtip on Hickam Field.
On the other hand One Wilshire benefits from everything done to protect L.A. as a whole.
Imagine how grand this building would have been if it was built in the victorian or early skyscraper era. It would be such a well known landmark. I think it does indicate an issue with modernist architecture it no longer speaks to people engages people.
It was designed as a pragmatic, efficient place to do business where everything comes together downtown, and it still is.
Imagine if I sprouted a fanny and pissed on the king....
just take this building for what it is mate.
I worked Night Security at Pacific Bell at 2nd & Folsom in San Francisco in the 90's. I patrolled the upper floors and they looked almost like a library except instead of books on the shelves they had electro-mechanical switches. The clatter was something.
So it's safe to say the NSA rent's the basement!
5:35 just wow
I like that you mentioned the Matrix--all the references to place in the movie (eg. the addresses of phone booths) are non-existing Chicago intersections.
The movie the Matrix was filmed in Australia in Sydney.
@@rossmeldrum3346 Also true. But none of the street names in the dialogue are Sydney streets.
One of my favorite buildings in LA. I love the Address ONE WILSHIRE
It's funny, even though really close to that international line, that it would be all housed in the middle of a city, "most" data centers are in the middle of nowhere, where its secure, eiser to cool, etc. but at the same time, being in the middle of it all does help. its a catch 22, where do they actualy belong. my question is, what happens during an earthquake, how sturdy is it, and what will happen if it fails?
Now you're talking network architecture 😉 and resiliency.
But seriously, One Wishire and similar urban colos are, in part, located for legacy reasons. Amazon cloud infrastructure for example is greenfield development with fewer constraints. (Would make a good, topical bookend.)
Unexpected plot twist: Architects and zoning officials in L.A. have heard of earthquakes, and spend a few minutes a day thinking what to do about them.
the scale of this building and what it offers is small compared to similar buildings in New York City that offer the same services.
1:41 Oof, that disk array has seen some rough handling. Did someone take a screwdriver to pins of the DE-9 plug?
Our enemies know exactly where to strike. We seem to tell them where all our most secret sites are.
You briefly mentioned contingencies for buildings like this, but the more I learned about this place the more interested in the topic I am.
I'd enjoy a deep dive into what a building like this does to make sure it stays up and running even in the worst of disasters!
Look into disaster recovery and backup and resiliency techniques for IT networking. Many of these probably apply to this building as well
Jimenez Lai has no business having a voice that good. That guy should have become a voice actor!
Here in Dallas, the InfoMart is a similar scaled Carrier Hotel. Been there quite a few times w/ my IT Teams to review issues.
Me to. Once.
There's dozens of undersea cables that land on the western cost of the US. If anything happens to this building, it would be an inconvenience at worst. Traffic would traverse another path. Do you think the companies mentioned in this video have a single point of failure on their network?
Square metres are denoted by "m²", not "sm". The latter might be interpreted as "second × meter", which is not a unit I've seen used anywhere.
Thanks for covering some LA! I'm originally from Chicago so I love your videos but love learning about the new city I live in!
Great video as usual! Quick correction @ 2:49, that's Venice Beach (not Hermosa Beach)
I'm impressed with your knowledge of the building. No -- REALLY I am.
Congratulations on informing the world --- including our adversaries!!
Switch SUPERNAP in Las Vegas is also a "highly connected" colocation facility, they leaned-in heavily with the Bond villain aesthetic throughout. The building has a ton of history having been an asset of Enron prior to their bankruptcy
We take the power of the internet for granted but stuff like this reminds me of two things
One being the old fotos of the electricity era where cables runned around buildings like a web to connect people to electricity
And two being Simon Stalenhag art book of massive towers that at first look like buildings where people live in but are actually mega houses for servers and computers
We are surprisingly going in a direction where mega towers are going to be build but nobody lives or works there aside from the servers and the technicians ho maintain them.
Not saying is good or bad just an observation.
Finally a good ad, or an ad about something real and useful. I just bought a blue Henson Razor and used your code thanks and you are welcome lol. ;-)
I've worked in telecom in SoCal for close to 27 years and I've spent more time than I'd care to remember in One Wilshire.