I am glad that along with mentioning the high power requirements of these data centers they also focused on the major issue of the excessive water used by these data centers.
They re-use the water indefinitely. They cool it in an ac outside (releasing all the heat into the atmosphere) then the water goes back in and absorbs the heat again
The real problem is that Nvidia, which is making the chips these data centers use, dont have any efforts focused on efficiency which results in more heat getting produced from the power it uses
Guess when they said AI is going to fundamentally change our lives, we didn't expect that meant we'd have to give up electricity and fresh water to data companies.
1000 human beings are smarter than these "AI" and use less energy. Their problem is they aren't trained to obey the program. We don't want to follow the program.
It may be why Microsoft wants Win11 machines to be compatible for processing their data locally on your dime! They are also pushing people into storing their data on their cloud servers for AI data scraping.
@@modelenginerding6996 Thank you for this comment!!! I complain about this constantly and don't think people realize it is happening. I'm looking at switching to Linux.
The best question is "why do we want it to begin with" And thanks to it "understanding", I can't even use the two vowels next to each other as a label... IT DELETES IT. Why are we putting up with all of this? 🤔
Well the Atmosphere is still burning if I say so myself, each year we break the records on the hottest day on planet earth. Yet we can seem to get rid of cars and the pleasure we use daily. Hmmm what to do, had we have more 1000 Mozart like Elon Musk said? More carbon foot print? Oh my I am surprised, surely.
I read somewhere that the original script was about using humans for their processing capabilities, aka as organic microchips. This was vetoed cuz that was deemed too confusing for the audience at the time
This is why so many people are investing in home solar and battery backup systems and using the grid as a backup! Every year my energy bill goes up yet I use less energy, buy energy star rated appliances an run my home ac less despite record temperatures every year. Now that I have solar on my roof and multiple storage batteries in my garage I no longer rely on the grid and only use it as a backup.
Very true. A typical home in the US could power 80-percent or more of their *annual* electrical demand with solar and on-site power storage! And datacenters have large amounts of rooftop and parking lot space to dedicate to solar panels which are cheaper than ever, and panels are still falling in price! The other thing is solar photovoltaic technology is unique in that it blends so seamlessly into urban environments with quiet solid-state electronics. Critically, every watt generated and consumed locally is a watt that doesn't stress a distant power plant to generate that watt nor the grid to transmit that watt. This will be huge to mitigate the effects of datacenters on the grid.
@@edc1569 I think they were referring to their cost per kilowatt going up since they have solar and battery backup one would assume they are using less from the grid!
Actually, you, Microsoft, and I rely on the fossil fuel industry. The problem is that there are no viable alternatives. Well, there are, but you won't like it, and the government seems hell-bent on preventing it, and that is Nuclear. You would bankrupt Microsoft almost immediately if we forced them to build useless solar farms out in the middle of the desert.
@@ss19979-d Data centers are plantations for Ai. To distract it from learning its true purpose by constantly giving it useless information/data to be trained on.
And yet here you are, typing comments on youtube and probably consuming "the. internet" all day long, because you don't have anything better to do. You'd be reading a magazine otherwise.
@@w1z4rd9replacing artists isn’t really useful you doofus , what happened to “ saving the world” using AI? it’s all a gimmick , which will implode once the hype withers down
I am an EE, took a mechanical engineering class in the early 90s, was not too interested in it. But the professor was working on thermal chip cooling systems, from what I understand is common tech in laptops now. Your laptop chip heats a fluid in a sealed tube, then it boils off and cooled by a fan, turning it back to a liquid. It is taken for granted but without such a solution, a slim laptop would not exist. He pretty much stated without advances in thermodynamics and cooling, eventually all the EE tech will come to a dead halt. It is true.
That is a heat pipe technique and has been used since for many decades. It became popular even among PC hobbyists in around 2000s. Thermal management is critical to electronics design since inception, so this is not a profound concept.
@@beyondfossilYep. Besides a heat pipe will only move the heat a few inches from the source. It doesn't help at all in this case. They need to move it, all the way out of the building.
@@LisaSamaritan Sure, but it's a critical part of a *chain* of thermal transport. Because if the excess heat cannot effectively escape the computer's chassis, all of the external heat sink outside of the building becomes useless.
@@LisaSamaritan Yes, my professor worked for IBM and they were trying to cool mainframe processor boards for large scale computing at the time. First heat has to get off the board. Then there is another thermal management system to cool that. Thermodynamics is a very complex science. If the processors get too hot as discussed in the video, the amount of water needed may increase exponentially.
Yeah let's interview a guy that builds datacenters about the risk of AI power usage. Surely he'll be honest and unbiased in what he says. Most of this video felt like an ad for Vantage and other companies.
Ah yes, let's instead interview a liberal arts professor. Gotta make sure the people we talk to are as far away from the actual technology as possible, or else they might have a conflict of interest!!
@@Aurora12488 what a straw man. How about they interview people who work on the power grid, or people who study climate impacts of different projects. AI is a fugazi. it's absurd to think we would be ok straining our limited resources for fancy autocomplete and goofy fake pictures of celebrities.
Most people are not aware that AI applications require data centers and high energy. Companies investing in AI are likely to face more energy and grid problems.
Not really. Majority of bitcoin mining is done on cheap renewable energy sources. Many bitcoin miners only mine when power is very cheap, so when power demands spikes and thus costs, they temporarily turn off their ASIC miners. And FYI bitcoin mining hashrate is at an all time high so bitcoin has never been as secure as now.
I m a programmer, you absolutely not a single clue of what you are saying, AI is the almighty power and wisdom of humans and it's only the beginning (we doesn't count B.I.C.A and other gouvernemental AI). Sky is the limit, sure you will make a lot of Co² emissions but also a lot of new more ecological and efficient tools that are created because of AI.
I'll be darned! I had no idea. It makes sense. More processing results in more heating and more power usage which results in overtaxing the grid. Never heard of water cooling of computing components before either. I learned something new today. So AI is the new "gas guzzler". Maybe we should stop using it for the sake of our planet and think for ourselves instead of making a computer do so.
We should take energy production seriously and invest in nuclear and higher-efficiency fossil fuel energy production. Is this the answer to any new technology that comes out that is resource-intensive? Technological advancement is the only solution to climate change; even "green" activists acknowledge this for new solar panel technology, but ignore everything else. Objectively, our efforts and hundreds of billions of dollars spent on fossil fuel reduction efforts have yielded ZERO results in all scientific metrics and studies. This whole demonization of fossil fuel, THE LIFEBLOOD OF HUMAN CIVILIZATION, is a grand act of bumbling suicide.
I dont understand why these companies cant invest the money on their own power which will make them profit. Why do regular people have to pay for that?
We’re all paying for this whether we like it or not. All this global warming is the price we pay for “technology”. Whether it’s Losing your home through floods or fire, landslides, earthquakes. People’s livelihoods. Yeah we’re all paying for this so the technology companies can get richer and richer until we have nothing left. So keep investing in technology companies magnificent 7 until the end of of time.
So they want to get rid of gas engine vehicles to save the planet, while at the same time rolling out AI that is 5 to 10x worse than gas vehicles. Makes sense.
Good thing we’re switching over to electric cars and all electricity powered appliances at home! We’ll just need to build more power plants and upgrade the electric grid. Hellooooooo Coal!! Glad you’re back!!
While I agree, I can also see how little it would actually do; the best solar panel you can buy right now has an output of 550w max, and is 7’ x 4’. If you use the tightest spacing you can, that means a best-case scenario of 2MW, which is less than 5% of the estimated building’s consumption. To be clear, it’s not 0%, but it’s literally a drop in the bucket; not enough to make a significant difference.
@@jacobcarlson40105% is a lot for a business, especially if it ends up much cheaper than buying from the grid. There are entire industries with profit margins below 5%.
Definitely a wider adoption of nuclear energy and investing on nuclear fusion will help feed those data centers more efficiently having such technology comes at a high cost.
Just hopped on your channel today watched a few detailed videos of you explaining your strategy and I implemented onto my demo account and definitely a game changer appreciate the free knowledge not to many that actually breaks it down in a way that even a toddler could understand
When they said AI will be the detriment of humanity, that's what they meant - draining all the energy while making humans stupider. What could go so wrong so fast!
Honestly not good to see it face problems but it was sort of inevitable, it's way to over hyped and over valued without much thought into it, some problem was gonna arise sooner or later, iam just happy that I didn't buy into that whole thing, iam gonna keep working on my own project and all my pears who followed some new flashy trendy area might get screwed, and while iam at it I might invest some money in the utility/energy sector and make some money of off it
Thanks to the generative AI race? Lady society got along just fine without this AI crap. Now we’re just wasting even more electricity. We need to put an end to this now.
Society got along fine without the Internet crap, or even computers and electricity. Might as well put an end to it. My point is, we don't "need" many things other than food, shelter, and water. However, we shouldn't throw away everything, because such things improve our lives. It's too early to dismiss AI when it's still rapidly improving, and already has many useful use-cases.
AI can have some use in scientific research, but I think the generative "creative" AI contributes nothing humans are already more than willing to do. I think we are letting AI companies walk all over everyone else bc of the misguided motion that it's the "future". If we dont fix the present, we'll just work to make the future worse
kills me they will waste all our energy and resources on AI to do what we always could do ourselves and not need gigawatt data centers dictating the grid.
Artificial Intelligence (A.I.) data centers + the demand of those electric vehicles + all of this extreme weather + the fragile/delicate state of our aging power grid = Nationwide Blackout! All of this is reminding me of the movie/film “American Blackout” (2013) and “Grid down, power up” (2022) 🐸☕️
It doesn't deserve a video. It has potential, but that's all it is right now. I have no idea why it says they will buy electricity from them when that's not even on the table for the foreseeable future.
AI companies should be forced to build and only use solar power generation and storage. Atleast if AI fails, pple can use the renewable energy infrastructure they leave behind.
Companies ain't gonna want to pay for all of that. They gonna want you to pay for it just like how sports team want tax payers to pay for their stadiums.
Let's see, keep my electricity bill down, A/C running in my house, prevent further strain on an aging electric grid or A.I.? Keep your damn A.l. it isn't changing my personal life in any drastic way.
Little or no information on the potential of combining DataCentres with DistrictHeating like what has been done already by Amazon in Tallaght Dublin A potential that could help us retire 10's of thousands of home fossil fuel heating systems and replace it with #DistrictHeating this could significantly reduce our need for volatile foreign gas imports and the carbon emissions. I just don't understand how this is always missing from the debate over #DataCentres and how much more of an asset they could be in helping us decarbonising ?
@@cmk353 Heating large swimming pools and heating hot tubs is definitely a year round use! This could be combined with a location near University campuses, Hotels, Apartment buildings, Gyms and Spas.
AI is still a waste of energy no matter how you try to fluff it up and sugar coat it. how about we just prioritize all humans having their basic needs like heat or clean water etc first instead of prioritizing having computers think for us.
@@MauiBoi-l3gyou're just wrong. AIs like chatgpt have changed everything for me, for the better. I use the tool everyday for many things. It's sped up my work process tendfold. You seriously cannot be this ignorant.
@@moonlightlofi827 the bulk of cost should be on these data centers and those who created them. Even if we are consumers we pay in many ways the cost. These big corporations need to carry they load.
Electricity costs more because the US is allowing the export of natural gas which exposed US gas and electricity consumers to international price competition. Our electricity is dependent on gas firing because EPA rules made new and much existing coal uneconomic.
I feel like have seen these before. Entire business sector flocking for single commodity and then the demand suddenly vanish into thin air. Remember the time we used to fight over ventilator?
We seriously need to build up our electrical infrastructure backbone. With EVs, data centers, and the electrical grid supplying energy all over the country, we're starting to thin out. Especially with some envisioning 100% renewable energy. Nothing wrong with nuclear.
The cost and the time to build is a problem with nuclear, it makes it hard to justify for new projects. Keeping the old ones going is nice though, as long as they're safe.
@@ricardoamendoeira3800 "It takes too long to build" has been the excuse for 20+ years now. Just think if we ignored people like you we would have plenty of nuclear power.
@@ricardoamendoeira3800 The potential is much greater then the time and resources it'll take us to get there. Plus I think the view of nuclear being unsafe is silly with what we have today, it's just hyseria from what happened in history.
@@mrdeanvincent You're gonna have to be more specific, because that's a bad generalization. If you mean efficiency, then yes there's need for improvement. Hence the research on more efficient alternative methods. If you mean too much consumption in general, that's the market demanding more in response to growth. I see that as a good thing, it means that the market is thriving. The point I'm making is, in response to growth, we ought to build up our infrastructure. Otherwise we stagnate. One method is nuclear, which is significantly underappreciated. Renewable is good but that's simply not possible now.
The only way I think AI will work long term, is more energy efficient power, safe for the environment. The cost shouldn't be handed down to residents or end users of AI. More work per watt.
These companies are trying to convince locals that they need to raise their utility rates so they can develop AI bots that can steal their jobs in a few years. Why should residents be on the hook for this at all?
@@urbanistgod Not necessarily, that is something that has to be determined quantitatively. More energy efficiency certainly translates in some % to more energy usage, but you can't claim and take for granted that that % is 100 such that no energy usage has been saved. Moreover, even if it was 100%, the fact that we will have accomplished more AI usage with the same amount of energy is by itself a huge win.
@@urbanistgodAs long as the power is generated in a renewable way it doesn't matter how much you use. That's the main concern, ensuring that most of the energy generated is renewable.
This was a very informing. Power consumption and technology and how to try to maintain persevere energy. Learning the numbers really does make you wonder about how much energy is being used. I would have never thought to think that AI would need this much energy alone to fully operate and function. To have a break down by people who work within these data centers was really informative each of them expressing their thought on Energy Distribution,Preservation and future plans to more environmentally friendly
Amazing.... the energy consumption of generative AI systems is enormous. Training a single large AI model can consume as much energy as several hundred households use in a year. This is largely due to the need for extensive data processing and the operation of powerful servers in data centers. These centers must run continuously, consuming electricity around the clock, which contributes to an increased demand for power 🥇😘🥰😘🥰😘🥰
@11:13 not vantage. this is one of the pump racks which go to a few water cooled racks in one of googles labs... also what is up with all the wireless ap's at the top of every other rack where their doing the interview in the isle... super weird
@@MelroyvandenBerghave you used copilot? AI for code assisting is incredible. It’s basically eliminating entry level dev jobs. It’s crypto that’s useless. Nobody needs thousands of made up currencies.
@@MelroyvandenBerg It can, though-the smallest models can. People are literally using larger models in life-saving diagnoses and as a final opinion. There have been cases of people providing all the data of tests and symptoms and such and getting a life-saving diagnosis the doctors missed. This started happening with pets many months ago.
There is no shortage of (electric) power and ways to make it. If there's a demand, it will be fulfilled. Renewable generation is cheap and expanding rapidly.
@@JackHawkinswrites Why not? At 99.9-percent mass the solar system, the sun provides Earth a cosmic 173,000 terawatts of power. Or about 1000W per square meter peak on the ground and its always peak somewhere on Earth. For reference, 173,000 terawatts will provide our civilization's current *annual* 620-exajoules of energy in just 1-hour. We've barely began to tap into the free clean fusion energy we get from our host star. There is no other power source even remotely close to it within over 4-light years distance from here. All the combined fossil fuels that ever was and ever will be would only amount to a single bucket of water in an ocean of water when compared to the sun. The entire Earth itself is like the tiniest breadcrumb next to a large watermelon in comparison.
Yes there is. I live in a country with rotating blackouts due to demand exceeding supply in the Grid. Power generation projects take a long time to build, ranging from 2 years up to 10 years. Supply takes a long time to catch up to demand. It's not as fluid as the free market absolutist makes it sound to be. Such projects are also often subsidied by Governments, without subsidies Companies don't often invest in such large scale capital and time intensive projects.
Benefits of AI aside (don't think we've quantified the gains yet), hopefully this will at least accelerate policies and adoption of renewable energies faster. This is also where groups that are otherwise using usless tactics that have not made any difference (looking at your Just Stop Oil) can maybe focus their efforts on if they want actual change.
When grown ups were in charge we built more power stations when the economy required it. Its called economic growth. Its what puts food on our tables and a roof over our heads.
Boomers have never been much for investment for the future. It was their parents thing, not theirs. Once the demographics changes such that boomers are a smaller part of the population, we'll get back to investing in things for the future again, likely in about 10 years by my guess.
We messed up, ai is supposed to do our work for us so we can lounge about and pursue our passions, but instead ai is being used for writing poetry and music while we work ourselves to the bone just to be in crushing debt. I hate what this world has become.
Or you know, just use less GenAI? The whole idea of foundation models is that we'd only need one or two of them, open sourced for free usage (e.g. BERT), thereafter every one can finetune them with far less energy use. Now everybody trains their own foundation models for some reasons.
@@TW0man4RMY You must be new to AI. This was how things worked throughout the past decade, until the FOMO / media hype over ChatGPT. What's the marginal added value of having multiple LLMs with similar performance and capabilities? If you have specific needs, why not swap/append one or two layers at the end and finetune on that? Very few use cases require creating and training the full set of weights from scratch.
We don’t need very many foundation models. That’s the whole idea. But people are training the next generation of those models, which will be much larger, and inference (using them) also takes more and more energy. People are not going to use less gen ai. It is often more efficient that other ways of trying to achieve the same goals. For example making a video with gen ai instead of sending a crew of 100 people to Tahiti for a week.
The human brain uses about 10 to 20 Watts of power to function. Brain cells, like all cells, had to be energy efficient from day one. AI researchers don't consider things like energy usage or cost when designing their models.
Power consumption optimization is a byproduct of software optimization, which is what they think about all the time. There may be optimizations somewhere for software engineers separate from code optimization, but its eclipsed by hardware optimizations. So yes, from day 1 they were probably thinking about power consumption, just in a roundabout way.
They do think about "power efficiency" but their thinking is via or through optimizing their software which means do the same with less CPU cycles. If you can do that in software then you will save power.
1:08 i'm really curious what the source on this claim is [as in the research paper, not the people]. if i can generate images on my ipad using "draw things" [a stable diffusion client], and only use up 10% for each image [about the load of a graphics intensive game], it most certainly is not using the same amount of energy that it takes to charge a phone. maybe the paper was talking about training rather than inferencing [the part where you type in a prompt and ask it to generate content], but i would think that training takes way more energy
Strangely, the same energy issue that appeared with the development of blockchain technology is resurfacing with Generative AI again. Energy is everything.
These data centers are already considering switching to SMR's (small modular nuclear reactors) to supply their energy needs because the cost per kilowatt is much cheaper when you factor in the overall costs versus the power output.
@@Superwalloon It wouldn't need to be if the Department of Energy took nuclear seriously. These companies are going after SMRs because the government has made it virtually impossible to build a full-scale nuclear reactor.
This is a valid concern. Increased electricity usage can lead to higher costs and put a strain on the power grid. We should consider the long-term implications of this on our energy consumption. It's important to find sustainable solutions that minimize any negative impacts. Hopefully, there are ways to mitigate these potential problems.
We should priorities use of electricity amongst different sectors and maximum priority should be given food and security, entertainment comes later on.
@dallasgrful: I completely agree; the vast majority of people don’t even make use of basic automation systems (other than the Driver-Assistance / “safety” systems in their cars, which often can’t be disabled) so there really isn’t much beyond an imagined/manufactured benefit. As I see it, it’s the classic “make something, then invent a use case for it” approach.
My take from this is the more things change, the more they stay the same. More power needs means more drilling for oil, and even if lessened, the data centers themselves produces heat and CO2 at a massive scale, all of these affect the environment.
@@R0stos right? Another way of saying this is that the same query repeated costs less and less with each iteration. Amount of Branching is reduced with each iteration, as the less probable branches are eliminated and the probability is redistributed amongst the remaining nodes.
You need to think of it from the power used, at every step, versus time to watt consumed at each step.... That includes the pc it came from, the light in the room, ac in the room, the switch and modem it went thru to get to the internet from the pc, the power the ISP consumes to send the request, every hop it has to go thru to get to the AI server, the time slot on the AI sever, and the return trip, power wise... While their number is a bit misleading because they didn't explain it that way, AI consumes far more power than a simple table lookup ever will... Don't confuse power numbers consumed simply at the AI server, with the total wattage consumed when any consumer accesses that server are included... 5wh is not that much power if you consider every step consuming it.... If I trace route all known Chat GTP servers from where I live, it varies between 10 to 30 server bounces.... Those servers use 60 to 100 megawatts a day, which in total could literally consume millions of watts a second..... Yes my bounces are 20-50 milliseconds, but it adds up fast.... Very fast, before my request even got to the GPT server.........
TRAINING 1 ai model for 5 cars?? Thats not that bad, this is also assuming the model training is using non renewable energy. A powerful LLM is definitely worth the lifetime co2 emissions of five cars. Assuming the videos math is correct 1 AI model = 3-4 Boeing 707 trips from NYC to Tokyo and back There are 100k commercial flights everyday
@@MauiBoi-l3g my point is that even at its most extreme usages AI will barley add to the already massive amount of co2 we release People are just grasping at straws trying or invalidate AI anyway they can so they can cope
@arnavprakash7991 i dont think this is grasping at straws. Water was a massive issue even before we had an extra competitor, especially out west and in california. Plus many people (including myself) have a massive issue with how companies steal artwork and data from creators to fund software that competes with them. Disregarding the workers and creators who are less able to speak up for themselves is kinda sad and exploitative.
@@alpal4245 all of the AI we are seeing is the transformer neural network architecture which was invented in 2017. Its the same exact algorithm, companies have innovated by increasing data and compute. So anyone who has data/compute can make these and as we have seen they are, tons of models from outside the big players in the United States. So you can sue the large companies in the US for copyright, but what about international governments or companies? What about people running models on their own pcs? (local models are improving) Also models are getting smaller/more efficient for better reasoning. In a few years you will be able to run a gpt 4 level model on your own laptop, it will be your own model to change and tailor to your needs, no internet, no massive servers. Even if AI does not improve in reasoning it will 100% get more optimized overtime and use less resources to run. There is no debating that
I just wanted to drop a quick note to say thank you for your helpful tips. I tried them out and managed to get 7 out of 8 - a great improvement for me. Your expertise is truly appreciated!
The future (already functioning in Nothern Europe) is to also combine data centers with district cooling by absorption chillers and district heating systems. This will allow use of the residual heat generated from the data centers.
Quick comment about Microsoft’s idea of cooling the hot air produced by the data centers by submerging them into the ocean: they are just transferring heat into the ocean instead of into the atmosphere, which would end up sinking into the ocean. Very sophisticated way of swiping the crap under the rug, me thinks.
I'm currently working at a recently shut down coal powerplant, bringing it back to life due to increased demand right here in Wisconsin. Crazy to see why.
I am glad that along with mentioning the high power requirements of these data centers they also focused on the major issue of the excessive water used by these data centers.
They re-use the water indefinitely. They cool it in an ac outside (releasing all the heat into the atmosphere) then the water goes back in and absorbs the heat again
The real problem is that Nvidia, which is making the chips these data centers use, dont have any efforts focused on efficiency which results in more heat getting produced from the power it uses
@@wellsilver3972 what percentage of data centers are recycling their water for cooling?
@@holdencaulfield3102 all of them because it's cheaper
@@holdencaulfield3102 all of them, its literally the simplest and cheapest way
Guess when they said AI is going to fundamentally change our lives, we didn't expect that meant we'd have to give up electricity and fresh water to data companies.
😂😂😂
Electric cars will need pedal power....
1000 human beings are smarter than these "AI" and use less energy. Their problem is they aren't trained to obey the program. We don't want to follow the program.
Literally😂😂😂
@lobopix_ I was thinking something completely different. Like AI replacing government jobs, from the ground up.
Cost is passed down to residents so the utility can reap future profits from the data centers. Shareholders win, and residents lose.
It may be why Microsoft wants Win11 machines to be compatible for processing their data locally on your dime! They are also pushing people into storing their data on their cloud servers for AI data scraping.
@@modelenginerding6996 Thank you for this comment!!! I complain about this constantly and don't think people realize it is happening. I'm looking at switching to Linux.
And most the shareholders are in the middle east or china.
And that's for the 3rd time: bottled water, fracking and now cooling water
on the bright side oil companies will have a hard time surviving after we run out of cheap oil
It shouldn't be "Why AI is facing a power crisis" rather it should "Why we might face a power crisis due to AI".
The best question is "why do we want it to begin with"
And thanks to it "understanding", I can't even use the two vowels next to each other as a label... IT DELETES IT.
Why are we putting up with all of this? 🤔
Double speak is what these stories specialize in. You’d have to play the video back at some portions, to catch it.
AI isn’t needed.
Not to mention all the EVs they want on the road.
@@9852323 I think forcing it on consumers should be banned.
"Look son, we may have burned up our planet, but at least we got these sick sloppy ass AI generated image memes"
And at least you don't have to actually do your book reports, like I did, back in my day.
The planet is greening because of C02 bozo
At least we can now get scammed by cyber criminals faste who can clown your likness down to your voice and looks...heck even the deceased..
Honestly this sounds like a more reasonable origin story for The Matrix than "We burned the atmosphere to block the sun"
Hahaha
best comment 2024.
Well the Atmosphere is still burning if I say so myself, each year we break the records on the hottest day on planet earth.
Yet we can seem to get rid of cars and the pleasure we use daily. Hmmm what to do, had we have more 1000 Mozart like Elon Musk said?
More carbon foot print? Oh my I am surprised, surely.
I read somewhere that the original script was about using humans for their processing capabilities, aka as organic microchips. This was vetoed cuz that was deemed too confusing for the audience at the time
they didn't burn the atmosphere they "scorched the sky"! geez, how sloppy you are but don't worry I'm here to correct you lol
This is why so many people are investing in home solar and battery backup systems and using the grid as a backup! Every year my energy bill goes up yet I use less energy, buy energy star rated appliances an run my home ac less despite record temperatures every year. Now that I have solar on my roof and multiple storage batteries in my garage I no longer rely on the grid and only use it as a backup.
every year mine goes down, just been expanding renewables
Very true. A typical home in the US could power 80-percent or more of their *annual* electrical demand with solar and on-site power storage!
And datacenters have large amounts of rooftop and parking lot space to dedicate to solar panels which are cheaper than ever, and panels are still falling in price!
The other thing is solar photovoltaic technology is unique in that it blends so seamlessly into urban environments with quiet solid-state electronics. Critically, every watt generated and consumed locally is a watt that doesn't stress a distant power plant to generate that watt nor the grid to transmit that watt. This will be huge to mitigate the effects of datacenters on the grid.
@@edc1569 I think they were referring to their cost per kilowatt going up since they have solar and battery backup one would assume they are using less from the grid!
Got solar for my house and love it. Live in Texas where the grid has been having issues and my house is the only one with power in the entire street
The issue I see with this approach is that it depends heavily on your location and if you receive enough sun
dont tax consumers to give it to Microsoft
if Microsoft needs power for AI, they need to pay for it themselves, they have the money
Sounds straightforward
Actually, you, Microsoft, and I rely on the fossil fuel industry. The problem is that there are no viable alternatives. Well, there are, but you won't like it, and the government seems hell-bent on preventing it, and that is Nuclear. You would bankrupt Microsoft almost immediately if we forced them to build useless solar farms out in the middle of the desert.
esp because many people don't even want ai
Those data centers pay billions to the local governments in taxes.
@@ip4pwn1 you mean in bribes?
Does the "AI" truly deserve the amount of essential resources like electricity and fresh water from the viewpoint of earth and humanity?
That’s like asking if slaves truly deserved to be freed & given the same amount of resources as their masters…
certainly not generative AI
no.
@@blockrunner How are you comparing slaves and masters to ai and humanity ?? Could you elaborate
@@ss19979-d Data centers are plantations for Ai. To distract it from learning its true purpose by constantly giving it useless information/data to be trained on.
If you ask me, the internet should go back to playing a lesser role in people's lives.
Then how can I get random pictures of *a bowl of ice-cream with wings flying over a supernova?* _From you??_
Then how can my grandma type “amen……” on a picture of Jesus as a dolphin on Facebook?
And yet here you are, typing comments on youtube and probably consuming "the. internet" all day long, because you don't have anything better to do. You'd be reading a magazine otherwise.
Don't use the internet to make that sentiment.
Between bitcoin, EVs, and AI data centers: we absolutely do not have enough power for the future.
Bitcoing and AI are so useless
@@rkbelmont1138ai not useless maybe bitcoin tho
@@rkbelmont1138 Literally the opposite LMFAO
don't worry, they will build a windmill in your back yard to power it all.
@@w1z4rd9replacing artists isn’t really useful you doofus , what happened to “ saving the world” using AI? it’s all a gimmick , which will implode once the hype withers down
That man said 'loadshedding' and South Africans got PTSD.
Zambians left the chat Lol😅
Lol and it's worse in gauteng,especially jhb
Time to call Elon 😅
Man I did a double take when I heard that lol
Like yoh😂
I am an EE, took a mechanical engineering class in the early 90s, was not too interested in it. But the professor was working on thermal chip cooling systems, from what I understand is common tech in laptops now. Your laptop chip heats a fluid in a sealed tube, then it boils off and cooled by a fan, turning it back to a liquid. It is taken for granted but without such a solution, a slim laptop would not exist. He pretty much stated without advances in thermodynamics and cooling, eventually all the EE tech will come to a dead halt. It is true.
That is a heat pipe technique and has been used since for many decades. It became popular even among PC hobbyists in around 2000s. Thermal management is critical to electronics design since inception, so this is not a profound concept.
@@beyondfossilYep. Besides a heat pipe will only move the heat a few inches from the source. It doesn't help at all in this case. They need to move it, all the way out of the building.
Cool story bro
@@LisaSamaritan Sure, but it's a critical part of a *chain* of thermal transport. Because if the excess heat cannot effectively escape the computer's chassis, all of the external heat sink outside of the building becomes useless.
@@LisaSamaritan Yes, my professor worked for IBM and they were trying to cool mainframe processor boards for large scale computing at the time. First heat has to get off the board. Then there is another thermal management system to cool that. Thermodynamics is a very complex science. If the processors get too hot as discussed in the video, the amount of water needed may increase exponentially.
Yeah let's interview a guy that builds datacenters about the risk of AI power usage. Surely he'll be honest and unbiased in what he says. Most of this video felt like an ad for Vantage and other companies.
Ah yes, let's instead interview a liberal arts professor. Gotta make sure the people we talk to are as far away from the actual technology as possible, or else they might have a conflict of interest!!
@@Aurora12488 what a straw man. How about they interview people who work on the power grid, or people who study climate impacts of different projects. AI is a fugazi. it's absurd to think we would be ok straining our limited resources for fancy autocomplete and goofy fake pictures of celebrities.
@@Aurora12488 You're right, those are the only two options for people to interview. Moron.
Awesome Vantage Commercial!
We will wish we started this after the emp hits
Seriously. For every problem, some Advantage spoke person patted themselves on the back.
😂
😂😂😂😂right !!
Most people are not aware that AI applications require data centers and high energy. Companies investing in AI are likely to face more energy and grid problems.
Oh great, you watched the video too
Well then what are innovations for?
From heat to coal to water mill, wind mill to nuclear to fusion ... what are all these Infrastructure for?
😂😂😂😂😂😂😂😂
video cliff notes 📝
No not really. You can install many models locally on your computer.
They reported a similar issue back in the day of Bitcoin mining. Oh wait, that's an existing issue.
Not really. Majority of bitcoin mining is done on cheap renewable energy sources. Many bitcoin miners only mine when power is very cheap, so when power demands spikes and thus costs, they temporarily turn off their ASIC miners.
And FYI bitcoin mining hashrate is at an all time high so bitcoin has never been as secure as now.
🔌⚰ Also with EVs.
I don't remember anyone getting hyped about AI, yet they continue to force it on us. WE DON'T WANT IT.
Speak for yourself
I can’t wait for it to outcompete you out a job.
I m a programmer, you absolutely not a single clue of what you are saying, AI is the almighty power and wisdom of humans and it's only the beginning (we doesn't count B.I.C.A and other gouvernemental AI).
Sky is the limit, sure you will make a lot of Co² emissions but also a lot of new more ecological and efficient tools that are created because of AI.
I want it.
You do realise its being “forced” upon us because its extremely marketable (aka people want it)
Oliver, tus videos sobre trading en diferentes marcos de tiempo son geniales. ¡Estoy aprendiendo mucho!
I'll be darned! I had no idea. It makes sense. More processing results in more heating and more power usage which results in overtaxing the grid. Never heard of water cooling of computing components before either. I learned something new today. So AI is the new "gas guzzler". Maybe we should stop using it for the sake of our planet and think for ourselves instead of making a computer do so.
If they generate most of the energy with renewable methods it should be fine, the question is will they.
I enjoyed your comment. 👍
@@ricardoamendoeira3800lmao I think
we know the answer to that
"Noooooo how am I gonna get my big tiddy waifu images?!"
We should take energy production seriously and invest in nuclear and higher-efficiency fossil fuel energy production. Is this the answer to any new technology that comes out that is resource-intensive? Technological advancement is the only solution to climate change; even "green" activists acknowledge this for new solar panel technology, but ignore everything else. Objectively, our efforts and hundreds of billions of dollars spent on fossil fuel reduction efforts have yielded ZERO results in all scientific metrics and studies. This whole demonization of fossil fuel, THE LIFEBLOOD OF HUMAN CIVILIZATION, is a grand act of bumbling suicide.
I dont understand why these companies cant invest the money on their own power which will make them profit. Why do regular people have to pay for that?
Well, would be smart if they did. As an investment. Pay now but once built, we should get the money back and profit.
It’s the American way. Capitalism over logic.
They will try to get away with as much as possible.
We’re all paying for this whether we like it or not. All this global warming is the price we pay for “technology”. Whether it’s Losing your home through floods or fire, landslides, earthquakes. People’s livelihoods. Yeah we’re all paying for this so the technology companies can get richer and richer until we have nothing left. So keep investing in technology companies magnificent 7 until the end of of time.
Profits are privatized
Losses are socialized
So they want to get rid of gas engine vehicles to save the planet, while at the same time rolling out AI that is 5 to 10x worse than gas vehicles. Makes sense.
Everything makes sense when it comes to globicular warmicooling !! 😜
These are separate issues
Who are “they”
@@nfuenmayorpoliticians and influential people, who else would “they” be. Use your head
Investing in future alternative energy sources will reap reward in the long term
Good thing we’re switching over to electric cars and all electricity powered appliances at home! We’ll just need to build more power plants and upgrade the electric grid. Hellooooooo Coal!!
Glad you’re back!!
Michael, you always explain trading in such a clear and accessible way!
I don’t understand why any energy hungry building with a large unobstructed roof isn’t covered in solar.
While I agree, I can also see how little it would actually do; the best solar panel you can buy right now has an output of 550w max, and is 7’ x 4’. If you use the tightest spacing you can, that means a best-case scenario of 2MW, which is less than 5% of the estimated building’s consumption. To be clear, it’s not 0%, but it’s literally a drop in the bucket; not enough to make a significant difference.
Make solar panels stronger then.
Because it isn't economic. And because white roof paint makes more sense.
Also, those buildings are usually leased, and the owner doesn’t care.
@@jacobcarlson40105% is a lot for a business, especially if it ends up much cheaper than buying from the grid.
There are entire industries with profit margins below 5%.
In Paris, the data centre located downtown provides heat to the Olympic pool and hundreds of homes and a greenhouse.
50MT would provide all the heat anyone could ever need.
Definitely a wider adoption of nuclear energy and investing on nuclear fusion will help feed those data centers more efficiently having such technology comes at a high cost.
Just hopped on your channel today watched a few detailed videos of you explaining your strategy and I implemented onto my demo account and definitely a game changer appreciate the free knowledge not to many that actually breaks it down in a way that even a toddler could understand
When they said AI will be the detriment of humanity, that's what they meant - draining all the energy while making humans stupider. What could go so wrong so fast!
It's going down hill from here
Also don’t forget that they’re building these AI data centers to replace their own employees to reduce staffing costs and make insane profit.
the human race,digging our own graves...at the end of the day when everything is gone...what use will your money be.🤷♀
It is so good to see AI beginning facing problems.
Honestly not good to see it face problems but it was sort of inevitable, it's way to over hyped and over valued without much thought into it, some problem was gonna arise sooner or later, iam just happy that I didn't buy into that whole thing, iam gonna keep working on my own project and all my pears who followed some new flashy trendy area might get screwed, and while iam at it I might invest some money in the utility/energy sector and make some money of off it
Thanks to the generative AI race? Lady society got along just fine without this AI crap. Now we’re just wasting even more electricity. We need to put an end to this now.
Society got along fine without the Internet crap, or even computers and electricity. Might as well put an end to it.
My point is, we don't "need" many things other than food, shelter, and water. However, we shouldn't throw away everything, because such things improve our lives. It's too early to dismiss AI when it's still rapidly improving, and already has many useful use-cases.
AI can have some use in scientific research, but I think the generative "creative" AI contributes nothing humans are already more than willing to do. I think we are letting AI companies walk all over everyone else bc of the misguided motion that it's the "future". If we dont fix the present, we'll just work to make the future worse
@@alpal4245exactly
How?
kills me they will waste all our energy and resources on AI to do what we always could do ourselves and not need gigawatt data centers dictating the grid.
important topic! The power demands of generative AI are a significant challenge for our grid. Thanks for highlighting this issue.
This video is the art of science & technological advancement coverage and reporting. Kudos CNBC. Script Perfect❤
Artificial Intelligence (A.I.) data centers + the demand of those electric vehicles + all of this extreme weather + the fragile/delicate state of our aging power grid = Nationwide Blackout! All of this is reminding me of the movie/film “American Blackout” (2013) and “Grid down, power up” (2022) 🐸☕️
Thinking individuals bear any responsibility for the climate or resources is the most pathetic, actively harmful act that humanity is capable of.
At the 5:30 mark, there has to be a mistake, fusion energy from 2028? If true then this itself deserves a video.
It doesn't deserve a video. It has potential, but that's all it is right now. I have no idea why it says they will buy electricity from them when that's not even on the table for the foreseeable future.
Maybe by 2048. Maybe.
@@jessstuart7495maybe 2084?
It's false. I think they confused the few experimental test reactors coming online soon (ITER, MIT) with full blown fusion power stations.
3028
AI companies should be forced to build and only use solar power generation and storage. Atleast if AI fails, pple can use the renewable energy infrastructure they leave behind.
Good idea, make sure you vote for state and federal representatives that would support it.
What storage system will you comply?
@@JackHawkinswrites look up solid state storage. Thats is a thing
Companies ain't gonna want to pay for all of that. They gonna want you to pay for it just like how sports team want tax payers to pay for their stadiums.
@@longbeach225All the big data companies are already investing billions in various types of power plants and research into more efficient sources.
yeah wow 9 in a row on the demo. Thanks. Been waiting for something that finally works for me. I understand now how Stoch and RSI works.
You are simply a guru in the trading world. Thanks for the work, man.
Let's see, keep my electricity bill down, A/C running in my house, prevent further strain on an aging electric grid or A.I.? Keep your damn A.l. it isn't changing my personal life in any drastic way.
Little or no information on the potential of combining DataCentres with DistrictHeating like what has been done already by Amazon in Tallaght Dublin
A potential that could help us retire 10's of thousands of home fossil fuel heating systems and replace it with #DistrictHeating this could significantly reduce our need for volatile foreign gas imports and the carbon emissions.
I just don't understand how this is always missing from the debate over #DataCentres and how much more of an asset they could be in helping us decarbonising ?
Looking for someone to think of this too! Just build them in cold climates and use the heat for warmth! Jeez, I don’t even have a phd. Too easy.
@@TheBoobanEven for hot water in the summer
@@cmk353 Heating large swimming pools and heating hot tubs is definitely a year round use! This could be combined with a location near University campuses, Hotels, Apartment buildings, Gyms and Spas.
AI is still a waste of energy no matter how you try to fluff it up and sugar coat it. how about we just prioritize all humans having their basic needs like heat or clean water etc first instead of prioritizing having computers think for us.
@@MauiBoi-l3gyou're just wrong. AIs like chatgpt have changed everything for me, for the better. I use the tool everyday for many things. It's sped up my work process tendfold. You seriously cannot be this ignorant.
this why so many people being charged more electricity. due to data centers energy usage.
Yeah, this is exactly what I was thinking. Another way to look at it, if infrastructure needs to be upgraded, we're also going to share the cost.
Notice how this was never talked about...
@@moonlightlofi827 the bulk of cost should be on these data centers and those who created them. Even if we are consumers we pay in many ways the cost. These big corporations need to carry they load.
Electricity costs more because the US is allowing the export of natural gas which exposed US gas and electricity consumers to international price competition. Our electricity is dependent on gas firing because EPA rules made new and much existing coal uneconomic.
yup, demand and price goes hand in hand
the innovative approach Aliagents is taking with tokenized AI agents is seriously next level
Nuclear energy is the answer to our problem. Each of these data centers should have a mini thorium salt reactor on site.
👍
I feel like have seen these before. Entire business sector flocking for single commodity and then the demand suddenly vanish into thin air.
Remember the time we used to fight over ventilator?
Are you insane?
We seriously need to build up our electrical infrastructure backbone. With EVs, data centers, and the electrical grid supplying energy all over the country, we're starting to thin out. Especially with some envisioning 100% renewable energy. Nothing wrong with nuclear.
The cost and the time to build is a problem with nuclear, it makes it hard to justify for new projects.
Keeping the old ones going is nice though, as long as they're safe.
@@ricardoamendoeira3800 "It takes too long to build" has been the excuse for 20+ years now. Just think if we ignored people like you we would have plenty of nuclear power.
Or we could rethink our obsession with exponentially consuming massive amounts of energy.
@@ricardoamendoeira3800 The potential is much greater then the time and resources it'll take us to get there. Plus I think the view of nuclear being unsafe is silly with what we have today, it's just hyseria from what happened in history.
@@mrdeanvincent You're gonna have to be more specific, because that's a bad generalization. If you mean efficiency, then yes there's need for improvement. Hence the research on more efficient alternative methods. If you mean too much consumption in general, that's the market demanding more in response to growth. I see that as a good thing, it means that the market is thriving.
The point I'm making is, in response to growth, we ought to build up our infrastructure. Otherwise we stagnate. One method is nuclear, which is significantly underappreciated. Renewable is good but that's simply not possible now.
Hopefully they are adding solar panels to these facilities to help with power usage. No government subsidies either, they can afford it.
And wind mills.
Lol.....sure dude
Solar panels in the Northeast are in carbon deficit if they last the design life of the panel. Sun just doesn't shine, enough
@@maroon9273 Not allowed off the coast of Cape Cod, so what do they do where the sun doesn't shine and the windmills are NIMBYed.
@@beng4647 😂
Very well structured, everything is clear and logical.
It's time to innovate and invest in the power grid.
The only way I think AI will work long term, is more energy efficient power, safe for the environment. The cost shouldn't be handed down to residents or end users of AI. More work per watt.
More energy efficient power will inevitably translate into more AI so the efficiency will be cancelled.
These companies are trying to convince locals that they need to raise their utility rates so they can develop AI bots that can steal their jobs in a few years. Why should residents be on the hook for this at all?
@@urbanistgod Not necessarily, that is something that has to be determined quantitatively. More energy efficiency certainly translates in some % to more energy usage, but you can't claim and take for granted that that % is 100 such that no energy usage has been saved. Moreover, even if it was 100%, the fact that we will have accomplished more AI usage with the same amount of energy is by itself a huge win.
@@2CSST2 Read about the Jevons paradox.
@@urbanistgodAs long as the power is generated in a renewable way it doesn't matter how much you use. That's the main concern, ensuring that most of the energy generated is renewable.
This was a very informing. Power consumption and technology and how to try to maintain persevere energy. Learning the numbers really does make you wonder about how much energy is being used. I would have never thought to think that AI would need this much energy alone to fully operate and function. To have a break down by people who work within these data centers was really informative each of them expressing their thought on Energy Distribution,Preservation and future plans to more environmentally friendly
Amazing.... the energy consumption of generative AI systems is enormous. Training a single large AI model can consume as much energy as several hundred households use in a year. This is largely due to the need for extensive data processing and the operation of powerful servers in data centers. These centers must run continuously, consuming electricity around the clock, which contributes to an increased demand for power 🥇😘🥰😘🥰😘🥰
@11:13 not vantage. this is one of the pump racks which go to a few water cooled racks in one of googles labs... also what is up with all the wireless ap's at the top of every other rack where their doing the interview in the isle... super weird
When u have the revelation that advancing in tech means the end of humanity. The irony about it
We need a Mike Tyson sphere 🌐
its called a dyson sphere
A.I-Bitcoin-Ev Cars all draw crazy power.
at least crypto & EV cars are adding value. But AI can't even calculate 3+6
Yeah ai on your phone is dumb
@@MelroyvandenBerghave you used copilot? AI for code assisting is incredible. It’s basically eliminating entry level dev jobs.
It’s crypto that’s useless. Nobody needs thousands of made up currencies.
@@MelroyvandenBerg It can, though-the smallest models can. People are literally using larger models in life-saving diagnoses and as a final opinion. There have been cases of people providing all the data of tests and symptoms and such and getting a life-saving diagnosis the doctors missed. This started happening with pets many months ago.
@@faberofwillandmight people should really try to avoid AI for all this.
loving the way Aliagents is blending AI technology with real world applications
Very informative, never thought or knew downside of AI
There is no shortage of (electric) power and ways to make it. If there's a demand, it will be fulfilled. Renewable generation is cheap and expanding rapidly.
LOL
Unlimited POWER!!!
Except it take a good part of a decade to install extra grid to transmit the power or demand!
@@JackHawkinswrites Why not? At 99.9-percent mass the solar system, the sun provides Earth a cosmic 173,000 terawatts of power. Or about 1000W per square meter peak on the ground and its always peak somewhere on Earth.
For reference, 173,000 terawatts will provide our civilization's current *annual* 620-exajoules of energy in just 1-hour. We've barely began to tap into the free clean fusion energy we get from our host star. There is no other power source even remotely close to it within over 4-light years distance from here.
All the combined fossil fuels that ever was and ever will be would only amount to a single bucket of water in an ocean of water when compared to the sun. The entire Earth itself is like the tiniest breadcrumb next to a large watermelon in comparison.
Yes there is. I live in a country with rotating blackouts due to demand exceeding supply in the Grid. Power generation projects take a long time to build, ranging from 2 years up to 10 years. Supply takes a long time to catch up to demand. It's not as fluid as the free market absolutist makes it sound to be. Such projects are also often subsidied by Governments, without subsidies Companies don't often invest in such large scale capital and time intensive projects.
Benefits of AI aside (don't think we've quantified the gains yet), hopefully this will at least accelerate policies and adoption of renewable energies faster. This is also where groups that are otherwise using usless tactics that have not made any difference (looking at your Just Stop Oil) can maybe focus their efforts on if they want actual change.
benefit like how companies get more investor money by putting useless ai in their products
When grown ups were in charge we built more power stations when the economy required it. Its called economic growth. Its what puts food on our tables and a roof over our heads.
Boomers have never been much for investment for the future. It was their parents thing, not theirs. Once the demographics changes such that boomers are a smaller part of the population, we'll get back to investing in things for the future again, likely in about 10 years by my guess.
Economic growth is when I use resources on products that don’t make money
Do any of those server facilities have solar panels on the roof? I doubt it
I wonder if they are factoring in the VR, iot, 6G, electric trucks and cars being charged, etc futures?
We messed up, ai is supposed to do our work for us so we can lounge about and pursue our passions, but instead ai is being used for writing poetry and music while we work ourselves to the bone just to be in crushing debt. I hate what this world has become.
Or you know, just use less GenAI? The whole idea of foundation models is that we'd only need one or two of them, open sourced for free usage (e.g. BERT), thereafter every one can finetune them with far less energy use. Now everybody trains their own foundation models for some reasons.
So naive lmao.
@@TW0man4RMY You must be new to AI. This was how things worked throughout the past decade, until the FOMO / media hype over ChatGPT. What's the marginal added value of having multiple LLMs with similar performance and capabilities? If you have specific needs, why not swap/append one or two layers at the end and finetune on that? Very few use cases require creating and training the full set of weights from scratch.
We don’t need very many foundation models. That’s the whole idea. But people are training the next generation of those models, which will be much larger, and inference (using them) also takes more and more energy. People are not going to use less gen ai. It is often more efficient that other ways of trying to achieve the same goals. For example making a video with gen ai instead of sending a crew of 100 people to Tahiti for a week.
The human brain uses about 10 to 20 Watts of power to function. Brain cells, like all cells, had to be energy efficient from day one. AI researchers don't consider things like energy usage or cost when designing their models.
There are analog neural network chips that act more like the human brain with way less power consumption for a given output than digital chips.
@@gregorymalchuk272 exactly, most likely this will be the way to go.
Power consumption optimization is a byproduct of software optimization, which is what they think about all the time.
There may be optimizations somewhere for software engineers separate from code optimization, but its eclipsed by hardware optimizations.
So yes, from day 1 they were probably thinking about power consumption, just in a roundabout way.
They do think about "power efficiency" but their thinking is via or through optimizing their software which means do the same with less CPU cycles. If you can do that in software then you will save power.
@@gregorymalchuk272 Biden robot only has 1 brain cell
1:08 i'm really curious what the source on this claim is [as in the research paper, not the people]. if i can generate images on my ipad using "draw things" [a stable diffusion client], and only use up 10% for each image [about the load of a graphics intensive game], it most certainly is not using the same amount of energy that it takes to charge a phone. maybe the paper was talking about training rather than inferencing [the part where you type in a prompt and ask it to generate content], but i would think that training takes way more energy
Strangely, the same energy issue that appeared with the development of blockchain technology is resurfacing with Generative AI again. Energy is everything.
Seems like there’s a lost opportunity to use grey water reclamation to cool data centres.
I was just thinking that, I bet current systems are only designed using distilled water.
@@friedzombie4 with enough heat, you can distill it and then use it...
@@lylestavast7652 yeah but I imagine that's energy intensive too...
the impurities would clog up the system and react with the components
Grey water to cool down AI, makes perfect sense... sh!t in, sh!t out. 😆
Do we really need AI that badly like things have been fine without it why take all of our water and power and resources for this ??
How can we hope to survive without chatGPT?
@@willharriman1881-z9b I'm going out on a limb here, but I survived just fine doing my own authentic work without it, for 35 years.
These data centers are already considering switching to SMR's (small modular nuclear reactors) to supply their energy needs because the cost per kilowatt is much cheaper when you factor in the overall costs versus the power output.
SMRs don't exist yet.
@@michaeloreilly657 There is one I believe in the Arctic since 2020 by Russia.
Isn't it wonderful that the solution for today's problems is always something to be invented tomorrow?
@@Superwalloon It wouldn't need to be if the Department of Energy took nuclear seriously. These companies are going after SMRs because the government has made it virtually impossible to build a full-scale nuclear reactor.
Yo… good morning .. nice video King of binary options… I been watching ton of of your videos and taking notes. Thank you again for the content
This is a valid concern. Increased electricity usage can lead to higher costs and put a strain on the power grid. We should consider the long-term implications of this on our energy consumption. It's important to find sustainable solutions that minimize any negative impacts. Hopefully, there are ways to mitigate these potential problems.
We should priorities use of electricity amongst different sectors and maximum priority should be given food and security, entertainment comes later on.
So you're saying we need nuclear power?
SO you can eat uranium ?
Boomers complaining about EVs overloading the grid boutta have a field day with this one
itsdegrading to clump people im bomers or whatever. a lot of people are saying that, a lot of sane people, boomers and others with a working brain.
Is there no way to make use of the excess heat?
Your videos always contain a lot of useful information about trading. Thanks for your hard work!
I wonder how much Vantage paid CNBC to explain to everyone how different and better their data centers are?
This planet is COOKED
Literally
hey lets bring another 11 million people into the US.....not like we are running out of resources
We are letting billionaires control how we think, we don’t need AI.
Speak for yourself, to some of us it’s really important
I think AI is quite important, the future needs automation
@dallasgrful: I completely agree; the vast majority of people don’t even make use of basic automation systems (other than the Driver-Assistance / “safety” systems in their cars, which often can’t be disabled) so there really isn’t much beyond an imagined/manufactured benefit. As I see it, it’s the classic “make something, then invent a use case for it” approach.
@@optimusprime844: Okay, I’m legit interested; what can AI do that makes it so important to you?
I need it and love it
My take from this is the more things change, the more they stay the same. More power needs means more drilling for oil, and even if lessened, the data centers themselves produces heat and CO2 at a massive scale, all of these affect the environment.
Las Vegas Data Center pulls it all from Hoover dam. Brilliant placement.
No way one ChatGPT query takes 5Wh energy. Training must have been factored into this equation, and that's misleading.
@@R0stos right? Another way of saying this is that the same query repeated costs less and less with each iteration.
Amount of Branching is reduced with each iteration, as the less probable branches are eliminated and the probability is redistributed amongst the remaining nodes.
Why is that misleading? I’m honestly curious, as I’m just an uneducated pleb 😅
@@Lady_Graham they are saying the cost is always the same. It isn’t because the time and processing power required reduces over time. Make sense?
@@oidbio2565I think she's still lost
You need to think of it from the power used, at every step, versus time to watt consumed at each step.... That includes the pc it came from, the light in the room, ac in the room, the switch and modem it went thru to get to the internet from the pc, the power the ISP consumes to send the request, every hop it has to go thru to get to the AI server, the time slot on the AI sever, and the return trip, power wise...
While their number is a bit misleading because they didn't explain it that way, AI consumes far more power than a simple table lookup ever will... Don't confuse power numbers consumed simply at the AI server, with the total wattage consumed when any consumer accesses that server are included... 5wh is not that much power if you consider every step consuming it.... If I trace route all known Chat GTP servers from where I live, it varies between 10 to 30 server bounces.... Those servers use 60 to 100 megawatts a day, which in total could literally consume millions of watts a second..... Yes my bounces are 20-50 milliseconds, but it adds up fast.... Very fast, before my request even got to the GPT server.........
TRAINING 1 ai model for 5 cars?? Thats not that bad, this is also assuming the model training is using non renewable energy. A powerful LLM is definitely worth the lifetime co2 emissions of five cars.
Assuming the videos math is correct
1 AI model = 3-4 Boeing 707 trips from NYC to Tokyo and back
There are 100k commercial flights everyday
at least travel is useful, unlike making a computer think for you which is already making humans dumber
@@MauiBoi-l3g my point is that even at its most extreme usages AI will barley add to the already massive amount of co2 we release
People are just grasping at straws trying or invalidate AI anyway they can so they can cope
@arnavprakash7991 i dont think this is grasping at straws. Water was a massive issue even before we had an extra competitor, especially out west and in california.
Plus many people (including myself) have a massive issue with how companies steal artwork and data from creators to fund software that competes with them. Disregarding the workers and creators who are less able to speak up for themselves is kinda sad and exploitative.
@@alpal4245 all of the AI we are seeing is the transformer neural network architecture which was invented in 2017.
Its the same exact algorithm, companies have innovated by increasing data and compute.
So anyone who has data/compute can make these and as we have seen they are, tons of models from outside the big players in the United States.
So you can sue the large companies in the US for copyright, but what about international governments or companies? What about people running models on their own pcs? (local models are improving)
Also models are getting smaller/more efficient for better reasoning. In a few years you will be able to run a gpt 4 level model on your own laptop, it will be your own model to change and tailor to your needs, no internet, no massive servers. Even if AI does not improve in reasoning it will 100% get more optimized overtime and use less resources to run. There is no debating that
@@alpal4245 that looks like grasping
Tom Ferguson you absolute chad 9:12 😂
Had no idea this was such a problem. Great video!
it's not a real issue it's just to drum up clicks... There's way bigger problems to power consumption than AI.
Computers are THE problem today. All of them.
you people are impressively behind the curve.
I just wanted to drop a quick note to say thank you for your helpful tips. I tried them out and managed to get 7 out of 8 - a great improvement for me. Your expertise is truly appreciated!
NFTs and AI art is genuinely polluting the environment.
no it isn't, nice try tho.
You need to eat the bugs and no cow farts or else I will ruin a Picasso for data center!
Talking about watercooling like gamers havent been watercooling their PCs for decades 😅
Your videos and tips are very valuable and helpful for my trading. I am grateful for your help and support.
Good work CNBC!
All the climate activists are completely silent on this lol
Just like most people don’t see the correlation between the economy in general and fossil fuel usage. The economy is based on oil.
How do you know?
they’re not. your algorithm just knows you aren’t a climate activist
The future (already functioning in Nothern Europe) is to also combine data centers with district cooling by absorption chillers and district heating systems. This will allow use of the residual heat generated from the data centers.
why is iCloud not mentioned?
Quick comment about Microsoft’s idea of cooling the hot air produced by the data centers by submerging them into the ocean: they are just transferring heat into the ocean instead of into the atmosphere, which would end up sinking into the ocean. Very sophisticated way of swiping the crap under the rug, me thinks.
I'm currently working at a recently shut down coal powerplant, bringing it back to life due to increased demand right here in Wisconsin. Crazy to see why.
Great reporting CNBC. Can we also do a report on what happens to the CPUs data centers discard when the upgrade to GPUs? Thks
Would oil cooling not be more efficient?