What? Elon Musk’s xAI data center in Tennessee (when fully expanded & operational) will need 2 GW of energy. That’s as much as some entire cities use in a year.
And then you have a trained model that requires vast amounts of energy per request, right? It doesn’t stop at training.
You need obscene amounts GPU power to run the ‘better’ models within reasonable response times.
In comparison, I could game on my modest rig just fine, but I can’t run a 22B model locally in any useful capacity while programming.
Sure, you could argue gaming is a waste of energy, but that doesn’t mean we can’t argue that it shouldn’t have to cost boiling a shitload of eggs to ask AI how long a single one should. Or each time I start typing a line of code for that matter.
What? Elon Musk’s xAI data center in Tennessee (when fully expanded & operational) will need 2 GW of energy. That’s as much as some entire cities use in a year.
Rockstar games: 6k employees 20 kwatt hours per square foot https://esource.bizenergyadvisor.com/article/large-offices 150 square feet per employee https://unspot.com/blog/how-much-office-space-do-we-need-per-employee/#%3A~%3Atext=The+needed+workspace+may+vary+in+accordance
18,000,000,000 watt hours
vs
10,000,000,000 watt hours for ChatGPT training
https://www.washington.edu/news/2023/07/27/how-much-energy-does-chatgpt-use/
Yet there’s no hand wringing over the environmental destruction caused by 3d gaming.
And then you have a trained model that requires vast amounts of energy per request, right? It doesn’t stop at training.
You need obscene amounts GPU power to run the ‘better’ models within reasonable response times.
In comparison, I could game on my modest rig just fine, but I can’t run a 22B model locally in any useful capacity while programming.
Sure, you could argue gaming is a waste of energy, but that doesn’t mean we can’t argue that it shouldn’t have to cost boiling a shitload of eggs to ask AI how long a single one should. Or each time I start typing a line of code for that matter.