Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Let's not gloss over the electrical supply. These chips won't work for free.


LLM inference uses on the order of 1 Wh per query. That's under 10 meters of driving on an EV or running air conditioning for under 5 seconds.

https://hannahritchie.substack.com/p/ai-footprint-august-202...


How many querys are people going to be using though when they don't see the upfront costs? And how many querys would have been just as solved with a simple google search or wikipedia page that will instead/also be put through an llm and use extra power? Like if I search for the chocolate tempering temperature or the atomic number of tantalum, isn't all that energy just wasted on the companion llm results? It seems like it will add up.


One query is not going to be a useful benchmark when people are deploying AI swarms in loops to solve simple problems


Or a human riding a stationary bike for 36 seconds.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: