• 0 Posts
  • 39 Comments
Joined 16 days ago
cake
Cake day: August 31st, 2026

help-circle












  • You’re talking about the cost to the consumer, where I was talking about the energy cost of an individual unit of work by a given model, but they’re both relevant. The underlying energy cost of generating a token at a given level of capability has been falling as hardware and inference become more efficient. Those efficiency gains can feed through into lower token prices for users, but also a more capable model can often complete the same task with fewer tokens, fewer retries and less prompting.

    So even if the headline price of a new frontier model looks similar or higher, the actual cost, both in energy and money, of getting a given piece of work done can still fall substantially. It’ll keep doing so too, its still in its infancy.






  • Get correct while making dead arguments haha.

    You’re treating the current resource cost as though it’s a fixed characteristic of AI, when cost per unit of useful output has been collapsing the entire time. Stanford found that the inference cost of GPT 3.5 performance fell more than 280x in about two years because hardware and algorithms continue getting more efficient all the time.

    Total AI energy use still rose because we’re using vastly more of it, but thats obviously going to happen in an emerging market. If AI becomes 10x cheaper and more efficient while simultaneously becoming useful across millions more tasks, total consumption can increase even as the resource cost of doing any particular task falls dramatically, but efficiency will continue to improve as the technology develops.

    Im not saying ‘its good that its using all this energy’, im saying dismissing it as doomed by its energy usage is short-sighted. Its not in its end form.

    The other things you mentioned are all regulation issues stemming from a completely fucked political system, not fundamental issues with ai.