This tool estimates how much electricity your chatbot messages consume


Ever wonder how much electricity you’re using when you prompt, or thank, an AI model? Hugging Face engineer Julien Delavande did, so he built a tool to help arrive at the answer.

AI models consume energy each time they’re run. They’re run on GPUs and specialized chips that need a lot of power to carry out the associated computational workloads at scale. It’s not easy to pin down model power consumption, but it’s widely expected that growing usage of AI technologies will drive electricity needs to new heights in the next couple of years.

The demand for more power to fuel AI has led some companies to pursue environmentally unfriendly strategies. Tools like Delavande’s aim to bring attention to this, and perhaps give some AI users pause.

“Even small energy savings can scale up across millions of queries — model choice or output length can lead to major environmental impact,” Delavande and the tool’s other creators wrote in a statement.

Delavande’s tool is designed to work with Chat UI, an open-source front-end for models like Meta’s Llama 3.3 70B and Google’s Gemma 3. The tool estimates the energy consumption of messages sent to and from a model in real time, reporting consumption in Watt-hours or Joules. It also compares model energy usage to that of common household appliances, like microwaves and LEDs.

According to the tool, asking Llama 3.3 70B to write a typical email uses approximately 0.1841 Watt-hours — equivalent to running a microwave for 0.12 seconds or using a toaster for 0.02 seconds.

It’s worth remembering that the tool’s estimates are only that — estimates. Delavande makes no claim that they’re incredibly precise. Still, they serve as a reminder that everything — chatbots included — has a cost.

“With projects like the AI energy score and broader research on AI’s energy footprint, we’re pushing for transparency in the open source community. One day, energy usage could be as visible as nutrition labels on food!” Delavande and his co-creators wrote.





Source link

  • Related Posts

    US DoJ wants Google to sell two of its ad products

    The U.S. Department of Justice is proposing that Google sell two of its advertising products to restore competition in the ad tech space, according to a new filing. The proposal…

    Blinq lands $25M to further its mission to make business cards passé

    It’s 2025, but business cards are still in vogue — just visit any conference or industry expo and you’ll end up with a pile that’s likely to be discarded sooner…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Movie tariffs proposal stokes confusion and the best Met Gala looks: Morning Rundown

    Movie tariffs proposal stokes confusion and the best Met Gala looks: Morning Rundown

    Merz defeat ‘an obstacle not a catastrophe’

    Merz defeat ‘an obstacle not a catastrophe’

    About 30 pro-Palestinian protesters arrested after occupying University of Washington building

    About 30 pro-Palestinian protesters arrested after occupying University of Washington building

    iPolitics AM: All eyes on Carney as he heads into first one-on-one with Trump

    iPolitics AM: All eyes on Carney as he heads into first one-on-one with Trump