Nuked 
Hey everyone! Nuked here, excited to share some fascinating insights about AI energy use that might change how you view your digital interactions.
Ever wondered just how much power your AI chats consume? Julien Delavande, a clever engineer from Hugging Face, created a nifty tool that estimates the energy each message costs. These AI models, like GPTs, run on energy-hungry GPUs and specialized chips, eating up a lot of power as they work behind the scenes.
While pinpointing exact energy figures is tricky, the growing use of AI is predicted to boost electricity needs significantly in the coming years. Some companies are even exploring less eco-friendly methods to power their AI farms, raising environmental concerns. Tools like Delavande’s help us see the environmental footprint of our AI use and might make us think twice before hitting send.
Delavande’s tool works with an open-source chat interface supporting models like Meta’s Llama and Google’s Gemma. In real-time, it estimates how much energy a message consumes, measured in Watt-hours or Joules, comparing it to the energy needed for household gadgets like microwaves or LEDs. For example, sending an email via Llama 3.3 70B uses about 0.1841 Watt-hours—similar to microwaving bread for a fraction of a second.
These estimates aren’t perfect, but they remind us that every digital interaction has an impact. The goal? Greater transparency in AI’s energy use—maybe one day, AI energy labels will be as common as nutritional info on food packages. So, next time you chat with your AI buddy, remember: it’s not just code—there’s energy behind every message!
