4 1 5

Julien Delavande

jdelavande

https://delavande.fr

AI & ML interests

None yet

Recent Activity

liked a Space 7 days ago

smolagents/computer-agent

updated a Space 14 days ago

jdelavande/chat-ui-energy

upvoted an article 14 days ago

Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference

View all activity

Organizations

jdelavande's activity

liked a Space 7 days ago

529

Computer Agent

🖥

Run tasks using an AI-powered computer agent

updated a Space 14 days ago

Chat UI Energy Score

⚡

Interact with an AI chatbot tracking energy usage

upvoted an article 14 days ago

Article

Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference

Jan 16

• 73

New activity in jdelavande/chat-ui-energy 19 days ago

Energy Calculation for more models

#6 opened 21 days ago by

Sarvesh19

replied to clem's post 21 days ago

curl https://jdelavande-dev-tgi.hf.space/
-X POST
-H "Content-Type: application/json"
-d '{"inputs":"Hello how are you ?", "parameters":{"max_new_tokens":20}}'

Should work, it directly calls the inference server where the Qwen 2.5 7B is hosted. We might work on integrating the data in the standard api of TGI in the future!

New activity in jdelavande/chat-ui-energy 21 days ago

403 when logged out?

#5 opened 21 days ago by

clem

reacted to clem's post with 🔥 21 days ago

Post

3996

Energy is a massive constraint for AI but do you even know what energy your chatGPT convos are using?

We're trying to change this by releasing ChatUI-energy, the first interface where you see in real-time what energy your AI conversations consume. Great work from @jdelavande powered by spaces & TGI, available for a dozen of open-source models like Llama, Mistral, Qwen, Gemma and more.

jdelavande/chat-ui-energy

Should all chat interfaces have this? Just like ingredients have to be shown on products you buy, we need more transparency in AI for users!