Run this on CPU and use tool calling

#38
by J22 - opened

ChatLLM.cpp:

python tool_llama3.1.py --temp 0 -m ..\llama3.1-8b.bin
    ________          __  __    __    __  ___ 
   / ____/ /_  ____ _/ /_/ /   / /   /  |/  /_________  ____  
  / /   / __ \/ __ `/ __/ /   / /   / /|_/ // ___/ __ \/ __ \ 
 / /___/ / / / /_/ / /_/ /___/ /___/ /  / // /__/ /_/ / /_/ / 
 \____/_/ /_/\__,_/\__/_____/_____/_/  /_(_)___/ .___/ .___/  
You are served by LlaMA3.1,                   /_/   /_/       
with 8030261248 (8.0B) parameters.

You  > which city is hotter, Beijing or New York?
A.I. > 
[Use Tool] get_weather
[Use Tool] get_weather
Based on the current weather conditions, Beijing is hotter than New York. The temperature in Beijing is 40°C, while in New York it is 23°C.
This comment has been hidden

Sign up or log in to comment