Tools Call?
#4
by
BarraHome
- opened
There is support for tool calling / functions?
I think it would be simillar to this:
https://www.philschmid.de/gemma-function-calling
It should be on the template right?
I think it would be simillar to this:
https://www.philschmid.de/gemma-function-callingIt should be on the template right?
According to the blog, you can try your own template but with my colleague's expirience you better stay with similar format especially when using small models.
If you are using Ollama, you can hack the tool calling as per given example here
https://github.com/ollama/ollama/issues/10792
If you are using Ollama, you can hack the tool calling as per given example here
https://github.com/ollama/ollama/issues/10792
No, vLLM. But thank you.
BarraHome
changed discussion status to
closed