Text Generation
Transformers
Safetensors
falcon
conversational
text-generation-inference

Can this work on TF Lite?

#3
by kthecoder - opened

For mobile device inference

For mobile device inference

I don't know the answer, but even if it works, 180B is big enough to be not reliable/doable on model devices.

Sign up or log in to comment