gguf version
#4
by
gixnu
- opened
im using android and want to use it since it 7b model
im using android and want to use it since it 7b model
Cool, how are you running models on Android?
And what device is it?
On my phone(A Pixel 2), last i checked it could only run like 3B models, even then, heat was an issue.
I'm using an app called layla-ai
and my phone is OnePlus 11 16gb ram
it can run 7b models sometimes and sometimes it can't