Will it run on a 4090?
#1
by
brifl
- opened
I ran this successfully on a home PC with a GeForce 4090 RTX. It ran on oobabooga. I'm sharing my success or failure of running these models larger than 13b locally to save some people time, disk, and bandwidth.
I really like this one and I want to explore it more. It seems to be able to hold onto a though without going off the rails.