It performs much better than bigger models (reasoning and not) and very fast at fp16 (over 65 token/s) with a Tesla P40 24 gb! I'm impressed!
· Sign up or log in to comment
