Quantizations of https://huggingface.co/TheDrummer/Gemmasutra-Small-4B-v1

Open source inference clients/UIs

Closed source inference clients/UIs


From original readme

image/png

Special Thanks

  • Thank you to each and everyone who donated and subscribed in Ko-Fi to make our venture a little bit easier.
  • I'm also recently unemployed. I am a Software Developer with 8 years of experience in Web, API, AI, and adapting to new tech and requirements. If you're hiring, feel free to reach out to me however.

Supported Chat Template

  • Gemma (user, assistant)

Description

An upscaled Gemma 2B tune with modern techniques. Au Revoir, Gemma!

Downloads last month
687
GGUF
Model size
3.86B params
Architecture
gemma2
Hardware compatibility
Log In to view the estimation

1-bit

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support