Free Beta Model Hosting
#16
by
carnalimr
- opened
We’re running a little experiment with our new servers and wanted to invite a few Model communities to test it out. If you've got a fine-tuned LLaMA 3B or 8B model, we’re offering free hosting for a few months — unlimited tokens and solid performance (80 TPS for 10-20 concurrent requests).
After the pilot, it’s just $30/month for 3B or $60/month for 8B — but no pressure, we're mainly looking for folks who are excited to try this out and help shape how we roll it out more broadly.
Some communities are already using it to run chatbots or embed their models into their websites — it’s a lightweight way to showcase your work and let others engage with it.
If you’re interested in being part of the pilot, just give us a shout!