Hugging Face's logo

KoboldAI

community
https://koboldai.com
KoboldAI
Activity Feed

AI & ML interests

Fiction Models made by the KoboldAI community. All uploaded models are either uploaded by their original finetune authors or with the finetune authors permission. Visit our Discord at https://koboldai.org/discord

Recent Activity

Henk717  updated a Space 6 days ago
KoboldAI/Koboldcpp-Tiefighter
Henk717  updated a model 4 months ago
KoboldAI/LLaMA-3.1-8B-Infinity3M-Kobo
Henk717  updated a dataset 4 months ago
KoboldAI/infinity3m-kobo
View all activity

KoboldAI's activity

Henk717 
updated a Space 6 days ago
elinas 
posted an update 4 months ago
view post
Post
2137
We conducted an experiment in an effort to revive LLaMA 1 33B as it had unique prose and a lack of "GPT-isms" and "slop" in its pretraining data, as well as being one of the favorites at the time. With multiple finetune runs, we were able to extend the model from it's pretrained base of 2048 to ~12,000 tokens adding approx. 500M tokens in the process. The effective length is 16,384 but it's better to keep it on the lower range. It writes well and in multiple formats. In the future, we have some ideas like implementing GQA. Please take a look and we would love to hear your feedback!

ZeusLabs/Chronos-Divergence-33B
Henk717 
updated a model 4 months ago
Henk717 
updated a dataset 4 months ago
Henk717 
updated a Space 4 months ago
Henk717 
updated a model 7 months ago
Henk717 
updated a model 9 months ago
Henk717 
updated a model 10 months ago
mrseeker87 
updated a model 10 months ago
Henk717 
updated 8 models 12 months ago
Henk717 
updated 3 models about 1 year ago