5k Tinystory QLora(rank=128, alpha=32, lr=5e-5)

  • Developed by: Nelathan
  • License: apache-2.0
  • Finetuned from model : unsloth/Qwen2.5-3B-bnb-4bit

Seems to be very overfit but coherent

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference API
Unable to determine this model’s pipeline type. Check the docs .

Model tree for Nelathan/Qwen2.5-3B-TinyStory-QLora

Base model

Qwen/Qwen2.5-3B
Finetuned
(1)
this model

Dataset used to train Nelathan/Qwen2.5-3B-TinyStory-QLora