Apply SFT and DPO to TinyLlama 1.1B
-
SebastianSchramm/tinyllama-1.1B-intermediate-step-715k-1.5T-sft-lora
Text Generation • Updated • 2 -
SebastianSchramm/tinyllama-1.1B-intermediate-step-715k-1.5T-sft-lora-merged
Text Generation • 1B • Updated • 11 -
SebastianSchramm/tinyllama-1.1B-intermediate-step-715k-1.5T-dpo-lora
Text Generation • Updated • 2 -
SebastianSchramm/tinyllama-1.1B-intermediate-step-715k-1.5T-dpo-lora-merged
Text Generation • 1B • Updated • 1.8k • 1