File size: 346 Bytes
667ab0b 39841a7 667ab0b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 |
---
license: mit
datasets:
- pr4nav101/COT_TTM_Finetuning
language:
- en
base_model:
- unsloth/Llama-3.2-1B-Instruct-bnb-4bit
- pr4nav101/llama-3-8b-Instruct-bnb-4bit-Tiny-Thought-Model-Large
pipeline_tag: text-generation
library_name: peft
tags:
- COT
- TTM
- LLM
method:
- Knowledge Distillation with Reverse KL Divergence + PEFT Finetuning
--- |