--- license: apache-2.0 language: - en library_name: peft pipeline_tag: text2text-generation --- * Base Model: [Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b-hf) * LoRA target: `q_proj,k_proj,v_proj,o_proj,gate_proj,up_proj,down_proj` * LoRA rank: 16 * Training epochs: 4 See