README.md

metadata

base_model:
  - Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4
  - CultriX/Qwen2.5-14B-Wernicke
library_name: peft
tags:
  - mergekit
  - peft

Qwen2.5-14B-MMLU_PRO-LoRA-R32

This is a LoRA extracted from a language model. It was extracted using mergekit.

LoRA Details

This LoRA adapter was extracted from CultriX/Qwen2.5-14B-Wernicke and uses Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4 as a base.

Parameters

The following command was used to extract this LoRA adapter:

mergekit/scripts/extract_lora.py --model CultriX/Qwen2.5-14B-Wernicke --base-model Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4 --out-path Qwen2.5-14B-MMLU_PRO-LoRA-R32 --cuda --no-lazy-unpickle --safe-serialization --trust-remote-code --read-to-gpu --copy-tokenizer --allow-crimes