mergekit-community/mergekit-model_stock-adqzxpt

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using refuelai/Llama-3-Refueled + kik41/lora-length-long-llama-3-8b-v2 as a base.

Models Merged

The following models were included in the merge:

• refuelai/Llama-3-Refueled + kik41/lora-type-descriptive-llama-3-8b-v2
• refuelai/Llama-3-Refueled + surya-narayanan/health
• refuelai/Llama-3-Refueled + surya-narayanan/anatomy
• refuelai/Llama-3-Refueled + ResplendentAI/Smarts_Llama3
• refuelai/Llama-3-Refueled + Azazelle/Llama3-RP-Lora
• refuelai/Llama-3-Refueled + Azazelle/Llama-3-8B-Abomination-LORA
• refuelai/Llama-3-Refueled + moetezsa/Llama3_instruct_on_wikibio
• refuelai/Llama-3-Refueled + DreadPoor/BAEZEL-8B-r128-LORA
• refuelai/Llama-3-Refueled + surya-narayanan/biology
• refuelai/Llama-3-Refueled + surya-narayanan/formal_logic
• refuelai/Llama-3-Refueled + surya-narayanan/human_sexuality
• refuelai/Llama-3-Refueled + vincentyandex/lora_llama3_chunked_novel_bs128
• refuelai/Llama-3-Refueled + surya-narayanan/professional_psychology
• refuelai/Llama-3-Refueled + DreadPoor/ASPIRE-8B-r128-LORA

Configuration

The following YAML configuration was used to produce this model:

models:   
  - model: refuelai/Llama-3-Refueled+surya-narayanan/formal_logic  
  - model: refuelai/Llama-3-Refueled+surya-narayanan/health 
  - model: refuelai/Llama-3-Refueled+vincentyandex/lora_llama3_chunked_novel_bs128   
  - model: refuelai/Llama-3-Refueled+DreadPoor/BAEZEL-8B-r128-LORA
  - model: refuelai/Llama-3-Refueled+DreadPoor/ASPIRE-8B-r128-LORA 
  - model: refuelai/Llama-3-Refueled+surya-narayanan/biology  
  - model: refuelai/Llama-3-Refueled+surya-narayanan/professional_psychology   
  - model: refuelai/Llama-3-Refueled+Azazelle/Llama3-RP-Lora
  - model: refuelai/Llama-3-Refueled+ResplendentAI/Smarts_Llama3
  - model: refuelai/Llama-3-Refueled+Azazelle/Llama-3-8B-Abomination-LORA
  - model: refuelai/Llama-3-Refueled+kik41/lora-type-descriptive-llama-3-8b-v2  
  - model: refuelai/Llama-3-Refueled+moetezsa/Llama3_instruct_on_wikibio
  - model: refuelai/Llama-3-Refueled+surya-narayanan/anatomy
  - model: refuelai/Llama-3-Refueled+surya-narayanan/human_sexuality
merge_method: model_stock
base_model: refuelai/Llama-3-Refueled+kik41/lora-length-long-llama-3-8b-v2