transformers safetensors llama text-generation mergekit merge conversational en arxiv:2306.01708 base_model:DavidAU/L3.1-Dark-Planet-SpinFire-Uncensored-8B base_model:merge:DavidAU/L3.1-Dark-Planet-SpinFire-Uncensored-8B base_model:deepseek-ai/DeepSeek-R1-Distill-Llama-8B base_model:merge:deepseek-ai/DeepSeek-R1-Distill-Llama-8B base_model:nbeerbower/Llama3.1-Allades-8B base_model:merge:nbeerbower/Llama3.1-Allades-8B license:llama3.1 model-index autotrain_compatible text-generation-inference endpoints_compatible region:us
---
base_model:
- deepseek-ai/DeepSeek-R1-Distill-Llama-8B
- nbeerbower/Llama3.1-Allades-8B
- DavidAU/L3.1-Dark-Planet-SpinFire-Uncensored-8B
language:
- en
library_name: transformers
license: llama3.1
tags:
- mergekit
- merge
model-index:
- name: Distilled-DarkPlanet-Allades-8B_TIES
  results:
  - task:
      type: text-generation
      name: Text Generation
    dataset:
      name: IFEval (0-Shot)
      type: HuggingFaceH4/ifeval
      args:
        num_few_shot: 0
    metrics:
    - type: inst_level_strict_acc and prompt_level_strict_acc
      value: 38.92
      name: strict accuracy
    source:
      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Triangle104/Distilled-DarkPlanet-Allades-8B_TIES
      name: Open LLM Leaderboard
  - task:
      type: text-generation
      name: Text Generation
    dataset:
      name: BBH (3-Shot)
      type: BBH
      args:
        num_few_shot: 3
    metrics:
    - type: acc_norm
      value: 29.96
      name: normalized accuracy
    source:
      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Triangle104/Distilled-DarkPlanet-Allades-8B_TIES
      name: Open LLM Leaderboard
  - task:
      type: text-generation
      name: Text Generation
    dataset:
      name: MATH Lvl 5 (4-Shot)
      type: hendrycks/competition_math
      args:
        num_few_shot: 4
    metrics:
    - type: exact_match
      value: 8.38
      name: exact match
    source:
      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Triangle104/Distilled-DarkPlanet-Allades-8B_TIES
      name: Open LLM Leaderboard
  - task:
      type: text-generation
      name: Text Generation
    dataset:
      name: GPQA (0-shot)
      type: Idavidrein/gpqa
      args:
        num_few_shot: 0
    metrics:
    - type: acc_norm
      value: 8.61
      name: acc_norm
    source:
      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Triangle104/Distilled-DarkPlanet-Allades-8B_TIES
      name: Open LLM Leaderboard
  - task:
      type: text-generation
      name: Text Generation
    dataset:
      name: MuSR (0-shot)
      type: TAUR-Lab/MuSR
      args:
        num_few_shot: 0
    metrics:
    - type: acc_norm
      value: 8.05
      name: acc_norm
    source:
      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Triangle104/Distilled-DarkPlanet-Allades-8B_TIES
      name: Open LLM Leaderboard
  - task:
      type: text-generation
      name: Text Generation
    dataset:
      name: MMLU-PRO (5-shot)
      type: TIGER-Lab/MMLU-Pro
      config: main
      split: test
      args:
        num_few_shot: 5
    metrics:
    - type: acc
      value: 26.68
      name: accuracy
    source:
      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Triangle104/Distilled-DarkPlanet-Allades-8B_TIES
      name: Open LLM Leaderboard
---
# Merge

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details

Different merge of Allades, Dark-Planet-SF and DS Distilled models, using DS as base. Doesn't seem to trigger thought proccess of Deepseek model, but useful nonetheless.

Sample
-
User: Write a story about an elf called Tyril fighting an owlbear.

Assistant: Tyril, a skilled Elven archer, crouched behind a moss-covered boulder, her piercing emerald eyes fixed on the snarling owlbear in front of her. The creature's yellow eyes glinted with menace as it reared up on its hind legs, its long claws flexing menacingly.

The boulder was no more than 20 feet away from Tyril, but it provided a modicum of cover. The forest floor around her was a tangle of thorny brambles and tall, swaying ferns that offered some concealment, but not enough to make the owlbear's keen eyes miss her.

Tyril inhaled deeply, filling her lungs with the damp, earthy scent of the forest. She mentally prepared herself for the fight ahead, as she had a reputation for being one of the most skilled and deadly archers among the Elven community.

The owlbear was a formidable opponent; its razor-sharp talons could tear through even the thickest of armor, and it possessed brute strength to match any bear. Tyril knew that if she didn't act quickly, her chances of victory would be slim to none. She slowly reached for one of the quivers of arrows at her side.

With a smooth, practiced motion, she nocked an arrow on to her bowstring. The owlbear, sensing her presence, turned its attention fully to Tyril and took a step forward, its claws scraping against the rough bark of a nearby tree as it shifted weight. Tyril's eyes never left the beast, tracking its every movement. She could almost feel the heat emanating from its body, and she knew that if she hesitated for even an instant, she would be within reach of those deadly talons.

Her bowstring hummed as she drew back to her ear, and a steady, measured breath escaped from between her lips. As her fingers released the arrow, it was gone in a flash - a streak of green and black, whirring through the air with a sharp, guttural whoosh. The owlbear, anticipating Tyril's next move, swiped at the arrow as if to knock it out of the sky.

However, Tyril had taken the angle into account, and her aim was true; the arrow struck the owlbear squarely between its eyes with a sickening thud. The creature let out an anguished howl that echoed through the forest, and for a moment, it stumbled backwards, clutching at the wound.

Tyril didn't wait to see if the attack had been effective - she immediately notched another arrow, her bow singing in its familiar rhythm as she drew back to her ear. With an economy of motion, she released the next arrow, which struck the owlbear's shoulder and caused it to rear up in agony.

The beast's howls now took on a desperate edge, and Tyril realized that this was no ordinary attack - the owlbear was not only wounded but also enraged by the pain. This made it an even more formidable foe, as its ferocity increased with every passing moment.

As she readied yet another arrow, Tyril's eyes flicked over to a nearby tree. She had seen a branch snap off under the weight of the owlbear during one of their earlier skirmishes. That same branch now lay on the forest floor about 20 feet from where Tyril was hiding - and in an instant, she decided that it could become her best friend.

Tyril swiftly nocked another arrow and released it with a smooth, practiced motion. The arrow flew true, striking the owlbear in its side, causing it to wince and take a step back. Then, using all of her archer's skill, she expertly guided her next arrow towards where she knew the snapped branch was lying - straight for the owlbear.

The owlbear, as if anticipating Tyril's strategy, swung around with an arm-like motion. The force of its swipe sent a flurry of leaves and twigs flying through the air, but, to Tyril's surprise, it failed to connect with the branch that she had aimed at. Instead, it missed by a fraction - but not before its razor-sharp talons brushed against her bow, sending a shiver of fear down Tyril's spine as the edge of the bow scraped and almost broke under the owlbear's swipe.

The creature's howls grew even more frantic now, as if enraged by its own ineptitude. However, this was merely a momentary setback for both combatants - Tyril knew that the owlbear would be back to try and claim her as its next meal in no time.

### Merge Method

This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [deepseek-ai/DeepSeek-R1-Distill-Llama-8B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-8B) as a base.

### Models Merged

The following models were included in the merge:
* [nbeerbower/Llama3.1-Allades-8B](https://huggingface.co/nbeerbower/Llama3.1-Allades-8B)
* [DavidAU/L3.1-Dark-Planet-SpinFire-Uncensored-8B](https://huggingface.co/DavidAU/L3.1-Dark-Planet-SpinFire-Uncensored-8B)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:
  - model: nbeerbower/Llama3.1-Allades-8B
    parameters:
      density: 0.5
      weight: 1
  - model: DavidAU/L3.1-Dark-Planet-SpinFire-Uncensored-8B
    parameters:
      density: 0.5
      weight: 1

merge_method: ties
base_model: deepseek-ai/DeepSeek-R1-Distill-Llama-8B
parameters:
  normalize: true
  int8_mask: true
dtype: float16

```
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/Triangle104__Distilled-DarkPlanet-Allades-8B_TIES-details)

|      Metric       |Value|
|-------------------|----:|
|Avg.               |20.10|
|IFEval (0-Shot)    |38.92|
|BBH (3-Shot)       |29.96|
|MATH Lvl 5 (4-Shot)| 8.38|
|GPQA (0-shot)      | 8.61|
|MuSR (0-shot)      | 8.05|
|MMLU-PRO (5-shot)  |26.68|

