Disya's picture
Update README.md
43dd131 verified
metadata
base_model:
  - soob3123/amoral-cogito-14b
  - aixonlab/Zara-14b-v1.2
library_name: transformers
tags:
  - mergekit
  - merge
license: apache-2.0

amoral-cogito-Zara-14B


I tried to make it more humane, creative, and suitable for writing, and it seemed to turn out not bad, but it needs testing.

We need to add Enable deep thinking subroutine to the beginning of the system prompt, and <think> at the start of the sentence.

This is very, very suck, don't download this.


This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the TIES merge method using ./amoral-cogito-14b as a base.

Models Merged

The following models were included in the merge:

  • aixonlab/Zara-14b-v1.2
  • soob3123/amoral-cogito-14b

Configuration

The following YAML configuration was used to produce this model:

name: amoral-cogito-Zara
models:
  - model: ./amoral-cogito-14b
    parameters:
      weight: 0.75
      density: 0.6 
  - model: ./Zara-14b-v1.2
    parameters:
      weight: 0.25
merge_method: ties
dtype: bfloat16
base_model: ./amoral-cogito-14b