Delta-Vector/Dans-LN

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the SCE merge method using NewEden/ckpt-44 as a base.

Models Merged

The following models were included in the merge:

• NewEden/ckpt-36
• NewEden/ckpt-42
• NewEden/checkpoint-30

Configuration

The following YAML configuration was used to produce this model:

base_model: NewEden/ckpt-44
merge_method: sce
dype: bfloat16
out_dtype: bfloat16
Parameters:
    select_topk: 0.15
models:
  - model: NewEden/checkpoint-30
  - model: NewEden/ckpt-36
  - model: NewEden/ckpt-42