File size: 583 Bytes
c7cc110 0c1384b cd722b8 0c1384b c7cc110 0c1384b c7cc110 0c1384b cd722b8 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
---
library_name: peft
license: apache-2.0
language:
- en
pipeline_tag: text-generation
tags:
- fine-tuned
inference:
parameters:
temperature: 0.7
---
## Training procedure
The TSOTSALLM-beta Large Language Model (LLM) is a fine-tuned generative text model based on LLama-2 with 7 billions parameters.
## Model Architecture
TSOTSALLM-beta is a transformer model, with the following architecture choices:
- Grouped-Query Attention
- Sliding-Window Attention
- Byte-fallback BPE tokenizer
## The TSOTSALLM AI Team
- Jean Petit BIKIM
- Fidel Jiomekong
- Martins Folefack
- Brice |