|
--- |
|
library_name: peft |
|
license: apache-2.0 |
|
language: |
|
- en |
|
pipeline_tag: text-generation |
|
tags: |
|
- fine-tuned |
|
inference: |
|
parameters: |
|
temperature: 0.7 |
|
--- |
|
## Training procedure |
|
The TSOTSALLM-beta Large Language Model (LLM) is a fine-tuned generative text model based on LLama-2 with 7 billions parameters. |
|
|
|
## Model Architecture |
|
TSOTSALLM-beta is a transformer model, with the following architecture choices: |
|
- Grouped-Query Attention |
|
- Sliding-Window Attention |
|
- Byte-fallback BPE tokenizer |
|
## The TSOTSALLM AI Team |
|
- Jean Petit BIKIM |
|
- Fidel Jiomekong |
|
- Martins Folefack |
|
- Brice |
