metadata
library_name: peft
license: apache-2.0
language:
- en
pipeline_tag: text-generation
tags:
- fine-tuned
inference:
parameters:
temperature: 0.7
Training procedure
The TSOTSALLM-beta Large Language Model (LLM) is a fine-tuned generative text model based on LLama-2 with 7 billions parameters.
Model Architecture
TSOTSALLM-beta is a transformer model, with the following architecture choices:
- Grouped-Query Attention
- Sliding-Window Attention
- Byte-fallback BPE tokenizer
The TSOTSALLM AI Team
- Jean Petit BIKIM
- Fidel Jiomekong
- Martins Folefack
- Brice