transformers safetensors llama text-generation LLM llama-2 finetuned fr arxiv:2307.09288 arxiv:2401.16182 license:llama2 autotrain_compatible text-generation-inference region:us
---
language: fr
license: llama2
pipeline_tag: text-generation
tags:
- LLM
- llama-2
- finetuned
inference: false
---

<p align="center" width="100%">
<img src="assets/logo.png" alt="Vigogne" style="width: 30%; min-width: 300px; display: block; margin: auto;">
</p>

# LLaMandement-7B: A Llama-2-based French Models for Summarization of French Legislative Proposals.

LLaMandement-7B is a French chat LLM, based on [LLaMA-2-7B](https://ai.meta.com/llama), optimized to summarize of French Legislative Proposals.

## Model Details

- **Developed by:** [DGFIP](https://www.impots.gouv.fr/presentation-de-la-dgfip-overview-dgfip) : 
- **Model type:** An auto-regressive language model based on the transformer architecture
- **License:** Llama 2 Community License Agreement
- **Finetuned from model:** [Llama 2](https://arxiv.org/abs/2307.09288)
- **Repository:** https://gitlab.adullact.net/dgfip/projets-ia/llamandement
- **Paper:** [Technical Report](https://arxiv.org/abs/2401.16182)

## Prompt Template


The prompt for LLaMandement-7B is based on alpaca template :

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{instruction}

### Response:
```

## How to Get Started with the Model

- Command line interface: https://github.com/lm-sys/FastChat
- APIs (OpenAI API, Huggingface API): https://github.com/lm-sys/FastChat/tree/main#api  


## Citation
```
@article{gesnouin2024llamandement,
  title={LLaMandement: Large Language Models for Summarization of French Legislative Proposals},
  author={Gesnouin, Joseph and Tannier, Yannis and Da Silva, Christophe Gomes and Tapory, Hatim and Brier, Camille and Simon, Hugo and Rozenberg, Raphael and Woehrel, Hermann and Yakaabi, Mehdi El and Binder, Thomas and others},
  journal={arXiv preprint arXiv:2401.16182},
  year={2024}
}
```
