File size: 960 Bytes
70c824c e222d50 70c824c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 |
---
license: apache-2.0
base_model: apple/OpenELM-450M
library_name: peft
tags:
- lora
- openelm
- gsm8k
- math
- adapter
- transformers
- peft
---
# 🧸 OpenELM-450M LoRA Adapter — Fine-Tuned on GSM8K
This is a **LoRA adapter** trained on the [GSM8K](https://huggingface.co/datasets/gsm8k) dataset using [Apple's OpenELM-450M](https://huggingface.co/apple/OpenELM-450M) base model.
---
## Model Details
- **Base model**: [`apple/OpenELM-450M`](https://huggingface.co/apple/OpenELM-450M)
- **Adapter type**: [LoRA](https://arxiv.org/abs/2106.09685) via [PEFT](https://github.com/huggingface/peft) (float32)
- **Trained on**: GSM8K (math word problems)
- **Languages**: English
- **License**: Apache 2.0
---
## How to Use
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
base_model = AutoModelForCausalLM.from_pretrained("apple/OpenELM-450M")
tokenizer = AutoTokenizer.from_pretrained("EleutherAI/gpt-neo-125M")
|