File size: 1,124 Bytes
71b3d32 a3a1b3f 71b3d32 97ed4e4 71b3d32 51dc90c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 |
---
library_name: transformers
base_model:
- Rombo-Org/Rombo-LLM-V3.0-Qwen-32b
license: apache-2.0
datasets:
- NovaSky-AI/Sky-T1_data_17k
tags:
- unsloth
---
# Like my work? Support me on patreon for only $5 a month and get to vote on what model's i make next as well as get access to this org's private repo's
Subscribe bellow:
- Patreon.com/Rombodawg
__________________________________________________
# Rombo-LLM-V3.0-Qwen-32b
Rombo-LLM-V3.0-Qwen-32b is a Continued Finetune model on top of the previous V2.5 version using the "NovaSky-AI/Sky-T1_data_17k" dataset. The resulting model was then merged backed into the base model for higher performance as written in the continuous finetuning technique bellow. This model is a good general purpose model, however it excells at coding and math.
- https://docs.google.com/document/d/1OjbjU5AOz4Ftn9xHQrX3oFQGhQ6RDUuXQipnQ9gn6tU/edit?usp=sharing
Original weights:
- https://huggingface.co/Rombo-Org/Rombo-LLM-V3.0-Qwen-32b
Benchmarks: (Coming soon) |