transformers pytorch safetensors llama text-generation text-generation-inference unsloth trl sft conversational en license:apache-2.0 autotrain_compatible endpoints_compatible 8-bit region:us
---
base_model: unsloth/deepseek-r1-distill-llama-8b-unsloth-bnb-4bit
language:
- en
license: apache-2.0
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
- sft
---

# Biochemistry fine-tuned model inspired by Dr. Taiju 

🧠 This model was fine-tuned using the camel-ai/chemistry dataset, specifically using 500 rows from the Biochemistry topic.

⚗️ This dataset was produced using an AI model, so please don't use it for serious tasks, since it hasn't been verified by experts, and probably it will never be, it's a fake scientist model (hence the name, stolen from Dr. Stone).

🧬 However you can test it and ask questions about Biochemistry like: enzymes, Michaelis–Menten kinetics, inhibitors, RNA transcription and translation, Nucleic acid structure and function, among many other related topics.

## Training summary

|     |     |
| --- | --- |
| total\_flos | 1.6102540324798464e+16 |
| train/epoch | 0.96 |
| train/global\_step | 60  |
| train/grad\_norm | 0.25071 |
| train/learning\_rate | 0   |
| train/loss | 0.5298 |
| train\_loss | 0.68625 |
| train\_runtime | 1200.9057 |
| train\_samples\_per\_second | 0.4 |
| train\_steps\_per\_second | 0.05 |

Some specs were chosen because free GPUs aren't that permissive.

- **Developed by:** EduardoZepeda
- **License:** apache-2.0
- **Finetuned from model :** unsloth/deepseek-r1-distill-llama-8b-unsloth-bnb-4bit
- **Dataset used :** [camel-ai/chemistry](https://huggingface.co/datasets/camel-ai/chemistry)
- 
This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.

[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
