transformers safetensors llama text-generation text-generation-inference unsloth trl conversational en ja dataset:NilanE/SmallParallelDocs-Ja_En-6k-preChunkedForTinyllama base_model:NilanE/tinyllama-relora-merge base_model:finetune:NilanE/tinyllama-relora-merge license:apache-2.0 autotrain_compatible endpoints_compatible region:us
---
base_model: NilanE/tinyllama-relora-merge
datasets:
- NilanE/SmallParallelDocs-Ja_En-6k-preChunkedForTinyllama
language:
- en
- ja
license: apache-2.0
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
---

In-progess long-context Japanese-English translation model based on tinyllama. Input should be 500-1000 tokens long. Make sure to set 'do_sample = False' if using HF transformers for inference, or otherwise set temperature to 0 for deterministic outputs.

## Prompt format
"""Translate this from Japanese to English:\n### JAPANESE: {source text} \n### ENGLISH: """