readme: ---
  language: en
  inference: false
  tags:
  - text-generation
  - opt
  
  license: other
  commercial: false
  ---
  
  # OPT-1.3B fine-tuned on officially translated light novels.
  
  Fine-tuned [OPT-1.3b](https://huggingface.co/facebook/opt-1.3b) on 2,500 light novel volumes (~825MB of text).
  
  | Epoch              | Test Loss | Train Loss |
  |--------------------|-----------|------------|
  | 0 (Not fine-tuned) | 4.9080    | N/A        |
  | 1                  | 2.1659    | 2.0625     |
  | 2                  | 2.0758    | 1.8504     |
  | 3                  | 2.0222    | 1.7778     |
  | 4                  | 1.9780    | 1.5146     |
  | 5                  | 1.9463    | 1.5302     |
  