readme: ---
  language:
  - ru
  tags:
  - PyTorch
  - Transformers
  thumbnail: "https://github.com/sberbank-ai/ru-gpts"
  ---
  # rugpt2large
  Model was trained with sequence length 1024 using transformers by [SberDevices](https://sberdevices.ru/) team on 170Gb data on 64 GPUs 3 weeks.
  