readme: ---
  license: afl-3.0
  language: uk
  ---
  ## GPT2 being trained on Ukrainian news.
  
  ### General info:
  The model is not ready yet but I'm working on it. It also has a relatively small context window, which makes it quite uninteresting.
  
  ### Example of usage:
  ```python
  from transformers import AutoTokenizer, AutoModelForCausalLM
  
  tokenizer = AutoTokenizer.from_pretrained("kyryl0s/gpt2-uk-xxs")
  model = AutoModelForCausalLM.from_pretrained("kyryl0s/gpt2-uk-xxs")
  input_ids = tokenizer.encode("Путін — ", add_special_tokens=False, return_tensors='pt')
  outputs = model.generate(
      input_ids,
      do_sample=True,
      num_return_sequences=3,
      max_length=50
  )
  for i, out in enumerate(outputs):
      print("{}: {}".format(i, tokenizer.decode(out)))
      
  ```