pytorch jax gpt2 lm-head causal-lm en arxiv:2009.07185 transformers text-generation
.gitattributes README.md config.json flax_model.msgpack log_history.json pytorch_model.bin tokenizer.json training_args.bin vocab.json
---
language: en
tags:
- gpt2
---

# CRiPT Model (Critical Thinking Intermediarily Pretrained Transformer)

Small version of the trained model (`SYL01-2020-10-24-72K/gpt2-small-train03-72K`) presented in the paper "Critical Thinking for Language Models" (Betz, Voigt and Richardson 2020). See also:

 * [blog entry](https://debatelab.github.io/journal/critical-thinking-language-models.html)
 * [GitHub repo](https://github.com/debatelab/aacorpus)
 * [paper](https://arxiv.org/pdf/2009.07185) 
