ChatGPT is a tool that allows users to interact with a LLM trained with RHLF. It is based on this paper: https://arxiv.org/abs/2203.02155.
The paper focuses on reinforcement learning from human feedback. It is important to note that the model and its training data is proprietary and unavailable to users.

Open Assistant is an open-source alternative to ChatGPT, where the data collection for RLHF is crowdsourced. The goal is to create a tool that is similar to ChatGPT, but can be used for free with open datasets and the availability to run the model on your own hardware and customize it on your task.
spam fails_task lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor helpfulness creativity violence