First, it start with supervised learning with data sets.
Then, it makes reward or reward functions for using on Reinforcement learning algorithm.
Last, it work with PPO  algorithm. We give prompt with reward, it keep learning with it.
spam fails_task lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor helpfulness creativity violence