OpenAI, Machine Learning, Artificial Intelligence, AI, Superalignment.
and more aligned. Using scientific experiments, we study how alignment techniques scale and where they will break. The ultimate goal is to build sufficiently aligned AI systems to substantially advance alignment research itself. 1. Training AI systems using human feedback 2. Training AI systems to