It's a language model. It says stuff that the algorithm thinks sound good to humans. It's not a physics model. It doesn't understand the underlying world it's talking about. Ask it a series of "Mind your Decisions" questions if you want to know if it understands. For it to be AGI it would need a language model, a physics model, and a social model.