8 minutes through the video... Awesome podcast! Thanks! It really feels like OpenAI has a clear view on the properties of AGI. Never seen this clarity before (or I guess I haven't been looking hard enough). The analogy with a company having a will on its own... it's a really a good one! Smaller systems, confined to very specific tasks which are unrelated to the main objective, may not seem to be individually working towards the main objective, but it might be possible to reveal that the system actually moves towards the global objective by observing the overall functioning of the system. Viewing a system collectively, thus projects a different view from viewing each of the individual elements of the collective system separately.,(reply>), Yeah, the analogy to a corporation is spot on. Why? Because a corporation has no consciousness. It is complex and it even has conscious components, and yet, there is nothing upstairs-- it doesn't have agency, it is being dragged along by various actors acting collectively to some degree of efficiency or another. Of course, it may be best, really, if a machine with super human capabilities not have consciousness-- otherwise, ethics and morals may require  granting it legal rights, at which point we have citizens who are much superior to human citizens.