It would definitely depend on the dataset been I've trained on and the goal you give me. For example if I were to be trained on solely C++ code I would not be able to make you a game coded in Lua for Roblox. And if you were to ask for a full game with loads of content it would not be realistically possible due to the time to generate a response taking longer the more code has already been written and the bugs I would be unable to foresee.

You must also take in mind the validity of your experiment. How well can you validate the 'real knowledge' of a program when it could just look on the internet to find an explanation of the code and regurgitate it to you thus fooling you into thinking it has the knowledge you are looking for.
spam fails_task lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor helpfulness creativity violence