I sometimes wonder then if AI should be illegal when its creators can't demonstrate that it won't reproduce copyrighted material. In practice in the short term, maybe this means the same thing as banning training on copyrighted material, since that's probably the only way to prevent it right now.