4. The problem starts when you have Evil Wizards And Shit who build world-spanning empires and destroy secrets that could be turned against them. The short version is 'regular, apocalyptic-scale wars and book-burning significantly slow magic improvements.'