Yeah,<p><i>One thing that I didn’t realise until sometime afterwards was just how challenging it is to handle issues like model decay, evaluation of models in production, dev-ops etc all by yourself.</i><p>Honestly, it seems like any standard machine learning application (based on train&#x2F;test&#x2F;deploy&#x2F;etc) is going to be more subject to decay&#x2F;bit-rot&#x2F;etc than some equivalently complex application with a codified specification.<p>It seems like something over time is going to be a problem for any institution which relies on such applications.