It would be hard to replicate as there are several things about training that are not open to the end-user: hyperparameters, optimizer, scheduler, etc. (Un)fortunately, this information will remain closed. You can call it the “secret sauce” of AutoNLP. The final model is, however, open to the end-user and you are free to do whatever you want with it.