Is your training a multinode training? What may have happened is that you saved the model on the main process only, so only on one machine. The other machines then don’t find your model when you try to load it.
You can use the is_main_local_process attribute of the accelerator to save once per machine.