without having the time to reproduce your errors right now. Did I understand correctly that you attempted to access the same hdf5 file from two different training sessions?
I am facing similar issues currently and one remedy that is supposed to work is enabling swmr in recent versions of libhdf5 which is said to resolve the concurrency issues which honestly have left me in doubt about the suitability of this data format for scientific applications all together