It looks like my issue is that the sample code I’m working with sets a new varialble mnetwork=DataParallel(network), and the training code operates on mnetwork but prediction code operates on network. Verifying the fix now.