Calling amp.initialize multiple times with different opt_levels is not supported, to you should split the test code into different runs using the same data (load the random tensors from disc and reinitialize the model with the same state_dict).
Also, you shouldn’t call half() on any parameter, model, or data.