I haven’t checked the complete repository, but guess that the returned device might be used somewhere, where it shouldn’t. Could you check, where this method is called and if the device is used to push some activations or parameters to cuda:0?