As the error says, your inputs (likely) are double (aka float64) while your weights are float32 (which is the standard in GPU computing).
inputs = inputs.to(device, dtype=torch.float32)

will help, but you could also see whether you want to provide the data as 32 bit floats to start with.
Best regards
Thomas