Thanks for the response and explanation!
Do you think it might be possible to use the automatic mixed-precision module to get any speed benefits with the linear layers I used but keep torch.slogdet as float32?
Thanks!