Optimization, Pytorch, Machine Learning, Deep Learning, Tensorboard.
the forward pass of your model can have a significant impact on its performance. Here we list just a few recommendations based on the example that we covered in this post. Avoid initializing constant tensors in the forward pass. Do it in the constructor instead. Avoid using asserts on tensors