Well first off you should do max pooling before relu as they are mathematically equivalent either order but it’s nearly 40% computationally more efficient to do maxpool before relu.
So look like this:
F.relu(F.max_pooling2d(nn.conv2d(x)))
Are u purposely only maxpooling twice or do want 4times on 4conv2d layers?