Wow, thank you sir it works now.
Can just explain in one or two sentences, why it works?
and is this activation function for the whole layer4? (seems to me it is). I wanted to just apply it to conv2  in  BasicBlock1  of  layer 4 .