I have a question for you, if self.layer_attend1 is nn.sequential of three other layers, how would you be able to print the output size of the middle layer?
Here, is the layer_attend1:
self.layer_attend1 =  nn.Sequential(nn.Conv2d(64, 64, stride=2, padding=1, kernel_size=3),
                                    nn.AdaptiveAvgPool2d(1),
                                    nn.Softmax(1))

and i want to know the shape of output of nn.AdaptiveAvgPool2d(1)
is there a way to do so?