Solved by hash-ir in post #2 
              
              
                Are you sure they are the same networks? In network B, the linear layers are not followed by any activation unlike in network A. This essentially means that there is a one big linear layer which makes your classifier.