Solved by ifedorov in post #2 
              
              
                I figured out why this happens. There is a line 1783 in transformers/models/unispeech_sat/modeling_unispeech_sat.py: 
output_hidden_states = True if self.config.use_weighted_layer_sum else output_hidden_states 
So even if you pass output_hidden_states=None in forward pass, the output will anyways co…