Well I can’t think of anything really 
It may be some discrepancy in your timing scripts?
It may be external factors?
It may be that they don’t actually have the same size?
It may be that your net does different things depending on the values (like a rnn where the length is controlled by the network itself)?