Looks like it is related to type of gpu, on k80 both versions take ~300mb, on p4 535 vs 595, on p100 715mb vs 777mb. So this example is invalid.
Still, top example was made on same gpu.
Maybe it is about rnn layers or zero padding, i will try to check later.