did you ever figure this out? I am trying to do the same - recover attention data from Reformer Classification Model.
I expect (batch_size, num_heads, num_chunks, seq_chunk_size X seq_chunk_size) but get (batch_size, num_heads, num_chunks, seq_chunk_size, 2 X seq_chunk_size)
Thank you