Attention mask is normally created from input_mask . You cannot bypass attention mask directly. I might be wrong also.
For your purpose, create an input_mask with 1s on First row rows and two colums and then 1s on last two rows and last two columns. Set else to 0.