So i made key_padding_mask and sent to MHA forward and got alignments like this How to mask top part?