Flash Attention

8

I have been speaking to a few different peers and they are noticing results similar to yours. I will have to test the Triton version by Tri Dao too.