How to implement local attention of machine translation?

How to implement local attention of the Luong. paper Effective Approaches to Attention-based Neural Machine Translation

2 Likes

I have a working, tested example here: https://github.com/A-Jacobson/minimal-nmt/blob/master/attention.py

1 Like