A Pytorch Implementation of the Transformer Network

This repository includes pytorch implementations of "Attention is All You Need" (Vaswani et al., NIPS 2017) and "Weighted Transformer Network for Machine Translation" (Ahmed et al., arXiv 2017)

Reference

Paper

• Vaswani et al., "Attention is All You Need", NIPS 2017
• Ahmed et al., "Weighted Transformer Network for Machine Translation", Arxiv 2017

Code

• jadore801120/attention-is-all-you-need
• OpenNMT/OpenNMT-py
• The Annotated Transformers