Pytorch for Beginners #43 | Transformer Model: Implement EncoderDecoder

Transformer Model: Implement EncoderDecoder In this tutorial, we’ll complete the implementation of TransformerEncoderDecoder model. First, we’ll discuss the embeddings layers and their implementation. Next, we’ll implement TransformerEncoderDecoder class with the Generator. We’ll also try to understand why do we need to have encode, decode, and generate methods rather than just one forward method. At the end we’ll test the implementation with dummy Source and Target inputs. In the next tutorial, we’ll train our implementation of TransformerEncoderDecoder model for Neural Machine Translation and see how well it performs. Stay tuned!! The code used in this tutorial is available here- #pytorch #tutorial #transformer #encoder #decoder #seq2seq