The results are sent to a decoder RNN – the so-called “sequence ... and fully connected feed-forward networks. The encoder’s self-attention mechanism helps the model weigh the importance ...