Conceptual

Sequence-to-Sequence Learning

An encoder LSTM compresses the input sequence into a final state that initializes a decoder LSTM, which emits the output sequence one token at a time through a softmax over the vocabulary. The single fixed-size bottleneck vector is its defining weakness on long inputs.