Originally introduced in a 2017 paper, “Attention Is All You Need” from researchers at Google, the transformer was introduced as an encoder-decoder ... captioning to voice cloning to image ...

It comes in two sizes — 232M and 771M parameters — and already excels at tasks such as captioning ... integrating an image encoder and a multi-modality encoder-decoder. This enables the ...