Overview
Released by Google, T5 unified the landscape of NLP by using a consistent format for all tasks. Whether you are translating English to German or sentiment-analyzing a movie review, the input and output are always text strings.
Unified Framework
For example, to summarize a text, the input would be: 'summarize: [full text]'. To translate, it would be: 'translate English to German: [text]'.
Architecture
Unlike GPT (decoder-only) or BERT (encoder-only), T5 uses the full Encoder-Decoder Transformer architecture.