Overview
Released by OpenAI in 2020, GPT-3 was a turning point for AI. With 175 billion parameters, it was the largest model of its time and showed that simply scaling up models leads to 'emergent' abilities.
Key Innovation
GPT-3 proved that a model could perform many tasks (coding, translation, creative writing) without specific fine-tuning, just by providing a few examples in the prompt.
Legacy
It paved the way for ChatGPT and the current era of generative AI assistants.