GPT

← Back to the article

GPT writes text by guessing the next word again and again.

What it does

GPT writes text by guessing the next word again and again.

Generative: AI that creates content • Prompt: Instructions given to AI

How it works

  • Read the prompt.
  • Guess a good next word.
  • Add that word, then guess the next one.

Uses and applications

  • A writing helper can draft an email.
  • A coding helper can suggest code.
  • A tutor chatbot can answer a question in simple words.

In short

GPT generates text one next piece at a time.

Related methods

  • Transformer: The architecture GPT is built on.
  • BERT: Reads text in both directions for understanding rather than generation.
  • RAG (Open Book AI): Adds retrieved sources to a generator's input before it answers.

Back to Language and text models · All topics

The interactive demonstration and the Python walkthrough for this topic need JavaScript.