Tuesday, July 28, 2026

What Is an LLM, Actually?

You've probably heard the term "LLM" a hundred times — Large Language Model, the brain behind ChatGPT, the "AI" everyone's talking about. But what is it, really?


A robot surrounded by open books, reaching up as if catching them
An LLM doesn't "know" everything — it's just read an enormous number of books.

Start With a Simple Picture

Imagine someone who has read almost everything ever written — every book, every website, every conversation posted online. But they've never lived in the real world. They've only ever read.

Now you ask this person a question. They don't look up the answer in a book. Instead, they start guessing the next word that makes sense, based on everything they've read before. Then the next word. Then the next.

That's basically what an LLM does. It's not searching for facts. It's predicting one word at a time — guessing what comes next, based on patterns it has seen millions of times before.

How It Actually Works

Here's the whole process, in order:

  1. You type something — a question, a sentence, anything.
  2. The model breaks it into small pieces (not always full words — sometimes just chunks of words).
  3. It predicts the most likely next piece, based on patterns from everything it was trained on.
  4. It adds that piece to the sentence, then predicts the next one.
  5. It repeats this, one piece at a time, until it has a full answer.

That's it. There's no separate "thinking" step where it plans the whole answer first. It's building the response one word at a time, live, as it goes — a bit like talking off the top of your head instead of reading from a script.

A Simple Example

Here's what "guessing the next word" looks like:

You type: "Once upon a"
It guesses: "time"

Nobody told it "Once upon a time" is a famous phrase. It just noticed, from reading a huge amount of text, that "time" comes after "once upon a" more often than any other word. That's the whole trick, done billions of times.

Model vs. Interface — Not the Same Thing

This trips a lot of people up, so let's clear it up simply.

The model is the actual "brain" doing the word-guessing. The interface is just the app or website you use to talk to it — like a car's dashboard sitting on top of its engine.

Interface (the app)
ChatGPT
runs on
Model (the brain)
GPT-4o
Interface (the app)
Claude.ai
runs on
Model (the brain)
Claude Opus 4.8

Same app, different "brain" underneath — that's why ChatGPT can feel smarter or faster after an update, even though the app itself looks unchanged. You didn't get a new dashboard. You got a new engine.

A Simple Thing You Can Try

Ask any AI chatbot the same kind of question three times, and compare a creative prompt to a factual one:

  • Creative: "Tell me a fun fact about octopuses."
  • Factual: "What temperature does water boil at?"

Notice the creative answers change a lot each time, but the factual one barely changes at all. For the factual question, there's one clear "most likely" answer, so it says roughly the same thing every time. For the creative question, lots of answers are equally likely, so you get real variety — same process, different results depending on the question.


What Is an LLM, Actually?

You've probably heard the term "LLM" a hundred times — Large Language Model, the brain behind ChatGPT, the "AI" ev...