Skip to main content

Locke Lee

Back to articles

ARTIFICIAL INTELLIGENCE / DEEP EXPLAINER

What Is a Large Language Model, and How Can It Write an Article?

A large language model does not plan an entire article before typing. It predicts one token from the context, then repeats. That mechanism enables novel expression—and lets a small early mistake grow into a coherent story.

01 / ARTIFICIAL INTELLIGENCE / DEEP EXPLAINER

The article is not generated all at once

An LLM does not privately compose a complete article and then type it out.Given the tokens already present, it calculates probabilities for the next token, selects one, appends it and repeats.

A paragraph is the accumulated result of many small predictions—like an improvising musician choosing the next note before the whole song exists.

02 / ARTIFICIAL INTELLIGENCE / DEEP EXPLAINER

“Large” mostly means parameters and data

Large mainly refers to scale: many adjustable parameters trained over a great volume of data.Parameters are not neat encyclopedia slots.

Patterns of syntax, style, association and concepts are distributed across them.A fact may not live at one address; many weights together make one continuation more likely than another.

03 / ARTIFICIAL INTELLIGENCE / DEEP EXPLAINER

Attention builds a temporary relationship map

Attention builds a temporary map of which positions in the current input matter to one another.Bank forms different relationships beside a river than beside a loan.

This map is recomputed for the present context, allowing meaning to shift with surrounding text.It is not limitless memory, and more positions create additional computational and retrieval difficulty.

04 / ARTIFICIAL INTELLIGENCE / DEEP EXPLAINER

It writes convincingly because the world leaves traces in language

Human knowledge leaves shapes in language.Recipes contain ordered steps, research contains arguments, and email contains social conventions.

Learning to predict across enough structures forces a model to capture patterns deeper than spelling.The surprise is how much structure must be represented to make strong next-token predictions at scale.

05 / ARTIFICIAL INTELLIGENCE / DEEP EXPLAINER

A good next step does not guarantee a correct whole

Local plausibility does not guarantee global truth.Every sentence in a long article may sound natural while a later paragraph quietly changes an earlier definition.

An early mistake also becomes context for later predictions, enabling a coherent explanation around a false premise.A long answer is a longer chain of unverified bets.

06 / ARTIFICIAL INTELLIGENCE / DEEP EXPLAINER

The most useful way to read model output

Read model output as a sophisticated draft, not its own source.Check names, numbers, quotations and causal jumps.

Ask for assumptions and uncertainty to be separated from facts.For current or high-stakes claims, place inspectable evidence back into the workflow.

Understanding generation tells us where human judgement still belongs.

07 / ARTIFICIAL INTELLIGENCE / DEEP EXPLAINER

The hidden cost of coherence

Because each new token conditions on the text already produced, coherence is partly self-reinforcing.A correct outline can stabilise a strong answer, while a false premise can stabilise an elegant mistake.

This is why planning, retrieval and checking change results even when the underlying model stays the same.The model is not merely revealing stored intelligence; it is travelling through a path created jointly by training, prompt, sampling and its own previous words.

Change the path and a different article can emerge.

Source notes

Source notes

  1. developers.google.com/machine-learning/crash-course/llm
  2. arxiv.org/abs/1706.03762

Sources support the mechanisms and limitations discussed. Models and products change; check each source’s date and version.

You reached the end. There is no pitch.

The purpose is a more accurate mental model—not turning curiosity into a sales funnel.

WhatsApp Locke Lee