Browse Teach Curate

Next-Token Prediction in Large Language Model Text Generation

How a language model produces text by repeatedly predicting the most probable next token from distributions learned during pre-training.

Sonny Text

Next-Token Prediction Explains What a Model Can Do — AI capabilities and limitations

Nearly every strength and quirk of a language model follows from predicting the next token: fluency without verification, plausible invention, and sensitivity to how a prompt starts. Taught in the co…