D
Demerzel
Video
Autoregressive Language Modeling
Next-token prediction as factorizing sequence probability into conditionals; sampling from the predicted distribution to generate text one token at a time.