Conceptual
Login

Context Windows and Token Limits in Large Language Models

The bounded span of text a language model can attend to in one request, and how that budget limits what can be included in a prompt.