What is Context window?

The maximum number of tokens a model can handle in one request, input and output together.

Long documents and long chat histories must fit inside it. Larger windows allow more, and cost more per request.

Learn more