user
Write a response that appropriately completes the request.

### Instruction:
What is the maximum size of the input for language models?

### Response:
assistant
The maximum size of the input for language models is usually limited to a few thousand tokens or around 100 thousand characters. Beyond that limit, the model will start to suffer from an excessive memory and computational burden. This can lead to poorer performance with longer inputs. Generally, smaller inputs will give better results. Ideally, the input should not exceed 500 tokens or 20,000 characters.