Token Limitations

Context

Privacy Considerations

Token Limitations

Essentially, this means ChatGPT can only process a certain amount of text. This amount is roughly equal to a few tens of pages.

The length is counted in tokens, which are bits of words roughly equal to 4 letters. In other words 100 tokens are roughly equal to 75 words.

The Tokenizer will calculate tokens for you.

Current limit for ChatGPT is 128k tokens.

Context

Context is how much ChatGPT can remember back in the conversation.

It is based on the Token Limit It is also 128k tokens. So if you start having a long conversation, after a while it will forget anything that was said in the beginning.

Currently context can be extended through RAG (Retrieval Augmented Generation)

Cut-off Date

• As you may have heard, ChatGPT has been trained on information before September 2023. For that reason, it knows nothing beyond that date
• keep in mind, it can sometimes fool you by trying to guess and extrapolate possible situation out of past data. This can sometimes be quite convincing because it is not clearly presented as “possible guess”