Wysor · working with AI

What is context rot?

Context rot is when an AI assistant gets less reliable as a conversation grows, losing track of details you gave it earlier. Every model reads your chat through a context window, a working memory with limited room. The longer the chat, the more crowded that window gets, and early details fall out of focus: the assistant starts to miss facts and even contradict itself. It is not a glitch, it is how the memory works, and the reliable fix is simple: start a new chat.

One conversation, top to bottomExample
Memory used
Msg 1 · You

Before anything else: Frau Weber is allergic to penicillin.

58 more messages: symptoms, results, history, back and forth. The rule scrolls further and further out of view.

Msg 60 · AI

Here is the prescription: Amoxicillin 500 mg, three times daily for seven days.

Amoxicillin is a penicillin. By message 60, the note from message 1 had scrolled out of the AI’s working memory. It simply forgot.

The note never left the chat. It just fell out of what the AI could still hold in mind. People call this context rot.

What is a context window?

A context window is the amount of text an AI model can take in at once: your messages, its own replies, any files you added and its instructions. It is measured in tokens, small chunks of text; in English one token is roughly three quarters of a word. Anything outside the window, the model simply does not see.

When a chat outgrows the window, the oldest parts are cut off or summarised, depending on the app. But context rot starts well before that point. Even inside the window, models pay the most attention to the beginning and the end of what they read, and details in the middle are easier to miss.

It is memory, not a malfunction

You would not expect to recall every detail of a three-hour conversation perfectly either. An AI’s memory works differently from yours, but it shares one limit with it: there is only so much room. Fill a chat with enough back and forth and the early details get crowded out by everything that came after.

And it is not a quirk of one app or one model. When researchers set out to measure it, they kept finding the same thing everywhere.

75% → 55%

A fact a model answered right about three times in four when it sat at the top of a long input was found only about half the time once it was buried in the middle. Same fact, just moved.

Stanford, “lost in the middle”

18 models

A 2025 report tested 18 of the leading models, including the newest from OpenAI, Anthropic and Google. Every one grew less reliable as the input got longer, even on simple tasks.

Chroma, 2025

The newest models make a headline of their memory, some now advertise a million tokens or more. It helps, but it does not cure this: a fuller window is still a foggier one. So the fix is not more context. It is less, a shorter and cleaner conversation, which is exactly what a new chat gives the model.

The fix

Start a new chat.

When you move on to a new task, or the assistant starts to slip, open a fresh conversation. It clears the crowded memory and gives the model a clean, short context to work from. In Wysor that is one click, and your files and past chats stay safe in your workspace, so a fresh start never loses your work.

One task per chat

Keep each conversation focused instead of letting one run all day.

Put what matters first

Restate the key facts right before you ask for something important.

Upload, don’t paste

Give the AI a document it can reopen, not one long wall of text.

What a new chat does not clear

A new chat resets what the model holds in mind. It does not delete what the app has stored. Most AI tools keep your conversations on their servers, and their terms decide what happens to them next.

That matters more than it sounds. Data protection law protects the parts that identify a person. Once the names are removed, the rest counts as anonymous, falls outside the GDPR, and can legally be pooled, licensed and sold, if the terms allow the provider to reuse it.

On Wysor, every connected AI model provider runs with zero data retention, and we take no licence to reuse your content: we never train on it and never sell it, anonymised or not. See where data goes once reuse is allowed

Common questions

What is context rot?+

Context rot is when an AI assistant gets less reliable as a conversation grows, losing track of details you gave it earlier. It happens because the model's working memory, its context window, gets crowded, and the further back something was said, the more likely it is to be missed.

What is a context window?+

The context window is how much text an AI model can consider at once, including your messages, its replies, any files and its instructions. It is measured in tokens, in English roughly three quarters of a word each. Text outside the window is not seen by the model at all.

Does a bigger context window fix context rot?+

No. A bigger window lets the model take in more, but a fuller window is still a foggier one: research has found that models get less reliable as their input grows longer, even well within their limits. Keeping the conversation short and focused helps more than a larger window.

Is the AI broken when this happens?+

No. An AI has a working memory that is finite, a bit like ours. You would not perfectly recall every detail of a three-hour conversation either. Once a chat gets long enough, the earliest details get crowded out. It is a limit of how the memory works, not a fault.

What is the fix?+

Start a new chat. A fresh conversation clears the crowded memory and gives the assistant a clean, short context to work from. It also helps to keep one task per chat, and to restate the key facts right before you ask for something important. In Wysor a new chat is one click, and your files and past chats stay in your workspace.

Fresh chat, sharp answers.

Every leading AI model, in a private workspace where a new chat is always one click away.