It's tempting to treat a large context window as a dumping ground, paste in the whole document, the whole chat history, the whole knowledge base, and let the model sort it out. Research from Chroma (July 2025) shows why that instinct backfires. Testing 18 leading LLMs, including GPT-