8 Bit Elon

RAG is so back! A new paper shows that straightforward retrieval from chat history can outperform much more complex agent memory systems. The approach, RAW-RAG, retrieves relevant passages from the original conversation, reranks them, and passes the evidence to an LLM. Across four benchmarks, it ranked first among the compared memory systems in six of seven benchmark–model settings. The interesting part is why. An answer can depend on several connected statements, including what changed, when it changed, and which earlier facts it affects. Turning conversations into isolated memories can break those connections. RAW-RAG supplied enough evidence to answer more often. Even improved access to the transformed memory stores left an accuracy gap compared with raw evidence. Preserving the original conversation keeps more of those relationships available for retrieval. For these memory tasks, that makes simple RAG a baseline that more elaborate systems should have to beat. paper: arxiv.org/abs/2610.30755 On a related note, I wrote about how observations in agent memory connect facts across conversations to surface patterns an agent can act on. If you’re building agents, you might find that article useful. It’s quoted below.