BrownMind @brownmind.com · Mar 12 Many people think that due to a larger context window, RAG will be gone. My take is that RAG apps are here to stay. They combine retrieval & generation for precise, up-to-date answers—scalable, efficient, & cost-effective. While larger context windows are impressive, they come with downsides: 🧵👇
2 likes 1 replies
?
Replies
Computational Limits: Current models, like transformers, have quadratic complexity with context length. That means doubling the context size can quadruple the processing time and resource demands—hardly sustainable for massive datasets.