There are some amazing innovative tools available for agents nowadays, while most AI chatbots are still using naive RAG. There have been advances such as late interaction (Modern ColBERT) which outperform naive RAG and BM25. The Colpali Gemma pipeline allows OCR less retrieval. Retrievers such as Promptrievers and Rank one have reasoning capabilities built into them. And, hypothetical document embeddings offer a representation of the data fitting the user’s thinking and intent.
