Situated Embedding Models for Context-Aware Dense Retrieval
Junjie Wu · Jiangnan Li · Yuqing Li · Lemao Liu · Liyan Xu · Jiwei Li · Dit-Yan Yeung · Jie Zhou · Mo Yu
摘要
Retrieval-augmented generation (RAG) over long documents typically involves splitting the text into smaller chunks, which serve as the basic units for retrieval. However, due to dependencies across the original document, contextual information is often essential for accurately interpreting each c...