ColBERTSaR: Sparsified ColBERT Index via Product Quantization
Eugene Yang · Andrew Yates · Dawn Lawrie · James Mayfield · Saron Samuel · Rohan Jha
摘要
While ColBERT is an effective neural retrieval architecture, it requires a heavy index structure to support candidate set retrieval based on approximated token embeddings, gathering and decompressing document token embeddings, and applying the MaxSim operation. Indexes in PLAID and similar ColBER...