一作SIGIR 2026Poster· Information Retrieval (Short)
How Fine-Grained Should a RAG Benchmark Be? A Hierarchical Framework for Synthetic Question Generation
Chase M. Fensore · Kaustubh Dhole · Jason Fan · Eugene Agichtein · Joyce C. Ho
摘要
Evaluating retrieval-augmented generation (RAG) systems requires benchmarks that capture diverse question characteristics, yet practitioners lack empirical guidance on which dimensions to vary and at what granularity. We present HieraRAG, a hierarchical framework for studying granularity in RAG b...