DRAGON : A Benchmark for Evidence-Grounded Visual Reasoning over Diagrams
Anirudh Iyengar Kaniyar Narayana Iyengar · Tampu Ravi Kumar · Gaurav Najpande · Manan Suri · Dinesh Manocha · Puneet Mathur · Vivek Gupta
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Anirudh Iyengar Kaniyar Narayana Iyengar · Tampu Ravi Kumar · Gaurav Najpande · Manan Suri · Dinesh Manocha · Puneet Mathur · Vivek Gupta
Adarsh Singh · Kushal Raj Bhandari · Jianxi Gao · Soham Dan · Vivek Gupta
Open-Domain Table Question Answering (TQA) involves retrieving relevant tables from a large corpus to answer natural language queries. Traditional dense retrieval models, such as DTR and DPR, not only incur high computational costs for large-scale retrieval tasks but also require retraining or fi...
Rishita Agarwal · Himanshu Singhal · Peter Baile Chen · Manan Roy Choudhury · Dan Roth · Vivek Gupta
Answering natural language queries over relational data often requires retrieving and reasoning over multiple tables, yet most retrievers optimize only for query–table relevance and ignore table–table compatibility. We introduce REaR (Retrieve, Expand and Refine), a three-stage, LLM-free framewor...
Tejas Anvekar · Junha Park · Aparna Garimella · Vivek Gupta
Evaluating the quality of tables generated by large language models (LLMs) remains an open challenge: existing metrics either flatten tables into text, ignoring structure, or rely on fixed references that limit generalization. We present TabReX, a reference-less, property-driven framework for eva...
Mayank Vyas · Abhijit Chakraborty · Vivek Gupta
Recruiters and job seekers rely on search systems to navigate labor markets, making candidate matching engines critical for hiring outcomes. Most systems act as keyword filters, failing to handle skill synonyms and nonlinear careers, resulting in missed candidates and opaque match scores. We intr...
Suparno Roy Chowdhury · Tejas Anvekar · Manan Roy Choudhury · Muhammad Ali Khan · Kaneez Zahra Rubab Khakwani · M Bassam Sonbol · Irbaz Bin Riaz · Vivek Gupta
Clinicians exploring oncology trial repositories often need ad-hoc, multi-constraint queries over biomarkers, endpoints, interventions, and time, yet writing SQL requires schema expertise. We demo FD-NL2SQL, a feedback-driven clinical NL2SQL assistant for SQLite-based oncology databases. Given a...
Anirudh Iyengar Kaniyar Narayana Iyengar · Tampu Ravi Kumar · Manan Suri · Raviteja Bommireddy · Dinesh Manocha · Puneet Mathur · Vivek Gupta
Diagram question answering (Diagram QA) requires reasoning-level attribution that links each question-answer pair to all visual regions needed to derive the answer, rather than only the region containing the final response. Creating such structured evidence across diagrams, charts, maps, circuits...
Shiven Agarwal · Yash Shah · Ashish Raj Shekhar · Priyanuj Bordoloi · Vivek Gupta
We introduce GameDAI, a hierarchical multi-agent framework that transforms instructor-provided questions into fully playable, pedagogically grounded educational games validated through formal mechanic contracts. Built on phase-based LangGraph sub-graphs, deterministic Quality Gates, and structure...
Dhruv Madhwal · Lyuxin David Zhang · Dan Roth · Tomer Wolfson · Vivek Gupta
Large language models often struggle to recognize their knowledge limits in closed-book question answering, leading to confident hallucinations. While decomposed prompting is typically used to improve accuracy, we investigate its impact on reliability. We evaluate three task-equivalent prompting...
Prasham Yatinkumar Titiya · Jainil Trivedi · Chitta Baral · Vivek Gupta
Multimodal tables i.e. tabular layouts interleaved with charts, maps, icons, and color encodings are ubiquitous in real applications yet remain difficult for Multimodal Large Language Models (MLLMs). Despite advances in text and image understanding, systematic evaluation of table-centric multimod...
Ritam Upadhyay · Naman Ahuja · Rishabh Baral · Aparna Garimella · Vivek Gupta
Large language model (LLM) approaches to tabular summarization rely on extensive prompt engineering, decomposition pipelines, or entity-level intermediate representations to achieve strong performance. While effective, these strategies are computationally expensive and offer limited insight into...