Neural Theorem Proving for Verification Conditions: A Real-World Benchmark
Qiyuan Xu · Xiaokun Luan · Renxi Wang · Joshua Leang · Peixin Wang · Haonan Li · Wenda Li · Conrad Watt
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Qiyuan Xu · Xiaokun Luan · Renxi Wang · Joshua Leang · Peixin Wang · Haonan Li · Wenda Li · Conrad Watt
Jiahui Geng · Fengyu Cai · Shaobo Cui · Qing Li · Liangwei Chen · Chenyang Lyu · Haonan Li · Derui Zhu · Alexander Pretschner · Heinz Koeppl · Fakhri Karray
Code retrieval is vital to modern software engineering as it boosts reuse and speeds up debugging. However, current benchmarks primarily emphasize functional relevance while neglecting code quality. To address this gap, we introduce CoQuIR, the first large-scale, multilingual benchmark specifical...
Saeed Almheiri · Bilal Elbouardi · Salsabila Zahirah Pranida · Irina Nikishina · Ashwath Rao B · Parameswari Krishnamurthy · Muhammad Cendekia Airlangga · Rifo Ahmad Genadi · Nguyen Phan Gia Bao · Amir Hossein Yari · Hawau Olamide Toyin · Nurdaulet Mukhituly · Mena Attia · Besher Hassan · Ahmad Fathan Hidayatullah · Tatsuki Kuribayashi · Haonan Li · Suma Bhat · Fajri Koto
Idiomatic expressions pose a major challenge for multilingual NLP because their meanings shift between figurative and literal usage, often requiring context for accurate interpretation. Prior work has focused on high-resource languages typically evaluates isolated idiom-meaning questions, overloo...
Zhuohan Xie · Daniil Orel · Rushil Thareja · Dhruv Sahnan · Hachem Madmoun · Fan Zhang · Debopriyo Banerjee · Georgi Nenkov Georgiev · Xueqing Peng · Lingfei Qian · Jimin Huang · Jinyan Su · Aaryamonvikram Singh · Rui Xing · Rania Elbadry · Chen Xu · Haonan Li · Fajri Koto · Ivan Koychev · Tanmoy Chakraborty · Yuxia Wang · Salem Lahlou · Veselin Stoyanov · Sophia Ananiadou · Preslav Nakov
Multi-step symbolic reasoning is essential for robust financial analysis; yet, current benchmarks largely overlook this capability. Existing datasets such as FinQA and ConvFinQA emphasize final numerical answers while neglecting the intermediate reasoning steps required for transparency and verif...