SciReason: A Controllable Benchmark for Scientific Reasoning in LLMs
Pierre Beckmann · Marco Valentino · Andre Freitas
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Pierre Beckmann · Marco Valentino · Andre Freitas
Mael Jullien · Andre Freitas · Marco Valentino · Lei Xu
Large language models can produce fluent judgments for clinical natural language inference, yet they frequently fail when the decision requires the correct inferential schema rather than surface matching. We introduce CARENLI , a compartmentalised agentic framework that routes each premise–statem...
Mael Jullien · Andre Freitas · Marco Valentino · Leonardo Ranaldi
Recent works on large language models (LLMs) have demonstrated the impact of prompting strategies and fine-tuning techniques on their reasoning capabilities. Yet, their effectiveness on clinical natural language inference (CTNLI) remains underexplored. This study presents the first controlled eva...
Mingzi Cao · Xingwei Tan · Mahmud Elahi Akhter · Marco Valentino · Maria Liakata · Xi Wang · Nikolaos Aletras
Deduction, induction, and abduction are fundamental reasoning paradigms, core for human logical thinking. Although improving Large Language Model (LLM) reasoning has attracted significant research efforts, the extent to which the fundamental paradigms induce generalization has yet to be systemati...
Yingji Zhang · Marco Valentino · Danilo S. Carvalho · Andre Freitas
Marco Valentino · Geonhee Kim · Dhairya Dalal · Zhixue Zhao · Andre Freitas