SciReason: A Controllable Benchmark for Scientific Reasoning in LLMs
Pierre Beckmann · Marco Valentino · Andre Freitas
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Pierre Beckmann · Marco Valentino · Andre Freitas
Jordan Meadows · Lan Zhang · Andre Freitas
Formalising informal mathematical reasoning into formally verifiable code is a significant challenge for large language models. In scientific fields such as physics, domain-specific machinery ( e.g. Dirac notation, vector calculus) imposes additional formalisation challenges that modern LLMs and...
Mael Jullien · Andre Freitas · Marco Valentino · Lei Xu
Large language models can produce fluent judgments for clinical natural language inference, yet they frequently fail when the decision requires the correct inferential schema rather than surface matching. We introduce CARENLI , a compartmentalised agentic framework that routes each premise–statem...
Mael Jullien · Andre Freitas · Marco Valentino · Leonardo Ranaldi
Recent works on large language models (LLMs) have demonstrated the impact of prompting strategies and fine-tuning techniques on their reasoning capabilities. Yet, their effectiveness on clinical natural language inference (CTNLI) remains underexplored. This study presents the first controlled eva...
Nura Aljaafari · Danilo S. Carvalho · Andre Freitas
Despite displaying semantic competence, large language models’ internal mechanisms that ground abstract semantic structure remain insufficiently characterised. To investigate whether and how LLMs develop causally functional representations of semantic roles, we introduce a causal-temporal methodo...
Yingji Zhang · Marco Valentino · Danilo S. Carvalho · Andre Freitas
Marco Valentino · Geonhee Kim · Dhairya Dalal · Zhixue Zhao · Andre Freitas