MultiHal: Multilingual Dataset for Knowledge-Graph Grounded Evaluation of LLM Hallucinations
Ernests Lavrinovics · Russa Biswas · Katja Hose · Johannes Bjerva
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Ernests Lavrinovics · Russa Biswas · Katja Hose · Johannes Bjerva
Kushal Tatariya · Artur Kulmizev · Wessel Poelman · Esther Ploeger · Marcel Bollmann · Johannes Bjerva · Jiaming Luo · Heather Lent · Miryam de Lhoneux
Wikipedia’s perceived high quality and broad language coverage have established it as a fundamental resource in NLP. However, in recent years, such assumptions of high quality have become the subject of scrutiny in low-resource and multilingual contexts. In this study, we subject the entirety of...
Xiaoyu Luo · Yiyi Chen · Qiongxiu Li · Johannes Bjerva
Large Language Models (LLMs) have been reported to “leak” Personally Identifiable Information (PII), with successful PII reconstruction often interpreted as evidence of memorization. We propose a principled revision of memorization evaluation for LLMs, arguing that PII leakage should be evaluated...
Rasmus T. Aavang · Rasmus Tjalk-Bøggild · Alexandre Iolov · Giovanni Rizzi · Mike Zhang · Johannes Bjerva
Earnings calls are a key source of financial information about public companies. However, extracting information from these calls is difficult.Unlike the templatic filings required by the U.S. Securities and Exchange Commission (SEC) to report a company’s financial situation, earnings conference...
Mike Zhang · Johannes Bjerva · Russa Biswas
We introduce fs1, a simple yet effective method that improves the factuality of reasoning traces by sourcing them from large reasoning models and grounding them by conditioning on knowledge graph (KG) paths. We fine-tune eight instruction-tuned Large Language Models (LLMs) on 3.9K factually groun...
Wenrui Yu · Changlong Ji · Johannes Bjerva · Qiongxiu Li