What About the Scene With the H itler Reference? HAUNT : A Framework to Probe LLM s’ Self-consistency in Closed Domains Via Adversarial Nudge
Arka Dutta · Sujan Dutta · Rijul Magu · Soumyajit Datta · Munmun De Choudhury · Ashiqur R. KhudaBukhsh
摘要
Hallucinations pose a critical challenge to the real-world deployment of large language models (LLMs) in high-stakes domains. In this paper, we present a framework for stress testing factual fidelity in LLMs in the presence of adversarial nudge. Our framework consists of three steps. First, we in...