一作SIGIR 2026Poster· Information Retrieval (Resource)
NanoKnow: How to Know What Your Language Model Knows
Lingwei Gu · Nour Jedidi · Jimmy Lin
摘要
How do large language models (LLMs) know what they know? Answering this question has been difficult because pre-training data is often a ''black box'' – unknown or inaccessible. The recent release of nanochat – a family of small LLMs with fully open pre-training data – addresses this as it provid...