Knowledge without Wisdom: Measuring Misalignment between LLM s and Intended Impact
Michael Hardy · Yunsung Kim
摘要
LLMs increasingly excel on AI benchmarks, but doing so does not guarantee validity for downstream tasks. This study contrasts LLM alignment on benchmarks, downstream tasks, and, importantly the intended impact of those tasks. We evaluate the performance of leading LLMs (i.e., generative pre-train...