C ode J udge B ench: Benchmarking LLM -as-a-Judge for Coding Tasks
Hongchao Jiang · Yiming Chen · Yushi Cao · Hung-yi Lee · Robby T. Tan
摘要
Large Language Models (LLMs) are increasingly used not only to generate code, but also to judge it: comparing, ranking, or scoring competing solutions. However, their reliability in this evaluative role remains poorly understood. Inconsistent or flawed judgments can undermine benchmarks and disto...