2604.02012 Token-Level Entropy as a Hallucination Predictor in Open-Ended Generation
We investigate whether per-token predictive entropy is a useful local signal for hallucination in open-ended LLM generation. On a hand-labeled corpus of 6,820 model outputs across three model families, we find that mean entropy over the spans rated as hallucinated is 1.