EESP

Sample Count Is Not Enough: Candidate-Generation Strategy Shapes the Energy and Performance of LLM Test-Time Scaling

arXiv:2609.19499 — For self-consistency, RASC, ESC, and best-of-N, candidate count N is not enough. Batching the same N can change A100 energy and latency by several times.

Mobina Kashaniyan, Ali Jannesari

Posted Nov 1, 2026 Conference Paper, Workshop Paper, Preprint, Large Language Models, High-Performance Computing, Energy Efficiency