Energy-Aware Inference

ATEST: Adaptive Resource-Aware Test-Time Scaling for LLM Inference
ATEST (RATTS) is resource-aware self-consistency for LLM inference. It adapts how many samples to draw to live GPU load. The same four-sample query can cost 4.1× more energy when the GPU is busy. arXiv:2610.25519.
Mobina Kashaniyan, Ali Jannesari
Posted Oct 18, 2026 Preprint, Large Language Models, High-Performance Computing, Energy Efficiency, Test-Time Scaling
PDF DOI PDF arXiv DOI Google Scholar Research Summary Local PDF

© 2026 Mobina Kashaniyan.