Shared GPU Inference

ATEST: Adaptive Resource-Aware Test-Time Scaling for LLM Inference

ATEST (RATTS) is resource-aware self-consistency for LLM inference. It adapts how many samples to draw to live GPU load. The same four-sample query can cost 4.1× more energy when the GPU is busy. arXiv:2610.25519.

Mobina Kashaniyan, Ali Jannesari

Posted Oct 18, 2026 Preprint, Large Language Models, High-Performance Computing, Energy Efficiency, Test-Time Scaling