Token serves as the basic unit of computation in trendy autoregressive fashions, and era size immediately influences each inference price and reasoning efficiency. Regardless of its significance, present approaches lack fine-grained size modeling, working primarily on the coarse-grained sequence degree. On this paper, we introduce the Size Worth Mannequin (LenVM), a token-level framework that fashions the remaining era size at every decoding step. By formulating size modeling as a price estimation drawback and assigning a continuing unfavourable reward to every generated token, LenVM predicts a bounded, discounted return that serves as a monotone proxy for the remaining era horizon. This formulation yields supervision that’s annotation-free, dense, unbiased, and scalable. Experiments on LLMs and VLMs show that LenVM offers a extremely efficient sign at inference time. On the LIFEBench actual size matching activity, making use of LenVM to a 7B mannequin improves the size rating from 30.9 to 64.8, considerably outperforming frontier closed-source fashions. Moreover, LenVM allows steady management over the commerce off between efficiency and effectivity. On GSM8K at a price range of 200 tokens, LenVM maintains 63 p.c accuracy in comparison with 6 p.c for token price range baseline. It additionally precisely predicts complete era size from the immediate boundary. Lastly, LenVM’s token-level values supply an interpretable view of era dynamics, revealing how particular tokens shift reasoning towards shorter or longer regimes. Outcomes show that LenVM helps a broad vary of functions, together with size management, prediction, and interpretation of era dynamics. They recommend that era size might be successfully modeled as a token-level worth sign, highlighting the potential of LenVM as a basic framework for size modeling and as a length-specific worth sign that might help future RL coaching.
- †College of California, Santa Barbara
- ‡ Carnegie Mellon College
- § LMSYS Org
- ¶ College of Wisconsin–Madison
