Search: “inference”

When Can LLM Digital Twins Reduce Human Measurement? From Behavioral Fidelity to Statistical Substitutability

arXiv:2609.07987v1 Announce Type: new Abstract: LLM-based digital twins promise to reduce repeated human data collection by generating person- specific responses, yet existing evaluations provide litt

researcharxiv-cs-ai

10 Sept 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Cost-Optimal LLM Routing with Limited User Feedback under User Satisfaction Guarantees

DGX agent

arXiv:2606.19376v2 Announce Type: replace Abstract: Inference costs for large language model (LLM) applications are rapidly growing, driven by surging demand and rising infrastructure cost. Users expe

model-releasesarxiv-cs-lg

9 Sept 2026

EntropyPrune: Matrix Entropy Guided Visual Token Pruning for Multimodal Large Language Models

arXiv:2602.17196v2 Announce Type: replace Abstract: Multimodal large language models (MLLMs) incur substantial inference cost due to the processing of hundreds of visual tokens per image. Although tok

Kalman Delta Networks: Uncertainty-aware Associative Memory

arXiv:2609.07816v1 Announce Type: new Abstract: Linear attention is increasingly used in frontier language models for efficient long-context inference and constant-memory decoding. Its fixed-size recu

hardwarearxiv-cs-lg

Remove360: Benchmarking Residuals After Object Removal in 3D Gaussian Splatting

model-releasesarxiv-cs-cv

arXiv:2508.11431v3 Announce Type: replace Abstract: An object can disappear from a 3D scene, yet still be detectable. Even after visual removal, modern vision models may infer what was originally pres

Robots Influencing Humans to Reveal their Goals during Collaboration and Competition

arXiv:2609.05519v1 Announce Type: new Abstract: We propose a unified strategy for fast goal inference in human-robot interaction. The core idea is to drive the human toward Critical Decision Points (C

safetyarxiv-cs-ro

TV-SGS: Gaussian Splatting with Geometric Information Propagation via Tensor Voting under sparse views

arXiv:2609.07734v1 Announce Type: new Abstract: Gaussian Splatting has been effective in inferring scene representations that excel in novel view synthesis. Multiple splats cooperate seamlessly to syn

Deep Microcompression: Structured Pruning and Bit-packed Quantization for Microcontrollers

arXiv:2609.05081v1 Announce Type: new Abstract: This paper introduces Deep Microcompression (DMC), a hardware-aware pipeline for deep learning inference on bare-metal microcontrollers. DMC integrates

researcharxiv-cs-lg

7 Sept 2026

Quantum-Assisted Memory-Efficient Training for Parameter-Intensive Wi-Fi-Based Human Activity Recognition

arXiv:2609.04271v1 Announce Type: new Abstract: Wi-Fi-based human activity recognition (HAR) has become an important part of integrated sensing and communications, paving the way for a range of contex

7 Sept 2026

EasySteer: A Unified Framework for High-Performance and Extensible LLM Steering

model-releasesarxiv-cs-ai

arXiv:2509.25175v3 Announce Type: replace-cross Abstract: Large language model (LLM) steering has emerged as a promising paradigm for controlling model behavior at inference time through targeted mani

Applications

From Euclidean to Graph-Structured Data: A Survey of Collaborative Learning

arXiv:2609.02984v1 Announce Type: new Abstract: The conventional approach to machine learning, that is, collecting data, training models, and performing inference in a single location, faces fundament

applicationsarxiv-cs-lg

Language-encoded network topology enables large language models to reason about complex networks

arXiv:2609.03229v1 Announce Type: new Abstract: Networks describe systems in biology and beyond, from protein interactions and social relationships to power grids and citation records. Reasoning about

researcharxiv-cs-lg

ProgResViT: Progressive Resolution and Width for Adaptive Vision Transformers

arXiv:2609.03216v1 Announce Type: new Abstract: Vision Transformers (ViTs) typically process every image using a fixed input resolution and model width, even though many images can be classified with

IDEEA: training-free Input-Dependent stEEring via Activation cluster matching

arXiv:2609.02089v1 Announce Type: new Abstract: Steering aligns large language models (LLMs) by injecting a bias into selected activations at inference time, offering a far cheaper alternative to weig

safetyarxiv-cs-cl

Learning to Track from Privileged Target Appearances

arXiv:2609.02471v1 Announce Type: new Abstract: Target templates define what a visual tracker searches for, yet the templates available at inference trade off localization certainty with appearance fr

local-aiarxiv-cs-cv

SocialMaze: A Benchmark for Evaluating and Enhancing Social Reasoning in Large Language Models in Complex Social Environments

arXiv:2505.23713v2 Announce Type: replace Abstract: Large language models (LLMs) are increasingly deployed in socially grounded applications, where success requires interpreting context, inferring oth

SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models

arXiv:2609.02886v1 Announce Type: new Abstract: We introduce SolarWM, a fully open foundation for building interactive video world models from data preparation through long-horizon inference. Training

GeoPAR: Large-Scale Multi-Agent Combinatorial Optimization with Geometry-Guided Parallel Autoregressive Learning

arXiv:2609.00577v1 Announce Type: cross Abstract: Multi-agent combinatorial optimization problems are notoriously challenging due to their NP-hard nature. Recent parallel autoregressive neural solvers

local-aiarxiv-cs-ai

Tutorials

Poisson-Gamma Dynamical Systems with Time-varying Transition Dynamics

arXiv:2609.00896v1 Announce Type: new Abstract: Bayesian methodologies for handling count-valued time series have gained prominence due to their ability to infer interpretable latent structures and to

tutorialsarxiv-cs-lg

QTEA: Ternary LLMs with Sparse Residual Salient Weight and By-Column Optimization

arXiv:2609.00224v1 Announce Type: cross Abstract: Weight-only post-training quantization (PTQ) can alleviate the computational burden of serving large language models (LLMs) at scale. However, existin

hardwarearxiv-cs-ai

Replacing Training with Memory: Listwise Selection for Text-to-SQL

arXiv:2609.00834v1 Announce Type: cross Abstract: Modern Text-to-SQL systems often follow generate-execute-select pipelines, generating multiple candidate queries then selecting the best one. Listwise

safetyarxiv-cs-ai

Agents

AdaptAV: Continuous Adaption of Vision Models for Autonomous Vehicles Using Cloud-based Oracle

arXiv:2608.28673v1 Announce Type: new Abstract: Deploying vision perception models in autonomous vehicles requires that we prioritize inference speeds, resulting in a model with shallower architecture

agentsarxiv-cs-cv

AdaVLA: Adaptive Step Flow Matching for Training-free Acceleration of Vision-Language-Action Models

arXiv:2608.29208v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models, built upon Vision-Language Models (VLMs), have significantly enhanced robotic capabilities by leveraging internet

Compression-Aware Abstention: Teaching LLMs to Refuse When KV-Compression Masks Remove Answer Evidence

arXiv:2608.29934v1 Announce Type: new Abstract: KV-cache compression reduces LLM inference memory by evicting context tokens, but when the evicted tokens contain answer-bearing evidence, the model may

Correctness Forensics for Batch Speculative Decoding: Diagnosing the Ragged Tensor Problem

arXiv:2510.22876v4 Announce Type: replace-cross Abstract: Inference optimizations are routinely evaluated by throughput alone, without verifying output correctness. We conduct a forensic analysis of b

safetyarxiv-cs-ai

Dimple: Discrete Diffusion Multimodal Large Language Model with Parallel Decoding

model-releasesarxiv-cs-cv

arXiv:2505.16990v3 Announce Type: replace Abstract: In this work, we propose Dimple, the first Discrete Diffusion Multimodal Large Language Model (DMLLM). We observe that training with a purely discre

Event-Driven Language Models with Sparse Neural Activity for Neuromorphic Hardware

arXiv:2608.30439v1 Announce Type: cross Abstract: Inference with transformer-based large language models (LLMs) is often limited by the memory-bound KV cache and quadratic attention cost. State-space

hardwarearxiv-cs-lg

Every Token Leaves a Ripple in the Stream of Thought: Eliciting Model-Internal Token Saliency for Chain-of-Thought Compression

arXiv:2608.31066v1 Announce Type: new Abstract: Chain-of-thought (CoT) reasoning improves multi-step problem solving, but long reasoning traces inflate inference cost. Token-level CoT compression redu

SALT: Salience-Aware Lexical Trie for Long-Context Compression

arXiv:2607.17486v2 Announce Type: replace-cross Abstract: As large language models (LLMs) process increasingly longer prompts, computation and KV-cache memory costs have emerged as major bottlenecks i

researcharxiv-cs-ai

SemPOI-RL: Aligning LLM Semantic Reasoning for Interpretable Out-of-Town POI Sequential Generation

arXiv:2608.30399v1 Announce Type: cross Abstract: Large language models (LLMs) exhibit strong semantic reasoning and open-ended generation abilities, but aligning these abilities with structured seque

safetyarxiv-cs-ai

Applications

SMILE: Smooth Motion for Improved Long-Horizon VLA Execution

arXiv:2608.29432v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models reduce inference cost by executing multiple actions per call, but longer horizons often degrade accuracy because raw

applicationsarxiv-cs-ro

Verification-Aware Training for Speculative Decoding

arXiv:2608.30135v1 Announce Type: new Abstract: Speculative decoding accelerates large language model inference by using a draft model to generate candidate tokens, which are verified by the target mo

DAMP: Decay-Aware Mixed-Precision Recurrent-State Quantization

arXiv:2608.27513v1 Announce Type: new Abstract: Softmax attention stores key and value vectors for every preceding token, causing inference memory to grow with sequence length. Recent language models

hardwarearxiv-cs-lg

FENCE: A Financial and Multimodal Jailbreak Detection Dataset

arXiv:2602.18154v3 Announce Type: replace Abstract: Jailbreaking poses a significant risk to the deployment of Large Language Models (LLMs) and Vision Language Models (VLMs). VLMs are particularly vul

safetyarxiv-cs-cl

Learning a Single Token to Replace Long System Prompts in LLMs

arXiv:2511.23271v2 Announce Type: replace Abstract: Long system prompts are widely used to steer Large Language Models (LLMs), but repeatedly processing them at inference time is inefficient and consu

Quantum SEDONet: Spectrally-Embedded Quantum Deep Operator Networks for Partial Differential Equations

arXiv:2608.27626v1 Announce Type: cross Abstract: Quantum DeepONet accelerates neural-operator inference by evaluating an orthogonally parameterized network on a quantum computer, reproducing in ideal

Speculative Probing: LLM Monitoring at Speculative-Decoding Cost

arXiv:2608.28099v1 Announce Type: cross Abstract: Real-time classification during language model inference is valuable for safety filtering, behavioral analysis, and model monitoring, but current appr

TokenPilot: Cache-Efficient Context Management for LLM Agents

arXiv:2606.17016v2 Announce Type: replace Abstract: As LLM agents are deployed in long-horizon sessions, context accumulation drives up inference costs. Existing approaches utilize text pruning or dyn

Affix Cache for Diffusion Large Language Models

arXiv:2608.26140v1 Announce Type: new Abstract: Diffusion Large Language Models (DLLMs) enable non-autoregressive decoding and bidirectional context modeling, but efficient inference remains challengi

Tutorials

Cross-lingual Representation Learning via Centroid Intervention Fusion

arXiv:2608.26357v1 Announce Type: new Abstract: Large language models (LLMs) exhibit uneven multilingual performance, especially when dealing with low-resource languages. Inference-time intervention o

tutorialsarxiv-cs-cl

Dynamical phase selection controls compute scaling in looped transformers

arXiv:2608.26556v1 Announce Type: cross Abstract: A looped transformer performs inference by iterating a weight-tied map, making its computation a dynamical process whose cost is set by the resulting

TreeGraft: Adaptive Multi-Drafter Grafting for Tree-Based Speculative Decoding

arXiv:2608.26112v1 Announce Type: new Abstract: Speculative decoding accelerates large language model inference through a draft-then-verify paradigm. Building on this, tree-structured methods improve

TwinKV: A Composable Repair Pass for KV Cache Eviction via Pairwise Key Redundancy

arXiv:2608.27128v1 Announce Type: new Abstract: Long-context inference is bottlenecked by the memory footprint of the key-value (KV) cache, especially for small models under tight resource budgets. Ex

Ultra Low-Power, Lightweight, Probabilistic RSS-Based Path Reconstruction: A System for Landscape-Scale Bee Tracking

arXiv:2608.27152v1 Announce Type: new Abstract: Applications in fields such as movement ecology, Internet of Things or robotics share the need for systems that localize devices that are too small and

local-aiarxiv-cs-lg

A Lightweight Multimodal Vision-Language Framework for Early-Stage Anatomical Green Fruit Classification in Commercial Orchards

arXiv:2608.24935v1 Announce Type: new Abstract: Accurate identification of early-stage apple fruitlet anatomical structures, including the calyx, fruitlet body, and peduncle, is essential for robotic

local-aiarxiv-cs-cv

Controllable Affective Generation via Latent Vector Steering

arXiv:2608.25569v1 Announce Type: new Abstract: Large Language Models (LLMs) often produce emotionally flattened responses after alignment, limiting their effectiveness in affect-sensitive application

safetyarxiv-cs-cl

GTPred: Benchmarking MLLMs for Interpretable Geo-localization and Time-of-capture Prediction

model-releasesarxiv-cs-cv

arXiv:2601.13207v2 Announce Type: replace Abstract: Geo-localization aims to infer the geographic location where an image was captured using observable visual evidence. Traditional methods achieve imp

Not All Attention Heads Contribute to Critical Visual Token Selection: Head-Aware Pruning Matters More

arXiv:2608.25332v1 Announce Type: new Abstract: Vision-Language Models (VLMs) have exhibited impressive performance across diverse visual scenarios. However, this success comes at the cost of explosiv