Search: “inference”

RRISE: Robust Radius Inference via a Surrogate Estimator

arXiv:2606.02876v1 Announce Type: new Abstract: Randomized smoothing (RS) uses a smoothed classifier to provide architecture-agnostic certificates of ell_2 classification robustness, but its dependenc

3 Jun 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

SEA-NLI: Natural Language Inference as a Lens into Southeast Asian Cultural Understanding

DGX agent

arXiv:2606.03284v1 Announce Type: new Abstract: Frontier LLMs perform well in Western contexts, but remain poorly tested on underrepresented cultures such as those in Southeast Asia (SEA). Existing NL

model-releasesarxiv-cs-cl

3 Jun 2026

Adversarially Robust Control of Conditional Value-at-Risk via Rockafellar-Uryasev Conformal Inference

arXiv:2606.00320v1 Announce Type: new Abstract: We present an online, distribution-free framework for controlling the Conditional Value-at-Risk (CVaR), extending conformal tail risk control to non-sta

safetyarxiv-cs-lg

Improving Visual Token Reduction via Rectifying Distortions for Efficient Multimodal LLM Inference

arXiv:2606.01711v1 Announce Type: new Abstract: Recent advancements in Multimodal Large Language Models (MLLMs) have achieved remarkable success in vision-language tasks, yet the quadratic computation

researcharxiv-cs-cv

Leyline: KV Cache Directives for Agentic Inference

arXiv:2606.01065v1 Announce Type: cross Abstract: Modern KV cache management assumes the chatbot workload: prompts arrive once and the cache grows append-only, so prefix caching and forward-only evict

ProbeScale: Probing Analysis to Optimize Neural Scaling Laws for Efficient Small Language Model Inference

arXiv:2606.01806v1 Announce Type: cross Abstract: Small Language Models (SLMs) offer a balance between capability and computational feasibility. Neural scaling laws inform their optimal training, sugg

CoFiDA-M: Concept-Aware Feature Modulation for Cross-Domain Adaptation with Image-Only Inference

model-releasesarxiv-cs-cv

arXiv:2605.31591v1 Announce Type: new Abstract: Models for AI-based skin cancer screening suffer a severe performance drop when shifting from expert dermoscopic (source) images to consumer-grade clini

IntAttention: A Fully Integer Attention Pipeline for Efficient Edge Inference

arXiv:2511.21513v2 Announce Type: replace Abstract: Deploying Transformer models on edge devices is limited by latency and energy budgets. While INT8 quantization effectively accelerates the primary m

OBCache: Optimal Brain KV Cache Pruning for Efficient Long-Context LLM Inference

arXiv:2510.07651v2 Announce Type: replace-cross Abstract: Large language models (LLMs) with extended context windows enable powerful applications but impose significant memory overhead, as caching all

Safeguarding Text-to-Image Generation via Inference-Time Prompt-Noise Optimization

arXiv:2412.03876v2 Announce Type: replace Abstract: Text-to-Image (T2I) diffusion models are widely recognized for their ability to generate high-quality and diverse images based on text prompts. Howe

safetyarxiv-cs-cv

SALAAD: Sparse And Low-Rank Adaptation via ADMM for Large Language Model Inference

arXiv:2602.00942v3 Announce Type: replace Abstract: Modern large language models are increasingly deployed under compute and memory constraints, making flexible control of model capacity a central cha

Local Ai

AsymVLM: Asymmetric Token Pruning for Efficient Vision-Language Model Inference

arXiv:2605.29535v1 Announce Type: new Abstract: Vision-Language Models (VLMs) process thousands of visual tokens per image alongside comparatively few text tokens, yet existing compression methods tre

local-aiarxiv-cs-lg

29 May 2026

OccamToken: Efficient VLM Inference with Training-Free and Budget-Adaptive Token Pruning

arXiv:2605.29657v1 Announce Type: cross Abstract: Vision-language models (VLMs) rely on long visual token sequences for visual understanding, making the prefill stage expensive in both computation and

29 May 2026

On the Construction and Implications of Low-Loss Valleys in LoRA-based Bayesian Inference

arXiv:2605.29580v1 Announce Type: new Abstract: While parameter-efficient fine-tuning methods like low-rank adaptation (LoRA) are standard for large language models, principled estimation of epistemic

29 May 2026

EAGer: Entropy-Aware GEneRation for Adaptive Inference-Time Scaling

arXiv:2510.11170v2 Announce Type: replace-cross Abstract: With the rise of reasoning language models and test-time scaling methods as a paradigm for improving model performance, substantial computatio

28 May 2026

Proprio: Latent Self-Scoring and Inference-Time Refinement for Physically Plausible Video Generation

arXiv:2605.28230v1 Announce Type: new Abstract: Modern video generative models produce visually impressive results, yet frequently violate basic physical principles. We propose Proprio, a training-fre

researcharxiv-cs-cv

28 May 2026

The Computational Boundary of Inference: Capability Internalization, Training, and the Turing Jump

arXiv:2605.27381v1 Announce Type: cross Abstract: Claims about recursive self-improvement in AI often slide from repeated internal revision to the possibility of qualitatively stronger capability with

28 May 2026

AGORA: Adapter-Grounded Observation-Action Retention for Inference-Free Prompt Compression in LLM Agents

arXiv:2605.26596v1 Announce Type: new Abstract: The token-level extractive compressors widely used for general LM context are structurally inappropriate for LLM agents: across 17 (env, backbone, metho

27 May 2026

Structure-Adaptive Conformal Inference for Large-Scale Out-of-Distribution Testing

arXiv:2605.26429v1 Announce Type: cross Abstract: This paper addresses structured out-of-distribution (OOD) testing in high-stakes machine learning applications. Traditional conformal methods rely on

27 May 2026

BODHI: Precise OS Kernel Specification Inference

arXiv:2605.23931v1 Announce Type: new Abstract: The formal verification of operating system kernels requires precise specifications that capture the intended behavior of system calls. Writing these sp

Identifying and Mitigating Systemic Measurement Bias in Production LLM Inference Benchmarks

arXiv:2605.24217v1 Announce Type: new Abstract: As Large Language Models (LLMs) transition from research environments to production deployments, evaluating their performance against strict Service Lev

INSIGHT: INference-time Sequence Introspection for Generating Help Triggers in Vision-Language-Action Models

arXiv:2510.01389v2 Announce Type: replace-cross Abstract: Recent Vision-Language-Action (VLA) models show strong generalization capabilities, yet they lack introspective mechanisms for anticipating fa

Applications

Overcoming 'Physics Shock' in Earth Observation A Heteroscedastic Uncertainty Framework for PINN-based Flood Inference

arXiv:2605.24106v1 Announce Type: cross Abstract: Rapid and accurate flood extent mapping from Remote Sensing data, such as Synthetic Aperture Radar (SAR), is critical for operational disaster respons

applicationsarxiv-cs-ai

StreamProfileBench: A Benchmark for Fine-Grained User Profile Inference in Real-World Streaming Scenarios

model-releasesarxiv-cs-cl

arXiv:2605.25758v1 Announce Type: new Abstract: Large Language Models (LLMs) have reshaped user profiling, yet current evaluations mainly focus on static data snapshots. This paradigm overlooks the re

Archimedean Copula Inference via Taylor-Mode AD

arXiv:2605.23134v1 Announce Type: new Abstract: No existing nested Archimedean copula tool handles all three of (a) arbitrary per-variable (right-)censoring in survival analysis, (b) arbitrary nesting

25 May 2026

Agents

From Residuals to Reasons: LLM-Guided Mechanism Inference from Tabular Data

arXiv:2605.22897v1 Announce Type: new Abstract: A persistent challenge in machine learning for scientific applications is jointly achieving prediction and understanding. Statistical models excel on st

agentsarxiv-cs-lg

25 May 2026

SciHorizon-GENE: Benchmarking LLM for Life Sciences Inference from Gene Knowledge to Functional Understanding

arXiv:2601.12805v3 Announce Type: replace-cross Abstract: Large language models (LLMs) have shown growing promise in biomedical research, particularly for knowledge-driven interpretation tasks. Howeve

25 May 2026

CausalGuard: Conformal Inference under Graph Uncertainty

arXiv:2605.21928v1 Announce Type: new Abstract: Estimating treatment effects from observational data requires choosing an adjustment set, but valid adjustment depends on an unknown causal graph. Graph

23 May 2026

Cross-domain benchmarks reveal when coordinated AI agents improve scientific inference from partial evidence

arXiv:2605.22300v1 Announce Type: cross Abstract: Scientific evidence often spans instruments, databases, and disciplines, so no single source records the full phenomenon. This makes it difficult to d

23 May 2026

PlantTraitNet: An Uncertainty-Aware Multimodal Framework for Global-Scale Plant Trait Inference from Citizen Science Data

arXiv:2511.06943v3 Announce Type: replace-cross Abstract: Global plant maps of plant traits, such as leaf nitrogen or plant height, are essential for understanding ecosystem processes, including the c

20 May 2026

Pseudocode-Guided Structured Reasoning for Automating Reliable Inference in Vision-Language Models

arXiv:2605.19663v1 Announce Type: new Abstract: Vision-Language Models (VLMs) are becoming the cornerstone of high-level reasoning for robotic automation, enabling robots to parse natural language com

20 May 2026

Latent-IMH: Efficient Bayesian Inference for Inverse Problems with Approximate Operators

arXiv:2601.20888v3 Announce Type: replace-cross Abstract: We study sampling from posterior distributions in Bayesian linear inverse problems where A, the parameters to observables operator, is computa

19 May 2026

Mechanism Learning: Prototype-Anchored Mechanism Inference for Scientific Forecasting

arXiv:2605.17091v1 Announce Type: new Abstract: Scientific forecasting typically relies on direct state prediction, an approach that grows brittle under data scarcity, extended horizons, non-stationar

19 May 2026

RAP: Runtime Adaptive Pruning for LLM Inference

arXiv:2505.17138v5 Announce Type: replace-cross Abstract: Large language models (LLMs) excel at language understanding and generation, but their enormous computational and memory requirements hinder d

19 May 2026

Inductive inference of gradient-boosted decision trees on graphs for insurance fraud detection

arXiv:2510.05676v2 Announce Type: replace Abstract: Graph-based methods are becoming increasingly popular in machine learning due to their ability to model complex data and relations. Insurance fraud

18 May 2026

Agents

When Should an AI Workflow Release? Always-Valid Inference for Black-Box Generate-Verify Systems

arXiv:2605.12947v1 Announce Type: cross Abstract: LLM-enabled AI workflows increasingly produce outputs through iterative generate-evaluate-revise loops. Each iteration can improve the candidate, but

agentsarxiv-cs-ai

14 May 2026

Patterns behind Chaos: Forecasting Data Movement for Efficient Large-Scale MoE LLM Inference

arXiv:2510.05497v5 Announce Type: replace-cross Abstract: Large-scale Mixture of Experts (MoE) Large Language Models (LLMs) have recently become the frontier open-weight models, achieving remarkable m

13 May 2026

Agents

SkillGen: Verified Inference-Time Agent Skill Synthesis

arXiv:2605.10999v1 Announce Type: new Abstract: Skills are a promising way to improve LLM agent capabilities without retraining, while keeping the added procedure reusable and controllable. However, h

agentsarxiv-cs-lg

13 May 2026

Attention-Mamba: A Mamba-Enhanced Multi-Scale Parallel Inference Network for Medical Image Segmentation

arXiv:2402.02286v4 Announce Type: replace-cross Abstract: U-shaped architectures have long dominated the field of medical image segmentation, while Transformers are widely employed for modeling long-r

Local Ai

Merlin: Deterministic Byte-Exact Deduplication for Lossless Context Optimization in Large Language Model Inference

arXiv:2605.09990v1 Announce Type: new Abstract: Data-intensive applications, ranging from large-scale retrieval systems to advanced data pipelines, are increasingly bottlenecked by the processing of h

local-aiarxiv-cs-cl

PMCTS: Particle Monte Carlo Tree Search for Principled Parallelized Inference Time Scaling

arXiv:2605.08982v1 Announce Type: new Abstract: Monte Carlo Tree Search (MCTS) is a widely used approach for policy improvement through search with increasing popularity for real world applications. D

safetyarxiv-cs-lg

Sketch-and-Verify: Structured Inference-Time Scaling via Program Sketching

arXiv:2605.08658v1 Announce Type: cross Abstract: SKETCHVERIFY is a within-tier cost-performance policy, not a universal accuracy improvement. The operational question: a practitioner stuck with a sma

Applications

SPECTRE: Hybrid Ordinary-Parallel Speculative Serving for Resource-Efficient LLM Inference

arXiv:2605.08151v1 Announce Type: cross Abstract: LLM serving platforms are increasingly deployed as multi-model cloud systems, where user demand is often long-tailed: a few popular large models recei

applicationsarxiv-cs-ai

SynerDiff: Synergetic Continuous Batching for Fast and Parallel Diffusion Model Inference

arXiv:2605.08835v1 Announce Type: new Abstract: The expansion of Artificial Intelligence-generated content service requires diffusion model serving to simultaneously achieve high throughput and low ta

Inference Time Causal Probing in LLMs

arXiv:2605.07631v1 Announce Type: new Abstract: Causal probing methods aim to test and control how internal representations influence the behavior of generative models. In causal probing, an intervent

11 May 2026

Task-Oriented Communication for Human Action Understanding via Edge-Cloud Co-Inference

arXiv:2605.07354v1 Announce Type: cross Abstract: The expanding application of smart sensing has created a growing demand for the accurate understanding of human action at the network edge. Traditiona

researcharxiv-cs-cv

11 May 2026

BOOOM: Loss-Function-Agnostic Black-Box Optimization over Orthonormal Manifolds for Machine Learning and Statistical Inference

arXiv:2605.04087v1 Announce Type: cross Abstract: Optimization over the Stiefel manifold St(p,d), the set of p imes d column-orthonormal matrices, is fundamental in statistics, machine learning, and s

7 May 2026

Applications

Do Multimodal RAG Systems Leak Data? A Comprehensive Evaluation of Membership Inference and Image Caption Retrieval Attacks