Search: “inference”

CareGuardAI: Context-Aware Multi-Agent Guardrails for Clinical Safety & Hallucination Mitigation in Patient-Facing LLMs

model-releasesarxiv-cs-ai

arXiv:2604.26959v1 Announce Type: cross Abstract: Integrating large language models (LLMs) into patient-facing healthcare systems offers significant potential to improve access to medical information.

1 May 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Compliance versus Sensibility: On the Reasoning Controllability in Large Language Models

DGX agent

arXiv:2604.27251v1 Announce Type: cross Abstract: Large Language Models (LLMs) are known to acquire reasoning capabilities through shared inference patterns in pre-training data, which are further eli

researcharxiv-cs-ai

1 May 2026

FluxMoE: Decoupling Expert Residency for High-Performance MoE Serving

arXiv:2604.02715v2 Announce Type: replace Abstract: Mixture-of-Experts (MoE) models have become a dominant paradigm for scaling large language models, but their rapidly growing parameter sizes introdu

1 May 2026

The Polynomial Stein Discrepancy for Assessing Moment Convergence

arXiv:2412.05135v2 Announce Type: replace-cross Abstract: We propose a novel method for measuring the discrepancy between a set of samples and a desired posterior distribution for Bayesian inference.

researcharxiv-cs-lg

1 May 2026

Consist-Retinex: One-Step Noise-Emphasized Consistency Training Accelerates High-Quality Retinex Enhancement

arXiv:2512.08982v2 Announce Type: replace-cross Abstract: Retinex-based low-light image enhancement benefits from separating reflectance and illumination, yet recent generative approaches often rely o

CoQuant: Joint Weight-Activation Subspace Projection for Mixed-Precision LLMs

arXiv:2604.26378v1 Announce Type: new Abstract: Post-training quantization (PTQ) has become an important technique for reducing the inference cost of Large Language Models (LLMs). While recent mixed-p

FaaSMoE: A Serverless Framework for Multi-Tenant Mixture-of-Experts Serving

arXiv:2604.26881v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) models offer high capacity with efficient inference cost by activating a small subset of expert models per input. However, de

researcharxiv-cs-lg

FASTER: Rethinking Real-Time Flow VLAs

arXiv:2603.19199v2 Announce Type: replace-cross Abstract: Real-time execution is crucial for deploying Vision-Language-Action (VLA) models in the physical world. Existing asynchronous inference method

applicationsarxiv-cs-cv

Tutorials

Observable Neural ODEs for Identifiable Causal Forecasting in Continuous Time

arXiv:2604.26070v1 Announce Type: new Abstract: Causal inference in continuous-time sequential decision problems is challenged by hidden confounders. We show that, in latent state-space models with ti

tutorialsarxiv-cs-lg

RaMP: Runtime-Aware Megakernel Polymorphism for Mixture-of-Experts

model-releasesarxiv-cs-ai

arXiv:2604.26039v1 Announce Type: cross Abstract: The optimal kernel configuration for Mixture-of-Experts (MoE) inference depends on both batch size and the expert routing distribution, yet production

Rethinking KV Cache Eviction via a Unified Information-Theoretic Objective

arXiv:2604.25975v1 Announce Type: cross Abstract: Key-value (KV) caching is essential for large language model inference, yet its memory overhead poses a critical bottleneck for long-context generatio

SD2AIL: Adversarial Imitation Learning from Synthetic Demonstrations via Diffusion Models

arXiv:2512.18583v2 Announce Type: replace Abstract: Adversarial Imitation Learning (AIL) is a dominant framework in imitation learning that infers rewards from expert demonstrations to guide policy op

safetyarxiv-cs-lg

Shorthand for Thought: Compressing LLM Reasoning via Entropy-Guided Supertokens

arXiv:2604.26355v1 Announce Type: new Abstract: Reasoning in Large Language Models incurs significant inference-time compute, yet the token-level information structure of reasoning traces remains unde

SpecTr-GBV: Multi-Draft Block Verification Accelerating Speculative Decoding

arXiv:2604.25925v1 Announce Type: new Abstract: Autoregressive language models suffer from high inference latency due to their sequential decoding nature. Speculative decoding (SD) mitigates this by e

researcharxiv-cs-cl

STLGT: A Scalable Trace-Based Linear Graph Transformer for Tail Latency Prediction in Microservices

arXiv:2604.26422v1 Announce Type: cross Abstract: Accurate end-to-end tail-latency forecasting is critical for proactive SLO management in microservice systems. However, modeling long-range dependency

applicationsarxiv-cs-ai

Through a Compressed Lens: Investigating The Impact of Quantization on Factual Knowledge Recall

arXiv:2505.13963v3 Announce Type: replace Abstract: Quantization methods are widely used to accelerate inference and streamline the deployment of large language models (LLMs). Although quantization's

researcharxiv-cs-cl

Training-Free Loosely Speculative Decoding: Accepting Semantically Correct Drafts Beyond Exact Match

arXiv:2511.22972v3 Announce Type: replace Abstract: Large language models (LLMs) achieve strong performance across diverse tasks but suffer from high inference latency due to their autoregressive gene

VLN-Cache: Enabling Token Caching for VLN Models with Visual/Semantic Dynamics Awareness

arXiv:2603.07080v3 Announce Type: replace-cross Abstract: Vision-and-Language Navigation (VLN) increasingly relies on large vision-language models, but their inference cost conflicts with real-time de

World2VLM: Distilling World Model Imagination into VLMs for Dynamic Spatial Reasoning

arXiv:2604.26934v1 Announce Type: new Abstract: Vision-language models (VLMs) have shown strong performance on static visual understanding, yet they still struggle with dynamic spatial reasoning that

CGU-ILALab at FoodBench-QA 2026: Comparing Traditional and LLM-based Approaches for Recipe Nutrient Estimation

arXiv:2604.25774v1 Announce Type: new Abstract: Accurate nutrient estimation from unstructured recipe text is an important yet challenging problem in dietary monitoring, due to ambiguous ingredient te

DCD: Decomposition-based Causal Discovery from Autocorrelated and Non-Stationary Temporal Data

arXiv:2602.01433v2 Announce Type: replace Abstract: Multivariate time series in domains such as finance, climate science, and healthcare often exhibit long-term trends, seasonal patterns, and short-te

applicationsarxiv-cs-lg

DenseScout: Algorithm-System Co-design for Budgeted Tiny Object Selection on Edge Platforms

arXiv:2604.25300v1 Announce Type: new Abstract: Deploying tiny object perception on edge platforms is challenging because practical systems must satisfy both strict compute budgets and end-to-end late

DualGeo: A Dual-View Framework for Worldwide Image Geo-localization

arXiv:2604.25533v1 Announce Type: new Abstract: Worldwide image geo-localization aims to infer the geographic location of an image captured anywhere on Earth, spanning street, city, regional, national

Dynamic Decision Learning: Test-Time Evolution for Abnormality Grounding in Rare Diseases

arXiv:2604.24972v1 Announce Type: new Abstract: Clinical abnormality grounding for rare diseases is often hindered by data scarcity, making supervised fine-tuning impractical and single-pass inference

local-aiarxiv-cs-cl

Incompressible Knowledge Probes: Estimating Black-Box LLM Parameter Counts via Factual Capacity

arXiv:2604.24827v1 Announce Type: new Abstract: Closed-source frontier labs do not disclose parameter counts, and the standard alternative -- inference economics -- carries 2imes+ uncertainty from har

Nautile-370M: Spectral Memory Meets Attention in a Small Reasoning Model

arXiv:2604.24809v1 Announce Type: new Abstract: We present Nautile-370M, a 371-million-parameter small language model designed for efficient reasoning under strict parameter and inference budgets. Nau

Privileged Foresight Distillation: Zero-Cost Future Correction for World Action Models

arXiv:2604.25859v1 Announce Type: new Abstract: World action models jointly predict future video and action during training, raising an open question about what role the future-prediction branch actua

researcharxiv-cs-ro

Sketch2Arti: Sketch-based Articulation Modeling of CAD Objects

arXiv:2604.25781v1 Announce Type: new Abstract: Articulation modeling aims to infer movable parts and their motion parameters for a 3D object, enabling interactive animation, simulation, and shape edi

A Mixture of Experts Vision Transformer for High-Fidelity Surface Code Decoding

arXiv:2601.12483v2 Announce Type: replace-cross Abstract: Quantum error correction is a key ingredient for large scale quantum computation, protecting logical information from physical noise by encodi

local-aiarxiv-cs-lg

An AI-Based Supervisory Measurement Integrity Validation Layer for Cyber-Resilient AC/DC Protection in Inverter-Based Microgrids

arXiv:2604.23666v1 Announce Type: cross Abstract: Line current differential relays (LCDRs) are measurement-driven relays that rely on time-synchronized multi-phase current waveforms to infer internal

AP-BMM: Approximating Capability-Efficiency Pareto Sets of LLMs via Asynchronous Prior-guided Bayesian Model Merging

arXiv:2512.09972v5 Announce Type: replace-cross Abstract: Navigating the capability--efficiency trade-off in Large Language Models (LLMs) requires approximating a high-quality Pareto set. Existing mod

researcharxiv-cs-cl

AutoPyVerifier: Learning Compact Executable Verifiers for Large Language Model Outputs

arXiv:2604.22937v1 Announce Type: new Abstract: Verification is becoming central to both reinforcement-learning-based training and inference-time control of large language models (LLMs). Yet current v

CARD: Cluster-level Adaptation with Reward-guided Decoding for Personalized Text Generation

arXiv:2601.06352v2 Announce Type: replace Abstract: Adapting large language models to individual users remains challenging due to the tension between fine-grained personalization and scalable deployme

Conditional Imputation for Within-Modality Missingness in Multi-Modal Federated Learning

arXiv:2604.23112v1 Announce Type: new Abstract: Multimodal Federated Learning (MMFL) enables privacy-preserving collaborative training, but real-world clinical applications often suffer from within-mo

safetyarxiv-cs-lg

From Similarity to Structure: Training-free LLM Context Compression with Hybrid Graph Priors

arXiv:2604.23277v1 Announce Type: cross Abstract: Long-context large language models remain computationally expensive to run and often fail to reliably process very long inputs, which makes context co

KERV: Kinematic-Rectified Speculative Decoding for Embodied VLA Models

arXiv:2603.01581v2 Announce Type: replace-cross Abstract: Vision-Language-Action (VLA) models build a token-domain robot control paradigm, yet suffer from low speed. Speculative Decoding (SD) is an op

researcharxiv-cs-lg

Kwai Summary Attention Technical Report

arXiv:2604.24432v1 Announce Type: cross Abstract: Long-context ability, has become one of the most important iteration direction of next-generation Large Language Models, particularly in semantic unde

local-aiarxiv-cs-ai

MERIT: Modular Framework for Multimodal Misinformation Detection with Web-Grounded Reasoning

arXiv:2510.17590v2 Announce Type: replace Abstract: We present MERIT, an inference-time modular framework for multimodal misinformation detection that decomposes verification into four specialized mod

MTServe: Efficient Serving for Generative Recommendation Models with Hierarchical Caches

arXiv:2604.22881v1 Announce Type: cross Abstract: Generative recommendation (GR) offers superior modeling capabilities but suffers from prohibitive inference costs due to the repeated encoding of long

Pref-CTRL: Preference Driven LLM Alignment using Representation Editing

model-releasesarxiv-cs-ai

arXiv:2604.23543v1 Announce Type: cross Abstract: Test-time alignment methods offer a promising alternative to fine-tuning by steering the outputs of large language models (LLMs) at inference time wit

ProEval: Proactive Failure Discovery and Efficient Performance Estimation for Generative AI Evaluation

arXiv:2604.23099v1 Announce Type: cross Abstract: Evaluating generative AI models is increasingly resource-intensive due to slow inference, expensive raters, and a rapidly growing landscape of models

RedParrot: Accelerating NL-to-DSL for Business Analytics via Query Semantic Caching

arXiv:2604.22758v1 Announce Type: cross Abstract: Recently, at Xiaohongshu, the rapid expansion of e-commerce and advertising demands real-time business analytics with high accuracy and low latency. T

applicationsarxiv-cs-ai

Reflective Flow Sampling Enhancement

arXiv:2603.06165v2 Announce Type: replace-cross Abstract: The growing demand for text-to-image generation has led to rapid advances in generative modeling. Recently, text-to-image diffusion models tra

Resource-Constrained UAV-Based Weed Detection for Site-Specific Management on Edge Devices

arXiv:2604.23442v1 Announce Type: new Abstract: Weeds compete with crops for light, water, and nutrients, reducing yield and crop quality. Efficient weed detection is essential for site-specific weed

local-aiarxiv-cs-cv

Scoring, Reasoning, and Selecting the Best! Ensembling Large Language Models via a Peer-Review Process

arXiv:2512.23213v3 Announce Type: replace-cross Abstract: We propose LLM-PeerReview, an unsupervised LLM Ensemble method that selects the most ideal response from multiple LLM-generated candidates for

Small Language Model Helps Resolve Semantic Ambiguity of LLM Prompt

arXiv:2604.23263v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly utilized in various complex reasoning tasks due to their excellent instruction following capability. How

Stabilizing Efficient Reasoning with Step-Level Advantage Selection

arXiv:2604.24003v1 Announce Type: new Abstract: Large language models (LLMs) achieve strong reasoning performance by allocating substantial computation at inference time, often generating long and ver

Stochastic KV Routing: Enabling Adaptive Depth-Wise Cache Sharing

arXiv:2604.22782v1 Announce Type: cross Abstract: Serving transformer language models with high throughput requires caching Key-Values (KVs) to avoid redundant computation during autoregressive genera