Search: “inference”

Underscoring the Problem: Why Softpick Fails at Initialization

arXiv:2610.05488v1 Announce Type: new Abstract: Softmax attention gives every token a nonzero weight, which in trained models concentrates into attention sinks and massive activations that widen the d

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Understanding the Weight Averaging Mechanism in LLM Training for Post-Training Quantization

DGX agent

arXiv:2610.05329v1 Announce Type: new Abstract: Large language models (LLMs) are typically pretrained in high precision but increasingly deployed with low-precision post-training quantization (PTQ). R

researcharxiv-cs-lg

6 Oct 2026

UniSlider: Perceptually Uniform Sliders for Continuous Image Editing

model-releasesarxiv-cs-cv

arXiv:2610.06831v1 Announce Type: new Abstract: Sliders provide an intuitive interface for continuous image editing. In current generative approaches, however, the slider is simply a rescaling of the

Agents

VepAgent: Bridging Causal-Transition via Tool-Augmented Reinforcement Learning for Video Event Prediction

arXiv:2610.06293v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have demonstrated remarkable potential in video understanding, yet their reliance on retrospective summarizatio

agentsarxiv-cs-cv

VideoTapestry: Query-Adaptive Memory Refinement for Multi-Agent Long-Video Understanding

model-releasesarxiv-cs-cv

arXiv:2610.06672v1 Announce Type: new Abstract: Long-video understanding places substantial demands on memory, as answering questions often requires retrieving information distributed across extended

Hardware

Vision Transformer Ensembles for Panoramic Street Segmentation

arXiv:2610.06063v1 Announce Type: new Abstract: Semantic segmentation of street panoramas can support detailed descriptions of urban environments, yet small datasets and unequal training costs make mo

hardwarearxiv-cs-cv

What Does It Cost to Simulate a Quantum Sentence Classifier? An Energy and Compute Perspective on Near-Term QNLP

model-releasesarxiv-cs-lg

arXiv:2610.06176v1 Announce Type: cross Abstract: Near-term quantum natural language processing (QNLP) experiments often run on classical simulators, so simulator cost is part of the field's practical

Tutorials

What Matters for Latent Reasoning with Flow Matching

arXiv:2610.06666v1 Announce Type: new Abstract: Latent reasoning lets a large language model (LLM) think in a continuous space and verbalize only the answer. We argue that an effective latent thought

tutorialsarxiv-cs-lg

Wiring Matters: Injection Topology and Initialization of Affordance Heads in Vision-Language-Action Policies

model-releasesarxiv-cs-cv

arXiv:2610.06318v1 Announce Type: new Abstract: Dense affordance supervision is an appealing auxiliary signal for vision-language-action (VLA) policies, yet naively co-training an affordance head can

ZeST: an VLM-based Zero-Shot Traversability Navigation for Unknown Environments

arXiv:2508.19131v3 Announce Type: replace-cross Abstract: The advancement of robotics and autonomous navigation systems hinges on the ability to accurately predict terrain traversability. Traditional

safetyarxiv-cs-cv

A Fully Automatic Pipeline for 3D Dendrite Instance Segmentation in SBF-SEM

arXiv:2610.03332v1 Announce Type: new Abstract: Accurate three-dimensional (3D) reconstruction of individual dendrites in serial block-face scanning electron microscopy (SBF-SEM) is essential for quan

researcharxiv-cs-cv

Adaptive Mutual Distillation for Balanced Multi-Task Post-Training of Large Language Models

model-releasesarxiv-cs-cl

arXiv:2610.02856v1 Announce Type: new Abstract: Multi-task post-training of large language models (LLMs) aims to improve performance across tasks with unequal amounts of training data. Existing method

Agents

APDMem: Agent-Controlled Progressive Disclosure for Query-Adaptive Long-Term Memory

arXiv:2610.02472v1 Announce Type: cross Abstract: Personalized LLM assistants must recover sparse evidence from long conversation histories across queries of varying complexity. We introduce APDMem (A

agentsarxiv-cs-ai

Hardware

Batched Speech Decisions Without Decoding: Single-Token Supervision Lets a Frozen LLM Hear Beyond the Transcript

arXiv:2610.02638v1 Announce Type: new Abstract: Full-duplex voice agents make many small, closed decisions, which current systems answer by slow autoregressive decoding. We propose DuplexJev, which fe

hardwarearxiv-cs-ai

Budgeted Cache Repair for Cross-Context KV-Cache Reuse

arXiv:2610.02233v1 Announce Type: cross Abstract: Cross-context KV-cache reuse predicts a shared segment's keys and values under a new prefix instead of recomputing them, and has been reported to do s

CLIMB: Confidence-Guided Complementary Evidence for Multimodal Retrieval-Augmented Generation

arXiv:2610.03421v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have shown strong visual reasoning abilities, but knowledge-intensive visual question answering often requires

safetyarxiv-cs-cl

Closing the Train-Test Gap in World Models for Gradient-Based Planning

arXiv:2512.09929v2 Announce Type: replace Abstract: World models paired with model predictive control (MPC) can be trained offline on large-scale datasets of expert trajectories and enable generalizat

Collective Bias Mitigation via Model Routing and Collaboration

arXiv:2610.03240v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly deployed in public health, finance, and governance, requiring both accuracy and societal value alignment.

safetyarxiv-cs-cl

Confidence-Gated Cloud-Edge Cascade Triage via Variational Risk Minimization for Medical Imaging

arXiv:2610.02269v1 Announce Type: cross Abstract: Emergency chest X-ray (CXR) triage has a structural modality gap: reports arrive after triage decisions, yet multimodal foundation models require imag

researcharxiv-cs-cv

Constraint-Aware Training

model-releasesarxiv-cs-lg

arXiv:2610.02909v1 Announce Type: new Abstract: When generating programs with language models, constrained decoding can apply program analyses to exclude tokens that violate syntax, scope, or typing r

Coverage You Can Steer: Online Conformal Calibration for RL-Driven Hardware-Aware NAS

arXiv:2610.03127v1 Announce Type: new Abstract: Hardware-aware neural architecture search (NAS) is dominated by evaluation cost: every architecture must be trained before its reward is known. Conforma

safetyarxiv-cs-lg

Local Ai

CreateScore: Domain-Theory-Informed Bayesian Routing for LLM-Based CV Screening

arXiv:2610.02972v1 Announce Type: new Abstract: Large language models (LLMs) can support rubric-based screening of CVs, but applying a high-capability model to every candidate and criterion is costly.

local-aiarxiv-cs-ai

DAWIS: Data Assimilation with Windowed Inverse Sampling via Multitask Interpolants

arXiv:2610.03314v1 Announce Type: cross Abstract: Flow- and diffusion-based generative models have recently emerged as flexible and highly efficient forecasting models for dynamical systems. When comb

Decoupling Memory from Context: Structured Memory for Token-Efficient Test-Time Continual Learning

arXiv:2610.02687v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly deployed in enterprise, scientific, and medical applications, where agents must incorporate domain-specifi

Deep learning-based prediction of time-resolved adhesive forces in viscoelastic Hertzian contacts

arXiv:2607.19060v2 Announce Type: replace-cross Abstract: Fast prediction of the response of adhesive soft viscoelastic contacts represents a current challenge in soft robotics and for gripping and ma

Detect and Suppress: A Mechanistic Defense against Adversarial Patches in VLA Models

arXiv:2610.03498v1 Announce Type: cross Abstract: Adversarial patches can disrupt Vision-Language-Action (VLA) models by manipulating visual observations, leading to failures in robot control. However

safetyarxiv-cs-ai

Do as the Romans Do: Learning Universal Behaviors from Heterogeneous Agents

arXiv:2606.18537v2 Announce Type: replace Abstract: Humans often acquire new skills by observing others, since observed behaviors implicitly reveal how to act reasonably in an environment. However, ob

safetyarxiv-cs-lg

EditHero: A Benchmark for Long-Horizon Part-Level 3D Editing and Vibe Modeling

arXiv:2610.02298v1 Announce Type: cross Abstract: 3D editing methods are usually tested on a single edit, yet an asset is built through a long sequence of revisions, each of which must implement the r

Efficient Reasoning Training Does Not Always Harm CoT Faithfulness and Monitorability

arXiv:2610.03509v1 Announce Type: new Abstract: Chain-of-thought (CoT) reasoning allows humans to inspect how large language models reach their answers, and oversee model behaviour. This reasoning com

researcharxiv-cs-ai

Emergent Structure in the Marginal Attention Space of Language Models

arXiv:2610.03109v1 Announce Type: new Abstract: While representation similarity across independently trained language models is well-documented, how internal mechanics such as attention behave across

Enhancing Biomedical Named Entity Recognition via Multiple Programming Languages Instruction Tuning and Ensemble Method

model-releasesarxiv-cs-cl

arXiv:2610.02949v1 Announce Type: new Abstract: Instruction tuning has become a common paradigm for applying large language models (LLMs) to biomedical named entity recognition (BioNER). However, exis

Equivariant Flow Matching for Electron Density Prediction

arXiv:2610.02651v1 Announce Type: cross Abstract: Machine learning surrogates for density functional theory (DFT) have been increasingly used to reduce the cost of first-principles calculations. In th

Evaluating Multi-Dimensional Generalization of Large Language Models in Temporal Extraction Tasks

arXiv:2610.02549v1 Announce Type: new Abstract: Time and event expression extraction are fundamental temporal reasoning tasks, but the problem remains difficult due to annotation ambiguity, domain sen

Evaluation of Sampling Strategies and Physics-Informed Kolmogorov--Arnold Networks in Unbounded Domains

model-releasesarxiv-cs-lg

arXiv:2512.12074v2 Announce Type: replace Abstract: Physics-informed neural networks (PINNs) have emerged as an effective approach for solving partial differential equations (PDEs) by incorporating ph

Exploring the Trade-Off Between Structured Pruning and Fault Tolerance in Deep Neural Networks for Space Applications

arXiv:2610.03117v1 Announce Type: new Abstract: Deep Neural Networks (DNNs) inherently exhibit a degree of robustness to bit-level faults due to their distributed representation of information. As a m

Local Ai

FactorSplat: Appearance-Controllable Gaussian Proxies for Medical Volume Rendering

arXiv:2610.02382v1 Announce Type: new Abstract: Transfer functions (TFs) control color and visibility in medical volume rendering, but image-trained Gaussian proxies typically bake one transfer functi

local-aiarxiv-cs-cv

FinDialogLens: Event Extraction over Multi-Party Dialogue for Missed-Trade Identification in Financial Chatrooms

arXiv:2610.02455v1 Announce Type: cross Abstract: Multi-party financial chatrooms are vital for sales-and-trading professionals, but their complexity makes manual recovery of missed trades infeasible:

researcharxiv-cs-ai

Follow the Winners: Conservative Policy Improvement with the Cross-Entropy Method for Critic-Free RFT

arXiv:2610.03361v1 Announce Type: cross Abstract: Critic-free reinforcement fine-tuning (RFT) for agentic large language models is often done through GRPO-style methods, which compute a group baseline

safetyarxiv-cs-ai

Generalizable single-cell perturbation response prediction using energy-guided flow matching

arXiv:2610.02232v1 Announce Type: cross Abstract: Predicting phenotypic and transcriptional responses to perturbations at single-cell resolution provides a powerful tool for probing biological systems

Generalization of Transformer-Based Neural Quantum States via In-Context Learning

arXiv:2610.03463v1 Announce Type: cross Abstract: Neural quantum states based on modern deep learning architectures have emerged as powerful representations for quantum many-body systems. In particula

GeoScaffold: Learning Compact Geometric Latents via Reconstruction for Efficient Vision-Language Navigation

arXiv:2610.02697v1 Announce Type: cross Abstract: Recent vision-and-language navigation (VLN) systems increasingly adopt streaming Video-LLM policies that map egocentric RGB observations and instructi

safetyarxiv-cs-cv

Hesitation Has a Geometry: Entropy-Trained Hyperbolic Probes for Sparse Activation Steering

model-releasesarxiv-cs-cl

arXiv:2610.02391v1 Announce Type: cross Abstract: When a large language model solves a mathematical problem, its reasoning is largely hierarchical, and the solution often branches at a few tokens wher

Hindsight-Guided Rationale Distillation for Rare Disease Diagnosis

arXiv:2610.03176v1 Announce Type: new Abstract: We study hindsight-guided distillation for rare disease diagnosis on ZebraMap: a 1.5B student is fine-tuned on chain-of-thought traces from a 8B teacher

How is it possible that qwen 27b is so good? When GPT 4o had a trillion parameters and was worse?

model-releasesr-localllama

Picture from a post in r/amodei . People were praising qwen and I'm just wondering, what kind of new technologies are at play here? Does qwen just have 'better' pre training data? That's more high qua

How Robust Is Multimodal Claim Verification to LLM Rewriting?

arXiv:2610.02841v1 Announce Type: new Abstract: LLMs are known to introduce stylistic changes into generated text, yet how these stylistic shifts affect model decisions on scientific tasks remains und

Tutorials

Improving Atomic-Fact Recall via Focused Views in Unstructured Knowledge Editing

arXiv:2610.02772v1 Announce Type: cross Abstract: Large language models (LLMs) increasingly serve as general-purpose interfaces to factual knowledge, but their parameters do not automatically reflect

tutorialsarxiv-cs-ai

Improving the Energy-Efficiency of the Code Generated by LLMs through Effective Prompting

arXiv:2610.02571v1 Announce Type: cross Abstract: As AI-assisted programming becomes increasingly mainstream, the environmental impact of AI-generated software has emerged as an important consideratio

Tutorials

JOVE: Joint Execution and Verification for Resource-Aware LLM Task Graphs

arXiv:2610.03296v1 Announce Type: new Abstract: Complex reasoning queries can be decomposed into directed acyclic task graphs and distributed across heterogeneous LLMs, reducing latency through parall

tutorialsarxiv-cs-ai