research

Multi-Stream Attention Residuals

arXiv:2610.13630v1 Announce Type: new Abstract: Attention Residuals (AttnRes) enables content-dependent retrieval over network depth, which can be viewed as single-stream softmax attention along the d

Multidimensional Bayesian Active Machine Learning of Working Memory Task Performance

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

arXiv:2510.00375v3 Announce Type: replace Abstract: While adaptive experimental design has outgrown one-dimensional, staircase-based adaptations, most cognitive experiments still control a single fact

researcharxiv-cs-lg

12 Oct 2026

Multimodal Image-based Robotic Assistance and Guidance Environment (MIRAGE): A Novel Unified Framework for Surgical Navigation and Visualization

arXiv:2610.12780v1 Announce Type: new Abstract: This paper presents the computational architecture and quantitative preclinical evaluation of MIRAGE, a multimodal image-guided robotic surgery framewor

Neural expectation-maximization and meta-models

arXiv:2610.12741v1 Announce Type: new Abstract: We interpret Transformer networks as learned approximations to a hybrid probabilistic-inference procedure that combines max-product Loopy Belief Propaga

Neural networks are more modular than single neurons suggest

arXiv:2610.12842v1 Announce Type: new Abstract: Neural networks routinely develop representations in which individual neurons contribute to multiple distinct functions, leading to the widespread view

Not All Dimensions Are Equal: Outlier-Aware Attention Linearization with Grouped Quadratic Kernels

arXiv:2610.13674v1 Announce Type: cross Abstract: Linearizing softmax attention offers a route to efficient Transformer inference, but preserving pretrained attention remains challenging. We identify

NucleoNet: A Nuclear-Aware Determinant Ansatz for Multi-Geometry Neural Variational Monte Carlo

arXiv:2610.12985v1 Announce Type: cross Abstract: Neural-network variational Monte Carlo provides an accurate route to solving the electronic Schrodinger equation, but many neural wavefunctions are op

On the Design Space of Continuous Diffusion Language Models

arXiv:2610.13834v1 Announce Type: new Abstract: Continuous diffusion language models (CDLMs) promise to bring the benefits of continuous flow modelling to language, including accelerated sampling and

On the Encoding of Calendar Features in Covariate-Informed Time Series Foundation Models

arXiv:2610.13676v1 Announce Type: new Abstract: Time series foundation models (TSFMs) increasingly offer covariate support, with calendar information being the most common type of categorical covariat

On the Rate of Convergence of GD in Non-linear Neural Networks: An Adversarial Robustness Perspective

arXiv:2603.02095v2 Announce Type: replace-cross Abstract: We study the convergence dynamics of Gradient Descent (GD) in a minimal binary classification setting, consisting of a two-neuron ReLU network

One Model to Loop Them All: Elastic Latent Recurrence for Language Models

arXiv:2610.12582v1 Announce Type: new Abstract: A latent recurrent language model applies a shared block of layers repeatedly, so one checkpoint can trade inference compute for accuracy by changing th

Optimal Algorithms for Nonsmooth Nonconvex Stochastic Optimization with Constraints

arXiv:2610.13787v1 Announce Type: cross Abstract: We present new algorithms for stochastic optimization problems in which the objective is neither smooth nor convex, subject to a convex constraint set

Overcoming Data Imbalances with Expert Selection Biases

arXiv:2610.13370v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models have become the standard architecture for frontier LLMs. The multiple parallel experts in each transformer block theoret

Partially Informed Stochastic Optimization via Zeroth-Order Residual Tracking

arXiv:2610.13871v1 Announce Type: new Abstract: Many optimization problems provide direct access to only part of the gradient, while the remaining component must be inferred from function evaluations.

PDE-PFN: Prior-Data Fitted Neural PDE Solver

arXiv:2610.13334v1 Announce Type: new Abstract: Motivated by the success of large language models (LLMs) with broad generalizability and robustness to noisy or unreliable pre-training data, we explore

Physics-inspired Generative AI models via real hardware-based noisy quantum diffusion

arXiv:2505.22193v2 Announce Type: replace-cross Abstract: Quantum Diffusion Models (QDMs) are an emerging paradigm in Generative AI that aims to use quantum properties to improve the performances of t

Polyconvex neural-network surrogates with learned paired directional features for anisotropic hyperelastic homogenization

arXiv:2610.12801v1 Announce Type: cross Abstract: Approximating the effective anisotropic hyperelastic response of a representative volume element (RVE) requires constitutive expressiveness, mechanica

PreSTO: Predictive Subtree Prefetching for Fast LLM Power Sampling

arXiv:2610.13171v1 Announce Type: new Abstract: Power sampling improves large language model (LLM) reasoning at test time by sampling from a sharpened version of the base model's distribution. Its sam

Pretraining and Test-Time Training Budgets Matter for ARC: A Controlled Study of VARC and TRM

arXiv:2610.13660v1 Announce Type: cross Abstract: The Abstraction and Reasoning Corpus (ARC) is increasingly used to evaluate whether neural networks can infer task-specific transformations from few d

Primal-Dual Flow Matching for Sample-Wise Constrained Generation

arXiv:2610.12699v1 Announce Type: new Abstract: We consider the problem of learning to generate data while satisfying a prescribed sample-wise constraint with a user-specified probability of constrain

PRIME: Pre-Retrieval Index Modeling Enhancement for Structured Document Retrieval-Real

arXiv:2610.13296v1 Announce Type: cross Abstract: High-precision retrieval over external knowledge bases is essential for LLM agents to operate effectively. However, existing Information Retrieval (IR

PriMoRetarget: Humanoid Motion Transfer Through Prioritized Motion Retargeting

arXiv:2610.12642v1 Announce Type: new Abstract: Motion retargeting is a critical preprocessing step for transferring human motion data to humanoid robots. While existing methods are effective for sing

Probabilistic Forecasting of Electric Vehicle Charging in a Time-varying Hierarchical Infrastructure

arXiv:2610.13588v1 Announce Type: cross Abstract: Uncertainty quantification for electric vehicle (EV) charging demand is essential to turn the increasing pressure of EV adoption on power systems into

Product Monte Carlo: Expectation Under a Product of Densities

arXiv:2610.12702v1 Announce Type: cross Abstract: Aggregating independently computed sub-sample inferences is a well-known challenge in large-scale Bayesian computation, federated learning, and opinio

Provably Accurate Shapley Value Estimation via Leverage Score Sampling

arXiv:2410.01917v3 Announce Type: replace-cross Abstract: Originally introduced in game theory, Shapley values have emerged as a central tool in explainable machine learning, where they are used to at

Provenance-grouped protocol for evaluating machine learning in perovskite photovoltaics

arXiv:2610.12766v1 Announce Type: new Abstract: Machine-learning models for perovskite solar cells are typically evaluated using random data splits, which we show systematically leak information throu

Rationally Linearized MLPs

arXiv:2610.13568v1 Announce Type: new Abstract: We present Rationally Linearized Multilayer Perceptrons(RaLiMPs), a new approach to efficiently linearizing MLPs using low-degree rational approximation

REDaCT: Collapse-Free Unlearning in Large Reasoning Models

arXiv:2610.12769v1 Announce Type: cross Abstract: Unlearning in large reasoning models (LRMs) requires removing forget-set information from both the reasoning trace and the final answer. Existing appr

Regression-adjusted Monte Carlo Estimators for Shapley Values and Probabilistic Values

arXiv:2506.11849v3 Announce Type: replace-cross Abstract: With origins in game theory, probabilistic values like Shapley values, Banzhaf values, and semi-values have emerged as a central tool in expla

ReplaySSM: Cache SSM Inputs, Not State

arXiv:2610.13778v1 Announce Type: cross Abstract: State-space models (SSMs) maintain a fixed-size recurrent state, but reading and writing it at every decoding step can bottleneck hybrid models. This

Retractions Revisited: A Replication, Extension, and Mechanistic Evaluation of Linguistic Obfuscation Effects in Fraudulent Science

arXiv:2610.13678v1 Announce Type: new Abstract: Prior work suggests fraudulent scientists write their articles with higher rates of linguistic obfuscation than genuine scientists, with a possible mech

Returning to Development States: When Full Sandbox Snapshots Help Coding Agents

arXiv:2610.13841v1 Announce Type: new Abstract: Coding agents often make useful progress before they fail, but retry-from-scratch discards the machine state created along the way. This makes failure r

Revisiting Tabular Deep Regression: Objectives and the Limits of Global Early Stopping

arXiv:2610.13909v1 Announce Type: cross Abstract: While deep learning models for tabular data have recently received significant research attention, the choice of objective functions for regression ta

Robust and Scalable UAV-UGV Planning for Aerial Monitoring under Energy and Precedence Constraints

arXiv:2610.12670v1 Announce Type: new Abstract: We consider planning for unmanned aerial vehicle (UAV) and unmanned ground vehicle (UGV) teams in aerial monitoring missions with ordering requirements

Robust Langevin Sampling under State-Dependent Heavy-Tailed Noise with Applications to LLM Fine-Tuning

arXiv:2610.12865v1 Announce Type: new Abstract: Existing convergence guarantees for non-log-concave sampling with stochastic gradient Langevin Monte Carlo (SG-LMC) typically assume globally Lipschitz

S-Space: Exploring Spatial Workspace in Multimodal Language Models

arXiv:2610.13527v1 Announce Type: cross Abstract: Multimodal language models (MLLMs) exhibit promising spatial reasoning capabilities, yet the internal mechanisms supporting them remain poorly underst

Same Query, Different Answer: Run-to-Run Variance in Semantic Query Processing

arXiv:2610.13823v1 Announce Type: cross Abstract: Semantic query engines ask a large language model (LLM) to judge individual rows, and benchmarks compare these engines on the quality of a few executi

Sample-Adaptive Zeroth-Order Post-Training

arXiv:2610.12566v1 Announce Type: new Abstract: Zeroth-order (ZO) optimization offers a memory-efficient alternative to backpropagation for fine-tuning large language models. However, existing ZO meth

Scalable Sparse Autoregressive Variational Inference for Non-Gaussian Spatial Fields

arXiv:2610.13656v1 Announce Type: cross Abstract: Latent field models are essential for spatial statistics, but the posterior distribution of the latent field, even with a Gaussian process (GP) prior,

Scan-Parallel Variational Inference for event-driven Latent Jump Models

arXiv:2610.12986v1 Announce Type: cross Abstract: Continuous-time latent state-space models are widely used for irregularly observed time series, typically representing uncertainty through a random in

Selectively Actuated Fiberbots for High-precision Minimally Invasive Surgery

arXiv:2610.12636v1 Announce Type: new Abstract: Long, slender instruments are essential for minimally invasive surgery (MIS), but achieving precise distal manipulation becomes increasingly difficult w

Self-Aware Knowledge Probing: Evaluating Language Models' Relational Knowledge through Confidence Calibration

arXiv:2601.18901v2 Announce Type: replace Abstract: Knowledge probing quantifies how much relational knowledge a language model (LM) has acquired during pre-training. Existing knowledge probes evaluat

Shared Canonical Component Removal Beyond Expert Views

arXiv:2610.13819v1 Announce Type: new Abstract: In clinical practice, experts often begin by converting raw inputs into a set of expert features before making a decision. While black-box models traine

Shortcut Learning in Geospatial Foundation Model Embeddings for Cross-Disaster Damage Assessment

arXiv:2610.13766v1 Announce Type: cross Abstract: Geospatial foundation models can support disaster damage assessment, but high accuracy on familiar disasters may hide shortcut learning: prediction fr

Some remarks on the connection between generative diffusion and optimal transport

arXiv:2610.13614v1 Announce Type: cross Abstract: We discuss three simple connections between generative diffusion and optimal transport. First, the joint law of the data and of their Ornstein-Uhlenbe

Sonic-AMG: Streaming Human Motion Generation from Spatial Audio

arXiv:2610.13300v1 Announce Type: cross Abstract: Modeling human reactions to spatial audio requires understanding both what is heard and where it comes from. Prior work generates motion offline from

Space Over Statistic, Retraining Over Ranking: Auditing Training Labels Under Label-Only Backdoors

arXiv:2610.13051v1 Announce Type: cross Abstract: Some backdoor attacks never touch an image. FLIP only changes labels: on CIFAR-10, flipping 3% of them makes a ResNet-32 send 99.7% of triggered sourc

Structural and Representational Agency in LLM-Driven Timbre Generation and Interpolation

arXiv:2610.12532v1 Announce Type: cross Abstract: Generative creative interfaces routinely report the user's position within a space of possibilities. Such displays imply that the quantities shown wer