Search: “arxiv-cs-lg”

When More Parameters Hurt: Foundation Model Priors Amplify Worst-Client Disparity Under Extreme Federated Heterogeneity

arXiv:2605.08992v1 Announce Type: new Abstract: Federated learning (FL) is increasingly used to fine-tune foundation models (FMs) on distributed private data. The community largely assumes that large-

12 May 2026

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Why Zeroth-Order Adaptation May Forget Less: A Randomized Shaping Theory

DGX agent

arXiv:2605.10658v1 Announce Type: new Abstract: Continual learning requires new-task adaptation without damaging previously acquired capabilities. Recent forward-pass and zeroth-order (ZO) results sho

model-releasesarxiv-cs-lg

12 May 2026

XQCfD: Accelerating Fast Actor-Critic Algorithms with Prior Data and Prior Policies

arXiv:2605.10734v1 Announce Type: new Abstract: For reinforcement learning in the real world online exploration is expensive A common practice in robotic reinforcement learning is to incorporate addit

12 May 2026

A Behavioral Framework for Data-Driven Modeling of Nonlinear Systems in Vector-Valued Reproducing Kernel Hilbert Spaces

arXiv:2605.07052v1 Announce Type: cross Abstract: We generalize Jan Willems' behavioral approach to a class of discrete-time nonlinear systems in a vector-valued reproducing kernel Hilbert space (RKHS

Local Ai

A Closed-Form Upper Bound for Admissible Learning-Rate Steps in Belief-Space Dynamics

arXiv:2605.06741v1 Announce Type: new Abstract: Learning-rate steps are usually treated as hyperparameters. This paper isolates a local beliefspace calculation: when an update is modeled as a projecte

local-aiarxiv-cs-lg

Agents

A Differentiable Bayesian Relaxation for Latent Partial-Order Inference

arXiv:2605.06976v1 Announce Type: cross Abstract: Many ranking and agent trace datasets are recorded as linear orders even though their latent structure is only partially ordered. This is especially c

agentsarxiv-cs-lg

A Finite-Iteration Theory for Asynchronous Categorical Distributional Temporal-Difference Learning

arXiv:2605.06866v1 Announce Type: new Abstract: Recent non-asymptotic analyses have substantially advanced the theory of distributional policy evaluation, but they largely concern synchronous full-sta

A Flexible Adaptive Stable Clustering Algorithm for Archive-Scale Online Mass Spectrometry

arXiv:2605.07424v1 Announce Type: new Abstract: Modern online mass spectrometry generates multi-terabyte data streams critical for understanding Earth's environmental systems. However, extracting acti

A Foundation Model for Instruction-Conditioned In-Context Time Series Tasks

arXiv:2603.22586v2 Announce Type: replace Abstract: In-context learning (ICL) enables task adaptation at inference time by conditioning on demonstrations rather than updating model parameters. Althoug

A Note on Non-Negative L_1-Approximating Polynomials

arXiv:2605.08072v1 Announce Type: cross Abstract: L_1-Approximating polynomials, i.e., polynomials that approximate indicator functions in L_1-norm under certain distributions, are widely used in comp

A Refined Generalization Analysis for Extreme Multi-class Supervised Contrastive Representation Learning

arXiv:2605.07596v1 Announce Type: cross Abstract: Contrastive Representation Learning (CRL) has achieved strong empirical success in multiple machine learning disciplines, yet its theoretical sample c

A Reproducible Optimisation Protocol for Calibrating Prompt-Based Large Language Model Workflows in Evidence Synthesis

arXiv:2605.06937v1 Announce Type: new Abstract: This methods article presents a reproducible calibration workflow for prompt-based large language models (LLMs) in structured evidence-synthesis tasks.

A Theory of Online Learning with Autoregressive Chain-of-Thought Reasoning

arXiv:2605.06819v1 Announce Type: new Abstract: Autoregressive generation lies at the heart of the mechanism of large language models. It can be viewed as the repeated application of a next-token gene

A Wasserstein GAN-based climate scenario generator for risk management and insurance: the case of soil subsidence

arXiv:2605.06678v1 Announce Type: new Abstract: According to the United Nations Office for Disaster Risk Reduction (2025), the average annual cost of natural catastrophes increased from 70--80 billion

Applications

Accelerated Relax-and-Round for Concave Coverage Problems

arXiv:2605.06900v1 Announce Type: cross Abstract: We present an accelerated relax-and-round algorithm for concave coverage problems, which generalize the classic maximum coverage problem. Building on

applicationsarxiv-cs-lg

Actor-Critic Algorithm for Dynamic Expectile and CVaR

arXiv:2605.07857v1 Announce Type: new Abstract: Optimizing dynamic risk with stochastic policies is challenging in both policy updates and value learning. The former typically requires transition pert

Actor-Critic with Active Importance Sampling

arXiv:2605.07094v1 Announce Type: new Abstract: This paper introduces the Active-Importance-Sampling Actor-Critic (AISAC) algorithm, an extension of the Actor-Critic framework for reducing variance in

AdaHOP: Fast and Accurate Low-Precision Training via Outlier-Pattern-Aware Rotation

arXiv:2604.02525v2 Announce Type: replace Abstract: Hadamard transforms have become a key tool for stabilizing low-precision training, but existing methods apply them uniformly across tensors and comp

Adaptive Domain Decomposition Physics-Informed Neural Networks for Traffic State Estimation with Sparse Sensor Data

arXiv:2605.08028v1 Announce Type: new Abstract: Traffic state estimation from sparse fixed sensors is challenging because physics-informed neural networks (PINNs) tend to over-smooth the shockwaves ad

Adaptive Regularization for Sparsity Control in Bregman-Based Optimizers

arXiv:2605.07892v1 Announce Type: new Abstract: Sparse training reduces the memory and computational costs of deep neural networks. However, sparse optimization methods, e.g., those adding an ell_1 pe

Local Ai

ADKO: Agentic Decentralized Knowledge Optimization

arXiv:2605.07863v1 Announce Type: new Abstract: We present Agentic Decentralized Knowledge Optimization (ADKO), a framework for collaborative black-box optimization across autonomous agents that achie

local-aiarxiv-cs-lg

AffineLens: Capturing the Continuous Piecewise Affine Functions of Neural Networks

arXiv:2605.06218v2 Announce Type: replace Abstract: Piecewise affine neural networks (PANNs) provide a principled geometric perspective on neural network expressivity by characterizing the input--outp

Aggregation in conformal e-classification

arXiv:2605.07963v1 Announce Type: new Abstract: Aggregating conformal predictors is a standard way of balancing their predictive and computational efficiency while retaining their validity, at least a

Almost Sure Convergence Rates of Stochastic Approximation and Reinforcement Learning via a Poisson-Moreau Drift

arXiv:2605.07104v1 Announce Type: new Abstract: Establishing almost sure convergence rates for stochastic approximation and reinforcement learning under Markovian noise is a fundamental theoretical ch

Amortized Molecular Optimization via Group Relative Policy Optimization

arXiv:2602.12162v3 Announce Type: replace Abstract: In structurally constrained molecular optimization, state-of-the-art methods restart an expensive oracle-driven search from scratch for every new in

Amortized Multi-Objective Optimization Across Tasks with Generative Solution Modeling

arXiv:2511.09598v5 Announce Type: replace Abstract: Many real-world applications require solving families of expensive multi-objective optimization problems~(EMOPs) under varying operational condition

An abstract effective convergence theorem for stochastic processes, with applications to stochastic approximation

arXiv:2504.12922v3 Announce Type: replace-cross Abstract: We provide a general theorem on the asymptotic behavior of stochastic processes that conform to a relaxed supermartingale condition. The disti

Applications

Approximation Error Upper and Lower Bounds for Holder Class with Transformers

arXiv:2605.07463v1 Announce Type: new Abstract: We explore the expressive power of Transformers by establishing precise approximation error upper and lower bounds for Holder class. Specifically, a new

applicationsarxiv-cs-lg

Arrow: A Foundation Model for Causal Discovery

arXiv:2605.07204v1 Announce Type: new Abstract: We introduce Arrow, a foundation model for zero-shot causal discovery on observational tabular data. Arrow factorizes a directed acyclic graph into an u

Tutorials

Assumed Density Filtering and Smoothing with Neural Network Surrogate Models

arXiv:2511.09016v2 Announce Type: replace-cross Abstract: The Kalman filter and Rauch-Tung-Striebel (RTS) smoother are optimal for state estimation in linear dynamic systems. With nonlinear systems, t

tutorialsarxiv-cs-lg

Asymptotically Log-Optimal Bayes-Assisted Confidence Sequences for Bounded Means

arXiv:2605.07964v1 Announce Type: cross Abstract: Confidence sequences based on test martingales provide time-uniform uncertainty quantification for the mean of bounded IID observations without parame

Attribution-Based Neuron Utility for Plasticity Restoration in Deep Networks

arXiv:2605.06834v1 Announce Type: new Abstract: Continual learning research attempts to conserve two fundamental capabilities: new knowledge acquisition and the preservation of previously acquired kno

Bayesian Conformal Prediction as a Decision Risk Problem

arXiv:2602.03331v2 Announce Type: replace Abstract: We propose Bayesian Conformal Prediction (BCP), a framework that combines Bayesian posterior predictive distributions with PAC-style conformal risk

Bayesian Fine-tuning in Projected Subspaces

arXiv:2605.07706v1 Announce Type: new Abstract: Low-Rank Adaptation (LoRA) enables parameter-efficient fine-tuning of large models by decomposing weight updates into low-rank matrices, significantly r

Applications

Bayesian Sensitivity of Causal Inference Estimators under Evidence-Based Priors

arXiv:2605.07993v1 Announce Type: new Abstract: Causal inference, especially in observational studies, relies on untestable assumptions about the true data-generating process. Sensitivity analysis hel

applicationsarxiv-cs-lg

Bellman Calibration for V-Learning in Offline Reinforcement Learning

arXiv:2512.23694v2 Announce Type: replace-cross Abstract: Reliable long-horizon value prediction is difficult in offline reinforcement learning because fitted value methods combine bootstrapping, func

Better Protein Function Prediction by Modeling Survivorship Bias

arXiv:2605.06879v1 Announce Type: new Abstract: Protein sequence data from nature exhibits survivorship bias: we only observe data from those organisms that survive and reproduce, while non-functional

Beyond Distribution Estimation: Simplex Anchored Structural Inference Towards Universal Semi-Supervised Learning

arXiv:2605.07557v1 Announce Type: new Abstract: Semi-supervised learning faces significant challenges in realistic scenarios where labeled data is scarce and unlabeled data follows unknown, arbitrary

Beyond Linear Attention: Softmax Transformers Implement In-Context Reinforcement Learning

arXiv:2605.07333v1 Announce Type: new Abstract: In-context reinforcement learning (ICRL) studies agents that, after pretraining, adapt to new tasks by conditioning on additional context without parame

Tutorials

Beyond the Wrapper: Identifying Artifact Reliance in Static Malware Classifiers using TRUSTEE

arXiv:2605.07034v1 Announce Type: cross Abstract: Modern cybersecurity relies heavily on static machine-learning-based malware classifiers. However, transformations such as packing and other non-seman

tutorialsarxiv-cs-lg

Bias and Uncertainty in LLM-as-a-Judge Estimation

arXiv:2605.06939v1 Announce Type: new Abstract: LLM-as-a-Judge evaluation has become a standard tool for assessing base model performance. However, characterizing performance via the naive estimator,

Bilevel Graph Structure Learning, Revisited: Inner-Channel Origins of the Reported Gain

arXiv:2605.07577v1 Announce Type: new Abstract: Bilevel graph structure learning is widely understood to improve graph neural networks by jointly optimizing model parameters and a learned graph struct

bispectrum: Selective G-Bispectra Made Practical

arXiv:2605.07270v1 Announce Type: new Abstract: Many machine learning tasks are invariant under the action of a group G of transformations: signal classification can be invariant under translations, i

Black-box model classification under the discriminative factorization

arXiv:2605.07878v1 Announce Type: new Abstract: Access to modern generative systems is often restricted to querying an API (the ``black-box' setting) and many properties of the system are unknown to t

Bloom Filter Encoding for Machine Learning

arXiv:2512.19991v2 Announce Type: replace Abstract: We present a method that uses a Bloom filter transform to preprocess data for machine learning. Each sample is encoded into a compact bit-array repr

BoHA: Blockwise Hadamard Product Adaptation for Parameter-Efficient Fine-Tuning

arXiv:2509.21637v2 Announce Type: replace Abstract: Parameter-efficient fine-tuning (PEFT) of large language models trains a small task-specific parameter set while keeping the pretrained model frozen

Breaking QAOA's Fixed Target Hamiltonian Barrier: A Fully Connected Quantum Boltzmann Machine via Bilevel Optimization

arXiv:2605.07473v1 Announce Type: cross Abstract: To overcome the limitations of classical partially connected Boltzmann machines and mainstream quantum Boltzmann machines (QBMs), this work extends th

Breaking the Illusion: When Positive Meets Negative in Multimodal Decoding

arXiv:2605.06679v1 Announce Type: new Abstract: Vision-Language Models (VLMs) are frequently undermined by object hallucination, generating content that contradicts visual reality, due to an over-reli