Search: “arxiv-cs-lg”

MuonEq: Balancing Before Orthogonalization with Lightweight Equilibration

arXiv:2603.28254v2 Announce Type: replace Abstract: Orthogonalized-update optimizers such as Muon improve training of matrix-valued parameters, but existing extensions typically either rescale updates

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Muown: Row-Norm Control for Muon Optimization

DGX agent

arXiv:2605.10797v1 Announce Type: new Abstract: Muon has emerged as a strong competitor to AdamW for language model pre-training, yet its behavior at scale is sensitive to weight decay. Recent work ha

researcharxiv-cs-lg

12 May 2026

Mutual Information Optimal Density Control of Linear Systems and Generalized Schrodinger Bridges with Reference Refinement

arXiv:2605.09349v1 Announce Type: cross Abstract: We consider a mutual information (MI) regularized version of optimal density control of a discrete-time linear system. MI optimal control has been pro

Natural Policy Gradient as Doubly Smoothed Policy Iteration: A Bellman-Operator Framework

arXiv:2605.10671v1 Announce Type: new Abstract: In this work, we show that natural policy gradient, a core algorithm in reinforcement learning, admits an exact formulation as a smoothed and averaged f

Near-Optimal Last-Iterate Convergence for Zero-Sum Games with Bandit Feedback and Opponent Actions

arXiv:2605.09363v1 Announce Type: new Abstract: Last-iterate convergence of learning dynamics in games has attracted significant recent attention. In two-player zero-sum games with bandit feedback, wh

Nearly-Optimal Algorithm for Adversarial Kernelized Bandits

arXiv:2605.10299v1 Announce Type: new Abstract: This paper studies kernelized bandits (also known as Gaussian process bandits) in an adversarial environment, where the reward functions in a known repr

Nested Slice Sampling: Vectorized Nested Sampling for GPU-Accelerated Inference

arXiv:2601.23252v2 Announce Type: replace-cross Abstract: Model comparison and calibrated uncertainty quantification often require integrating over parameters, but scalable inference can be challengin

Neural Co-state Policies: Structuring Hidden States in Recurrent Reinforcement Learning

arXiv:2605.05373v2 Announce Type: replace Abstract: A key capability of intelligent agents is operating under partial observability: reasoning and acting effectively despite missing or incomplete stat

Neural Posterior Estimation of Terrain Parameters from Radar Sounder Data

arXiv:2605.08179v1 Announce Type: cross Abstract: Radar sounders are electromagnetic instruments that can probe deep into the subsurface of Earth and other planetary bodies by processing the echo of t

Neural Variance-aware Dueling Bandits with Deep Representation and Shallow Exploration

arXiv:2506.01250v2 Announce Type: replace Abstract: In this paper, we address the contextual dueling bandit problem by proposing variance-aware algorithms that leverage neural networks to approximate

Neural Weight Norm = Kolmogorov Complexity

arXiv:2605.10878v1 Announce Type: new Abstract: Why does weight decay work? We prove that, in any fixed-precision regime, the smallest weight norm of a looped neural network outputting a binary string

NeuralBench: A Unifying Framework to Benchmark NeuroAI Models

arXiv:2605.08495v1 Announce Type: new Abstract: Deep learning and large public datasets have recently catalyzed the proliferation of AI models for processing brain recordings. However, systematically

Neurally-plausible radial basis kernels using distributed Fourier embeddings

arXiv:2605.08458v1 Announce Type: new Abstract: Coherent, continuous spatial representations are critical for synthesizing physical and perceptual phenomena into a single representational space. Radia

Neuroprobe: Evaluating Intracranial Brain Responses to Naturalistic Stimuli

arXiv:2509.21671v2 Announce Type: replace Abstract: High-resolution neural datasets enable foundation models for the next generation of brain-computer interfaces and neurological treatments. The commu

Non-intrusive Body Composition Assessment from Full-body mmWave Scans

arXiv:2605.08306v1 Announce Type: cross Abstract: Body composition assessment (BCA) provides detailed information about the distribution of different tissue types in the body, enabling more precise ch

Non-Parametric Rehearsal Learning via Conditional Mean Embeddings

arXiv:2605.08999v1 Announce Type: new Abstract: In machine learning, a critical class of decision-related problems concerns preventing predicted undesirable outcomes, referred to as the extit{avoiding

Nonlinear GENERIC Informed Neural Networks (N-GINNs): learning GENERIC dynamics with non-quadratic dissipation potentials

arXiv:2605.09058v1 Announce Type: cross Abstract: We introduce Nonlinear GENERIC Informed Neural Networks (N-GINNs), a deep learning framework for discovering evolution equations of systems governed b

NoRIN: Backbone-Adaptive Reversible Normalization for Time-Series Forecasting

arXiv:2605.10823v1 Announce Type: new Abstract: Reversible instance normalization (RevIN) and its successors (Dish-TS, SAN, FAN) have become the de facto plug-in for time-series forecasting, yet the m

Objective-Specific Privileged Bases via Full-Prefix Matryoshka Learning

arXiv:2605.09160v1 Announce Type: new Abstract: Learned representations are often invariant to rotational transformations, leaving individual dimensions non-identifiable and interchangeable. We study

Omni-DeepSearch: A Benchmark for Audio-Driven Omni-Modal Deep Search

arXiv:2605.08762v1 Announce Type: cross Abstract: Current omni-modal benchmarks mainly evaluate models under settings where multiple modalities are provided simultaneously, while the ability to start

On Characterizing Learnability for Adversarial Noisy Bandits

arXiv:2605.09200v1 Announce Type: new Abstract: We study adversarial noisy bandits given a known function class F. In each round, the adversary selects a function f in F, the learner chooses an arm, a

On Improving Graph Neural Networks for QSAR by Pre-training on Extended-Connectivity Fingerprints

arXiv:2605.10722v1 Announce Type: new Abstract: Molecular Graph Neural Networks (GNNs) are increasingly common in drug discovery, particularly for Quantitative Structure-Activity Relationship (QSAR) s

On Observation Time for Recovering Latent Hawkes Networks

arXiv:2605.08400v1 Announce Type: cross Abstract: Dynamics of interacting systems in engineering, society, and nature often evolve over latent networks that govern which entities can interact. We stud

On periodic distributed representations using Fourier embeddings

arXiv:2605.10818v1 Announce Type: new Abstract: Periodic signals are critical for representing physical and perceptual phenomena. Scalar, real angular measures, e.g., radians and degrees, result in di

On the Convergence of Muon and Beyond

arXiv:2509.15816v5 Announce Type: replace Abstract: The Muon optimizer has demonstrated remarkable empirical success in handling matrix-structured parameters for training neural networks. However, a s

On the Convergence Rate of LoRA Gradient Descent

arXiv:2512.18248v3 Announce Type: replace Abstract: The low-rank adaptation (LoRA) algorithm for fine-tuning large models has grown popular in recent years due to its remarkable performance and low co

On the global convergence of gradient descent for wide shallow models with bounded nonlinearities

arXiv:2605.10775v1 Announce Type: cross Abstract: A surprising phenomenon in the training of neural networks is the ability of gradient descent to find global minimizers of the training loss despite i

On Uniform Error Bounds for Kernel Regression under Non-Gaussian Noise

arXiv:2605.09757v1 Announce Type: new Abstract: Providing non-conservative uncertainty quantification for function estimates derived from noisy observations remains a fundamental challenge in statisti

Online Set Learning from Precision and Recall Feedback

arXiv:2605.09565v1 Announce Type: new Abstract: We consider the problem of learning an unknown subset N_ext{target} of a domain in an online setting. In each round t, the learner predicts a set of ite

Online Sharp-Calibrated Bayesian Optimization

arXiv:2605.10572v1 Announce Type: new Abstract: Bayesian optimization (BO) is a widely used framework for optimizing expensive black-box functions, commonly based on Gaussian process (GP) surrogate mo

Agents

Optimal and Scalable MAPF via Multi-Marginal Optimal Transport and Schrodinger Bridges

arXiv:2605.10917v1 Announce Type: new Abstract: We consider anonymous multi-agent path finding (MAPF) where a set of robots is tasked to travel to a set of targets on a finite, connected graph. We sho

agentsarxiv-cs-lg

Optimal Attention Temperature Improves the Robustness of In-Context Learning under Distribution Shift in High Dimensions

arXiv:2511.01292v2 Announce Type: replace-cross Abstract: Pretrained Transformers can perform in-context learning (ICL) from a few demonstrations, but this ability can fail sharply when the test distr

Optimal Regret for Single Index Bandits

arXiv:2605.09454v1 Announce Type: cross Abstract: We study the extit{single-index bandit} problem, where rewards depend on an unknown one-dimensional projection of high-dimensional contexts through an

Optimality of Sub-network Laplace Approximations: New Results and Methods

arXiv:2605.09075v1 Announce Type: cross Abstract: Although the Laplace approximation offers a simple route to uncertainty quantification in deep neural networks, its reliance on inverting large Hessia

Optimised Support Vector Regression for California Housing Price Prediction: The Critical Role of Feature Engineering and Hyperparameter Tuning

arXiv:2605.08660v1 Announce Type: new Abstract: In the recent literature, Support Vector Regression (SVR) has been cited as one of the weakest performers on the California Housing benchmark dataset, w

Optimizing Server Placement for Vertical Federated Learning in Dynamic Edge/Fog Networks

arXiv:2605.09813v1 Announce Type: cross Abstract: We investigate the control and optimization of vertical federated learning (VFL), a class of distributed machine learning (ML) methods in which edge/f

OTora: A Unified Red Teaming Framework for Reasoning-Level Denial-of-Service in LLM Agents

arXiv:2605.08876v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly deployed as autonomous agents that execute tool-augmented, multi-step tasks, where latency is a critical f

OUIDecay: Adaptive Layer-wise Weight Decay for CNNs Using Online Activation Patterns

arXiv:2605.10161v1 Announce Type: new Abstract: Weight decay remains one of the most widely used regularization mechanisms for training convolutional neural networks, yet it is still commonly applied

Outlier detection for patient monitoring and alerting

arXiv:2605.08955v1 Announce Type: new Abstract: We develop and evaluate a data-driven approach for detecting unusual (anomalous) patient-management decisions using past patient cases stored in electro

Tutorials

Outlier-robust Diffusion Posterior Sampling for Bayesian Inverse Problems

arXiv:2602.02045v2 Announce Type: replace Abstract: Diffusion models have emerged as powerful learned priors for Bayesian inverse problems (BIPs). Diffusion-based solvers rely on a presumed likelihood

tutorialsarxiv-cs-lg

PA-RNet: Perturbation-Aware Residual Network for Robust Multimodal Time Series Forecasting

arXiv:2508.04750v2 Announce Type: replace Abstract: In real-world applications, multimodal time-series forecasting faces a key challenge: textual information is often useful but unreliable. Auxiliary

PACT: Peak-Aware Cross-Attention Graph Transformers for Efficient Storm-Surge Emulation

arXiv:2605.09036v1 Announce Type: new Abstract: Accurate and efficient storm-surge emulation is essential for coastal hazard assessment, yet high-fidelity hydrodynamic models remain too expensive for

Parameterized Complexity of Stationarity Testing for Piecewise-Affine Functions and Shallow CNN Losses

arXiv:2605.10219v1 Announce Type: cross Abstract: We study the parameterized complexity of testing approximate first-order stationarity at a prescribed point for continuous piecewise-affine (PA) funct

Path-Based Gradient Boosting for Graph-Level Prediction

arXiv:2605.08102v1 Announce Type: new Abstract: We propose PathBoost, a gradient tree boosting method for graph-level classification and regression that learns discriminative path-based features direc

Local Ai

Path-Dependent Denoising: A Non-Conservative Field Perspective on Order Collapse in Diffusion Language Models

arXiv:2605.09303v1 Announce Type: new Abstract: Diffusion language models (DLMs) offer a structural alternative to autoregressive generation: denoising can update tokens in arbitrary orders or in para

local-aiarxiv-cs-lg

Agents

PC3D: Zero-Shot Cooperation Across Variable Rosters via Personalized Context Distillation

arXiv:2605.10377v1 Announce Type: new Abstract: Cooperative multi-agent reinforcement learning often assumes a fixed execution team, yet many decentralized systems must operate with varying numbers of

agentsarxiv-cs-lg

Per-Loss Adapters for Gradient Conflict in Physics-Informed Neural Networks

arXiv:2605.10136v1 Announce Type: new Abstract: Physics-informed neural networks (PINNs) train a single neural approximation by minimizing multiple physics- and data-derived losses, but the gradients

Performance and Energy Trade-Off Analysis of Hierarchical Federated Learning for Plant Disease Classification

arXiv:2605.08121v1 Announce Type: cross Abstract: Early detection of plant diseases is critical for improving crop productivity, while it also facilitates the foundations of precision agriculture. Rec