Search: “arxiv-cs-lg”

Finding Structure in Continual Learning

arXiv:2602.04555v2 Announce Type: replace Abstract: Learning from a stream of tasks usually pits plasticity against stability: acquiring new knowledge often causes catastrophic forgetting of past info

Fine-Tuning Without Forgetting via Loss-Adaptive Learning Rates

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2605.20005v1 Announce Type: new Abstract: Fine-tuning large language models on new data improves task performance but degrades capabilities learned during pretraining, a phenomenon known as cata

researcharxiv-cs-lg

20 May 2026

From Cumulative Constraints to Adaptive Runtime Safety Control for Nonstationary Reinforcement Learning

arXiv:2605.18841v1 Announce Type: new Abstract: Safety in reinforcement learning is often specified through cumulative cost constraints, but these trajectory-level guarantees do not directly prevent u

From Score Matching to Diffusion: A Fine-Grained Error Analysis in the Gaussian Setting

arXiv:2503.11615v3 Announce Type: replace Abstract: Sampling from an unknown distribution, accessible only through discrete samples, is a fundamental problem at the core of generative AI. The current

From Simple to Complex: Curriculum-Guided Physics-Informed Neural Networks via Gaussian Mixture Models

arXiv:2605.19263v1 Announce Type: new Abstract: Physics-informed neural networks (PINNs) offer a mesh-free framework for solving partial differential equations (PDEs), yet training often suffers from

GAE Falls Short in Imperfect-Information Self-Play Reinforcement Learning

arXiv:2605.19235v1 Announce Type: new Abstract: Competitive multi-agent reinforcement learning in imperfect-information games requires agents to act under partial observability and against adversarial

Gauge-Equivariant Graph Networks via Self-Interference Cancellation

arXiv:2511.16062v2 Announce Type: replace Abstract: Graph Neural Networks (GNNs) excel on homophilous graphs but often fail under heterophily due to self-reinforcing and phase-inconsistent signals. We

Local Ai

Gaussian Approximation and Multiplier Bootstrap for Federated Linear Stochastic Approximation

arXiv:2605.19629v1 Announce Type: cross Abstract: In this paper, we establish Berry-Esseen-type bounds for federated linear stochastic approximation (LSA). Our results provide the first federated Gaus

local-aiarxiv-cs-lg

General Lower Bounds for Differentially Private Federated Learning with Arbitrary Public-Transcript Interactions

arXiv:2605.19813v1 Announce Type: new Abstract: We prove a general lower bound for differentially private federated learning protocols with arbitrary public-transcript interactions. The protocol may u

Generalization Bounds of Surrogate Policies for Combinatorial Optimization Problems

arXiv:2407.17200v3 Announce Type: replace-cross Abstract: Many real-world decision problems require solving, again and again, combinatorial optimization instances drawn from a common distribution. A r

Generative Pseudo-Force Fields for Molecular Generation

arXiv:2605.19050v1 Announce Type: new Abstract: Generating stable molecular conformations typically forces a tradeoff between the physical realism of energy-based relaxation and the sampling efficienc

Goal-Oriented Lower-Tail Calibration of Gaussian Processes for Bayesian Optimization

arXiv:2605.20145v1 Announce Type: cross Abstract: Bayesian optimization (BO) selects evaluation points for expensive black-box objectives using Gaussian process (GP) predictive distributions. Kernel c

Graph Neural Networks for Community Detection in Graph Signal Analysis

arXiv:2605.19733v1 Announce Type: cross Abstract: Community detection is a central problem in graph analysis, with applications ranging from network science to graph signal processing. In recent years

Guiding Neuro-Symbolic Scenario Generation with Spatio-Temporal Logic

arXiv:2605.19038v1 Announce Type: cross Abstract: The rapid advancement of autonomous driving (AD) technologies has outpaced the development of robust safety evaluation methods. Conventional testing r

Heterogeneity-Aware Dataset Scheduling for Efficient Audio Large Language Model Training

arXiv:2605.19101v1 Announce Type: cross Abstract: Training general-purpose Audio Large Language Models (ALLMs) across diverse datasets is essential for holistic audio understanding, yet it faces signi

Hierarchical Contrastive Learning for Multi-Domain Protein-Ligand Binding

arXiv:2605.19902v1 Announce Type: new Abstract: Predicting protein-ligand binding affinity remains intractable for multi-domain proteins, where inter-domain dynamics govern molecular recognition. Exis

Hardware

HiLiftAeroML: High-Fidelity Computational Fluid Dynamics Dataset for High-Lift Aircraft Aerodynamics

arXiv:2605.19565v1 Announce Type: cross Abstract: This paper describes the first-ever open-source high-fidelity CFD dataset of a high-lift aircraft for the purpose of AI surrogate model development. T

hardwarearxiv-cs-lg

How Does Overparameterization Affect Machine Unlearning of Deep Neural Networks?

arXiv:2503.08633v2 Announce Type: replace Abstract: Machine unlearning is the task of updating a trained model to forget specific training data without retraining from scratch. In this paper, we inves

How Faithful Is Trajectory-Based Data Attribution? Error Sources, Remedies, and Practical Guidelines

arXiv:2605.18814v1 Announce Type: new Abstract: Trajectory-based data attribution methods estimate the influence of training samples on model predictions by unrolling the training trajectory. They are

Hardware

Hyrax: An Extensible Framework for Rapid ML Experimentation and Unsupervised Discovery in the Era of Rubin, Roman, and Euclid

arXiv:2605.18959v1 Announce Type: cross Abstract: The NSF-DOE Vera C. Rubin Observatory, Roman Space Telescope, Euclid, and other next-generation surveys will deliver imaging, spectroscopic, and time-

hardwarearxiv-cs-lg

Identifiable Multimodal Causal Representation Learning under Partial Latent Sharing

arXiv:2605.19135v1 Announce Type: new Abstract: Causal representation learning (CRL) seeks to uncover meaningful latent variables and their corresponding causal structure from high-dimensional observa

Implicit Bias of Mirror Flow in Homogeneous Neural Networks: Sparse and Dense Feature Learning

arXiv:2605.19458v1 Announce Type: new Abstract: We study the max-margin solutions reached by mirror flow in deep neural networks with homogeneous activation functions. Extending classical results on g

In-Context Learning Operates as Concept Subspace Learning

arXiv:2605.18830v1 Announce Type: new Abstract: Regression and Bayesian accounts of in-context learning (ICL) explain how demonstrations can induce predictors, while mechanistic analyses often identif

Increasing Missingness to Reduce Bias: Richardson-SGD with Missing Data

arXiv:2605.19641v1 Announce Type: cross Abstract: Stochastic gradient methods are central to modern large-scale learning, but their use with incomplete covariates remains delicate since imputation sch

Applications

Inferring Sensitive Attributes from Knowledge Graph Embeddings: Attack and Defense Strategies

arXiv:2605.19644v1 Announce Type: cross Abstract: Knowledge Graphs (KGs) are a powerful representation of linked data, offering flexibility, semantic richness, and support for knowledge enrichment and

applicationsarxiv-cs-lg

Information Processing Capacity of Stationary Physical Systems: Theory, Data-efficient Estimation Methods, and Photonic Demonstration

arXiv:2605.19152v1 Announce Type: cross Abstract: Physical computing systems provide a promising route toward hardware-native machine learning, but their computational capabilities remain difficult to

JAXenstein: Accelerated Benchmarking for First-Person Environments

arXiv:2605.19926v1 Announce Type: new Abstract: The progression of reinforcement learning algorithms have been driven by challenging benchmarks. The rate in which a researcher can iterate on a problem

Learned Static Function Data Structures

arXiv:2510.27588v3 Announce Type: replace-cross Abstract: We consider the task of constructing a data structure for associating a static set of keys with values, while allowing arbitrary output values

Learning Abstract World Models with a Group-Structured Latent Space

arXiv:2506.01529v2 Announce Type: replace Abstract: Learning meaningful abstract models of Markov Decision Processes (MDPs) is crucial for improving generalization from limited data. In this work, we

Learning-Accelerated Optimization-based Trajectory Planning for Cooperative Aerial-Ground Handover Missions

arXiv:2605.19562v1 Announce Type: cross Abstract: This paper presents a learning-augmented trajectory planning framework for cooperative unmanned aerial vehicle (UAV) and unmanned ground vehicle (UGV)

Learning Interpretable Point-Based Clinical Risk Scores via Direct Optimization

arXiv:2605.19113v1 Announce Type: cross Abstract: Many clinical risk scores are deployed as additive rules with nonnegative integer points assigned to relevant binary predictive features. These intege

Learning ORDER-Aware Multimodal Representations for Composite Materials Design

arXiv:2602.02513v2 Announce Type: replace Abstract: Artificial intelligence has shown remarkable success in materials discovery and property prediction, particularly for crystalline and polymer system

Learning Orthonormal Bases for Function Spaces

arXiv:2605.19959v1 Announce Type: new Abstract: Infinite-dimensional orthonormal basis expansions play a central role in representing and computing with function spaces due to their favorable linear a

Learning When to Adapt

arXiv:2605.19028v1 Announce Type: new Abstract: Low-rank adaptation (LoRA) is a widely used parameter-efficient fine-tuning method, yet its learned correction is static: the same low-rank update is ap

LionMuon: Alternating Spectral and Sign Descent for Efficient Training

arXiv:2605.19811v1 Announce Type: new Abstract: In large-scale optimization, the cheapness and effectiveness of update steps are the most crucial factors for a successful optimizer. Sign-based optimiz

LoRA vs. Full Fine-Tuning: A Theoretical Perspective

arXiv:2605.19018v1 Announce Type: new Abstract: Fine-tuning adapts a pre-trained model to downstream tasks using a small amount of labeled data. Low-Rank Adaptation (LoRA) is an efficient fine-tuning

Lossless Anti-Distillation Sampling

arXiv:2605.18829v1 Announce Type: new Abstract: Frontier commercial generative models face a growing threat from distillation, whereby a distiller harvests generated responses and trains a competing m

Lynx: Enabling Efficient MoE Inference through Dynamic Batch-Aware Expert Selection

arXiv:2411.08982v3 Announce Type: replace Abstract: Selective parameter activation provided by Mixture-of-Expert (MoE) models have made them a popular choice in modern foundational models. However, Mo

Mapping Uncharted Symmetries: Machine Discovery in Combinatorics

arXiv:2605.19063v1 Announce Type: new Abstract: Inspired by long-standing open problems in algebraic combinatorics, we show that modern machine learning can meaningfully contribute to verifiable mathe

MSAlign: Aligning Molecule and Mass Spectra Foundation Models for Metabolite Identification

arXiv:2605.19752v1 Announce Type: new Abstract: Accurately identifying metabolites i.e. small molecules from mass spectrometry data remains a core challenge in metabolomics, with broad applications in

Agents

Multi-Headed Transformer Architectures as Time-dependent Wasserstein Gradient Flows

arXiv:2605.18870v1 Announce Type: new Abstract: In recent years, transformer architectures have revolutionized the field of language processing, opening the door to previously unforeseen possibilities

agentsarxiv-cs-lg

Local Ai

Multi-Pedestrian Safety Warning at Urban Intersections Use Case of Digital Twin

arXiv:2605.18823v1 Announce Type: new Abstract: Digital twins (DTs) for urban transportation systems have gained increasing attention; however, their systematic evaluation in safety-critical scenarios

local-aiarxiv-cs-lg

Applications

Multi-Token Residual Prediction

arXiv:2605.18817v1 Announce Type: new Abstract: Diffusion Language Models (DLMs) generate text by iteratively denoising masked token sequences, offering a tradeoff between parallelism and quality comp

applicationsarxiv-cs-lg

Applications

Multilayer Correlation Clustering

arXiv:2404.16676v2 Announce Type: replace-cross Abstract: We establish Multilayer Correlation Clustering, a novel generalization of Correlation Clustering to the multilayer setting. In this model, we

applicationsarxiv-cs-lg

Neural Actor-Critic Methods for Hamilton-Jacobi-Bellman PDEs: Asymptotic Analysis and Numerical Studies

arXiv:2507.06428v2 Announce Type: replace-cross Abstract: We mathematically analyze and numerically study an actor-critic machine learning algorithm for solving high-dimensional Hamilton-Jacobi-Bellma

Neural Configuration-Space Barriers for Manipulation Planning and Control

arXiv:2503.04929v3 Announce Type: replace-cross Abstract: Planning and control for high-dimensional robot manipulators in cluttered dynamic environments require computational efficiency and robust saf

Neural Network Models for Contextual Regression

arXiv:2603.24400v2 Announce Type: replace-cross Abstract: We propose a neural network model for contextual regression in which the regression model depends on contextual features that determine the ac

Noise scheduling and linear dynamics in diffusion models on Lie groups

arXiv:2605.17326v1 Announce Type: cross Abstract: We investigate the role of the noise schedule in diffusion processes on Lie groups, with particular emphasis on applications to lattice gauge theory.