Search: “arxiv-cs-lg”

Post-Training Neural Network Pruning using Graph Curvature

arXiv:2601.16366v2 Announce Type: replace Abstract: This paper provides a fresh view of the neural network (NN) pruning problem through the lens of graph theory. To achieve effective pruning, we aim t

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Protein Language Model Embeddings Improve Generalization of Implicit Transfer Operators

DGX agent

arXiv:2602.11216v2 Announce Type: replace Abstract: Molecular dynamics (MD) is a central computational tool in physics, chemistry, and biology, enabling quantitative prediction of experimental observa

researcharxiv-cs-lg

1 Jun 2026

Provably Convergent Actor-Critic for MARL through Risk-aversion

arXiv:2602.12386v2 Announce Type: replace-cross Abstract: Learning stationary policies in infinite-horizon general-sum Markov games (MGs) remains a fundamental open problem in Multi-Agent Reinforcemen

QASM-Eval: A Dataset to Train and Evaluate LLMs on OpenQASM-3 Beyond Quantum Circuits

arXiv:2605.30358v1 Announce Type: new Abstract: Quantum computing remains in the Noisy Intermediate-Scale Quantum (NISQ) era, where the performance is highly constrained to noise. Addressing the limit

Quantifying Error Propagation and Model Collapse in Diffusion Models

arXiv:2602.16601v2 Announce Type: replace-cross Abstract: Machine learning models are increasingly trained or fine-tuned on synthetic data. Recursively training on such data has been observed to signi

Quantifying the Uncertainty of Foundation Models with Singular Value Ensembles

arXiv:2601.22068v2 Announce Type: replace Abstract: Foundation models have become a dominant paradigm in machine learning, achieving remarkable performance across diverse tasks through large-scale pre

Randomized Feasibility Methods for Constrained Optimization with Adaptive Step Sizes

arXiv:2601.20076v2 Announce Type: replace-cross Abstract: We consider minimizing an objective function subject to constraints defined by the intersection of lower-level sets of convex functions. We st

Re-examining Low Rank adaptation for private LLM fine-tuning

arXiv:2510.01137v3 Announce Type: replace Abstract: Privacy is a central concern when fine-tuning large language models (LLMs) on sensitive data, and differentially private stochastic gradient descent

Reduced-order modeling of Hamiltonian dynamics based on symplectic neural networks

arXiv:2508.11911v2 Announce Type: replace-cross Abstract: We introduce a novel data-driven symplectic induced-order modeling (ROM) framework for high-dimensional Hamiltonian systems that unifies laten

Hardware

Reducing the GPU Memory Bottleneck with Lossless Compression for ML -- Extended

arXiv:2605.30728v1 Announce Type: new Abstract: Machine learning (ML) training and inference often process data sets far exceeding GPU memory capacity, forcing them to rely on PCIe for on-demand tenso

hardwarearxiv-cs-lg

Reinforced sequential Monte Carlo for amortised sampling

arXiv:2510.11711v2 Announce Type: replace Abstract: This paper proposes a synergy of amortised and particle-based methods for sampling from distributions defined by unnormalised density functions. We

Representation Collapse in Sequential Post-Training of Large Language Models

arXiv:2605.30524v1 Announce Type: new Abstract: Large language models are now adapted through chains of post-training stages rather than through a single instruction-tuning pass. This paper studies wh

Retriever Portfolios: A Principled Approach to Adaptive RAG

arXiv:2605.31176v1 Announce Type: new Abstract: Retrieval-augmented generation (RAG) systems typically rely on a single retriever and a single set of hyperparameters, despite facing highly heterogeneo

Revisiting the Bertrand Paradox via Equilibrium Analysis of No-regret Learners

arXiv:2602.21620v2 Announce Type: replace-cross Abstract: We study the discrete Bertrand pricing game with a non-increasing demand function. The game has n ge 2 players who simultaneously choose price

Revisiting Zeroth-Order Hessian Approximation: A Single-Step Policy Optimization Lens

arXiv:2605.30960v1 Announce Type: new Abstract: Accurate Zeroth-Order (ZO) Hessian estimation is a cornerstone of derivative-free methods, essential for tasks such as bilevel optimization, Bayesian in

Tutorials

Riemannian Diffusion Models on General Manifolds via Physics-Informed Neural Networks

arXiv:2605.31106v1 Announce Type: new Abstract: Riemannian diffusion models generalize score-based generative modeling to manifold-supported data via stochastic diffusion equations on the manifold. Ho

tutorialsarxiv-cs-lg

S^3LDBO: A Snapshot Single-Loop Algorithm for Decentralized Bilevel Optimization

arXiv:2605.31311v1 Announce Type: cross Abstract: Networked AI systems increasingly rely on multiple agents that collaboratively learn and adapt models over communication networks. In such systems, bi

SALAAD: Sparse And Low-Rank Adaptation via ADMM for Large Language Model Inference

arXiv:2602.00942v3 Announce Type: replace Abstract: Modern large language models are increasingly deployed under compute and memory constraints, making flexible control of model capacity a central cha

Scalable Bayesian Inference for Nonlinear Conservation Laws

arXiv:2605.31127v1 Announce Type: new Abstract: Nonlinear conservation laws are at the heart of many of the most important dynamical systems in science and engineering. In practical applications, such

Scalable Inference-Time Annealing with Surrogate Likelihood Estimators

arXiv:2605.31498v1 Announce Type: new Abstract: A long standing challenge in computational chemistry and biophysics is efficiently sampling the Boltzmann distribution of molecules. Advances in generat

Scalable Topology-Preserving Graph Coarsening: Concepts and Algorithms

arXiv:2601.22943v2 Announce Type: replace Abstract: Graph coarsening reduces the size of a graph while preserving certain properties. Most existing methods preserve either spectral or spatial characte

ScaleMAP: Preserving Local Density and Neighborhood Structure in Low-Dimensional Embeddings

arXiv:2605.30597v1 Announce Type: new Abstract: Nonlinear dimensionality-reduction methods such as UMAP and PaCMAP adaptively normalize local distances during graph construction, erasing neighborhood

SDM-Q: Cost-Aware Staged Decision-Making for Multi-Omics Classification with Deep Q-Learning

arXiv:2605.31014v1 Announce Type: new Abstract: Multi-omics data provide complementary molecular characterizations of disease phenotypes and play an important role in disease diagnosis and subtype cla

Self-Certifying Transport MCMC via Dual Spectral-Gap Certificates

arXiv:2605.30722v1 Announce Type: new Abstract: We propose CerT-MCMC, a framework that equips learned-transport Markov chain Monte Carlo with automatic, rigorous convergence certificates. A normalisin

SemStruct: Contextualizing Semantic Embeddings with Structural Information for Schema Matching

arXiv:2605.30729v1 Announce Type: new Abstract: Schema matching is a fundamental step in integrating heterogeneous data sources. While Pre-trained Language Models (PLMs) have revolutionized this task

Send a SCOUT First: Pre-hoc Reasoning for Adaptive Detector Allocation in Prompt-Injection Defense

arXiv:2605.30837v1 Announce Type: cross Abstract: Prompt-injection detectors are heterogeneous: each is strong on a different slice of attacks, and none is always reliable. Yet existing systems still

Tutorials

Sequential Group Composition: A Window into the Mechanics of Deep Learning

arXiv:2602.03655v2 Announce Type: replace Abstract: How do neural networks trained over sequences acquire the ability to perform structured operations, such as arithmetic, geometric, and algorithmic c

tutorialsarxiv-cs-lg

Sequential Least-Squares Estimators with Fast Randomized Sketching for Linear Statistical Models

arXiv:2509.06856v2 Announce Type: replace-cross Abstract: We propose a novel randomized framework for the estimation problem of large-scale linear statistical models, namely Sequential Least-Squares E

Sequential Subspace Noise Injection Prevents Accuracy Collapse in Certified Unlearning

arXiv:2601.05134v2 Announce Type: replace Abstract: Certified unlearning based on differential privacy offers strong guarantees but remains largely impractical: the noisy fine-tuning approaches propos

ShapDBM: Exploring Decision Boundary Maps in Shapley Space

arXiv:2603.22235v2 Announce Type: replace-cross Abstract: Decision Boundary Maps (DBMs) are an effective tool for visualising machine learning classification boundaries. Yet, DBM quality strongly depe

Smaller and Faster 3DGS via Post-Training Dictionary Learning

arXiv:2605.30396v1 Announce Type: cross Abstract: 3D Gaussian Splatting (3DGS) is a promising neural scene representation for real-time rendering, but trained models often suffer from large memory foo

Softly Constrained Denoisers for Diffusion Models Applied to Partial Differential Equations

arXiv:2512.14980v4 Announce Type: replace Abstract: Diffusion models have become a powerful generative prior for solutions of partial differential equations (PDEs). Existing approaches enforce physica

Softsign: Smooth Sign in Your Optimizer For Better Parameter Heterogeneity Handling

arXiv:2605.31371v1 Announce Type: new Abstract: Sign-based and LMO-inspired optimizers have recently attracted substantial attention in deep learning due to their strong performance and low memory foo

Applications

Spatio-temporal stochastic graph-based learning for infectious disease forecasting

arXiv:2605.30662v1 Announce Type: new Abstract: Spatio-temporal graph-based models have typically been used to forecast new cases of infectious diseases such as COVID-19 and chickenpox outbreaks. Howe

applicationsarxiv-cs-lg

Spectral Anatomy of Quantum Gaussian Process Kernels

arXiv:2605.30952v1 Announce Type: new Abstract: Two recent results have reshaped quantum Gaussian processes (QGPs). On the one hand, itet{lowe2025assessing} rule out the exponential speedups claimed b

Tutorials

Spectral Reach: Understanding Neural Scaling as Progress into the Spectral Tail

arXiv:2605.31244v1 Announce Type: new Abstract: Neural scaling laws describe predictable power-law relationships between model size, dataset size, compute, and performance. While these laws guide the

tutorialsarxiv-cs-lg

Stochastic Gradients under Nuisances

arXiv:2508.20326v2 Announce Type: replace-cross Abstract: Stochastic gradient optimization is the dominant learning paradigm for a variety of scenarios, from classical supervised learning to modern se

Structural Bias Beyond Homophily: A Study of Fairness in Link Prediction

arXiv:2602.11802v2 Announce Type: replace Abstract: Graph link prediction (LP) plays a critical role in socially impactful applications such as job recommendation and friendship formation, making fair

Subspace-Decomposed JEPAs: Disentangling Progression and Content in Latent World Models

arXiv:2605.31111v1 Announce Type: new Abstract: Joint-Embedding Predictive Architectures (JEPAs) learn compact latent world models by predicting future embeddings, but no single coordinate of the late

Hardware

SubsurfaceGen: Procedural Generation of Field-Scale Earth Models and Seismic Data

arXiv:2605.30541v1 Announce Type: new Abstract: Full waveform inversion (FWI) is the gold standard for subsurface imaging, with applications from carbon sequestration to energy and mineral exploration

hardwarearxiv-cs-lg

Supervised Learning as Lossy Compression: Characterizing Generalization and Sample Complexity via Finite Blocklength Analysis

arXiv:2602.04107v2 Announce Type: replace Abstract: This paper presents a novel information-theoretic perspective on generalization in machine learning by framing the learning problem within the conte

Supervised Training Rapidly Degrades Early Visual Cortex Alignment Across Biologically Plausible Learning Rules

arXiv:2605.30556v1 Announce Type: new Abstract: Random, untrained neural networks consistently match or exceed trained networks in representational similarity to early visual cortex. This puzzling fin

Survival Reinforcement Learning: Toward Scalable Self-Supervised RL

arXiv:2605.31273v1 Announce Type: new Abstract: While self-supervised Contrastive Reinforcement Learning (CRL) has shown remarkable depth-scaling capabilities, successfully using networks over 64 laye

TabCausal: Pretraining Across Causal Environments for Tabular Causal Discovery

arXiv:2605.31156v1 Announce Type: new Abstract: Causal discovery aims to recover directed causal relations from observational and interventional data, providing a basis for mechanistic understanding a

TASER: Task-Aware Stein Regularisation for Geometry-Driven Robustness

arXiv:2605.30601v1 Announce Type: new Abstract: Modern deep networks remain fragile under distribution shift and adversarial perturbations, often due to excessive or poorly structured input sensitivit

Technical note on Sequential Test-Time Adaptation via Martingale-Driven Fisher Prompting

arXiv:2510.03839v2 Announce Type: replace Abstract: We present a theoretical framework for M-FISHER, a method for sequential distribution shift detection and stable adaptation in streaming data. For d

Applications

The Challenges of Using Reinforcement Learning for Controlling Industrial Energy Systems

arXiv:2605.31044v1 Announce Type: new Abstract: Reinforcement learning has shown promising results for optimizing the control of industrial energy systems, yet most existing studies remain limited to

applicationsarxiv-cs-lg

Local Ai

The Dynamic-Probabilistic Consistency Gap in Chaotic Surrogate Modeling

arXiv:2605.31547v1 Announce Type: new Abstract: Dynamical systems reconstruction (DSR) aims to learn surrogate models that capture the dynamics underlying time-series data. Reliably deploying these su

local-aiarxiv-cs-lg