Search: “arxiv-cs-lg”

On the Convergence and Size Transferability of Continuous-depth Graph Neural Networks

arXiv:2510.03923v2 Announce Type: replace Abstract: Continuous-depth graph neural networks, also known as Graph Neural Differential Equations (GNDEs), combine the structural inductive bias of Graph Ne

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

On the Generalization Bounds of Symbolic Regression with Genetic Programming

DGX agent

arXiv:2604.17402v1 Announce Type: new Abstract: Symbolic regression (SR) with genetic programming (GP) aims to discover interpretable mathematical expressions directly from data. Despite its strong em

model-releasesarxiv-cs-lg

21 Apr 2026

On the Interpolation Effect of Score Smoothing in Diffusion Models

arXiv:2502.19499v3 Announce Type: replace Abstract: Diffusion models have achieved remarkable progress in various domains with an intriguing ability to produce new data that do not exist in the traini

On The Mathematics of the Natural Physics of Optimization

arXiv:2604.17645v1 Announce Type: cross Abstract: A number of optimization algorithms have been inspired by the physics of Newtonian motion. Here, we ask the question: do algorithms themselves obey so

On the Sample Complexity of Learning for Blind Inverse Problems

arXiv:2512.23405v4 Announce Type: replace Abstract: Blind inverse problems arise in many experimental settings where both the signal of interest and the forward operator are (partially) unknown. In th

On the Theory of Continual Learning with Gradient Descent for Neural Networks

arXiv:2510.05573v2 Announce Type: replace-cross Abstract: Continual learning, the ability of a model to adapt to an ongoing sequence of tasks without forgetting earlier ones, is a central goal of arti

Online Conformal Prediction with Adversarial Semi-bandit Feedback via Regret Minimization

arXiv:2604.17984v1 Announce Type: new Abstract: Uncertainty quantification is crucial in safety-critical systems, where decisions must be made under uncertainty. In particular, we consider the problem

Open-TQ-Metal: Fused Compressed-Domain Attention for Long-Context LLM Inference on Apple Silicon

arXiv:2604.16957v1 Announce Type: new Abstract: We present Open-TQ-Metal, the first implementation of fused compressed-domain attention on Apple Silicon, enabling 128K-context inference for Llama 3.1

OptunaHub: A Platform for Black-Box Optimization

arXiv:2510.02798v2 Announce Type: replace Abstract: Black-box optimization (BBO) underpins advances in domains such as AutoML and Materials Informatics, yet implementations of algorithms and benchmark

Overcoming Selection Bias in Statistical Studies With Amortized Bayesian Inference

arXiv:2604.18319v1 Announce Type: cross Abstract: Selection bias arises when the probability that an observation enters a dataset depends on variables related to the quantities of interest, leading to

PAC-Bayes Bounds for Gibbs Posteriors via Singular Learning Theory

arXiv:2604.17219v1 Announce Type: cross Abstract: We derive explicit non-asymptotic PAC-Bayes generalization bounds for Gibbs posteriors, that is, data-dependent distributions over model parameters ob

Parkinson's Disease Detection via Self-Supervised Dual-Channel Cross-Attention on Bilateral Wrist-Worn IMU Signals

arXiv:2604.18372v1 Announce Type: new Abstract: Parkinson's disease (PD) is a chronic neurodegenerative disease. It shows multiple motor symptoms such as tremor, bradykinesia, postural instability, fr

PaTaRM: Bridging Pairwise and Pointwise Signals via Preference-Aware Task-Adaptive Reward Modeling

arXiv:2510.24235v3 Announce Type: replace Abstract: Reward models (RMs) are central to reinforcement learning from human feedback (RLHF), providing the critical supervision signals that align large la

Tutorials

Path-Based Quantum Meta-Learning for Adaptive Optimization of Reconfigurable Intelligent Surfaces

arXiv:2604.17690v1 Announce Type: cross Abstract: Reconfigurable intelligent surfaces (RISs) modify signal reflections to enhance wireless communication capabilities. Classical RIS phase optimization

tutorialsarxiv-cs-lg

Persistence-Augmented Neural Networks

arXiv:2604.08469v2 Announce Type: replace Abstract: Topological Data Analysis (TDA) provides tools to describe the shape of data, but integrating topological features into deep learning pipelines rema

PFDelta: A Benchmark Dataset for Power Flow under Load, Generation, and Topology Variations

arXiv:2510.22048v3 Announce Type: replace Abstract: Power flow (PF) calculations are the backbone of real-time grid operations, across workflows such as contingency analysis (where repeated PF evaluat

Physics-Informed Causal MDPs for Sequential Constraint Repair in Engineering Simulation Pipelines

arXiv:2604.17910v1 Announce Type: cross Abstract: Off-policy learning in constrained MDPs with large binary state spaces faces a fundamental tension: causal identification of transition dynamics requi

Physics-Informed Graph Neural Networks for Transverse Momentum Estimation in CMS Trigger Systems

arXiv:2507.19205v2 Announce Type: replace Abstract: Real-time particle transverse momentum (p_T) estimation in high-energy physics demands algorithms that are both efficient and accurate under strict

Physics-Informed Neural Networks: A Didactic Derivation of the Complete Training Cycle

arXiv:2604.18481v1 Announce Type: cross Abstract: This paper is a step-by-step, self-contained guide to the complete training cycle of a Physics-Informed Neural Network (PINN) -- a topic that existing

Physics-Informed Neural Networks for Biological 2D{+}t Reaction-Diffusion Systems

arXiv:2604.18548v1 Announce Type: new Abstract: Physics-informed neural networks (PINNs) provide a powerful framework for learning governing equations of dynamical systems from data. Biologically-info

PiCa: Parameter-Efficient Fine-Tuning with Column Space Projection

arXiv:2505.20211v3 Announce Type: replace Abstract: Fine-tuning large foundation models is essential for building expert models tailored to specialized tasks and domains, but fully updating billions o

Plasticity Loss in Deep Reinforcement Learning: A Survey

arXiv:2411.04832v3 Announce Type: replace-cross Abstract: Plasticity refers to a network's ability to adapt to changing data distributions, which is crucial for the successful training of deep reinfor

Hardware

POLAR: Online Learning for LoRA Adapter Caching and Routing in Edge LLM Serving

arXiv:2604.16583v1 Announce Type: new Abstract: Edge deployment of large language models (LLMs) increasingly relies on libraries of lightweight LoRA adapters, yet GPU/DRAM can keep only a small reside

hardwarearxiv-cs-lg

Policy Testing in Markov Decision Processes

arXiv:2505.15342v2 Announce Type: replace-cross Abstract: We study the policy testing problem in discounted Markov decision processes (MDPs) in the fixed-confidence setting under a generative model wi

Local Ai

Positive-Only Drifting Policy Optimization

arXiv:2604.16519v1 Announce Type: new Abstract: In the field of online reinforcement learning (RL), traditional Gaussian policies and flow-based methods are often constrained by their unimodal express

local-aiarxiv-cs-lg

Predicting LLM Compression Degradation from Spectral Statistics

arXiv:2604.18085v1 Announce Type: new Abstract: Matrix-level low-rank compression is a promising way to reduce the cost of large language models, but running compression and evaluating the resulting m

Predictive Modeling of Natural Medicinal Compounds for Alzheimer Disease Using Cheminformatics

arXiv:2604.18316v1 Announce Type: cross Abstract: The most common cause of dementia is Alzheimer disease, a progressive neurodegenerative disorder affecting older adults that gradually impairs memory,

Preventing overfitting in deep learning using differential privacy

arXiv:2604.16334v1 Announce Type: new Abstract: The use of Deep Neural Network based systems in the real world is growing. They have achieved state-of-the-art performance on many image, speech and tex

Prior-Fitted Functional Flow: In-Context Generative Models for Pharmacokinetics

arXiv:2604.17670v1 Announce Type: new Abstract: We introduce Prior-Fitted Functional Flows, a generative foundation model for pharmacokinetics that enables zero-shot population synthesis and individua

PrivaDE: Privacy-preserving Data Evaluation for Blockchain-based Data Marketplaces

arXiv:2510.18109v4 Announce Type: replace-cross Abstract: Evaluating the usefulness of data before purchase is essential when obtaining data for high-quality machine learning models, yet both model bu

Program Structure-aware Language Models: Targeted Software Testing beyond Textual Semantics

arXiv:2604.17715v1 Announce Type: cross Abstract: Recent advances in large language models for test case generation have improved branch coverage via prompt-engineered mutations. However, they still l

Projected Coupled Diffusion for Test-Time Constrained Joint Generation

arXiv:2508.10531v3 Announce Type: replace Abstract: Modifications to test-time sampling have emerged as an important extension to diffusion algorithms, with the goal of biasing the generative process

ProTrain: Efficient LLM Training via Memory-Aware Techniques

arXiv:2406.08334v2 Announce Type: replace-cross Abstract: Memory pressure has emerged as a dominant constraint in scaling the training of large language models (LLMs), particularly in resource-constra

Pulse Shape Discrimination Algorithms: Survey and Benchmark

arXiv:2508.02750v2 Announce Type: replace Abstract: This review presents a comprehensive survey and benchmark of pulse shape discrimination (PSD) algorithms for radiation detection, classifying nearly

Putting a Face to Forgetting: Continual Learning meets Mechanistic Interpretability

arXiv:2601.22012v2 Announce Type: replace Abstract: Catastrophic forgetting in continual learning is often measured at the performance or last-layer representation level, overlooking the underlying me

Tutorials

PyEPO: A PyTorch-based End-to-End Predict-then-Optimize Library for Linear and Integer Programming

arXiv:2206.14234v3 Announce Type: replace-cross Abstract: In deterministic optimization, it is typically assumed that all problem parameters are fixed and known. In practice, however, some parameters

tutorialsarxiv-cs-lg

Q-SINDy: Quantum-Kernel Sparse Identification of Nonlinear Dynamics with Provable Coefficient Debiasing

arXiv:2604.16779v1 Announce Type: cross Abstract: Quantum feature maps offer expressive embeddings for classical learning tasks, and augmenting sparse identification of nonlinear dynamics (SINDy) with

Quantifying how AI Panels improve precision

arXiv:2604.16432v1 Announce Type: cross Abstract: AI in applications like screening job applicants had become widespread, and may contribute to unemployment especially among the young. Biases in the A

Hardware

RACE Attention: A Strictly Linear-Time Attention Layer for Training on Outrageously Large Contexts

arXiv:2510.04008v5 Announce Type: replace Abstract: Softmax Attention has a quadratic time complexity in sequence length, which becomes prohibitive to run at long contexts, even with highly optimized

hardwarearxiv-cs-lg

Random Matrix Theory of Early-Stopped Gradient Flow: A Transient BBP Scenario

arXiv:2604.18450v1 Announce Type: cross Abstract: Empirical studies of trained models often report a transient regime in which signal is detectable in a finite gradient descent time window before over

Randomized Antipodal Search Done Right for Data Pareto Improvement of LLM Unlearning

arXiv:2604.16591v1 Announce Type: new Abstract: Large language models (LLMs) sometimes memorize undesirable knowledge, which must be removed after deployment. Prior work on machine unlearning has focu

Tutorials

Randomly Initialized Networks Can Learn from Peer-to-Peer Consensus

arXiv:2604.18390v1 Announce Type: new Abstract: In self-supervised learning, self-distilled methods have shown impressive performance, learning representations useful for downstream tasks and even dis

tutorialsarxiv-cs-lg

Ranking Abuse via Strategic Pairwise Data Perturbations

arXiv:2604.17805v1 Announce Type: new Abstract: Pairwise ranking systems based on Maximum Likelihood Estimation (MLE), such as the Bradley-Terry model, are widely used to aggregate preferences from pa

RASP-Tuner: Retrieval-Augmented Soft Prompts for Context-Aware Black-Box Optimization in Non-Stationary Environments

arXiv:2604.18026v1 Announce Type: new Abstract: Many deployed systems expose black-box objectives whose minimizing configuration shifts with an externally observed context. When contexts revisit a sma

Rate-Distortion Optimization for Transformer Inference

arXiv:2601.22002v3 Announce Type: replace Abstract: Transformers achieve superior performance on many tasks, but impose heavy compute and memory requirements during inference. This inference can be ma

RAYEN: Imposition of Hard Convex Constraints on Neural Networks

arXiv:2307.08336v2 Announce Type: replace Abstract: Despite the numerous applications of convex constraints in Robotics, enforcing them within learning-based frameworks remains an open challenge. Exis

REALM: Reliable Expertise-Aware Language Model Fine-Tuning from Noisy Annotations

arXiv:2604.17289v1 Announce Type: new Abstract: Supervised fine-tuning of large language models relies on human-annotated data, yet annotation pipelines routinely involve multiple crowdworkers of hete

Reasoning on the Manifold: Bidirectional Consistency for Self-Verification in Diffusion Language Models

arXiv:2604.16565v1 Announce Type: new Abstract: While Diffusion Large Language Models (dLLMs) offer structural advantages for global planning, efficiently verifying that they arrive at correct answers