Search: “arxiv-cs-lg”

Neural Garbage Collection: Learning to Forget while Learning to Reason

arXiv:2604.18002v1 Announce Type: new Abstract: Chain-of-thought reasoning has driven striking advances in language model capability, yet every reasoning step grows the KV cache, creating a bottleneck

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Neural Network-Based Score Estimation in Diffusion Models: Optimization and Generalization

DGX agent

arXiv:2401.15604v4 Announce Type: replace Abstract: Diffusion models have become a leading paradigm in generative AI, with score estimation via denoising score matching as a central component. While r

researcharxiv-cs-lg

21 Apr 2026

Neural Operator: Is data all you need to model the world? An insight into the paradigm of data-driven scientific ML

arXiv:2301.13331v3 Announce Type: replace-cross Abstract: Numerical approximations of partial differential equations (PDEs) are routinely employed to formulate the solution of physics, engineering, an

Neural Shape Operator Surrogates -- Expression Rate Bounds

arXiv:2604.18012v1 Announce Type: new Abstract: We prove error bounds for operator surrogates of solution operators for partial differential and boundary integral equations on families of domains whic

Neuroscience Inspired Graph Operators Towards Edge-Deployable Virtual Sensing for Irregular Geometries

arXiv:2604.16722v1 Announce Type: new Abstract: Predicting full-field physics through the real-time virtual sensing of engineering systems can enhance limited physical sensors but often requires spars

NI Sampling: Accelerating Discrete Diffusion Sampling by Token Order Optimization

arXiv:2604.18471v1 Announce Type: new Abstract: Discrete diffusion language models (dLLMs) have recently emerged as a promising alternative to traditional autoregressive approaches, offering the flexi

Non-Stationarity in the Embedding Space of Time Series Foundation Models

arXiv:2604.16428v1 Announce Type: new Abstract: Time series foundation models (TSFMs) are widely used as generic feature extractors, yet the notion of non-stationarity in their embedding spaces remain

NPCNet: Navigator-Driven Pseudo Text for Deep Clustering of Early Sepsis Phenotyping

arXiv:2602.03562v2 Announce Type: replace Abstract: Electronic Health Records (EHRs) provide high-dimensional temporal data essential for patient modeling; however, conventional algorithmic approaches

OC-Distill: Ontology-aware Contrastive Learning with Cross-Modal Distillation for ICU Risk Prediction

arXiv:2604.16878v1 Announce Type: new Abstract: Early prediction of severe clinical deterioration and remaining length of stay can enable timely intervention and better resource allocation in high-acu

On Different Notions of Redundancy in Conditional-Independence-Based Discovery of Graphical Models

arXiv:2502.08531v3 Announce Type: replace Abstract: Conditional-independence-based discovery uses statistical tests to identify a graphical model that represents the independence structure of variable

On Inverse Problems, Parameter Estimation, and Domain Generalization

arXiv:2506.06024v2 Announce Type: replace-cross Abstract: Signal restoration and inverse problems are key elements in most real-world data science applications. In the past decades, with the emergence

On the Convergence and Size Transferability of Continuous-depth Graph Neural Networks

arXiv:2510.03923v2 Announce Type: replace Abstract: Continuous-depth graph neural networks, also known as Graph Neural Differential Equations (GNDEs), combine the structural inductive bias of Graph Ne

On the Generalization Bounds of Symbolic Regression with Genetic Programming

arXiv:2604.17402v1 Announce Type: new Abstract: Symbolic regression (SR) with genetic programming (GP) aims to discover interpretable mathematical expressions directly from data. Despite its strong em

On the Interpolation Effect of Score Smoothing in Diffusion Models

arXiv:2502.19499v3 Announce Type: replace Abstract: Diffusion models have achieved remarkable progress in various domains with an intriguing ability to produce new data that do not exist in the traini

On The Mathematics of the Natural Physics of Optimization

arXiv:2604.17645v1 Announce Type: cross Abstract: A number of optimization algorithms have been inspired by the physics of Newtonian motion. Here, we ask the question: do algorithms themselves obey so

On the Sample Complexity of Learning for Blind Inverse Problems

arXiv:2512.23405v4 Announce Type: replace Abstract: Blind inverse problems arise in many experimental settings where both the signal of interest and the forward operator are (partially) unknown. In th

On the Theory of Continual Learning with Gradient Descent for Neural Networks

arXiv:2510.05573v2 Announce Type: replace-cross Abstract: Continual learning, the ability of a model to adapt to an ongoing sequence of tasks without forgetting earlier ones, is a central goal of arti

Online Conformal Prediction with Adversarial Semi-bandit Feedback via Regret Minimization

arXiv:2604.17984v1 Announce Type: new Abstract: Uncertainty quantification is crucial in safety-critical systems, where decisions must be made under uncertainty. In particular, we consider the problem

Open-TQ-Metal: Fused Compressed-Domain Attention for Long-Context LLM Inference on Apple Silicon

arXiv:2604.16957v1 Announce Type: new Abstract: We present Open-TQ-Metal, the first implementation of fused compressed-domain attention on Apple Silicon, enabling 128K-context inference for Llama 3.1

OptunaHub: A Platform for Black-Box Optimization

arXiv:2510.02798v2 Announce Type: replace Abstract: Black-box optimization (BBO) underpins advances in domains such as AutoML and Materials Informatics, yet implementations of algorithms and benchmark

Overcoming Selection Bias in Statistical Studies With Amortized Bayesian Inference

arXiv:2604.18319v1 Announce Type: cross Abstract: Selection bias arises when the probability that an observation enters a dataset depends on variables related to the quantities of interest, leading to

PAC-Bayes Bounds for Gibbs Posteriors via Singular Learning Theory

arXiv:2604.17219v1 Announce Type: cross Abstract: We derive explicit non-asymptotic PAC-Bayes generalization bounds for Gibbs posteriors, that is, data-dependent distributions over model parameters ob

Parkinson's Disease Detection via Self-Supervised Dual-Channel Cross-Attention on Bilateral Wrist-Worn IMU Signals

arXiv:2604.18372v1 Announce Type: new Abstract: Parkinson's disease (PD) is a chronic neurodegenerative disease. It shows multiple motor symptoms such as tremor, bradykinesia, postural instability, fr

PaTaRM: Bridging Pairwise and Pointwise Signals via Preference-Aware Task-Adaptive Reward Modeling

arXiv:2510.24235v3 Announce Type: replace Abstract: Reward models (RMs) are central to reinforcement learning from human feedback (RLHF), providing the critical supervision signals that align large la

Path-Based Quantum Meta-Learning for Adaptive Optimization of Reconfigurable Intelligent Surfaces

arXiv:2604.17690v1 Announce Type: cross Abstract: Reconfigurable intelligent surfaces (RISs) modify signal reflections to enhance wireless communication capabilities. Classical RIS phase optimization

Persistence-Augmented Neural Networks

arXiv:2604.08469v2 Announce Type: replace Abstract: Topological Data Analysis (TDA) provides tools to describe the shape of data, but integrating topological features into deep learning pipelines rema

PFDelta: A Benchmark Dataset for Power Flow under Load, Generation, and Topology Variations

arXiv:2510.22048v3 Announce Type: replace Abstract: Power flow (PF) calculations are the backbone of real-time grid operations, across workflows such as contingency analysis (where repeated PF evaluat

Physics-Informed Causal MDPs for Sequential Constraint Repair in Engineering Simulation Pipelines

arXiv:2604.17910v1 Announce Type: cross Abstract: Off-policy learning in constrained MDPs with large binary state spaces faces a fundamental tension: causal identification of transition dynamics requi

Physics-Informed Graph Neural Networks for Transverse Momentum Estimation in CMS Trigger Systems

arXiv:2507.19205v2 Announce Type: replace Abstract: Real-time particle transverse momentum (p_T) estimation in high-energy physics demands algorithms that are both efficient and accurate under strict

Physics-Informed Neural Networks: A Didactic Derivation of the Complete Training Cycle

arXiv:2604.18481v1 Announce Type: cross Abstract: This paper is a step-by-step, self-contained guide to the complete training cycle of a Physics-Informed Neural Network (PINN) -- a topic that existing

Applications

Physics-Informed Neural Networks for Biological 2D{+}t Reaction-Diffusion Systems

arXiv:2604.18548v1 Announce Type: new Abstract: Physics-informed neural networks (PINNs) provide a powerful framework for learning governing equations of dynamical systems from data. Biologically-info

applicationsarxiv-cs-lg

PiCa: Parameter-Efficient Fine-Tuning with Column Space Projection

arXiv:2505.20211v3 Announce Type: replace Abstract: Fine-tuning large foundation models is essential for building expert models tailored to specialized tasks and domains, but fully updating billions o

Plasticity Loss in Deep Reinforcement Learning: A Survey

arXiv:2411.04832v3 Announce Type: replace-cross Abstract: Plasticity refers to a network's ability to adapt to changing data distributions, which is crucial for the successful training of deep reinfor

Hardware

POLAR: Online Learning for LoRA Adapter Caching and Routing in Edge LLM Serving

arXiv:2604.16583v1 Announce Type: new Abstract: Edge deployment of large language models (LLMs) increasingly relies on libraries of lightweight LoRA adapters, yet GPU/DRAM can keep only a small reside

hardwarearxiv-cs-lg

Policy Testing in Markov Decision Processes

arXiv:2505.15342v2 Announce Type: replace-cross Abstract: We study the policy testing problem in discounted Markov decision processes (MDPs) in the fixed-confidence setting under a generative model wi

Local Ai

Positive-Only Drifting Policy Optimization

arXiv:2604.16519v1 Announce Type: new Abstract: In the field of online reinforcement learning (RL), traditional Gaussian policies and flow-based methods are often constrained by their unimodal express

local-aiarxiv-cs-lg

Predicting LLM Compression Degradation from Spectral Statistics

arXiv:2604.18085v1 Announce Type: new Abstract: Matrix-level low-rank compression is a promising way to reduce the cost of large language models, but running compression and evaluating the resulting m

Predictive Modeling of Natural Medicinal Compounds for Alzheimer Disease Using Cheminformatics

arXiv:2604.18316v1 Announce Type: cross Abstract: The most common cause of dementia is Alzheimer disease, a progressive neurodegenerative disorder affecting older adults that gradually impairs memory,

Applications

Preventing overfitting in deep learning using differential privacy

arXiv:2604.16334v1 Announce Type: new Abstract: The use of Deep Neural Network based systems in the real world is growing. They have achieved state-of-the-art performance on many image, speech and tex

applicationsarxiv-cs-lg

Prior-Fitted Functional Flow: In-Context Generative Models for Pharmacokinetics

arXiv:2604.17670v1 Announce Type: new Abstract: We introduce Prior-Fitted Functional Flows, a generative foundation model for pharmacokinetics that enables zero-shot population synthesis and individua

PrivaDE: Privacy-preserving Data Evaluation for Blockchain-based Data Marketplaces

arXiv:2510.18109v4 Announce Type: replace-cross Abstract: Evaluating the usefulness of data before purchase is essential when obtaining data for high-quality machine learning models, yet both model bu

Program Structure-aware Language Models: Targeted Software Testing beyond Textual Semantics

arXiv:2604.17715v1 Announce Type: cross Abstract: Recent advances in large language models for test case generation have improved branch coverage via prompt-engineered mutations. However, they still l

Projected Coupled Diffusion for Test-Time Constrained Joint Generation

arXiv:2508.10531v3 Announce Type: replace Abstract: Modifications to test-time sampling have emerged as an important extension to diffusion algorithms, with the goal of biasing the generative process

ProTrain: Efficient LLM Training via Memory-Aware Techniques

arXiv:2406.08334v2 Announce Type: replace-cross Abstract: Memory pressure has emerged as a dominant constraint in scaling the training of large language models (LLMs), particularly in resource-constra

Pulse Shape Discrimination Algorithms: Survey and Benchmark

arXiv:2508.02750v2 Announce Type: replace Abstract: This review presents a comprehensive survey and benchmark of pulse shape discrimination (PSD) algorithms for radiation detection, classifying nearly

Applications

Putting a Face to Forgetting: Continual Learning meets Mechanistic Interpretability

arXiv:2601.22012v2 Announce Type: replace Abstract: Catastrophic forgetting in continual learning is often measured at the performance or last-layer representation level, overlooking the underlying me

applicationsarxiv-cs-lg

PyEPO: A PyTorch-based End-to-End Predict-then-Optimize Library for Linear and Integer Programming

arXiv:2206.14234v3 Announce Type: replace-cross Abstract: In deterministic optimization, it is typically assumed that all problem parameters are fixed and known. In practice, however, some parameters

Q-SINDy: Quantum-Kernel Sparse Identification of Nonlinear Dynamics with Provable Coefficient Debiasing

arXiv:2604.16779v1 Announce Type: cross Abstract: Quantum feature maps offer expressive embeddings for classical learning tasks, and augmenting sparse identification of nonlinear dynamics (SINDy) with