Search: “arxiv-cs-lg”

Nautile-370M: Spectral Memory Meets Attention in a Small Reasoning Model

arXiv:2604.24809v1 Announce Type: new Abstract: We present Nautile-370M, a 371-million-parameter small language model designed for efficient reasoning under strict parameter and inference budgets. Nau

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Applications

Near-Optimal Sample Complexities of Divergence-based S-rectangular Distributionally Robust Reinforcement Learning

DGX agent

arXiv:2505.12202v3 Announce Type: replace Abstract: Distributionally robust reinforcement learning (DR-RL) has recently gained significant attention as a principled approach that addresses discrepanci

applicationsarxiv-cs-lg

29 Apr 2026

Applications

Negative Ontology of True Target for Machine Learning: Towards Evaluation and Learning under Democratic Supervision

arXiv:2604.24824v1 Announce Type: new Abstract: This article philosophically examines how shifts in assumptions regarding the existence and non-existence of the true target (TT) give rise to new persp

applicationsarxiv-cs-lg

NUBO: A Transparent Python Package for Bayesian Optimization

arXiv:2305.06709v4 Announce Type: replace Abstract: NUBO, short for Newcastle University Bayesian Optimisation, is a Bayesian optimization framework for the optimization of expensive-to-evaluate black

Null Measurability at the Symmetrization Interface in VC Learning

arXiv:2604.25028v1 Announce Type: new Abstract: Recent work revisiting measurability in the fundamental theorem of statistical learning imposes Borel measurability of ghost-gap suprema. We show that,

On Halting vs Converging in Recurrent Graph Neural Networks

arXiv:2604.25551v1 Announce Type: new Abstract: Recurrent Graph Neural Networks (RGNNs) extend standard GNNs by iterating message-passing until some stopping condition is met. Various RGNN models have

On quantitative Laplace-type convergence results for some exponential probability measures, with two applications

arXiv:2110.12922v2 Announce Type: replace-cross Abstract: Laplace-type results characterize the limit of sequence of measures (pi_arepsilon)_{arepsilon >0} with density w.r.t the Lebesgue measure (d p

On the Trainability of Masked Diffusion Language Models via Blockwise Locality

arXiv:2604.24832v1 Announce Type: new Abstract: Masked diffusion language models (MDMs) have recently emerged as a promising alternative to standard autoregressive large language models (AR-LLMs), yet

Online combinatorial optimization with stochastic decision sets and adversarial losses

arXiv:2604.25269v1 Announce Type: new Abstract: Most work on sequential learning assumes a fixed set of actions that are available all the time. However, in practice, actions can consist of picking su

Online learning with Erdos-Renyi side-observation graphs

arXiv:2604.25271v1 Announce Type: cross Abstract: We consider adversarial multi-armed bandit problems where the learner is allowed to observe losses of a number of arms beside the arm that it actually

Optimization-Free Topological Sort for Causal Discovery via the Schur Complement of Score Jacobians

arXiv:2604.25295v1 Announce Type: new Abstract: Continuous causal discovery typically couples representation learning with structural optimization via non-convex acyclicity penalties, which subjects s

Origin-Destination Demand Prediction: An Urban Radiation and Attraction Perspective

arXiv:2412.00167v2 Announce Type: replace Abstract: In recent years, origin-destination (OD) demand prediction has gained significant attention for its profound implications in urban development. Exis

Physics-Guided Tiny-Mamba Transformer for Reliability-Aware Early Fault Warning

arXiv:2601.21293v2 Announce Type: replace Abstract: Reliability-centered prognostics for rotating machinery requires early-warning signals that remain accurate under nonstationary operating conditions

Pimp My LLM: Leveraging Variability Modeling to Tune Inference Hyperparameters

arXiv:2602.17697v2 Announce Type: replace Abstract: Large Language Models (LLMs) are being increasingly used across a wide range of tasks. However, their substantial computational demands raise concer

PINNs in More General Geometry

arXiv:2604.25020v1 Announce Type: cross Abstract: Neural architectures trained with losses inspired by differential conditions are the basis for PINN models. Since many constructions in differential g

PLMGH: What Matters in PLM-GNN Hybrids for Code Classification and Vulnerability Detection

arXiv:2604.25599v1 Announce Type: cross Abstract: Code understanding models increasingly rely on pretrained language models (PLMs) and graph neural networks (GNNs), which capture complementary semanti

Policy Improvement Reinforcement Learning

arXiv:2604.00860v2 Announce Type: replace Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has become a central post-training paradigm for improving the reasoning capabilities of large

Prior-Aligned Data Cleaning for Tabular Foundation Models

arXiv:2604.25154v1 Announce Type: new Abstract: Tabular Foundation Models (TFMs) achieve state-of-the-art zero-shot accuracy on small tabular datasets by meta-learning over synthetic data-generating p

Tutorials

Provable Accelerated Bayesian Optimization with Knowledge Transfer

arXiv:2511.03125v2 Announce Type: replace-cross Abstract: We study how to accelerate Bayesian optimization (BO) on a target task by transferring historical knowledge from related source tasks. Existin

tutorialsarxiv-cs-lg

QFlash: Bridging Quantization and Memory Efficiency in Vision Transformer Attention

arXiv:2604.25306v1 Announce Type: new Abstract: FlashAttention improves efficiency through tiling, but its online softmax still relies on floating-point arithmetic for numerical stability, making full

Quantum Dynamics via Score Matching on Bohmian Trajectories

arXiv:2604.25137v1 Announce Type: cross Abstract: We solve the time-dependent Schrodinger equation by learning the score function, the gradient of the log-probability density, on Bohmian trajectories.

Query-Efficient Quantum Approximate Optimization via Graph-Conditioned Trust Regions

arXiv:2604.24803v1 Announce Type: new Abstract: In low-depth implementations of the Quantum Approximate Optimization Algorithm (QAOA), the dominant cost is often the number of objective evaluations ra

RCProb: Probabilistic Rule Extraction for Efficient Simplification of Tree Ensembles

arXiv:2604.25304v1 Announce Type: new Abstract: Tree ensembles are widely used in industrial machine learning due to their strong predictive performance and efficient training procedures. However, as

Reinforcement Learning for Testing Interdependent Requirements in Autonomous Vehicles: An Empirical Study

arXiv:2502.15792v2 Announce Type: replace-cross Abstract: Autonomous vehicles (AVs) make driving decisions without humans, making dependability assurance critical. Scenario-based testing is widely use

Applications

Reinforcement Learning Using known Invariances

arXiv:2511.03473v2 Announce Type: replace Abstract: In many real-world reinforcement learning (RL) problems, the environment exhibits inherent symmetries that can be exploited to improve learning effi

applicationsarxiv-cs-lg

Applications

Relational In-Context Learning via Synthetic Pre-training with Structural Prior

arXiv:2603.03805v2 Announce Type: replace Abstract: Relational Databases (RDBs) are the backbone of modern business, yet they lack foundation models comparable to those in text or vision. A key obstac

applicationsarxiv-cs-lg

Residual-loss Anomaly Analysis of Physics-Informed Neural Networks: An Inverse Method for Change-point Detection in Nonlinear Dynamical Systems with Regime Switching

arXiv:2604.25655v1 Announce Type: cross Abstract: Nonlinear dynamical systems with regime transitions are typically described by ordinary differential equations with jumping parameters parameters. Tra

Rethinking Efficiency in Neural Combinatorial Optimization: Batched Preference Optimization with Mamba

arXiv:2602.20730v2 Announce Type: replace Abstract: We study efficiency as a first-class objective in Neural Combinatorial Optimization (NCO) and present ECO, an efficient learning framework that comb

Rethinking Entropy Interventions in RLVR: An Entropy Change Perspective

arXiv:2510.10150v3 Announce Type: replace Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) serves as a cornerstone technique for enhancing the reasoning capabilities of Large Language M

Revisiting the Past: Data Unlearning with Model State History

arXiv:2506.20941v3 Announce Type: replace Abstract: Large language models are trained on massive corpora of web data, which may include private data, copyrighted material, factually inaccurate data, o

Safe-Support Q-Learning: Learning without Unsafe Exploration

arXiv:2604.25379v1 Announce Type: new Abstract: Ensuring safety during reinforcement learning (RL) training is critical in real-world applications where unsafe exploration can lead to devastating outc

Sharp Capacity Scaling of Spectral Optimizers in Learning Associative Memory

arXiv:2603.26554v2 Announce Type: replace Abstract: Spectral optimizers such as Muon have recently shown strong empirical performance in large-scale language model training, but the source and extent

Sharp Risk Bounds for Early-Stopping in Gaussian Linear Regression

arXiv:2503.03426v2 Announce Type: replace Abstract: We study early-stopped mirror descent (ESMD) for high-dimensional Gaussian linear regression over arbitrary convex bodies and design matrices, where

Shearlet Neural Operators for Anisotropic-Shock-Dominated and Multi-scale parametric partial differential equations

arXiv:2604.25181v1 Announce Type: new Abstract: Neural operators have emerged as powerful data-driven surrogates for learning solution operators of parametric partial differential equations (PDEs). Ho

Spark Policy Toolkit: Semantic Contracts and Scalable Execution for Policy Learning in Spark

arXiv:2604.25061v1 Announce Type: cross Abstract: Custom policy-learning pipelines in Spark fail for two coupled systems reasons: rowwise Python execution makes inference impractical, and driver-side

Spectral bandits

arXiv:2604.25272v1 Announce Type: cross Abstract: Smooth functions on graphs have wide applications in manifold and semi-supervised learning. In this work, we study a bandit problem where the payoffs

StrADiff: A Structured Source-Wise Adaptive Diffusion Framework for Linear and Nonlinear Blind Source Separation

arXiv:2604.04973v2 Announce Type: replace-cross Abstract: This paper presents StrADiff, a Structured Source-Wise Adaptive Diffusion Framework for unsupervised blind source separation under linear and

Subspace Optimization for Efficient Federated Learning under Heterogeneous Data

arXiv:2604.25467v1 Announce Type: new Abstract: Federated learning increasingly operates in a large-model regime where communication, memory, and computation are all scarce. Typically, non-IID client

Sustained Gradient Alignment Mediates Subliminal Learning in a Multi-Step Setting: Evidence from MNIST Auxiliary Logit Distillation Experiment

arXiv:2604.25779v1 Announce Type: new Abstract: In the MNIST auxiliary logit distillation experiment, a student can acquire an unintended teacher trait despite distilling only on no-class logits throu

Teacher Forcing as Generalized Bayes: Optimization Geometry Mismatch in Switching Surrogates for Chaotic Dynamics

arXiv:2604.25904v1 Announce Type: new Abstract: Identity teacher forcing (ITF) enables stable training of deterministic recurrent surrogates for chaotic dynamical systems and has been highly effective

The Rashomon Effect for Visualizing High-Dimensional Data

arXiv:2604.00485v2 Announce Type: replace Abstract: Dimension reduction (DR) is inherently non-unique: multiple embeddings can preserve the structure of high-dimensional data equally well while differ

The Role of Symmetry in Optimizing Overparameterized Networks

arXiv:2604.25150v1 Announce Type: new Abstract: Overparameterization is central to the success of deep learning, yet the mechanisms by which it improves optimization remain incompletely understood. We

Time-varying Interaction Graph ODE for Dynamic Graph Representation Learning

arXiv:2604.24811v1 Announce Type: new Abstract: Graph neural Ordinary Differential Equations (ODE) combine neural ODE with the message passing mechanism of Graph Neural Networks (GNN), providing a con

Towards interpretable AI with quantum annealing feature selection

arXiv:2604.25649v1 Announce Type: new Abstract: Deep learning models are used in critical applications, in which mistakes can have serious consequences. Therefore, it is crucial to understand how and

Towards Unified Multi-task EEG Analysis with Low-Rank Adaptation

arXiv:2604.25131v1 Announce Type: new Abstract: Recent self-supervised pre-training methods for electroencephalogram (EEG) have shown promising results. However, the pre-trained models typically requi

Transformer Approximations from ReLUs

arXiv:2604.24878v1 Announce Type: new Abstract: We provide a systematic recipe for translating ReLU approximation results to softmax attention mechanism. This recipe covers many common approximation t

TSN-Affinity: Similarity-Driven Parameter Reuse for Continual Offline Reinforcement Learning

arXiv:2604.25898v1 Announce Type: new Abstract: Continual offline reinforcement learning (CORL) aims to learn a sequence of tasks from datasets collected over time while preserving performance on prev

Uncovering Exotic Paired States in the 2D Spin-Imbalanced Fermi Gas with Neural Wave Functions

arXiv:2604.24883v1 Announce Type: cross Abstract: We study the zero-temperature phase diagram of the 2D spin-imbalanced Fermi gas with short-ranged attractive interactions using the recently developed