Search: “arxiv-cs-lg”

Distinguishing performance gains from learning when using generative AI

arXiv:2605.13731v1 Announce Type: new Abstract: Generative artificial intelligence (AI) is increasingly being integrated into education, where it can boost learners' performance. However, these uses d

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Tutorials

Distribution Shift in Missing Data Imputation: A Risk-Based Perspective and Importance-Weighted Correction under MAR

DGX agent

arXiv:2602.06713v2 Announce Type: replace-cross Abstract: Missing data imputation, where a model is trained on observed data to estimate unobserved values, is a fundamental problem in machine learning

tutorialsarxiv-cs-lg

14 May 2026

Do Activation Verbalization Methods Convey Privileged Information?

arXiv:2509.13316v4 Announce Type: replace-cross Abstract: Recent interpretability methods have proposed to translate LLM internal representations into natural language descriptions using a second verb

Do Heavy Tails Help Diffusion? On the Subtle Trade-off Between Initialization and Training

arXiv:2605.13175v1 Announce Type: new Abstract: Recent works have proposed incorporating heavy-tailed (HT) noise into diffusion- and flow-based generative models, with the goals of better recovering t

DP-KFC: Data-Free Preconditioning for Privacy-Preserving Deep Learning

arXiv:2605.13418v1 Announce Type: new Abstract: Differentially private optimization suffers from a fundamental geometric mismatch: deep networks have highly anisotropic loss landscapes, yet DP-SGD inj

DP-Muon: Differentially Private Optimization via Matrix-Orthogonalized Momentum

arXiv:2605.12994v1 Announce Type: new Abstract: We study differentially private (DP) training with Muon, a matrix-valued optimizer that updates hidden-layer weights using momentum followed by Newton--

DRIFT: A Benchmark for Task-Free Continual Graph Learning with Continuous Distribution Shifts

arXiv:2605.12998v1 Announce Type: new Abstract: Continual graph learning (CGL) aims to learn from dynamically evolving graphs while mitigating catastrophic forgetting. Existing CGL approaches typicall

Early Data Exposure Improves Robustness to Subsequent Fine-Tuning

arXiv:2605.12705v1 Announce Type: new Abstract: How can we train models whose post-trained capabilities survive subsequent fine-tuning? Rather than focusing on downstream interventions to mitigate for

Agents

Earth Science Foundation Models: From Perception to Reasoning and Discovery

arXiv:2605.12542v1 Announce Type: cross Abstract: Large foundation models (FMs) are transforming Earth science by integrating heterogeneous multimodal data, such as multi-platform imagery, gridded rea

agentsarxiv-cs-lg

Effective Context in Transformers: An Analysis of Fragmentation and Tokenization

arXiv:2605.13485v1 Announce Type: new Abstract: Transformers predict over a representation of a sequence. The same data can be written as bytes, characters, or subword tokens, and these representation

Tutorials

Efficient distributional regression trees learning algorithms for calibrated non-parametric probabilistic forecasts

arXiv:2502.05157v3 Announce Type: replace Abstract: The perspective of developing trustworthy AI for critical applications in science and engineering requires machine learning techniques that are capa

tutorialsarxiv-cs-lg

Efficient Generative Prediction for EHR Foundation Models: The SCOPE and REACH Estimators

arXiv:2602.03730v2 Announce Type: replace-cross Abstract: Generative foundation models trained on tokenized electronic health record (EHR) timelines show promise for clinical outcome prediction via Mo

Local Ai

Efficient Sensor Fusion for Gesture Recognition on Resource-Constrained Devices

arXiv:2605.13462v1 Announce Type: new Abstract: Gesture recognition is a cornerstone of Human-Computer Interaction (HCI) for smart eyewear, enabling natural and device-free control in augmented realit

local-aiarxiv-cs-lg

Agents

EGSS: Entropy-guided Stepwise Scaling for Reliable Software Engineering

arXiv:2602.05242v1 Announce Type: cross Abstract: Agentic Test-Time Scaling (TTS) has delivered state-of-the-art (SOTA) performance on complex software engineering tasks such as code generation and bu

agentsarxiv-cs-lg

Embodied Neurocomputation: A Framework for Interfacing Biological Neural Cultures with Scaled Task-Driven Validation

arXiv:2605.13315v1 Announce Type: cross Abstract: Biological neural networks (BNNs) have been established as a powerful and adaptive substrate that offer the potential for incredibly energy and data e

Hardware

EMO: Frustratingly Easy Progressive Training of Extendable MoE

arXiv:2605.13247v1 Announce Type: new Abstract: Sparse Mixture-of-Experts (MoE) models offer a powerful way to scale model size without increasing compute, as per-token FLOPs depend only on k active e

hardwarearxiv-cs-lg

Ergodic Trajectory Design by Learned Pushforward Maps: Provable Coverage via Conditional Flow Matching

arXiv:2605.13063v1 Announce Type: new Abstract: Designing continuous trajectories whose time-averaged occupancy provably matches a prescribed spatial density (the ergodic coverage problem) is central

ERPPO: Entropy Regularization-based Proximal Policy Optimization

arXiv:2605.13131v1 Announce Type: new Abstract: Multi-Agent Proximal Policy Optimization (MAPPO) is a variant of the Proximal Policy Optimization (PPO) algorithm, specifically tailored for multi-agent

Exact Sequence Interpolation with Transformers

arXiv:2502.02270v3 Announce Type: replace Abstract: We prove that transformers can exactly interpolate datasets of finite input sequences in R^d, dgeq 2, with corresponding output sequences of smaller

Exemplar-Free Continual Learning for State Space Models

arXiv:2505.18604v3 Announce Type: replace Abstract: State-Space Models (SSMs) excel at capturing long-range dependencies with structured recurrence, making them well-suited for sequence modeling. Howe

Exploring the holographic entropy cone via reinforcement learning

arXiv:2601.19979v2 Announce Type: replace-cross Abstract: We develop a reinforcement learning algorithm to study the holographic entropy cone. Given a target entropy vector, our algorithm searches for

F-GRPO: Factorized Group-Relative Policy Optimization for Unified Candidate Generation and Ranking

arXiv:2605.12995v1 Announce Type: new Abstract: Traditional retrieval pipelines optimize utility through stages of candidate retrieval and reranking, where ranking operates over a predefined candidate

Fast and effective algorithms for fair clustering at scale

arXiv:2605.13759v1 Announce Type: new Abstract: Clustering is an unsupervised machine learning task that consists of identifying groups of similar objects. It has numerous applications and is increasi

Few-shot Multi-Task Learning of Linear Invariant Features with Meta Subspace Pursuit

arXiv:2409.02708v2 Announce Type: replace Abstract: Data scarcity poses a serious threat to modern machine learning and artificial intelligence, as their practical success typically relies on the avai

Agents

Finding the Weakest Link: Adversarial Attack against Multi-Agent Communications

arXiv:2605.13170v1 Announce Type: new Abstract: Multi-agent systems rely on communication for information sharing and action coordination, which exposes a vulnerability to attacks. We investigate sing

agentsarxiv-cs-lg

Flow Matching for Offline Reinforcement Learning with Discrete Actions

arXiv:2602.06138v2 Announce Type: replace Abstract: Generative policies based on diffusion models and flow matching have shown strong promise for offline reinforcement learning (RL), but their applica

Force-Aware Neural Tangent Kernels for Scalable and Robust Active Learning of MLIPs

arXiv:2605.13788v1 Announce Type: new Abstract: Active learning for machine-learning interatomic potentials (MLIPs) must address several challenges to be practical: scaling to large candidate pools, l

Frequency Bias and OOD Generalization in Neural Operators under a Variable-Coefficient Wave Equation

arXiv:2605.12997v1 Announce Type: new Abstract: Neural operators learn to map initial conditions to the terminal solution of partial differential equations (PDEs), providing a surrogate for the full o

From Heuristics to Analytics: Forecasting Effort and Progress in Online Learning

arXiv:2605.12788v1 Announce Type: new Abstract: Sustained effort is essential for realizing the benefits of intelligent tutoring systems (ITS), yet many learners disengage or underuse available practi

From Instance Selection to Fixed-Pool Data Recipe Search for Supervised Fine-Tuning

arXiv:2605.12944v1 Announce Type: new Abstract: Supervised fine-tuning (SFT) data selection is commonly formulated as instance ranking: score each example and retain a top-k subset. However, effective

GAGPO: Generalized Advantage Grouped Policy Optimization

arXiv:2605.13217v1 Announce Type: cross Abstract: Reinforcement learning has become a powerful paradigm for post-training large language model agents, yet credit assignment in multi-turn environments

Generative Modeling by Minimizing the Wasserstein-2 Loss

arXiv:2406.13619v4 Announce Type: replace-cross Abstract: This paper develops a generative model by minimizing the second-order Wasserstein loss (the W_2 loss) through a distribution-dependent ordinar

Generative Modeling of Approximately Periodic Time Series by a Posterior-Weighted Gaussian Process

arXiv:2605.13150v1 Announce Type: cross Abstract: Discrete automated processes in industrial and cyber-physical systems often exhibit a repetitive structure in which successive repetitions follow a co

GeoFlowVLM: Geometry-Aware Joint Uncertainty for Frozen Vision-Language Embedding

arXiv:2605.13352v1 Announce Type: new Abstract: Standard dual-encoder vision-language models that map images and text to deterministic points on a shared unit hypersphere through ell_2 normalization t

Hardware

Geometric Autoencoder Priors for Bayesian Inversion: Learn First Observe Later

arXiv:2509.19929v4 Announce Type: replace-cross Abstract: Uncertainty Quantification (UQ) is paramount for inference in engineering. A common inference task is to recover full-field information of phy

hardwarearxiv-cs-lg

Geometric Preconditioning and Curriculum Optimization for Trainable Variational Quantum Regression

arXiv:2601.11942v3 Announce Type: replace Abstract: Variational quantum circuits are increasingly studied as continuous-function approximators, but quantum regression remains difficult to train when g

GHGbench: A Unified Multi-Entity, Multi-Task Benchmark for Carbon Emission Prediction

arXiv:2605.13743v1 Announce Type: new Abstract: Open datasets and benchmarks for entity-level carbon-emission prediction remain fragmented across access, scale, granularity, and evaluation. We introdu

Gradual Domain Adaptation for Graph Learning

arXiv:2501.17443v4 Announce Type: replace Abstract: Existing machine learning literature lacks graph-based domain adaptation techniques capable of handling large distribution shifts, primarily due to

Graph-Based Financial Fraud Detection with Calibrated Risk Scoring and Structural Regularization

arXiv:2605.12782v1 Announce Type: new Abstract: Financial transaction fraud prevention faces challenges such as complex relationship structures, concealed behavioral patterns, and dynamically changing

Graph Neural Networks with Triangle-Based Messages for the Multicut Problem

arXiv:2605.13673v1 Announce Type: new Abstract: The multicut problem is an NP-hard combinatorial optimization problem with diverse applications in fields such as bioinformatics, data mining and comput

Hessian Matching for Machine-Learned Coarse-Grained Molecular Dynamics

arXiv:2605.12823v1 Announce Type: new Abstract: Coarse-grained (CG) molecular dynamics enables simulations of atomic systems such as biomolecules at timescales inaccessible to all-atom (AA) methods, b

Hierarchical Transformer Preconditioning for Interactive Physics Simulation

arXiv:2605.13343v1 Announce Type: cross Abstract: Neural preconditioners for real-time physics simulation offer promising data-driven priors, but they often fail to capture long-range couplings effici

High-Dimensional Analysis of Bootstrap Ensemble Classifiers

arXiv:2505.14587v2 Announce Type: replace-cross Abstract: Bootstrap methods have long been the cornerstone of ensemble learning in machine learning. This paper presents a theoretical analysis of boots

High-Order Epistasis Detection Using Factorization Machine with Quadratic Optimization Annealing and MDR-Based Evaluation

arXiv:2601.01860v2 Announce Type: replace Abstract: Detecting high-order epistasis is a fundamental challenge in genetic association studies due to the combinatorial explosion of candidate locus combi

Tutorials

How Do Transformers Learn to Associate Tokens: Gradient Leading Terms Bring Mechanistic Interpretability

arXiv:2601.19208v2 Announce Type: replace-cross Abstract: Semantic associations such as the link between 'bird' and 'flew' are foundational for language modeling as they enable models to go beyond mem

tutorialsarxiv-cs-lg

How Well Do Large-Scale Chemical Language Models Transfer to Downstream Tasks?

arXiv:2602.11618v4 Announce Type: replace Abstract: Chemical Language Models (CLMs) pre-trained on large scale molecular data are widely used for molecular property prediction. However, the common bel

Identifying the nonlinear string dynamics with port-Hamiltonian neural networks

arXiv:2605.12785v1 Announce Type: new Abstract: Hybrid machine learning combines physical knowledge with data-driven models to enhance interpretability and performance. In this context, Port-Hamiltoni

IGT-OMD: Implicit Gradient Transport for Decision-Focused Learning under Delayed Feedback

arXiv:2605.12693v1 Announce Type: new Abstract: Decision-focused learning trains predictive models end-to-end against downstream decision loss, but online settings suffer delayed feedback: outcomes ma