Search: “arxiv-cs-lg”

Convergent Differential Privacy Analysis for General Federated Learning

arXiv:2408.15621v3 Announce Type: replace Abstract: The powerful cooperation of federated learning (FL) and differential privacy~(DP) provides a promising paradigm for the large-scale private clients.

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Coreset-Induced Conditional Velocity Flow Matching

DGX agent

arXiv:2605.12951v1 Announce Type: cross Abstract: We propose Coreset-Induced Conditional Velocity Flow Matching (CCVFM), a generative model that augments hierarchical rectified flow with a data-inform

researcharxiv-cs-lg

14 May 2026

Coupling-Informed Transport Maps for Bayesian Filtering in Nonlinear Dynamical Systems

arXiv:2605.13174v1 Announce Type: cross Abstract: A likelihood-free transport filtering method is proposed based on the couplings between state and observation variables. By exploiting a block-triangu

CR-Net: Scaling Parameter-Efficient Training with Cross-Layer Low-Rank Structure

arXiv:2509.18993v3 Announce Type: replace Abstract: Low-rank architectures have become increasingly important for efficient large language model (LLM) pre-training, providing substantial reductions in

Data-Driven Integration Kernels for Interpretable Nonlocal Operator Learning

arXiv:2603.10305v3 Announce Type: replace Abstract: Machine learning models can represent climate processes that are nonlocal in horizontal space, height, and time, often by combining information acro

Decision Support for Marketplace Policies under Incomplete Evidence: From Replay to Launch Readiness

arXiv:2605.12840v1 Announce Type: cross Abstract: Marketplace platforms routinely evaluate pricing and allocation policies using logged observational data, yet strong offline performance does not impl

Decision Tree Learning on Product Spaces

arXiv:2605.12983v1 Announce Type: new Abstract: Decision tree learning has long been a central topic in theoretical computer science, driven by its practical importance. A fundamental and widely used

Decoupling Exploration and Policy Optimization: Uncertainty Guided Tree Search for Hard Exploration

arXiv:2603.22273v4 Announce Type: replace Abstract: The process of discovery requires active exploration -- the act of collecting new and informative data. However, efficient autonomous exploration re

Tutorials

Deep Learning as Neural Low-Degree Filtering: A Spectral Theory of Hierarchical Feature Learning

arXiv:2605.13612v1 Announce Type: new Abstract: Understanding how deep neural networks learn useful internal representations from data remains a central open problem in the theory of deep learning. We

tutorialsarxiv-cs-lg

Dense vs Sparse Pretraining at Tiny Scale: Active-Parameter vs Total-Parameter Matching

arXiv:2605.13769v1 Announce Type: cross Abstract: We study dense and mixture-of-experts (MoE) transformers in a tiny-scale pretraining regime under a shared LLaMA-style decoder training recipe. The sp

Descriptive Collision in Sparse Autoencoder Auto-Interpretability: When One Explanation Describes Many Features

arXiv:2605.12874v1 Announce Type: new Abstract: Sparse autoencoders (SAEs) are now standard tools for decomposing language model activations into interpretable features, and automated interpretability

Differentially Private Nonparametric Confidence Intervals Under Minimal Distributional Assumptions

arXiv:2511.01303v2 Announce Type: replace-cross Abstract: We consider the problem of constructing differentially private nonparametric confidence intervals (CIs) for an arbitrary quantity using resamp

Diffusion-Inspired Reconfiguration of Transformers for Uncertainty Calibration

arXiv:2602.08920v2 Announce Type: replace Abstract: Uncertainty calibration in pre-trained transformers is critical for their reliable deployment in risk-sensitive applications. Yet, most existing pre

Diffusion Model's Generalization Can Be Characterized by Inductive Biases toward a Data-Dependent Ridge Manifold

arXiv:2602.06021v2 Announce Type: replace-cross Abstract: We study a data-dependent notion of diffusion-model generalization: when a model does not memorize the training set, where do its generated sa

DiffusionHijack: Supply-Chain PRNG Backdoor Attack on Diffusion Models and Quantum Random Number Defense

arXiv:2605.13115v1 Announce Type: cross Abstract: Diffusion models depend on pseudo-random number generators (PRNGs) for latent noise sampling. We present DiffusionHijack, a supply-chain backdoor atta

Digital Twins as Synthetic Controls in Single-Arm Trials

arXiv:2605.12832v1 Announce Type: cross Abstract: Single-arm trials are an important study design for evaluating drug efficacy and safety without enrolling patients into a control arm. Although they d

DisAgg: Distributed Aggregators for Efficient Secure Aggregation in Federated Learning

arXiv:2605.13708v1 Announce Type: cross Abstract: Federated learning enables collaborative model training across distributed clients, yet vanilla FL exposes client updates to the central server. Secur

Discrete Stochastic Localization for Non-autoregressive Generation

arXiv:2605.12836v1 Announce Type: new Abstract: Continuous diffusion is a natural framework for non-autoregressive generation but has generally lagged behind masked discrete diffusion models (MDMs) on

Applications

Distinguishing performance gains from learning when using generative AI

arXiv:2605.13731v1 Announce Type: new Abstract: Generative artificial intelligence (AI) is increasingly being integrated into education, where it can boost learners' performance. However, these uses d

applicationsarxiv-cs-lg

Tutorials

Distribution Shift in Missing Data Imputation: A Risk-Based Perspective and Importance-Weighted Correction under MAR

arXiv:2602.06713v2 Announce Type: replace-cross Abstract: Missing data imputation, where a model is trained on observed data to estimate unobserved values, is a fundamental problem in machine learning

tutorialsarxiv-cs-lg

Do Activation Verbalization Methods Convey Privileged Information?

arXiv:2509.13316v4 Announce Type: replace-cross Abstract: Recent interpretability methods have proposed to translate LLM internal representations into natural language descriptions using a second verb

Applications

Do Heavy Tails Help Diffusion? On the Subtle Trade-off Between Initialization and Training

arXiv:2605.13175v1 Announce Type: new Abstract: Recent works have proposed incorporating heavy-tailed (HT) noise into diffusion- and flow-based generative models, with the goals of better recovering t

applicationsarxiv-cs-lg

DP-KFC: Data-Free Preconditioning for Privacy-Preserving Deep Learning

arXiv:2605.13418v1 Announce Type: new Abstract: Differentially private optimization suffers from a fundamental geometric mismatch: deep networks have highly anisotropic loss landscapes, yet DP-SGD inj

DP-Muon: Differentially Private Optimization via Matrix-Orthogonalized Momentum

arXiv:2605.12994v1 Announce Type: new Abstract: We study differentially private (DP) training with Muon, a matrix-valued optimizer that updates hidden-layer weights using momentum followed by Newton--

DRIFT: A Benchmark for Task-Free Continual Graph Learning with Continuous Distribution Shifts

arXiv:2605.12998v1 Announce Type: new Abstract: Continual graph learning (CGL) aims to learn from dynamically evolving graphs while mitigating catastrophic forgetting. Existing CGL approaches typicall

Early Data Exposure Improves Robustness to Subsequent Fine-Tuning

arXiv:2605.12705v1 Announce Type: new Abstract: How can we train models whose post-trained capabilities survive subsequent fine-tuning? Rather than focusing on downstream interventions to mitigate for

Agents

Earth Science Foundation Models: From Perception to Reasoning and Discovery

arXiv:2605.12542v1 Announce Type: cross Abstract: Large foundation models (FMs) are transforming Earth science by integrating heterogeneous multimodal data, such as multi-platform imagery, gridded rea

agentsarxiv-cs-lg

Effective Context in Transformers: An Analysis of Fragmentation and Tokenization

arXiv:2605.13485v1 Announce Type: new Abstract: Transformers predict over a representation of a sequence. The same data can be written as bytes, characters, or subword tokens, and these representation

Tutorials

Efficient distributional regression trees learning algorithms for calibrated non-parametric probabilistic forecasts

arXiv:2502.05157v3 Announce Type: replace Abstract: The perspective of developing trustworthy AI for critical applications in science and engineering requires machine learning techniques that are capa

tutorialsarxiv-cs-lg

Applications

Efficient Generative Prediction for EHR Foundation Models: The SCOPE and REACH Estimators

arXiv:2602.03730v2 Announce Type: replace-cross Abstract: Generative foundation models trained on tokenized electronic health record (EHR) timelines show promise for clinical outcome prediction via Mo

applicationsarxiv-cs-lg

Local Ai

Efficient Sensor Fusion for Gesture Recognition on Resource-Constrained Devices

arXiv:2605.13462v1 Announce Type: new Abstract: Gesture recognition is a cornerstone of Human-Computer Interaction (HCI) for smart eyewear, enabling natural and device-free control in augmented realit

local-aiarxiv-cs-lg

Agents

EGSS: Entropy-guided Stepwise Scaling for Reliable Software Engineering

arXiv:2602.05242v1 Announce Type: cross Abstract: Agentic Test-Time Scaling (TTS) has delivered state-of-the-art (SOTA) performance on complex software engineering tasks such as code generation and bu

agentsarxiv-cs-lg

Embodied Neurocomputation: A Framework for Interfacing Biological Neural Cultures with Scaled Task-Driven Validation

arXiv:2605.13315v1 Announce Type: cross Abstract: Biological neural networks (BNNs) have been established as a powerful and adaptive substrate that offer the potential for incredibly energy and data e

Hardware

EMO: Frustratingly Easy Progressive Training of Extendable MoE

arXiv:2605.13247v1 Announce Type: new Abstract: Sparse Mixture-of-Experts (MoE) models offer a powerful way to scale model size without increasing compute, as per-token FLOPs depend only on k active e

hardwarearxiv-cs-lg

Ergodic Trajectory Design by Learned Pushforward Maps: Provable Coverage via Conditional Flow Matching

arXiv:2605.13063v1 Announce Type: new Abstract: Designing continuous trajectories whose time-averaged occupancy provably matches a prescribed spatial density (the ergodic coverage problem) is central

ERPPO: Entropy Regularization-based Proximal Policy Optimization

arXiv:2605.13131v1 Announce Type: new Abstract: Multi-Agent Proximal Policy Optimization (MAPPO) is a variant of the Proximal Policy Optimization (PPO) algorithm, specifically tailored for multi-agent

Exact Sequence Interpolation with Transformers

arXiv:2502.02270v3 Announce Type: replace Abstract: We prove that transformers can exactly interpolate datasets of finite input sequences in R^d, dgeq 2, with corresponding output sequences of smaller

Exemplar-Free Continual Learning for State Space Models

arXiv:2505.18604v3 Announce Type: replace Abstract: State-Space Models (SSMs) excel at capturing long-range dependencies with structured recurrence, making them well-suited for sequence modeling. Howe

Exploring the holographic entropy cone via reinforcement learning

arXiv:2601.19979v2 Announce Type: replace-cross Abstract: We develop a reinforcement learning algorithm to study the holographic entropy cone. Given a target entropy vector, our algorithm searches for

F-GRPO: Factorized Group-Relative Policy Optimization for Unified Candidate Generation and Ranking

arXiv:2605.12995v1 Announce Type: new Abstract: Traditional retrieval pipelines optimize utility through stages of candidate retrieval and reranking, where ranking operates over a predefined candidate

Fast and effective algorithms for fair clustering at scale

arXiv:2605.13759v1 Announce Type: new Abstract: Clustering is an unsupervised machine learning task that consists of identifying groups of similar objects. It has numerous applications and is increasi

Few-shot Multi-Task Learning of Linear Invariant Features with Meta Subspace Pursuit

arXiv:2409.02708v2 Announce Type: replace Abstract: Data scarcity poses a serious threat to modern machine learning and artificial intelligence, as their practical success typically relies on the avai

Agents

Finding the Weakest Link: Adversarial Attack against Multi-Agent Communications

arXiv:2605.13170v1 Announce Type: new Abstract: Multi-agent systems rely on communication for information sharing and action coordination, which exposes a vulnerability to attacks. We investigate sing

agentsarxiv-cs-lg

Flow Matching for Offline Reinforcement Learning with Discrete Actions

arXiv:2602.06138v2 Announce Type: replace Abstract: Generative policies based on diffusion models and flow matching have shown strong promise for offline reinforcement learning (RL), but their applica

Force-Aware Neural Tangent Kernels for Scalable and Robust Active Learning of MLIPs

arXiv:2605.13788v1 Announce Type: new Abstract: Active learning for machine-learning interatomic potentials (MLIPs) must address several challenges to be practical: scaling to large candidate pools, l

Frequency Bias and OOD Generalization in Neural Operators under a Variable-Coefficient Wave Equation

arXiv:2605.12997v1 Announce Type: new Abstract: Neural operators learn to map initial conditions to the terminal solution of partial differential equations (PDEs), providing a surrogate for the full o

From Heuristics to Analytics: Forecasting Effort and Progress in Online Learning

arXiv:2605.12788v1 Announce Type: new Abstract: Sustained effort is essential for realizing the benefits of intelligent tutoring systems (ITS), yet many learners disengage or underuse available practi

From Instance Selection to Fixed-Pool Data Recipe Search for Supervised Fine-Tuning

arXiv:2605.12944v1 Announce Type: new Abstract: Supervised fine-tuning (SFT) data selection is commonly formulated as instance ranking: score each example and retain a top-k subset. However, effective