Search: “arxiv-cs-lg”

ReLibra: Routing-Replay-Guided Load Balancing for MoE Training in Reinforcement Learning

arXiv:2605.08639v1 Announce Type: new Abstract: Load imbalance is a long-standing challenge in Mixture-of-Experts (MoE) training and is exacerbated in reinforcement learning (RL) for LLMs, where hot e

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Remember to Forget: Gated Adaptive Positional Encoding

DGX agent

arXiv:2605.10414v1 Announce Type: new Abstract: Rotary Positional Encoding (RoPE) is widely used in modern large language models. However, when sequences are extended beyond the range seen during trai

safetyarxiv-cs-lg

12 May 2026

Rennala MVR: Improved Time Complexity for Parallel Stochastic Optimization via Momentum-Based Variance Reduction

arXiv:2605.08871v1 Announce Type: cross Abstract: Large-scale machine learning models are trained on clusters of machines that exhibit heterogeneous performance due to hardware variability, network de

Representative Action Selection for Large Action Space Bandit Families

arXiv:2505.18269v5 Announce Type: replace Abstract: We study the problem of selecting a subset from a large action space shared by a family of bandits. In many natural situations, while the nominal se

Rethinking Ratio-Based Trust Regions for Policy Optimization in Multi-Agent Reinforcement Learning

arXiv:2605.09212v1 Announce Type: new Abstract: Centralized training with decentralized execution (CTDE) is a standard framework for cooperative multi-agent policy-gradient reinforcement learning, all

Tutorials

Rethinking the Global Knowledge of CLIP in Training-Free Open-Vocabulary Semantic Segmentation

arXiv:2502.06818v3 Announce Type: replace Abstract: Recent works modify CLIP to perform open-vocabulary semantic segmentation in a training-free manner (TF-OVSS). In vanilla CLIP, patch-wise image rep

tutorialsarxiv-cs-lg

Retrieval Mechanisms Surpass Long-Context Scaling in Time Series Forecasting

arXiv:2605.08217v1 Announce Type: new Abstract: Time Series Foundation Models (TSFMs) have borrowed the long context paradigm from natural language processing under the premise that feeding more histo

Revisiting Policy Gradients for Restricted Policy Classes: Escaping Myopic Local Optima with k-step Policy Gradients

arXiv:2605.10909v1 Announce Type: new Abstract: This work revisits standard policy gradient methods used on restricted policy classes, which are known to get stuck in suboptimal critical points. We id

Reward-Conditioned Reinforcement Learning

arXiv:2603.05066v2 Announce Type: replace Abstract: Single-task RL agents are typically trained under a fixed reward function, which limits their robustness to reward misspecification and their abilit

Applications

RIR-Former: Coordinate-Guided Transformer for Continuous Reconstruction of Room Impulse Responses

arXiv:2602.01861v3 Announce Type: replace-cross Abstract: Room impulse responses (RIRs) are essential for many acoustic signal processing tasks, yet measuring them densely across space is often imprac

applicationsarxiv-cs-lg

Agents

Robust Remote Reinforcement Learning over Unreliable Communication Channels using Homomorphic State Encoding

arXiv:2508.07722v2 Announce Type: replace Abstract: Traditional Reinforcement Learning (RL) frameworks generally assume that the agent perceives the state of the underlying Markov process instantaneou

agentsarxiv-cs-lg

Robust Server Defense Against Unreliable Clients in One-Shot Fair Collaborative Machine Learning

arXiv:2605.08616v1 Announce Type: new Abstract: Collaborative machine learning (CML) enables multiple clients to train a global model jointly in a data-distributed setting. To address data privacy and

Robust Spectral Watermark for Synthetic Tabular Data

arXiv:2511.21600v2 Announce Type: replace-cross Abstract: The rise of generative AI has enabled the production of high-fidelity synthetic tabular data across fields such as healthcare, finance, and pu

Applications

Root Cause Analysis of Measurement and Mechanistic Anomalies

arXiv:2601.23026v2 Announce Type: replace Abstract: Root cause analysis of anomalies aims to identify how and why a sample deviates from the normal process. Existing methods primarily focus on telling

applicationsarxiv-cs-lg

Applications

RubiConv -- Efficient Boundary-Respecting Convolutions

arXiv:2605.08451v1 Announce Type: new Abstract: Convolutional architectures have emerged as powerful alternatives to Transformers for sequence modeling. The primary advantage is that they offer improv

applicationsarxiv-cs-lg

RubricRefine: Improving Tool-Use Agent Reliability with Training-Free Pre-Execution Refinement

arXiv:2605.09730v1 Announce Type: new Abstract: Iterative self-refinement is a popular inference-time reliability technique, but its effectiveness in code-mode tool use depends heavily on the structur

SACHI: Structured Agent Coordination via Holistic Information Integration in Multi-Agent Reinforcement Learning

arXiv:2605.08391v1 Announce Type: new Abstract: Cooperative multi-agent reinforcement learning agents that act on partial local observations face a fundamental information bottleneck: the knowledge ne

SAFA-SNN: Sparsity-Aware On-Device Few-Shot Class-Incremental Learning with Fast-Adaptive Structure of Spiking Neural Network

arXiv:2510.03648v2 Announce Type: replace Abstract: Continuous learning of novel classes is crucial for edge devices to preserve data privacy and maintain reliable performance in dynamic environments.

Agents

SAGE: Agentic Framework for Interpretable and Clinically Translatable Computational Pathology Biomarker Discovery

arXiv:2602.00953v2 Announce Type: replace Abstract: Engineered image-based biomarkers offer a clinically interpretable alternative to black-box AI in computational pathology, yet their discovery remai

agentsarxiv-cs-lg

Sample-Mean Anchored Thompson Sampling for Offline-to-Online Learning with Distribution Shift

arXiv:2605.10289v1 Announce Type: new Abstract: Offline-to-online learning aims to improve online decision-making by leveraging offline logged data. A central challenge in this setting is the distribu

Scalable Gaussian process inference via neural feature maps

arXiv:2605.10285v1 Announce Type: cross Abstract: We present a theoretically grounded Gaussian process framework that leverages neural feature maps to construct expressive kernels. We show that the le

Scalable Mamba-Based Message-Passing Neural Decoder for Error-Correcting Codes

arXiv:2605.10681v1 Announce Type: cross Abstract: Forward error correction is essential for reliable communication over noisy channels. Attention-based model-free neural decoders have shown strong per

Scaling the Memory of Balanced Adam

arXiv:2605.10119v1 Announce Type: new Abstract: Recent evidence suggests that Adam performs robustly when its momentum parameters are tied, eta_1=eta_2, reducing the optimizer to a single remaining pa

SCOT: Multi-Source Cross-City Transfer with Optimal-Transport Soft-Correspondence Objective

arXiv:2604.07383v2 Announce Type: replace Abstract: Cross-city transfer improves prediction in label-scarce cities by leveraging labeled data from other cities, but it becomes challenging when cities

SeBA: Semi-supervised few-shot learning via Separated-at-Birth Alignment for tabular data

arXiv:2605.08519v1 Announce Type: new Abstract: Learning from scarce labeled data with a larger pool of unlabeled samples, known as semi-supervised few-shot learning (SS-FSL), remains critical for app

Selection of the Best Policy under Fairness Constraints for Subpopulations

arXiv:2605.09945v1 Announce Type: new Abstract: Many high-stakes decisions in health care, public policy, and clinical development require committing to a single policy that will be applied uniformly

Selection Plateau and a Sparsity-Dependent Hierarchy of Pruning Features

arXiv:2605.09345v1 Announce Type: new Abstract: We identify a Selection Plateau phenomenon in one-shot neural network pruning: all rank-monotone weight scorers converge to identical accuracy at fixed

Self-Attention as a Covariance Readout: A Unified View of In-Context Learning and Repetition

arXiv:2605.10466v1 Announce Type: new Abstract: Large language models (LLMs) exhibit two striking and ostensibly unrelated behaviours: in-context learning (ICL) and repetitive generation. In both, the

SEMASIA: A Large-Scale Dataset of Semantically Structured Latent Representations

arXiv:2605.09485v1 Announce Type: new Abstract: Latent representations learned by neural networks often exhibit semantic structure, where concept similarity is reflected by geometric proximity in embe

Sequential Causal Discovery with Noisy Language Model Priors

arXiv:2506.16234v2 Announce Type: replace Abstract: Causal discovery from observational data typically assumes access to complete data and availability of perfect domain experts. In practice, data oft

Sequential Membership Inference Attacks

arXiv:2602.16596v2 Announce Type: replace Abstract: Modern AI models are not static. They go through multiple updates in their lifecycles. We propose to design Sequential Membership Inference (SeMI) a

Set Prediction for Next-Day Active Fire Forecasting

arXiv:2605.10298v1 Announce Type: new Abstract: Accurate next-day active fire forecasts can support early warning, disaster response, forest risk assessment, and downstream estimation of fire-related

Sharp feature-learning transitions and Bayes-optimal neural scaling laws in extensive-width networks

arXiv:2605.10395v1 Announce Type: cross Abstract: We study the information-theoretic limits of learning a one-hidden-layer teacher network with hierarchical features from noisy queries, in the context

Tutorials

Signal from Structure: Exploiting Submodular Upper Bounds in Generative Flow Networks

arXiv:2601.21061v2 Announce Type: replace Abstract: Generative Flow Networks (GFlowNets; GFNs) are a class of generative models that learn to sample compositional objects proportionally to their a pri

tutorialsarxiv-cs-lg

Signature Approach for Contextual Bandits with Nonlinear and Path-dependent Rewards

arXiv:2605.10313v1 Announce Type: new Abstract: We study contextual bandits with nonlinear and path-dependent rewards through a novel signature-transform-based approach. Leveraging the universal nonli

Single-Thread JPEG Decoder Benchmarks Mis-Evaluate ML Data Loaders

arXiv:2605.08731v1 Announce Type: cross Abstract: JPEG decode is routine ML infrastructure, but Python decoder choices are often justified by single-process, single-thread microbenchmarks. We audit th

Sinkhorn Treatment Effects: A Causal Optimal Transport Measure

arXiv:2605.08485v1 Announce Type: cross Abstract: We introduce the Sinkhorn treatment effect, an entropic optimal transport measure of divergence between counterfactual distributions. Unlike classical

Agents

Skill-CMIB: Multimodal Agent Skill for Consistent Action via Conditional Multimodal Information Bottleneck

arXiv:2605.08526v1 Announce Type: new Abstract: While LLM-based agents excel at planning and executing long action sequences, their execution often remains inconsistent across trials, limiting reliabi

agentsarxiv-cs-lg

Sliced Inner Product Gromov-Wasserstein Distances

arXiv:2605.08546v1 Announce Type: cross Abstract: The Gromov-Wasserstein (GW) problem provides a framework for aligning heterogeneous datasets by matching their intrinsic geometry, but its statistical

Sliding Window Informative Canonical Correlation Analysis

arXiv:2507.17921v2 Announce Type: replace-cross Abstract: Canonical correlation analysis (CCA) is a technique for finding correlated sets of features between two datasets. In this paper, we propose a

SMIXAE: Towards Unsupervised Manifold Discovery in Language Models

arXiv:2605.09224v1 Announce Type: new Abstract: Sparse autoencoders (SAEs) have been used widely to decompose and interpret neural network activations, especially those of transformer language models.

SMOG: Scalable Meta-Learning for Multi-Objective Bayesian Optimization

arXiv:2601.22131v2 Announce Type: replace Abstract: Multi-objective optimization aims to solve problems with competing objectives. Evaluating such problems is often slow or expensive, limiting the bud

Social Determinants of Health and Fentanyl Overdose Mortality Across US Counties: An XGBoost and SHAP Analysis Identifying Silent Risk Counties and Treatment Deserts

arXiv:2605.08230v1 Announce Type: new Abstract: Background: Fentanyl overdose deaths are still increasing across the U.S. We do not fully understand which county-level social and structural conditions

SPDEBench: An Extensive Benchmark for Learning Stochastic PDEs

arXiv:2505.18511v2 Announce Type: replace Abstract: Stochastic Partial Differential Equations (SPDEs) driven by random noise play a central role in modeling physical processes with rough spatio-tempor

Spectral Condition for muP under Width-Depth Scaling

arXiv:2603.00541v2 Announce Type: replace Abstract: Generative foundation models are increasingly scaled in both width and depth, posing significant challenges for stable feature learning and reliable

SpectraLLM: Uncovering the Ability of LLMs for Molecular Structure Elucidation from Multi-Spectral Data

arXiv:2508.08441v3 Announce Type: replace-cross Abstract: Automated molecular structure elucidation remains challenging, as existing approaches often depend on pre-compiled databases or restrict thems

Spherical Boltzmann machines: a solvable theory of learning and generation in energy-based models

arXiv:2605.09031v1 Announce Type: new Abstract: Energy-based models (EBMs) are flexible generative architectures inspired by statistical physics, but their learning and generative properties remain po

Split CNN Inference on Networked Microcontrollers

arXiv:2605.09357v1 Announce Type: cross Abstract: Running deep neural networks on microcontroller units (MCUs) is severely constrained by limited memory resources. While TinyML techniques reduce model