Search: “arxiv-cs-lg”

Principles and Guidelines for Randomized Controlled Trials in AI Evaluation

arXiv:2605.02050v1 Announce Type: cross Abstract: This work establishes a foundational framework for standardizing AI evaluation RCTs (sometimes called human uplift studies). Drawing on established ex

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Probe-Geometry Alignment: Erasing the Cross-Sequence Memorization Signature Below Chance

DGX agent

arXiv:2605.01699v1 Announce Type: new Abstract: Recent attacks show that behavioural unlearning of large language models leaves internal traces recoverable by adversarial probes. We characterise where

model-releasesarxiv-cs-lg

5 May 2026

Projection-Free Transformers via Gaussian Kernel Attention

arXiv:2605.02144v1 Announce Type: new Abstract: Self-attention in Transformers is typically implemented as softmax(QK^op/sqrt{d})V, where Q=XW_Q, K=XW_K, and V=XW_V are learned linear projections of t

ProPACT: A Proactive AI-Driven Adaptive Collaborative Tutor for Pair Programming

arXiv:2605.02703v1 Announce Type: cross Abstract: Effective pair programming depends on coordination of attention, cognitive effort, and joint regulation over time, yet most adaptive learning systems

Protein-Conditioned Multi-Objective Reinforcement Learning for Full-Length mRNA Design

arXiv:2605.01513v1 Announce Type: new Abstract: Designing therapeutic messenger RNA (mRNA) requires creating full-length transcripts that carefully balance stability, translation efficiency, and immun

Provable Benefit of Curriculum in Transformer Tree-Reasoning Post-Training

arXiv:2511.07372v3 Announce Type: replace Abstract: Recent curriculum techniques in the post-training stage of LLMs have been empirically observed to outperform non-curriculum approaches in improving

Tutorials

Provably Learning Attention with Queries

arXiv:2601.16873v2 Announce Type: replace Abstract: We study the problem of learning Transformer-based sequence models with black-box access to their outputs. In this setting, a learner may adaptively

tutorialsarxiv-cs-lg

Pruning Federated Models through Loss Landscape Analysis and Client Agreement Scoring

arXiv:2405.10271v4 Announce Type: replace Abstract: The practical deployment of Federated Learning (FL) on resource-constrained devices is fundamentally limited by the high cost of training large mode

Q-RAG: Long Context Multi-step Retrieval via Value-based Embedder Training

arXiv:2511.07328v2 Announce Type: replace Abstract: Retrieval-Augmented Generation (RAG) methods enhance LLM performance by efficiently filtering relevant context for LLMs, reducing hallucinations and

QHyer: Q-conditioned Hybrid Attention-mamba Transformer for Offline Goal-conditioned RL

arXiv:2605.01862v1 Announce Type: new Abstract: Offline goal-conditioned RL (GCRL) learns goal-reaching policies from static datasets, but real-world datasets are often partially observable and histor

Hardware

Quant VideoGen: Auto-Regressive Long Video Generation via 2-Bit KV-Cache Quantization

arXiv:2602.02958v4 Announce Type: replace Abstract: Despite rapid progress in autoregressive video diffusion, an emerging system algorithm bottleneck limits both deployability and generation capabilit

hardwarearxiv-cs-lg

Quantifying Multimodal Capabilities: Formal Generalization Guarantees in Pairwise Metric Learning

arXiv:2605.01424v1 Announce Type: new Abstract: Multimodal learning leverages the integration of diverse data modalities to enhance performance in complex tasks. Yet, it frequently encounters incomple

Quantum-inspired Techniques in Tensor Networks for Industrial Contexts

arXiv:2404.11277v2 Announce Type: replace-cross Abstract: In this paper we present a study of the applicability and feasibility of quantum-inspired algorithms and techniques in tensor networks for ind

RamanBench: A Large-Scale Benchmark for Machine Learning on Raman Spectroscopy

arXiv:2605.02003v1 Announce Type: new Abstract: Machine Learning (ML) has transformed many scientific fields, yet key applications still lack standardized benchmarks. Raman spectroscopy, a widely used

Random-Effects Algorithm for Random Objects in Metric Spaces

arXiv:2605.02693v1 Announce Type: cross Abstract: Across many scientific disciplines, multiple observations are collected from the same experimental units, and in modern datasets these observations of

RAST-MoE-RL: A Regime-Aware Spatio-Temporal MoE Framework for Deep Reinforcement Learning in Ride-Hailing

arXiv:2512.13727v2 Announce Type: replace Abstract: Ride-hailing platforms face the challenge of balancing passenger waiting times with overall system efficiency under highly uncertain supply-demand c

Rate-optimal Design for Anytime Best Arm Identification

arXiv:2510.23199v3 Announce Type: replace-cross Abstract: We consider the best arm identification problem, where the goal is to identify the arm with the highest mean reward from a set of K arms under

Rationality Measurement and Theory for Reinforcement Learning Agents

arXiv:2602.04737v2 Announce Type: replace Abstract: This paper proposes a suite of rationality measures and associated theory for reinforcement learning agents, a property increasingly critical yet ra

Real-Time Text Transmission via LLM-Based Entropy Coding over Fixed-Rate Channels

arXiv:2605.01991v1 Announce Type: cross Abstract: Learning, prediction, and compression are intimately connected: a model that accurately predicts the next symbol in a sequence can be coupled with a s

Reconstructing conformal field theoretical compositions with Transformers

arXiv:2605.01072v1 Announce Type: cross Abstract: We study the use of transformers to reconstruct the compositions of tensor products of two-dimensional rational conformal field theories (RCFTs) based

Recurrent Deep Reinforcement Learning for Chemotherapy Control under Partial Observability

arXiv:2605.02552v1 Announce Type: new Abstract: Chemotherapy dose optimization can be formulated as a dynamic treatment regime, requiring sequential decisions under uncertainty that must balance tumor

Recurrent Graph Neural Networks and Arithmetic Circuits

arXiv:2603.05140v2 Announce Type: replace-cross Abstract: We characterise the computational power of recurrent graph neural networks (GNNs) in terms of arithmetic circuits over the real numbers. Our n

Reference-Sampled Boltzmann Projection for KL-Regularized RLVR: Target-Matched Weighted SFT, Finite One-Shot Gaps, and Policy Mirror Descent

arXiv:2605.02469v1 Announce Type: new Abstract: Online reinforcement learning with verifiable rewards (RLVR) turns checkable outcomes into a scalable training signal, but it keeps rollout generation,

Remote Action Generation: Remote Control with Minimal Communication

arXiv:2605.01833v1 Announce Type: cross Abstract: We address the challenge of remote control where one or more actors, lacking direct reward access, are steered by a controller over a communication-co

Rethinking Multi-Label Node Classification: Do Tuned Classic GNNs Suffice?

arXiv:2605.01403v1 Announce Type: new Abstract: Multi-label node classification (MLNC) has recently been addressed by increasingly complex label-aware designs that explicitly model node-label interact

Retrieval with Multiple Query Vectors through Anomalous Pattern Detection

arXiv:2605.01965v1 Announce Type: new Abstract: A classical vector retrieval problem typically considers a single query embedding vector as input and retrieves the most similar embedding vectors from

Rhamba: Region-Aware Hybrid Attention-Mamba Framework for Self-Supervised Learning in Resting-State fMRI

arXiv:2605.01240v1 Announce Type: new Abstract: Self-supervised pretraining is promising for large-scale neuroimaging, yet the impact of region-aware masking and hybrid sequence modeling remains under

Riemannian Generative Decoder

arXiv:2506.19133v3 Announce Type: replace Abstract: Euclidean representations distort data with intrinsic non-Euclidean structure. While Riemannian representation learning offers a solution by embeddi

Local Ai

Robust and Explainable Divide-and-Conquer Learning for Intrusion Detection

arXiv:2605.02015v1 Announce Type: new Abstract: Machine learning-based intrusion detection requires complex models to capture patterns in high-dimensional, noisy, and class-imbalanced raw network traf

local-aiarxiv-cs-lg

Robust and Fast Training via Per-Sample Clipping

arXiv:2605.02701v1 Announce Type: cross Abstract: We propose a robust gradient estimator based on per-sample gradient clipping and analyze its properties both theoretically and empirically. We show th

Robust Conditional Conformal Prediction via Branched Normalizing Flow

arXiv:2605.01868v1 Announce Type: new Abstract: Conformal prediction (CP) constructs prediction sets with marginal coverage guarantees under the assumption that the calibration and test distributions

Robust Linear Dueling Bandits with Post-serving Context under Unknown Delays and Adversarial Corruptions

arXiv:2605.01752v1 Announce Type: new Abstract: We study linear dueling bandits in volatile environments characterized by the simultaneous presence of post-serving contexts, delayed feedback, and adve

Robust Parameter Learning for Uncertain MDPs

arXiv:2605.01339v1 Announce Type: new Abstract: Learning-based approaches to verifying unknown Markov decision processes (MDPs) often employ uncertain MDPs. These models use, for example, confidence i

Robust volatility updates for Hierarchical Gaussian Filtering

arXiv:2605.00966v1 Announce Type: new Abstract: Hierarchical Gaussian Filtering (HGF) networks allow for efficient updating of posterior distributions (beliefs) about hidden states of an agent's envir

Rule Extraction in Machine Learning: Chat Incremental Pattern Constructor

arXiv:2208.00335v4 Announce Type: replace Abstract: Rule extraction is a central problem in interpretable machine learning because it seeks to convert opaque predictive behavior into human-readable sy

Agents

S^3-R1: Learning to Retrieve and Answer Step-by-Step with Synthetic Data

arXiv:2605.01248v1 Announce Type: new Abstract: Reinforcement learning (RL) post-training has enabled newer capabilities in models, such as agentic tool-use for search. However, these models struggle

agentsarxiv-cs-lg

SCALE-LoRA: Auditing Post-Retrieval LoRA Composition with Residual Merging and View Reliability

arXiv:2605.01429v1 Announce Type: cross Abstract: Libraries of Low-Rank Adaptation (LoRA) adapters are becoming a practical by-product of parameter-efficient adaptation. Once such adapters accumulate,

Segment-Aligned Policy Optimization for Multi-Modal Reasoning

arXiv:2605.01327v1 Announce Type: cross Abstract: Existing reinforcement learning approaches for Large Language Models typically perform policy optimization at the granularity of individual tokens or

Selective Prediction from Agreement: A Lipschitz-Consistent Version Space Approach

arXiv:2605.02611v1 Announce Type: new Abstract: We consider selective classification with abstention in the fixed-pool (or transductive) setting, where the unlabeled pool is given beforehand and only

Selector-Guided Autonomous Curriculum for One-Shot Reinforcement Learning from Verifiable Rewards

arXiv:2605.01823v1 Announce Type: new Abstract: Recently, Reinforcement Learning from Verifiable Rewards (RLVR) has been established as a highly effective technique for augmenting the math reasoning s

Self-Normalized Martingales and Uniform Regret Bounds for Linear Regression

arXiv:2605.01628v1 Announce Type: cross Abstract: Self-normalized martingale inequalities lie at the heart of confidence ellipsoids for online least squares and, more broadly, many bandit and reinforc

Semi-Supervised Treatment Effect Estimation with Unlabeled Covariates for Prediction-Powered Causal Inference

arXiv:2511.08303v2 Announce Type: replace-cross Abstract: This study investigates treatment effect estimation in the semi-supervised setting, also can be interpreted as prediction-powered inference. I

Separation Assurance between Heterogeneous Fleets of Small Unmanned Aerial Systems via Multi-Agent Reinforcement Learning

arXiv:2605.01041v1 Announce Type: cross Abstract: In the envisioned future dense urban airspace, multiple companies will operate heterogeneous fleets of small unmanned aerial systems (sUASs), where ea

Sequential Learning and Catastrophic Forgetting in Differentiable Resistor Networks

arXiv:2605.01383v1 Announce Type: new Abstract: Differentiable physical networks provide a simple setting in which learning can be studied through the interaction between trainable parameters and phys

ShiftLIF: Efficient Multi-Level Spiking Neurons with Power-of-Two Quantization

arXiv:2605.01866v1 Announce Type: cross Abstract: Spiking neural networks (SNNs) are promising for edge sensing due to their event-driven computation and temporal filtering capability. However, standa

Short window attention enables long-term memorization

arXiv:2509.24552v3 Announce Type: replace Abstract: Recent works show that hybrid architectures combining local sliding window attention layers and global attention layers outperform either of these a

Singular Bayesian Neural Networks

arXiv:2602.00387v3 Announce Type: replace-cross Abstract: Bayesian neural networks promise calibrated uncertainty but require O(mn) parameters for standard mean-field Gaussian posteriors. We argue thi

Skipping the Zeros in Diffusion Models for Sparse Data Generation

arXiv:2605.01817v1 Announce Type: new Abstract: Diffusion models (DMs) excel on dense continuous data, but are not designed for sparse continuous data. They do not model exact zeros that represent the