Search: “arxiv-cs-lg”

Autoregressive Learning in Joint KL: Sharp Oracle Bounds and Lower Bounds

arXiv:2605.12316v1 Announce Type: new Abstract: We study the fundamental and timely problem of learning long sequences in autoregressive modeling and next-token prediction under model misspecification

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Backbone-Equated Diffusion OOD via Sparse Internal Snapshots

DGX agent

arXiv:2605.11014v1 Announce Type: new Abstract: Fair comparison between diffusion-based OOD detectors is challenging, as conclusions can vary with backbone choice, corruption parameterization, and tes

model-releasesarxiv-cs-lg

13 May 2026

Bayesian Surrogate Training on Multiple Data Sources: A Hybrid Modeling Strategy

arXiv:2412.11875v3 Announce Type: replace-cross Abstract: Surrogate models are often used as computationally efficient approximations to complex simulation models, enabling tasks such as solving inver

Behavioral Mode Discovery for Fine-tuning Multimodal Generative Policies

arXiv:2605.11387v1 Announce Type: new Abstract: We address the problem of fine-tuning pre-trained generative policies with reinforcement learning (RL) while preserving the multimodality of their actio

Beyond GRPO and On-Policy Distillation: An Empirical Sparse-to-Dense Reward Principle for Language-Model Post-Training

arXiv:2605.12483v1 Announce Type: new Abstract: In settings where labeled verifiable training data is the binding constraint, each checked example should be allocated carefully. The standard practice

Agents

Beyond Manual Curation: Augmenting Targeted Protein Degradation Databases via Agentic Literature Extraction Workflows

arXiv:2605.11221v1 Announce Type: cross Abstract: Predictive models in biomedicine depend on structured assay data locked in the text, tables, and supplements of primary publications. This bottleneck

agentsarxiv-cs-lg

Beyond Parameter Aggregation: Semantic Consensus for Federated Fine-Tuning of LLMs

arXiv:2605.11857v1 Announce Type: new Abstract: Federated fine-tuning of large language models is commonly formulated as a parameter aggregation problem. However, even parameter-efficient methods requ

Beyond Point Estimates: Distributional Uncertainty in Machine Learning Performance Evaluation

arXiv:2501.16931v2 Announce Type: replace Abstract: Machine learning models are often evaluated using point estimates of performance metrics such as accuracy, F1 score, or mean squared error. Such sum

Beyond Prediction: Interval Neural Networks for Uncertainty-Aware System Identification

arXiv:2605.11460v1 Announce Type: new Abstract: System identification (SysID) is critical for modeling dynamical systems from experimental data, yet traditional approaches often fail to capture nonlin

Beyond Similarity: Temporal Operator Attention for Time Series Analysis

arXiv:2605.11287v1 Announce Type: new Abstract: A persistent paradox in time-series forecasting is that structurally simple MLP and linear models often outperform high-capacity Transformers. We argue

Bin Latent Transformer (BiLT): A shift-invariant autoencoder for calibration-free spectral unmixing of turbid media

arXiv:2605.11829v1 Announce Type: cross Abstract: The accurate recovery of constituent-level optical properties from integrating sphere measurements is a central analytical challenge in pharmaceutical

BLOCK-EM: Preventing Emergent Misalignment via Latent Blocking

arXiv:2602.00767v2 Announce Type: replace Abstract: Emergent misalignment can arise when a language model is fine-tuned on a narrowly scoped supervised objective: the model learns the target behavior,

Block-R1: Rethinking the Role of Block Size in Multi-domain Reinforcement Learning for Diffusion Large Language Models

arXiv:2605.11726v1 Announce Type: new Abstract: Recently, reinforcement learning (RL) has been widely applied during post-training for diffusion large language models (dLLMs) to enhance reasoning with

Hardware

BOOST: BOttleneck-Optimized Scalable Training Framework for Low-Rank Large Language Models

arXiv:2512.12131v2 Announce Type: replace Abstract: The scale of transformer model pre-training is constrained by the increasing computation and communication cost. Low-rank bottleneck architectures o

hardwarearxiv-cs-lg

Breaking extit{Winner-Takes-All}: Cooperative Policy Optimization Improves Diverse LLM Reasoning

arXiv:2605.11461v1 Announce Type: cross Abstract: Reinforcement learning with verifiers (RLVR) has become a central paradigm for improving LLM reasoning, yet popular group-based optimization algorithm

BSO: Safety Alignment Is Density Ratio Matching

arXiv:2605.12339v1 Announce Type: new Abstract: Aligning language models for both helpfulness and safety typically requires complex pipelines-separate reward and cost models, online reinforcement lear

CATS: Cascaded Adaptive Tree Speculation for Memory-Limited LLM Inference Acceleration

arXiv:2605.11186v1 Announce Type: new Abstract: Auto-regressive decoding in Large Language Models (LLMs) is inherently memory-bound: every generation step requires loading the model weights and interm

Causal Algorithmic Recourse: Foundations and Methods

arXiv:2605.11373v1 Announce Type: cross Abstract: The trustworthiness of AI decision-making systems is increasingly important. A key feature of such systems is the ability to provide recommendations f

Causal Bias Detection in Generative Artifical Intelligence

arXiv:2605.11365v1 Announce Type: cross Abstract: Automated systems built on artificial intelligence (AI) are increasingly deployed across high-stakes domains, raising critical concerns about fairness

Causal Fairness for Survival Analysis

arXiv:2605.11362v1 Announce Type: new Abstract: In the data-driven era, large-scale datasets are routinely collected and analyzed using machine learning (ML) and artificial intelligence (AI) to inform

Hardware

ChunkFlow: Communication-Aware Chunked Prefetching for Layerwise Offloading in Distributed Diffusion Transformer Inference

arXiv:2605.11335v1 Announce Type: cross Abstract: Layerwise offloading reduces the GPU memory footprint of large diffusion transformer (DiT) inference by prefetching upcoming layers from host memory,

hardwarearxiv-cs-lg

Clarity: The Flexibility-Interpretability Trade-Off in Sparsity-aware Concept Bottleneck Models

arXiv:2601.21944v2 Announce Type: replace Abstract: The widespread adoption of deep learning models in computer vision has intensified concerns about interpretability. Despite strong performance, thes

Compositional Neural Operators for Multi-Dimensional Fluid Dynamics

arXiv:2605.11691v1 Announce Type: new Abstract: Partial differential equations (PDEs) govern diverse physical phenomena, yet high-fidelity numerical solutions are computationally expensive and Machine

Constrained Stochastic Spectral Preconditioning Converges for Nonconvex Objectives

arXiv:2605.11850v1 Announce Type: cross Abstract: In this work, we develop proximal preconditioned gradient methods with a focus on spectral gradient methods providing a proximal extension to the Muon

Context Steering: A New Paradigm for Compression-based Embeddings by Synthesizing Relevant Information Features

arXiv:2508.14780v2 Announce Type: replace Abstract: Compression-based dissimilarities (CD) offer a flexible and domain-agnostic means of measuring similarity by identifying implicit information throug

Continuous Discovery of Vulnerabilities in LLM Serving Systems with Fuzzing

arXiv:2605.11202v1 Announce Type: cross Abstract: LLM inference and serving systems have become security-critical infrastructure; however, many of their most concerning failures arise from the serving

Agents

Control Charts for Multi-agent Systems

arXiv:2605.11135v1 Announce Type: cross Abstract: Generative agents have proven to be powerful assistants in a wide variety of contexts. Given this success, users are now deploying agents with minimal

agentsarxiv-cs-lg

CORE: Cyclic Orthotope Relation Embedding for Knowledge Graph Completion

arXiv:2605.11159v1 Announce Type: new Abstract: Knowledge graph completion (KGC) aims to automatically infer missing facts in multi-relational data by mapping entities and relations into continuous re

Local Ai

COSMOS: Model-Agnostic Personalized Federated Learning with Clustered Server Models and Pseudo-Label-Only Communication

arXiv:2605.11165v1 Announce Type: new Abstract: Federated learning (FL) in heterogeneous environments remains challenging because client models often differ in both architecture and data distribution.

local-aiarxiv-cs-lg

Crash Assessment via Mesh-Based Graph Neural Networks and Physics-Aware Attention

arXiv:2605.11784v1 Announce Type: cross Abstract: Full-vehicle crash simulations are computationally expensive, limiting their use in iterative design exploration. This work investigates learned hybri

CTFusion: A CTF-based Benchmark for LLM Agent Evaluation

arXiv:2605.11504v1 Announce Type: new Abstract: Recent advances in Large Language Models (LLMs) have enabled agentic systems for complex, multi-step tasks; cybersecurity is emerging as a prominent app

Curriculum Learning-Guided Progressive Distillation in Large Language Models

arXiv:2605.11260v1 Announce Type: new Abstract: Knowledge distillation is a key technique for transferring the capabilities of large language models (LLMs) into smaller, more efficient student models.

DAG: A Dual Correlation Network for Time Series Forecasting with Exogenous Variables

arXiv:2509.14933v3 Announce Type: replace Abstract: Time series forecasting is essential in various domains. Compared to relying solely on endogenous variables (i.e., target variables), considering ex

Debiased Model-based Representations for Sample-efficient Continuous Control

arXiv:2605.11711v1 Announce Type: new Abstract: Model-based representations recently stand out as a promising framework that embeds latent dynamics information into the representations for downstream

Debiasing Message Passing to Mitigate Popularity Bias in GNN-based Collaborative Filtering

arXiv:2605.11145v1 Announce Type: cross Abstract: Collaborative filtering (CF) models based on graph neural networks (GNNs) achieve strong performance in recommender systems by propagating user-item s

Decomposing the Generalization Gap in PROTAC Activity Prediction: Variance Attribution and the Inter-Laboratory Ceiling

arXiv:2605.11764v1 Announce Type: new Abstract: Machine-learning predictors of biochemical activity often exhibit large random-split-to-leave-one-target-out generalisation gaps that have been document

DeconDTN-Toolkit: A Library for Evaluation and Enhancement of Robustness to Provenance Shift

arXiv:2605.11237v1 Announce Type: new Abstract: Despite the burgeoning body of work on distribution shifts, provenance shift-where the relationship between data source and label changes at deployment-

Deep Learning for Protein Complex Prediction and Design

arXiv:2605.11189v1 Announce Type: new Abstract: Accurately modeling and designing protein complex structures is a central problem in computational structural biology, with broad implications for under

Deep Minds and Shallow Probes

arXiv:2605.11448v1 Announce Type: new Abstract: Neural representations are not unique objects. Even when two systems realize the same downstream computation, their hidden coordinates may differ by rep

Delay-Empowered Causal Hierarchical Reinforcement Learning

arXiv:2605.12261v1 Announce Type: new Abstract: Many real-world tasks involve delayed effects, where the outcomes of actions emerge after varying time lags. Existing delay-aware reinforcement learning

Delightful Gradients Accelerate Corner Escape

arXiv:2605.11908v1 Announce Type: new Abstract: Softmax policy gradient converges at O(1/t), but its transient behavior near sub-optimal corners of the simplex can be exponentially slow. The bottlenec

Detecting In-Person Conversations in Noisy Real-World Environments with Smartwatch Audio and Motion Sensing

arXiv:2507.12002v2 Announce Type: replace Abstract: Social interactions play a crucial role in shaping human behavior, relationships, and societies. It encompasses various forms of communication, such

Detecting overfitting in Neural Networks during long-horizon grokking using Random Matrix Theory

arXiv:2605.12394v1 Announce Type: new Abstract: Training Neural Networks (NNs) without overfitting is difficult; detecting that overfitting is difficult as well. We present a novel Random Matrix Theor

Dirichlet process mixtures of block g priors for model selection and prediction in linear models

arXiv:2411.00471v3 Announce Type: replace-cross Abstract: This paper introduces Dirichlet process mixtures of block g priors for model selection and prediction in linear models. These priors are exten

DisagMoE: Computation-Communication overlapped MoE Training via Disaggregated AF-Pipe Parallelism

arXiv:2605.11005v1 Announce Type: new Abstract: Mixture-of-experts (MoE) architectures enable trillion-parameter LLMs with sparsely activated experts. Expert parallelism (EP) is a widely adopted MoE t

Discrete Flow Matching for Offline-to-Online Reinforcement Learning

arXiv:2605.12379v1 Announce Type: new Abstract: Many reinforcement learning (RL) tasks have discrete action spaces, but most generative policy methods based on diffusion and flow matching are designed

Dissecting Discrete Soft Actor-Critic: Limitations and Principled Alternatives

arXiv:2509.09838v2 Announce Type: replace Abstract: While Soft Actor-Critic (SAC) is highly effective in continuous control, its discrete counterpart (DSAC) performs poorly on challenging discrete-act

Local Ai

Distributed Quantum Gaussian Processes for Multi-Agent Systems

arXiv:2602.15006v2 Announce Type: replace-cross Abstract: Gaussian Processes (GPs) are a powerful tool for probabilistic modeling, but their performance is often constrained in complex, large-scale re

local-aiarxiv-cs-lg