Search: “arxiv-cs-lg”

Transformers for Learning on Noisy and Task-Level Manifolds: Approximation and Generalization Insights

arXiv:2505.03205v3 Announce Type: replace Abstract: Transformers serve as the foundational architecture for large language and video generation models, such as GPT, BERT, SORA and their successors. Em

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Hardware

TriAxialKV: Toward Extreme Low-Precision KV-Cache Quantization for Agentic Inference Tasks

DGX agent

arXiv:2605.17170v1 Announce Type: new Abstract: Agentic workloads have emerged as a major workload for LLM inference. They differ significantly from chat-only workloads, requiring long-context process

hardwarearxiv-cs-lg

19 May 2026

TriOpt: A Scalable Algorithm for Linear Causal Discovery

arXiv:2605.17465v1 Announce Type: new Abstract: Learning causal relations from observational data is challenging because the graph search space grows super-exponentially with the number of variables.

Hardware

Truthful Calibration Errors for Multi-Class Prediction

arXiv:2510.06388v2 Announce Type: replace Abstract: Calibrated predictions are useful because their numerical values can be interpreted as probabilities. Calibration errors are therefore widely used t

hardwarearxiv-cs-lg

UB-SMoE: Universally Balanced Sparse Mixture-of-Experts for Resource-adaptive Federated Fine-tuning of Foundation Models

arXiv:2605.16690v1 Announce Type: new Abstract: Heterogeneous LoRA-rank methods address system heterogeneity in federated fine-tuning of foundation models by assigning client-specific ranks based on c

Uncertainty-Calibrated Recommendations for Low-Active Users

arXiv:2605.17788v1 Announce Type: cross Abstract: A fundamental challenge in recommender systems is balancing reliability for Low-Active Users (LAUs) with diversity for High-Active Users (HAUs). The k

Uncertainty Reliability Under Domain Shift: An Investigation for Data-Driven Blood Pressure Estimation in Photoplethysmography

arXiv:2605.18008v1 Announce Type: new Abstract: Uncertainty quantification (UQ) is critical for safety-critical domains like healthcare, yet it is rarely evaluated under realistic out-of-distribution

Universal Graph Backdoor Defense: A Feature-based Homophily Perspective

arXiv:2605.16815v1 Announce Type: cross Abstract: Graph neural networks (GNNs) have achieved remarkable success in relational learning. However, their vulnerability to graph backdoor attacks (GBAs) po

Universal Inverse Distillation for Matching Models with Real-Data Supervision (No GANs)

arXiv:2509.22459v4 Announce Type: replace-cross Abstract: While achieving exceptional generative quality, modern diffusion, flow, and other matching models suffer from slow inference, as they require

Use the Online Network If You Can: Towards Fast and Stable Reinforcement Learning

arXiv:2510.02590v2 Announce Type: replace Abstract: The use of target networks is a popular approach for estimating value functions in deep Reinforcement Learning (RL). While effective, the target net

Usenix'23 Extended Version: Smart Learning to Find Dumb Contracts

arXiv:2304.10726v3 Announce Type: replace-cross Abstract: We introduce the Deep Learning Vulnerability Analyzer (DLVA) for Ethereum smart contracts based on neural networks. We train DLVA to judge byt

UTOPYA: A Multimodal Deep Learning Framework for Physics-Informed Anomaly Detection and Time-Series Prediction

arXiv:2605.18188v1 Announce Type: new Abstract: Anomaly detection in batch processes is hindered by transient dynamics, scarce fault labels, and reliance on single-modality sensor data. This work intr

Variational Optimality of Follmer Processes in Generative Diffusions

arXiv:2602.10989v2 Announce Type: replace-cross Abstract: We construct and analyze generative diffusions that transport a point mass to a prescribed target distribution over a finite time horizon usin

Tutorials

Venom: A PyTorch Generative Modeling Toolkit

arXiv:2605.17605v1 Announce Type: new Abstract: Modern generative modeling has grown into a broad collection of related but often separately implemented paradigms, including denoising diffusion models

tutorialsarxiv-cs-lg

Hardware

VeriCache: Turning Lossy KV Cache into Lossless LLM Inference

arXiv:2605.17613v1 Announce Type: cross Abstract: The large size of the KV cache has become a major bottleneck for serving LLMs with increasing context lengths. In response, many KV cache compression

hardwarearxiv-cs-lg

Verifier-Guided Code Translation via Meta-Step Decoding

arXiv:2605.17626v1 Announce Type: new Abstract: Test-time scaling is an important mechanism for improving large language models, especially on tasks with deterministic verifiers. Code translation is a

Wasserstein bounds for denoising diffusion probabilistic models via the Follmer process

arXiv:2605.18069v1 Announce Type: cross Abstract: This paper studies sampling error bounds for denoising diffusion probabilistic models (DDPMs) in the 2-Wasserstein distance. Our contributions are thr

Weighted Flow Matching and Physics-Informed Nonlinear Filtering for Parameter Estimation in Digital Twins

arXiv:2605.17146v1 Announce Type: cross Abstract: Digital twins (DTs) rely on continuous synchronization between physical systems and their virtual counterparts through online parameter estimation und

Weisfeiler and Leman Follow the Arrow of Time: Expressive Power of Message Passing in Temporal Event Graphs

arXiv:2505.24438v3 Announce Type: replace Abstract: An important characteristic of temporal graphs is how the directed arrow of time influences their causal topology, i.e., which nodes can possibly in

What is the long-run distribution of stochastic gradient descent? A large deviations analysis

arXiv:2406.09241v3 Announce Type: replace-cross Abstract: In this paper, we examine the long-run distribution of stochastic gradient descent (SGD) in general, non-convex problems. Specifically, we see

When a Zero-Shooter Cheats: Improving Age Estimation via Activation Steering

arXiv:2605.17658v1 Announce Type: new Abstract: Different age-related regulations have been proposed to protect minors from harmful content and interactions online. Automated age estimation is central

Local Ai

When Molecular Similarity Works: Property Cliffs Reveal Hidden Errors

arXiv:2605.17265v1 Announce Type: new Abstract: Accurate prediction of molecular properties underpins drug discovery and material design, yet even state-of-the-art models remain vulnerable to localize

local-aiarxiv-cs-lg

Where Does Warm-Up Come From? Adaptive Scheduling for Norm-Constrained Optimizers

arXiv:2602.05813v2 Announce Type: replace Abstract: We study adaptive learning rate scheduling for norm-constrained optimizers (e.g., Muon and Lion). We introduce a generalized smoothness assumption u

Why Do Reasoning Models Lose Coverage? The Role of Data and Forks in the Road

arXiv:2605.17026v1 Announce Type: new Abstract: Recent progress in large language models has led to the emergence of reasoning models, which have shown strong performance on complex tasks through spec

WinQ: Accelerating Quantization-Aware Training of Language Models Around Saddle Points

arXiv:2605.17471v1 Announce Type: new Abstract: Quantization-aware training (QAT) is widely adopted to quantize language models by training full-precision weights using gradients from the quantized mo

World Model-Enabled Causal Digital Twins for Semantic Communications in Physical AI Systems

arXiv:2605.16547v1 Announce Type: new Abstract: Semantic communication has emerged as a promising paradigm for enabling goal-oriented networking. However, most existing semantic communication solution

XCTFormer: Leveraging Cross-Channel and Cross-Time Dependencies for Enhanced Time-Series Analysis

arXiv:2605.18534v1 Announce Type: new Abstract: Multivariate time-series analysis involves extracting informative representations from sequences of multiple interdependent variables, supporting tasks

Your SaaS Is an Insurance Product: A Modeling Framework

arXiv:2605.16699v1 Announce Type: new Abstract: Capped-usage SaaS products -- LLM subscriptions such as Claude Code and ChatGPT, cloud platforms such as Vercel and Cloudflare Workers, corporate benefi

ZeroSiam: An Efficient Asymmetry for Test-Time Entropy Optimization without Collapse

arXiv:2509.23183v3 Announce Type: replace Abstract: Test-time entropy minimization helps adapt a model to novel environments and incentivize its reasoning capability, unleashing the model's potential

2Mamba2Furious: Linear in Complexity, Competitive in Accuracy

arXiv:2602.17363v3 Announce Type: replace Abstract: Linear attention transformers have become a strong alternative to softmax attention due to their efficiency. However, linear attention tends to be l

A Differentiable Measure of Algebraic Complexity: Provably Exact Discovery of Group Structures

arXiv:2511.23152v3 Announce Type: replace Abstract: Discovering discrete algebraic rules from data is a fundamental challenge in machine learning. We formalize this problem through Cayley-table comple

A Multi-Layer Cloud-IDS Pipeline with LLM and Adaptive Q-Learning Calibration

arXiv:2605.15889v1 Announce Type: cross Abstract: Security in cloud computing has become a major concern due to several factors such as layered cloud architectures, dynamic environments, and exposure

A numerical study into neural network surrogate model performance for uncertainty propagation

arXiv:2605.16078v1 Announce Type: cross Abstract: Neural network surrogate models have emerged as a promising approach to model solution fields for a wide variety of boundary value problems encountere

A Retrieval-Enhanced Transformer for Multi-Step Port-of-Call Sequence Prediction in Global Liner Shipping

arXiv:2605.15937v1 Announce Type: new Abstract: Accurate multi-step port-of-call sequence prediction is vital for tactical resource orchestration and logistical efficiency. However, existing methods s

A Scalable Nonparametric Continuous-Time Survival Model through Numerical Quadrature

arXiv:2605.16208v1 Announce Type: cross Abstract: Flexible continuous-time survival modeling is critical for capturing complex time-varying hazard dynamics in high-dimensional data; however, training

A Split-Client Approach to Second-Order Optimization

arXiv:2510.15714v3 Announce Type: replace-cross Abstract: Second-order optimization methods offer superior convergence rates but are often bottlenecked by the wall-clock cost of Hessian computation an

A Statistical Analysis for Per-Instance Evaluation of Stochastic Optimizers: Avoiding Unreliable Conclusions

arXiv:2503.16589v2 Announce Type: replace Abstract: A key trait of stochastic optimizers is that multiple runs of the same optimizer in attempting to solve the same problem can produce different resul

A Unified Perturbation Framework for Analyzing Leaderboard Stability and Manipulation

arXiv:2605.15761v1 Announce Type: new Abstract: Evaluation leaderboards such as LMArena play a central role in benchmarking large language models by aggregating pairwise human preferences into model r

Accelerated Gradient Descent for Faster Convergence with Minimal Overhead

arXiv:2605.16017v1 Announce Type: new Abstract: In this paper, we present CT-AGD (Curvature-Tuned Accelerated Gradient Descent), an optimization method for non-convex optimization problems in deep lea

ADAPT: A Self-Calibrating Proactive Autoscaler for Container Orchestration

arXiv:2605.15788v1 Announce Type: cross Abstract: Proactive autoscaling for containerized workloads depends on knowing the provisioning delay, i.e., the time between a scaling decision and the moment

Adaptive Conformal Prediction for Quantum Machine Learning

arXiv:2511.18225v2 Announce Type: replace Abstract: Quantum machine learning seeks to leverage quantum computers to improve upon classical machine learning algorithms. Currently, robust uncertainty qu

Adaptive Outer-Loop Control of Quadrotors via Reinforcement Learning

arXiv:2605.16015v1 Announce Type: cross Abstract: Deep Reinforcement Learning (DRL) for quadrotor flight control typically relies on Domain Randomization (DR) for sim-to-real transfer, resulting in ov

AGOP-IxG: A Gradient Covariance Filter for Local Feature Attribution on Tabular Data, with a Controlled Benchmark

arXiv:2605.15700v1 Announce Type: new Abstract: Automated machine learning pipelines increasingly produce models whose predictions must be explained to end users, auditors, and downstream decision sys

Algorithmic Simplification of Neural Networks with Mosaic-of-Motifs

arXiv:2602.14896v2 Announce Type: replace Abstract: Large-scale deep learning models are well-suited for compression. Across a variety of tasks, methods like pruning, quantization, and knowledge disti

An Introduction to Deep Reinforcement and Imitation Learning

arXiv:2512.08052v3 Announce Type: replace-cross Abstract: Embodied agents, such as robots and virtual characters, must continuously select actions to execute tasks effectively, solving complex sequent

AOT-POT: Adaptive Operator Transformation for Large-Scale PDE Pre-training

arXiv:2605.15793v1 Announce Type: new Abstract: Pre-training neural operators on diverse partial differential equation (PDE) datasets has emerged as a promising direction for building general-purpose

BAPR: Bayesian amnesic piecewise-robust reinforcement learning for non-stationary continuous control

arXiv:2605.16170v1 Announce Type: new Abstract: Real-world control systems frequently operate under piecewise stationary conditions, where dynamics remain stable for extended periods before undergoing

Best-of-Both-Worlds for Heavy-Tailed Markov Decision Processes

arXiv:2602.01295v3 Announce Type: replace Abstract: We investigate episodic Markov Decision Processes with heavy-tailed losses (HTMDPs). Existing approaches for HTMDPs are conservative in stochastic e