Search: “arxiv-cs-lg”

The Geometry of Projection Heads: Conditioning, Invariance, and Collapse

arXiv:2605.17180v1 Announce Type: new Abstract: We develop a geometric theory of projection heads in self-supervised learning by modeling the head as a trainable Riemannian metric on the backbone repr

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

The Neural Tangent Kernel for Classification

DGX agent

arXiv:2605.17606v1 Announce Type: new Abstract: In wide neural networks, the Neural Tangent Kernel (NTK) remains approximately constant during training, providing a powerful theoretical tool for study

model-releasesarxiv-cs-lg

19 May 2026

The Normal Distributions Indistinguishability Spectrum and its Application to Privacy-Preserving Machine Learning

arXiv:2309.01243v4 Announce Type: replace-cross Abstract: We investigate the privacy of {em any} algorithm whose outputs have Gaussian distribution. This work is motivated by the prevalence of such al

The Powers of Precision: Structure-Informed Detection in Complex Systems -- From Customer Churn to Seizure Onset

arXiv:2601.21170v3 Announce Type: replace Abstract: Emergent phenomena -- onset of epileptic seizures, sudden customer churn, or pandemic outbreaks -- often arise from hidden causal interactions in co

The Range Shrinks, the Threat Remains: Re-evaluating LLM Package Hallucinations on the 2026 Frontier-Model Cohort

arXiv:2605.17062v1 Announce Type: cross Abstract: Spracklen et al. (USENIX Security '25) showed that code-generating large language models hallucinate package names that do not exist on PyPI or npm at

The Score Kalman Filter

arXiv:2605.16644v1 Announce Type: cross Abstract: A central obstacle in nonlinear Bayesian filtering is representing the belief distribution. Moment-based filters address this by propagating polynomia

The Symmetries of Three-Layer ReLU Networks

arXiv:2605.18319v1 Announce Type: new Abstract: We develop a framework for analyzing parameter symmetries in deep ReLU networks and obtain a complete characterization of the generic parameter fibers f

Theory of Minimal Weight Perturbations in Deep Networks and its Applications for Low-Rank Activated Backdoor Attacks

arXiv:2601.16880v2 Announce Type: replace Abstract: The minimal norm weight perturbations of DNNs required to achieve a specified change in output are derived and the factors determining its size are

Agents

Throughput-Optimal Scheduling Algorithms for LLM Inference and AI Agents

arXiv:2504.07347v3 Announce Type: replace-cross Abstract: As demand for Large Language Models (LLMs) and AI agents grows rapidly, optimizing systems for efficient LLM inference becomes critical. While

agentsarxiv-cs-lg

Time Series Foundation Models as Strong Baselines in Transportation Forecasting: A Large-Scale Benchmark Analysis

arXiv:2602.24238v2 Announce Type: replace Abstract: Accurate forecasting of transportation dynamics is essential for urban mobility and infrastructure planning. Although recent work has achieved stron

Topological Data Analysis combined with Machine Learning for Predicting Permeability of Porous Media

arXiv:2605.17581v1 Announce Type: cross Abstract: Flow in porous media is difficult to address using standard analytical or numerical methods due to its complexity. However, since synthetic representa

Toward Near-Real-Time Marine Oil Spill Detection in SAR Imagery using Quantum-Assisted SVM

arXiv:2605.17217v1 Announce Type: cross Abstract: Marine oil spills require rapid detection to mitigate severe ecological and economic damage. While satellite-based Synthetic Aperture Radar (SAR) prov

Towards Migrating Neural Network Implementations

arXiv:2511.02610v2 Announce Type: replace Abstract: The development of smart systems (i.e., systems enhanced with AI components) has thrived thanks to the rapid advancements in neural networks (NNs).

Towards Principled Test-Time Adaptation for Time Series Forecasting

arXiv:2605.17250v1 Announce Type: new Abstract: Test-time adaptation (TTA) has recently emerged as a promising approach for improving time series forecasting (TSF) under distribution shift. Existing T

Toy Combinatorial Interpretability Models Reveal Lottery Tickets in Early Feature Space

arXiv:2605.17704v1 Announce Type: new Abstract: The lottery ticket hypothesis posits that dense networks contain sparse subnetworks, ``winning tickets,'' that, when rewound to their initial weights an

TPV: Parameter Perturbations Through the Lens of Test Prediction Variance

arXiv:2512.11089v4 Announce Type: replace-cross Abstract: We introduce test prediction variance (TPV)--the first-order sensitivity of a trained model's outputs to parameter perturbations--as a unifyin

Agents

Transfer Learning for Customized Car Racing Environments

arXiv:2605.17928v1 Announce Type: cross Abstract: Transfer Learning, a technique where a model/agent can use the knowledge/expertise that it gained from one task and exploit that to solve another clos

agentsarxiv-cs-lg

Transformer-Based MCS Prediction for 5G Multicast-Broadcast Services (MBS)

arXiv:2605.16735v1 Announce Type: cross Abstract: The deployment of 5G Multicast-Broadcast Services (MBS) is emerging as a critical technology for spectral-efficient UHD content delivery and serving a

Applications

Transformers for Learning on Noisy and Task-Level Manifolds: Approximation and Generalization Insights

arXiv:2505.03205v3 Announce Type: replace Abstract: Transformers serve as the foundational architecture for large language and video generation models, such as GPT, BERT, SORA and their successors. Em

applicationsarxiv-cs-lg

Hardware

TriAxialKV: Toward Extreme Low-Precision KV-Cache Quantization for Agentic Inference Tasks

arXiv:2605.17170v1 Announce Type: new Abstract: Agentic workloads have emerged as a major workload for LLM inference. They differ significantly from chat-only workloads, requiring long-context process

hardwarearxiv-cs-lg

Applications

TriOpt: A Scalable Algorithm for Linear Causal Discovery

arXiv:2605.17465v1 Announce Type: new Abstract: Learning causal relations from observational data is challenging because the graph search space grows super-exponentially with the number of variables.

applicationsarxiv-cs-lg

Hardware

Truthful Calibration Errors for Multi-Class Prediction

arXiv:2510.06388v2 Announce Type: replace Abstract: Calibrated predictions are useful because their numerical values can be interpreted as probabilities. Calibration errors are therefore widely used t

hardwarearxiv-cs-lg

UB-SMoE: Universally Balanced Sparse Mixture-of-Experts for Resource-adaptive Federated Fine-tuning of Foundation Models

arXiv:2605.16690v1 Announce Type: new Abstract: Heterogeneous LoRA-rank methods address system heterogeneity in federated fine-tuning of foundation models by assigning client-specific ranks based on c

Uncertainty-Calibrated Recommendations for Low-Active Users

arXiv:2605.17788v1 Announce Type: cross Abstract: A fundamental challenge in recommender systems is balancing reliability for Low-Active Users (LAUs) with diversity for High-Active Users (HAUs). The k

Uncertainty Reliability Under Domain Shift: An Investigation for Data-Driven Blood Pressure Estimation in Photoplethysmography

arXiv:2605.18008v1 Announce Type: new Abstract: Uncertainty quantification (UQ) is critical for safety-critical domains like healthcare, yet it is rarely evaluated under realistic out-of-distribution

Universal Graph Backdoor Defense: A Feature-based Homophily Perspective

arXiv:2605.16815v1 Announce Type: cross Abstract: Graph neural networks (GNNs) have achieved remarkable success in relational learning. However, their vulnerability to graph backdoor attacks (GBAs) po

Universal Inverse Distillation for Matching Models with Real-Data Supervision (No GANs)

arXiv:2509.22459v4 Announce Type: replace-cross Abstract: While achieving exceptional generative quality, modern diffusion, flow, and other matching models suffer from slow inference, as they require

Use the Online Network If You Can: Towards Fast and Stable Reinforcement Learning

arXiv:2510.02590v2 Announce Type: replace Abstract: The use of target networks is a popular approach for estimating value functions in deep Reinforcement Learning (RL). While effective, the target net

Usenix'23 Extended Version: Smart Learning to Find Dumb Contracts

arXiv:2304.10726v3 Announce Type: replace-cross Abstract: We introduce the Deep Learning Vulnerability Analyzer (DLVA) for Ethereum smart contracts based on neural networks. We train DLVA to judge byt

UTOPYA: A Multimodal Deep Learning Framework for Physics-Informed Anomaly Detection and Time-Series Prediction

arXiv:2605.18188v1 Announce Type: new Abstract: Anomaly detection in batch processes is hindered by transient dynamics, scarce fault labels, and reliance on single-modality sensor data. This work intr

Variational Optimality of Follmer Processes in Generative Diffusions

arXiv:2602.10989v2 Announce Type: replace-cross Abstract: We construct and analyze generative diffusions that transport a point mass to a prescribed target distribution over a finite time horizon usin

Tutorials

Venom: A PyTorch Generative Modeling Toolkit

arXiv:2605.17605v1 Announce Type: new Abstract: Modern generative modeling has grown into a broad collection of related but often separately implemented paradigms, including denoising diffusion models

tutorialsarxiv-cs-lg

Hardware

VeriCache: Turning Lossy KV Cache into Lossless LLM Inference

arXiv:2605.17613v1 Announce Type: cross Abstract: The large size of the KV cache has become a major bottleneck for serving LLMs with increasing context lengths. In response, many KV cache compression

hardwarearxiv-cs-lg

Verifier-Guided Code Translation via Meta-Step Decoding

arXiv:2605.17626v1 Announce Type: new Abstract: Test-time scaling is an important mechanism for improving large language models, especially on tasks with deterministic verifiers. Code translation is a

Wasserstein bounds for denoising diffusion probabilistic models via the Follmer process

arXiv:2605.18069v1 Announce Type: cross Abstract: This paper studies sampling error bounds for denoising diffusion probabilistic models (DDPMs) in the 2-Wasserstein distance. Our contributions are thr

Weighted Flow Matching and Physics-Informed Nonlinear Filtering for Parameter Estimation in Digital Twins

arXiv:2605.17146v1 Announce Type: cross Abstract: Digital twins (DTs) rely on continuous synchronization between physical systems and their virtual counterparts through online parameter estimation und

Weisfeiler and Leman Follow the Arrow of Time: Expressive Power of Message Passing in Temporal Event Graphs

arXiv:2505.24438v3 Announce Type: replace Abstract: An important characteristic of temporal graphs is how the directed arrow of time influences their causal topology, i.e., which nodes can possibly in

What is the long-run distribution of stochastic gradient descent? A large deviations analysis

arXiv:2406.09241v3 Announce Type: replace-cross Abstract: In this paper, we examine the long-run distribution of stochastic gradient descent (SGD) in general, non-convex problems. Specifically, we see

When a Zero-Shooter Cheats: Improving Age Estimation via Activation Steering

arXiv:2605.17658v1 Announce Type: new Abstract: Different age-related regulations have been proposed to protect minors from harmful content and interactions online. Automated age estimation is central

Local Ai

When Molecular Similarity Works: Property Cliffs Reveal Hidden Errors

arXiv:2605.17265v1 Announce Type: new Abstract: Accurate prediction of molecular properties underpins drug discovery and material design, yet even state-of-the-art models remain vulnerable to localize

local-aiarxiv-cs-lg

Where Does Warm-Up Come From? Adaptive Scheduling for Norm-Constrained Optimizers

arXiv:2602.05813v2 Announce Type: replace Abstract: We study adaptive learning rate scheduling for norm-constrained optimizers (e.g., Muon and Lion). We introduce a generalized smoothness assumption u

Why Do Reasoning Models Lose Coverage? The Role of Data and Forks in the Road

arXiv:2605.17026v1 Announce Type: new Abstract: Recent progress in large language models has led to the emergence of reasoning models, which have shown strong performance on complex tasks through spec

WinQ: Accelerating Quantization-Aware Training of Language Models Around Saddle Points

arXiv:2605.17471v1 Announce Type: new Abstract: Quantization-aware training (QAT) is widely adopted to quantize language models by training full-precision weights using gradients from the quantized mo

World Model-Enabled Causal Digital Twins for Semantic Communications in Physical AI Systems

arXiv:2605.16547v1 Announce Type: new Abstract: Semantic communication has emerged as a promising paradigm for enabling goal-oriented networking. However, most existing semantic communication solution

Applications

XCTFormer: Leveraging Cross-Channel and Cross-Time Dependencies for Enhanced Time-Series Analysis

arXiv:2605.18534v1 Announce Type: new Abstract: Multivariate time-series analysis involves extracting informative representations from sequences of multiple interdependent variables, supporting tasks

applicationsarxiv-cs-lg

Your SaaS Is an Insurance Product: A Modeling Framework

arXiv:2605.16699v1 Announce Type: new Abstract: Capped-usage SaaS products -- LLM subscriptions such as Claude Code and ChatGPT, cloud platforms such as Vercel and Cloudflare Workers, corporate benefi

ZeroSiam: An Efficient Asymmetry for Test-Time Entropy Optimization without Collapse

arXiv:2509.23183v3 Announce Type: replace Abstract: Test-time entropy minimization helps adapt a model to novel environments and incentivize its reasoning capability, unleashing the model's potential

2Mamba2Furious: Linear in Complexity, Competitive in Accuracy

arXiv:2602.17363v3 Announce Type: replace Abstract: Linear attention transformers have become a strong alternative to softmax attention due to their efficiency. However, linear attention tends to be l