Search: “arxiv-cs-lg”

The Role of Feed-Forward Layers in Transformer Dynamics

arXiv:2609.36230v1 Announce Type: new Abstract: We study the dynamical behavior of tokens in transformers from a control-theoretic perspective. Our model includes the feed-forward layer present after

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

The Signed Geometry of One-Shot Recourse: On-Path Validity and the Signed-Curvature Criterion

DGX agent

arXiv:2609.36252v1 Announce Type: new Abstract: Closed-form recourse moves a rejected user along the unit gradient hat g of the classifier score f by the promised distance d_p=|f(x)|/|nabla f(x)|, at

researcharxiv-cs-lg

30 Sept 2026

The Teacher Is a Direction, Not a Destination: Extrapolating RL-Induced Representation Residuals in On-Policy Distillation

arXiv:2609.36484v1 Announce Type: new Abstract: On-policy distillation (OPD) trains a student to match the teacher's next-token distributions on the student's own trajectories and has yielded substant

The Universal Classifier for Graph Learning

arXiv:2609.36302v1 Announce Type: new Abstract: While foundation models have revolutionized natural language processing and computer vision by leveraging universal vocabularies, Graph Machine Learning

The Vote Hides the Failure: Aggregation Choice and Noise Robustness in Heart Murmur Detection

arXiv:2609.37161v1 Announce Type: new Abstract: Noise robustness in automated phonocardiogram (PCG) murmur detection, and how it is measured, remains underexamined despite growing interest in low-reso

Theory on Attention Dynamics for Out-of-Distribution In-Context Learning

arXiv:2609.36448v1 Announce Type: new Abstract: Transformers have demonstrated remarkable in-context learning (ICL) capabilities, enabling them to perform new tasks without additional fine-tuning. How

TopoEmbedX: A General Framework for Representation Learning on Topological Domains

arXiv:2609.37884v1 Announce Type: new Abstract: Topological structures such as simplicial complexes, hypergraphs, and cell complexes extend standard graph models by modeling higher-order relationships

Towards Better Training Signal: Advantage Clipped Policy Optimization

arXiv:2609.36816v1 Announce Type: new Abstract: Reinforcement learning (RL) has become a cornerstone for improving the reasoning capabilities of large language models (LLMs), but the need for on-polic

Transversal Pooling Neural Networks

arXiv:2609.36237v1 Announce Type: new Abstract: Many learning tasks require stability to small transformations while retaining sensitivity to larger ones. We introduce transversal pooling neural netwo

Local Ai

Traversing the solution space of neural networks with Hessian Null Space Continuation

arXiv:2609.38081v1 Announce Type: new Abstract: On a single task, deep networks can learn many solutions, depending on their optimizer, training data, architecture, and hyperparameters. Many of these

local-aiarxiv-cs-lg

Hardware

Trident: Unifying Guarded Dispatch and Host Execution for PyTorch Triton Workloads

arXiv:2609.37241v1 Announce Type: new Abstract: User-written Triton kernels enable high-performance GPU computation within PyTorch, but their end-to-end latency can remain dominated by host-side orche

hardwarearxiv-cs-lg

Understanding LLM Parameter Update Sparsity through the Lens of Fisher

arXiv:2609.36262v1 Announce Type: new Abstract: Recent studies have observed that parameter changes during language-model post-training can be concentrated in a small subset of coordinates. This pheno

Understanding Private Evolution as Learning-Augmented Clustering

arXiv:2609.36678v1 Announce Type: new Abstract: Private Evolution (PE) is a differentially private algorithm for synthetic data generation. While it can be viewed as a Wasserstein learning algorithm,

UnlearningSoup: Is Repeated Tuning Necessary for Large Language Model Unlearning?

arXiv:2609.37076v1 Announce Type: new Abstract: Large language models trained on vast corpora inherently risk memorizing harmful content that may later re-emerge in their outputs. To mitigate this iss

Variational Augmented Invertible Koopman Autoencoder for probabilistic time series forecasting

arXiv:2609.37435v1 Announce Type: new Abstract: Neural Koopman autoencoder models have been shown to successfully build a latent embedding with linear dynamics for arbitrary dynamical systems, enablin

Variational Mixtures and Multi-Marginal Flow Matching: Advancing Statistical Inference with Biological Applications

arXiv:2609.36911v1 Announce Type: new Abstract: In this thesis I develop methods for statistical inference when the distributions arising from complex biological systems are multi-modal, geometrically

Volatility-Clustering Adaptation for Financial Time Series

arXiv:2609.37715v1 Announce Type: new Abstract: Time-series foundation models are increasingly adapted to new domains through fine-tuning on target data, under the implicit assumption that more target

vSkipper: Translating Dynamic Layer Skipping into LLM Serving Gains

arXiv:2609.37062v1 Announce Type: cross Abstract: Dynamic layer skipping reduces LLM computation by allowing each token to execute only a subset of the model's layers. However, existing skippers rely

Wasserstein Causal Forests for Distribution-Valued Outcomes

arXiv:2609.35898v1 Announce Type: cross Abstract: This paper proposes Wasserstein Causal Forests (WCF) for settings in which each unit's outcome is itself a probability distribution. This study also d

Weights Read and Write Features: Scalable Parameter Decomposition Grounded in Activation Space

arXiv:2609.37731v1 Announce Type: new Abstract: Activation space and parameter space provide complementary views of model computation. Activations represent information, while weights read, transform,

What You Observe Determines How You Identify Causal Effects: Evaluating Causal Models across Observational Views

arXiv:2609.36881v1 Announce Type: new Abstract: Causal foundation models (CFMs) pre-trained on data generated from various structural causal models (SCMs) have been proposed for estimating causal effe

When Can Prefixes Compile LoRA? Exact Resource-Capped Tests for Frozen Attention

arXiv:2609.36766v1 Announce Type: new Abstract: Can a fixed continuous prefix replace a given low-rank adapter while the attention head stays frozen? In this research, we show that the answer depends

When do data mixtures improve scaling laws? Insights from high-dimensional regression

arXiv:2609.38011v1 Announce Type: new Abstract: Modern machine learning systems are trained on mixtures of data from different domains, and choosing the right mixture can substantially improve downstr

When Is Coarse Supervision Worth It? Cost-Aware Learning under Unknown Aggregation

arXiv:2609.36704v1 Announce Type: new Abstract: Modern learning systems often acquire supervision at multiple resolutions, trading annotation cost against information content. We study cost-aware two-

Tutorials

Where Does Randomness Matter in Neural Cellular Automata?

arXiv:2609.36797v1 Announce Type: new Abstract: Stochastic cell updates are often used throughout the life of a neural cellular automaton (NCA), from backpropagation through time to final rollout. Thi

tutorialsarxiv-cs-lg

Where Privacy Belongs: Placement Diagnosis and Certified Selection for Private Counterfactual Explanations on Graphs

arXiv:2609.37667v1 Announce Type: new Abstract: Counterfactual explanations for graph neural networks (GNNs) find the minimal intervention that flips a node's prediction--but computing one requires re

Where Root Cause Analysis Fails: A Retrieval-Reranking Decomposition

arXiv:2609.36686v1 Announce Type: new Abstract: Identifying the root cause of an anomaly among hundreds of sensors is critical for preventing safety incidents and costly downtime in complex monitored

Where the Model Changes Its Mind: Hindsight-Divergence Localization for Efficient Reinforcement Learning with Verifiable Rewards

arXiv:2609.36864v1 Announce Type: new Abstract: Group-relative methods for reinforcement learning with verifiable rewards (RLVR) learn from differences in rollout outcomes. Independently sampling comp

Why Adaptive Optimizers Underestimate Rare Tokens

arXiv:2609.37535v1 Announce Type: new Abstract: In the softmax output layer, a rare token receives a small positive logit gradient on most steps and a much larger negative gradient on the few steps wh

Why Backdooring Neural Networks is so Easy?

arXiv:2609.36117v1 Announce Type: new Abstract: Securing modern AI systems against backdoor attacks remains an open challenge and requires fundamentally principled estimates of the adversary's budget

WUSH-KV: KV Cache Quantization with Data-Adaptive Transforms

arXiv:2609.38121v1 Announce Type: new Abstract: KV cache memory and bandwidth costs grow with context length and batch size, which limits efficient long-context inference. To address this bottleneck,

Zero Sum SVD: Balancing Loss Sensitivity for Low Rank LLM Compression

arXiv:2602.02848v2 Announce Type: replace Abstract: Advances in large language models have driven strong performance across many tasks, but their memory and compute costs still hinder deployment. SVD-

ZeroDiff: Zero-Shot Time Series Reconstruction via Informed-Prior Diffusion

arXiv:2609.37078v1 Announce Type: new Abstract: Time series modeling increasingly demands high-quality supervision, yet target observations remain scarce - exogenous inputs are broadly available, but

3-D Emissions Mapping and Social Cost Estimation for US Domestic Aviation at West Coast Hubs

arXiv:2609.31686v1 Announce Type: new Abstract: Existing aviation emissions inventories lack accurate trajectory data for high-resolution social cost and health impact assessment. This paper develops

A Cheap Verifier is Good Enough: LLM Post-training is Robust to Erroneous Rewards

arXiv:2609.33467v1 Announce Type: new Abstract: When post-training large language models on tasks with semi-verifiable rewards, there are many factors (training steps, base model size, training order,

A Comparative Analysis of Attention versus State-Space Models for In-Context Learning

arXiv:2609.32341v1 Announce Type: new Abstract: Transformers and state-space models (SSMs) are two prominent sequential learning architectures, yet their comparison remains largely empirical and exist

A Continuous-Time Reinforcement Learning Framework for Fine-Tuning Discrete Diffusion Models

arXiv:2607.14522v2 Announce Type: replace Abstract: We formulate reinforcement learning (RL) in continuous time with discrete state spaces and possibly arbitrary action spaces via a stochastic control

A family of graph GOSPA metrics for graphs with different sizes

arXiv:2506.17316v2 Announce Type: replace-cross Abstract: This paper proposes a family of graph metrics for measuring distances between graphs of different sizes. The proposed metric family defines a

A Free Knob: Decoupling Calibration and Predictive Skill in Threshold-Based Evaluation

arXiv:2609.33457v1 Announce Type: new Abstract: Many dense-prediction benchmarks evaluate rare events by pooling prediction and target over spatial blocks, thresholding each, and scoring the contingen

A Function-Level Vulnerability Score Measures Flag Rate More Than the Model: Protocol Effects on Paired Benchmarks

arXiv:2609.32890v1 Announce Type: new Abstract: Language models are increasingly evaluated as vulnerability detectors, and scores reported for similar models differ widely between papers. We measured

A Game-Theoretic Spatio-Temporal Reinforcement Learning Framework for Collaborative Public Resource Allocation

arXiv:2510.26184v2 Announce Type: replace Abstract: Public resource allocation involves distributing resources, including urban infrastructure, energy, and transportation, which are typically limited

A Hierarchy of Entropy-Shapley Games for Multivariate Predictive Uncertainty

arXiv:2609.35217v1 Announce Type: cross Abstract: Modern probabilistic machine learning models increasingly produce multivariate outputs with complex dependence structure, from multi-step time-series

A Journey to the Edge of Stability

arXiv:2609.32290v1 Announce Type: new Abstract: It has recently been found that deep learning often occurs at the 'edge of stability (EoS),' where the maximum Hessian eigenvalue of the model is stabil

A Kernel-based Stochastic Approximation Framework for Nonlinear Operator Learning

arXiv:2509.11070v4 Announce Type: replace-cross Abstract: We develop a stochastic approximation framework for learning nonlinear operators between infinite-dimensional spaces utilizing general Mercer

A Large-Scale Benchmark and Risk Assessment of Traffic Analysis Attacks on Cloud LLM Services

arXiv:2609.31877v1 Announce Type: cross Abstract: Cloud-based Large language model (LLM) services create a network-level traffic side channel that can expose model, prompt, and task behavior despite e

A Multimodal Autonomic Sensing Framework for Objective Assessment of Patient Responses to Dental Pulp Stimulation

arXiv:2609.35121v1 Announce Type: new Abstract: Patient responses to dental pulp testing, ranging from no sensation to intense pain, provide important information for assessing pulp status in endodont

Local Ai

A Solvable Theory of Pre-training Data Poisoning: Regime-Dependent Scaling Exponents

arXiv:2609.32288v1 Announce Type: new Abstract: Pre-training data poisoning of large language models is usually studied using targeted backdoors and their survival through safety post-training, which

local-aiarxiv-cs-lg

A Spectral Theory of Compositional Learning

arXiv:2609.33708v1 Announce Type: new Abstract: How does compositional reasoning emerge during learning? We address this question by mathematically analyzing the learning dynamics of deep linear netwo