Search: “arxiv-cs-lg”

arXiv:2610.13524v1 Announce Type: new Abstract: Intermittent ``spikes'' in loss, during the pre-training of Large Language Models (LLMs), remains a mysterious phenomenon both theoretically and empiric

applicationsarxiv-cs-lg

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Tutorials

Simultaneous Competitive and Regret Guarantees for TCP Acknowledgment

DGX agent

arXiv:2610.13571v1 Announce Type: new Abstract: We study simultaneous competitive and regret guarantees for TCP acknowledgment. Each acknowledgment serves all pending packets, and the objective is to

tutorialsarxiv-cs-lg

12 Oct 2026

SmolWAM: A Latent World-Action Model for Robotic Manipulation on Edge Devices

arXiv:2610.13740v1 Announce Type: cross Abstract: World-action models (WAMs) predict a robot's actions together with the observations those actions will produce. However, the strongest models rely on

Some remarks on the connection between generative diffusion and optimal transport

arXiv:2610.13614v1 Announce Type: cross Abstract: We discuss three simple connections between generative diffusion and optimal transport. First, the joint law of the data and of their Ornstein-Uhlenbe

Sonic-AMG: Streaming Human Motion Generation from Spatial Audio

arXiv:2610.13300v1 Announce Type: cross Abstract: Modeling human reactions to spatial audio requires understanding both what is heard and where it comes from. Prior work generates motion offline from

Space Over Statistic, Retraining Over Ranking: Auditing Training Labels Under Label-Only Backdoors

arXiv:2610.13051v1 Announce Type: cross Abstract: Some backdoor attacks never touch an image. FLIP only changes labels: on CIFAR-10, flipping 3% of them makes a ResNet-32 send 99.7% of triggered sourc

Spanning Diffusion and Flow-based Posterior Sampling via Exact Gaussian Conditioning

arXiv:2610.13812v1 Announce Type: new Abstract: Flow-matching and diffusion models are increasingly used as priors for linear inverse problems, however, most methods are bespoke to one class of trajec

Sparse Dictionary Learning for Measure-Valued Data via Linearized Optimal Transport: Efficient Algorithms and Sample Complexity

arXiv:2610.12924v1 Announce Type: cross Abstract: We study dictionary learning for probability measure-valued data by embedding measures into Hilbert spaces using features derived from optimal transpo

Local Ai

Spatial Context or Memory? Sizing the Inputs of Neural Surrogates for Partially Observed Fields

arXiv:2610.12723v1 Announce Type: new Abstract: Neural surrogates that forecast a physical field from sparse, noisy sensors read a window of nearby sensors and a history of past snapshots. Practitione

local-aiarxiv-cs-lg

Specialists Learn Faster: Knowledge Organization in Pre-training Shapes Knowledge Update Efficiency

arXiv:2610.13835v1 Announce Type: new Abstract: An ideal (language) model must continually update its knowledge. Existing work largely focuses on making these updates efficient after training. We inve

Hardware

STAPLE: Static Sparse Upcycling of Pretrained Checkpoints via Embedding Modules

arXiv:2610.12599v1 Announce Type: new Abstract: Sparse computation can scale the parametric capacity of LLMs without proportionally increasing active computation, but pretraining sparse architectures

hardwarearxiv-cs-lg

State-OPD: State-Grounded On-Policy Distillation for Multi-Turn Agents

arXiv:2610.13238v1 Announce Type: new Abstract: On-Policy Distillation (OPD) has emerged as a powerful paradigm for transferring reasoning capabilities from frontier models to smaller models, while ex

Static Gradient Attribution Underperforms a Density-Matched Random Mask on Loss-Based Forgetting Within LoRA B-Matrix

arXiv:2610.12744v1 Announce Type: new Abstract: Parameter-efficient continual learning updates a restricted subset of adapter parameters to incorporate sequential tasks while limiting catastrophic for

StereoEngine: Scaling Stereo Bimanual Robot Data without Stereo Cameras

arXiv:2610.12734v1 Announce Type: cross Abstract: Stereo vision is increasingly used for robotic manipulation, with a growing body of work incorporating it into Vision-Language-Action (VLA) models. Ho

Structural and Representational Agency in LLM-Driven Timbre Generation and Interpolation

arXiv:2610.12532v1 Announce Type: cross Abstract: Generative creative interfaces routinely report the user's position within a space of possibilities. Such displays imply that the quantities shown wer

Structure-Aware Numerical Stabilization for Half-Precision Proximal Policy Optimization

arXiv:2610.13306v1 Announce Type: new Abstract: Local online training on resource-constrained platforms requires low computational and training-state overhead. We study the numerical stability and com

Applications

Studying the Effects of Task Diversity Using Small Mathematical Worlds

arXiv:2610.13750v1 Announce Type: new Abstract: Basic mathematical tasks like modular addition have been a valuable tool for illuminating aspects of neural network behavior that are challenging to see

applicationsarxiv-cs-lg

Surrogate Graph Partitioning for Spatial Prediction

arXiv:2510.07832v2 Announce Type: replace-cross Abstract: Spatial prediction refers to the estimation of unobserved values from spatially distributed observations. Although recent advances have improv

Agents

Sustainable Cloud-Fog-Edge Systems for Smart Buildings: Algorithmic Adaptation under Memory Constraints and Dynamic Orchestration Strategies

arXiv:2610.13307v1 Announce Type: new Abstract: The escalating environmental footprint of the Information and Communication Technol- ogy (ICT) sectorwith global Data Center electric- ity usage potenti

agentsarxiv-cs-lg

Agents

SynAct: Synergistic Active Feedback Learning for LLM Agents

arXiv:2610.12651v1 Announce Type: new Abstract: LLM agents executing multi-step workflows fail in two fundamentally different ways: recoverable slips, which further attempts can repair, and knowledge

agentsarxiv-cs-lg

TabMF: Learning Dataset Representations with Tabular Foundation Models

arXiv:2610.13818v1 Announce Type: new Abstract: Representations of supervised datasets support higher-level machine-learning tasks such as dataset retrieval and distribution-shift monitoring. However,

TabReliBench: Evaluating Tabular Foundation Models Beyond Predictive Accuracy

arXiv:2610.13654v1 Announce Type: new Abstract: Tabular foundation models (TFMs) are increasingly popular for their strong predictive performance. Many also provide posterior predictive distributions

Target-Constrained Pooling for Trajectory Extrapolation

arXiv:2610.13034v1 Announce Type: new Abstract: Trajectory extrapolation from a partial target trajectory is underdetermined, but completed related trajectories provide information about the unresolve

Tensor-based Fusion of Multi-modal Data for Predicting Cancer Risk Levels

arXiv:2610.13221v1 Announce Type: new Abstract: Cancer diagnosis and treatment increasingly rely on multi-modal diagnostic technologies that generate high-dimensional datasets. Although these datasets

TernaryLLM: Ternarized Large Language Model

arXiv:2406.07177v2 Announce Type: replace Abstract: Large language models (LLMs) have achieved remarkable performance on Natural Language Processing (NLP) tasks, but they are hindered by high computat

The Expressive Power of Random-Feature MPNNs Across Graph Sizes

arXiv:2610.12809v1 Announce Type: new Abstract: Continuous random node features increase the expressivity of message-passing neural networks (MPNNs), but existing theoretical analyses are not fine-gra

The Limits of Query Monitoring against Distributed Model Extraction

arXiv:2610.13083v1 Announce Type: cross Abstract: Model providers now face distillation campaigns run through thousands of accounts, each of which looks like an ordinary user. When network and payment

The Predictability Bias of Joint-Embedding Predictive Learning in Medical Imaging

arXiv:2610.13237v1 Announce Type: cross Abstract: Joint-embedding predictive architectures (JEPAs) learn by predicting teacher representations of masked regions from visible context. Point prediction

Toward Maximizing Algebraic Connectivity via Density-Dependent Backbone Construction and Reinforcement Learning Completion

arXiv:2610.12697v1 Announce Type: cross Abstract: This paper studies an open network design problem of constructing graph topologies with maximum algebraic connectivity under fixed numbers of vertices

Towards Easier-to-Tune Training Algorithms: New Results from AlgoPerf

arXiv:2610.13036v1 Announce Type: new Abstract: Evaluating deep learning optimizer is challenging because confounding factors such as hyperparameter tuning and optimizer-model co-design often obscure

Towards Understanding the Training of GFlowNets: A Theoretical Perspective

arXiv:2610.13711v1 Announce Type: new Abstract: Generative Flow Networks (GFlowNets) learn policies that sample discrete objects in proportion to a positive reward. They are trained by minimizing bala

Trainable Quantum-Native Language Models: Dissipative Memory, Capacity Limits, and Hardware Validation

arXiv:2610.12806v1 Announce Type: cross Abstract: We study byte-level autoregressive language models whose hidden state is a small quantum register, whose transitions are learned token-conditioned qua

Local Ai

Trajectory-Aware Policy Optimization: Closing the State Distribution Gap in Long-Horizon LLM RL

arXiv:2610.13020v1 Announce Type: new Abstract: Reinforcement learning (RL) has become a dominant paradigm for enhancing LLMs' reasoning capabilities. Yet long-horizon autoregressive rollouts introduc

local-aiarxiv-cs-lg

Transformer-based In-Context Score Operator Learning for Diffusion Models

arXiv:2610.13690v1 Announce Type: new Abstract: Diffusion models typically learn the generative dynamics of a single target distribution or a family of distributions indexed by conditioning variables

Transformer-Based Masked Diffusion Models Provably Learn Distributions with Latent Structure

arXiv:2610.12544v1 Announce Type: new Abstract: Masked diffusion models (MDMs) generate discrete data by iteratively unmasking multiple tokens in parallel using a learned mask predictor. Their output

TreeHCA: Hindsight-Guided Exploration and Credit Assignment for Multi-Turn LLM Agents

arXiv:2610.12828v1 Announce Type: new Abstract: Outcome-supervised group-relative policy optimization (GRPO) assigns the same advantage to every token in an LLM agent trajectory, leaving useful and un

TTS-Q: Perception-Guided Post-Training Quantization of Text-to-Speech Diffusion Transformers

arXiv:2610.12474v1 Announce Type: cross Abstract: Zero-shot text-to-speech (TTS) can clone a voice from seconds of audio. Yet the quality comes from billion-parameter diffusion transformers whose size

Two-way Guidance: Simultaneous Learning of Summary Statistics for Generative Bayes

arXiv:2610.12850v1 Announce Type: cross Abstract: Bayesian simulation-based inference (SBI) can struggle to recover increasingly concentrated posteriors as observation size grows. We consider learning

Understanding Mamba-3 Through Oscillatory Dynamics

arXiv:2610.13341v1 Announce Type: new Abstract: Mamba-3 introduces input-dependent rotations into recurrent state updates, but their contribution beyond state retention remains unclear. We interpret t

Universal Bounds for Self-Normalized Kullback-Leibler Estimation

arXiv:2610.12851v1 Announce Type: cross Abstract: This work studies an entropy-based estimator of Kullback-Leibler (KL) divergence constructed from normalized importance weights. We prove a universal

Local Ai

User Trajectory Prediction Unifying Global and Local Temporal Information

arXiv:2508.02161v2 Announce Type: replace Abstract: Trajectory prediction is essential for formulating proactive strategies that anticipate user mobility and support advance preparation. Therefore, ho

local-aiarxiv-cs-lg

Verifiable Sampling for Delegated Generative Quantum Machine Learning

arXiv:2610.13211v1 Announce Type: cross Abstract: Generative machine learning has shown remarkable results across a wide range of interdisciplinary tasks, motivating significant efforts toward Quantum

Vocal Intensity Conversion with Continuous SPL Control via Adversarial Training

arXiv:2610.13608v1 Announce Type: cross Abstract: Vocal intensity conversion renders a recorded utterance at a different vocal intensity, rather than simply scaling its amplitude, while preserving its

VQIL: Visible Quantum Interference Learning for Perturbation Response Ranking on Graphs

arXiv:2610.13689v1 Announce Type: new Abstract: Learning how local perturbations affect a network is important for identifying which components drive or absorb a system's response. We formulate this a

WaSA: Wavelet Scattering Autoencoders for Unsupervised Offline Detection of Malicious Clients in Federated Learning

arXiv:2610.13186v1 Announce Type: new Abstract: Federated Learning (FL) enables collaborative model training without exposing raw data, yet remains vulnerable to malicious clients injecting poisoned d

When Solvers Get Moody: Quantifying and Predicting Performance Variability in Mixed Integer Programming

arXiv:2610.12876v1 Announce Type: cross Abstract: Mixed-integer programming (MIP) solvers are widely used, yet their performance can vary substantially even under seemingly neutral perturbations. Such

Why Heavy-Tailed Weight Spectra Predict Model Quality

arXiv:2610.13123v1 Announce Type: cross Abstract: A solid understanding of the predictive success of deep neural networks (DNNs) remains elusive. For example, while many data-dependent metrics exist t

Why Linear Models Can Still Work in a Complex and Changing World

arXiv:2610.13404v1 Announce Type: new Abstract: Linear models can predict well in complex domains even when underlying mechanisms are nonlinear. We argue that this can occur because the complexity of