Search: “arxiv-cs-lg”

Next-token Preference: Scaling Unsupervised Reward Modeling

arXiv:2603.02225v3 Announce Type: replace Abstract: Learning from feedback advances the capabilities and safety of frontier models, but preference supervision remains costly and difficult to scale. We

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

NFMap: Topographic 2D Manifold Learning with Invertible Normalizing Flows

DGX agent

arXiv:2610.16750v1 Announce Type: new Abstract: We present NFMap, a dimensionality reduction method for 2D visualisation that extends Generative Topographic Mapping (GTM) with a bijective normalizing

researcharxiv-cs-lg

14 Oct 2026

Non-Euclidean Gradient Descent Has Many Edges of Stability

arXiv:2610.15223v1 Announce Type: cross Abstract: Recent observations that deep learning models train at the edge of stability have renewed interest in understanding stability properties of classical

Applications

Nonparametric Kernel Clustering with Bandit Feedback

arXiv:2601.07535v2 Announce Type: replace-cross Abstract: Clustering with bandit feedback refers to the problem of partitioning the arms of an N-armed stochastic bandit according to their underlying d

applicationsarxiv-cs-lg

Not All Drift Is a Mechanism: Tracing Prompt Adaptation in LLMs

arXiv:2610.18412v1 Announce Type: new Abstract: Prompt-based adaptation offers several ways to specialize a frozen language model, ranging from natural-language prompt optimization to learned continuo

Notes on Uniform Policy Score Bounds and Lipschitz Continuity for Truncated Gaussian, Product Cauchy, Boltzmann, and Softmax Policies

arXiv:2610.15690v1 Announce Type: cross Abstract: We establish uniform score bounds and Lipschitz continuity for truncated Gaussian, Cauchy, Boltzmann, and softmax policies under explicitly stated par

ObsSpec: Accelerating Agentic Reinforcement Learning with Observation Speculation

arXiv:2610.15246v1 Announce Type: new Abstract: Tool-using agents alternate between model generation and tool execution, waiting for each tool call to complete before starting the next generation. Thi

OceanFlow: Coherent Flow Matching for Probabilistic Ocean Modeling

arXiv:2610.15518v1 Announce Type: new Abstract: Probabilistic ocean modeling is essential for risk-aware marine operations, climate analysis, and scientific decision-making, where downstream decisions

OctMole: Multiscale 3D Molecular Generation with Hierarchical Spatial Flows

arXiv:2610.16586v1 Announce Type: new Abstract: Generating accurate 3D molecules requires jointly determining a variable number of atoms, their identities, and geometry across spatial scales: global s

On Collusion-Free Teaching in Planar Graphs

arXiv:2610.18714v1 Announce Type: cross Abstract: Non-clashing teaching minimizes teaching complexity among models satisfying the Goldman--Mathias collusion-avoidance criterion. While the Vapnik--Cher

On Generalizing Preference-based Reinforcement Learning to Multi-Objective Problems

arXiv:2607.11432v2 Announce Type: replace Abstract: We study reinforcement learning (RL) from pairwise human-generated trajectory comparisons. We generalize preference-based RL by formalizing a novel

On Making SE(2)-Invariant Networks Optimal

arXiv:2610.17424v1 Announce Type: new Abstract: Respecting a-priori known symmetries of underlying data is a key principle in designing efficient neural architectures. Convolutional neural networks ar

On physical implementability of reinforcement-learning-driven reasoning

arXiv:2610.14131v1 Announce Type: cross Abstract: In the machine learning community, the reinforcement-learning-driven reasoning process has been intensively studied since around 2025. In this article

On Sleep-Wake Disorder Identification from Polysomnographic Representations

arXiv:2610.17451v1 Announce Type: new Abstract: Self-supervised polysomnography foundation models (PSG FMs) aim to capture clinically useful information beyond sleep staging, yet are rarely compared w

On the Calibration of Crowdsourcing Aggregators

arXiv:2610.16815v1 Announce Type: cross Abstract: Calibration has been extensively studied for classifiers, but remains largely unexplored for crowdsourcing aggregation methods, which are increasingly

On the Depth Transfer of Neural Optimizers via L-Smoothness

arXiv:2610.14344v1 Announce Type: new Abstract: Scaling deep learning models efficiently requires predictable performance transfer across compute regimes. Establishing reliable hyperparameter transfer

On the Dynamics of Delayed Generalization in Linear Models

arXiv:2602.08302v2 Announce Type: replace Abstract: Delayed generalization, where training accuracy becomes nearly perfect substantially before test accuracy, has often been studied in the context of

On the Monitorability of Natural Language Autoencoders: Identification vs Discrimination

arXiv:2610.18727v1 Announce Type: new Abstract: Natural Language Autoencoders (NLAs) are proposed as oversight tools for language models: an Activation Verbaliser (AV) writes an English explanation of

On the Optimality of Random Features under General Conditions: Misspecified Cases and Robust Learning

arXiv:2610.18333v1 Announce Type: cross Abstract: Random features provide a standard approach to scaling kernel methods to large datasets by approximating the kernel with a finite-dimensional feature

On the Statistical Mechanics of Attention

arXiv:2610.17347v1 Announce Type: new Abstract: We revisit the statistical mechanics of Transformer attention via modern Hopfield models. We present a free-energy formalism to characterize parameter r

On the Theoretical Limits of Learning Unconstrained Interatomic Potentials

arXiv:2610.15078v1 Announce Type: new Abstract: Machine-learned interatomic potentials (MLIPs) accelerate molecular dynamics (MD) simulations by learning the energies and forces that govern atomic mot

Applications

On the Upper Bounds for the Matrix Spectral Norm

arXiv:2506.15660v2 Announce Type: replace-cross Abstract: We consider the problem of estimating the spectral norm of a matrix using only matrix-vector products. We propose a new Counterbalance estimat

applicationsarxiv-cs-lg

Tutorials

One-Layer Transformers Provably Learn In-Context K-Nearest Neighbor Prediction with Chain-of-Thought

arXiv:2610.16798v1 Announce Type: new Abstract: Chain-of-Thought (CoT) enables transformers to solve complex reasoning tasks by generating intermediate reasoning steps. Despite strong empirical succes

tutorialsarxiv-cs-lg

One Model, Multiple Compute Budgets: Multi-Ratio ConceptMoE for Flexible Compute Across Turns

arXiv:2610.14074v1 Announce Type: new Abstract: Large language models typically support different inference budgets through separate model sizes or fixed compute configurations. In multi-turn interact

One Size Does Not Fit All: Distribution-Guided Tensor-Wise Adaptive Sparsification for Model Merging

arXiv:2508.06163v2 Announce Type: replace-cross Abstract: Merging multiple task-specific fine-tuned checkpoints into a single multi-task model provides an attractive alternative to joint multi-task tr

One-Way Coupling via Patchwise Adaptive Normalization in Transformer Surrogates

arXiv:2610.14687v1 Announce Type: new Abstract: Many physical systems exhibit one-way coupling: exogenous fields such as medium density or obstacle geometry influence the dynamics without being affect

OneShot: Label-Efficient Detector Weighting for Time Series Anomaly Detection

arXiv:2610.16219v1 Announce Type: cross Abstract: Time series (TS) anomaly detection (AD) lacks a universal detector, with the best choice determined by the series rather than by the algorithm. Existi

Online Individualized Treatment Selection under Partial Feedback: False Discovery Control and Minimax Optimality

arXiv:2610.16464v1 Announce Type: cross Abstract: We study online individualized treatment selection when only the outcome under the assigned treatment is observed. Our objective is to preferentially

Online learning of neural state-space models

arXiv:2607.17614v2 Announce Type: replace-cross Abstract: Recent advances in deep-learning-based nonlinear system identification have led to encoder-based estimation of neural state-space (ANN-SS) mod

Online LLM Personalization from Pairwise Preferences Across Users

arXiv:2610.17203v1 Announce Type: new Abstract: Large language models can answer the same question in different styles, but users' preferred styles are hidden and vary across users and questions. We s

Only What You've Signed up For: Secure Workflows with Constrained Diffusion Agents

arXiv:2610.15177v1 Announce Type: new Abstract: As agentic AI systems take on increasingly complex and consequential tasks, securing them against prompt injection becomes critical. Existing defenses o

Open Foundation Models in Healthcare: Challenges, Paradoxes, and Opportunities with GenAI Driven Personalized Prescription

arXiv:2502.04356v2 Announce Type: replace-cross Abstract: In response to the success of proprietary Large Language Models (LLMs), there is a growing interest in developing open, non-proprietary LLMs a

OpenDGO: Benchmarking Multi-Agent Organizations Across Diverse Application Domains

arXiv:2610.17143v1 Announce Type: new Abstract: Large language model (LLM)-based multi-agent systems are increasingly applied across diverse domains, yet different applications require different forms

Operator Surrogates

arXiv:2610.18210v1 Announce Type: new Abstract: This chapter provides a mathematical introduction to operator surrogates, which are finite-parametric maps approximating complex (typically nonlinear) o

OPMD: On-Policy Mechanism Distillation Beyond Output Supervision

arXiv:2610.14022v1 Announce Type: new Abstract: On-policy distillation (OPD) improves language-model by supervising a student on prefixes sampled from its own policy, but its supervision remains confi

Tutorials

OPTIC-ER: A Reinforcement Learning Framework for Real-Time Emergency Response and Equitable Resource Allocation in Underserved African Communities

arXiv:2508.12943v3 Announce Type: replace-cross Abstract: Public service systems in many African regions suffer from delayed emergency response and spatial inequity, causing avoidable suffering. This

tutorialsarxiv-cs-lg

Optimal Online Regret for Context-Lumpable Bandits

arXiv:2610.18258v1 Announce Type: new Abstract: We study stochastic contextual bandits with an unknown context-lumpable structure. The S contexts are partitioned into r blocks, and every arm has the s

Local Ai

Optimal Transport Aggregation for Distributed Mixture-of-Experts

arXiv:2312.09877v3 Announce Type: replace Abstract: This paper considers the setting in which local Mixture-of-experts (MoE) models are fitted independently on distributed datasets and must be combine

local-aiarxiv-cs-lg

Optimal Transport PAC-Bayes Bounds

arXiv:2610.16560v1 Announce Type: new Abstract: PAC-Bayesian generalization bounds are among the strongest distribution-dependent guarantees in statistical learning and are typically expressed in term

Over-parameterization Is Neither Robust nor Fragile in Matrix Sensing: A Geometric Theory of Solution Robustness

arXiv:2610.18318v1 Announce Type: new Abstract: Over-parameterization is ubiquitous in modern machine learning, yet its effect on robustness remains poorly understood. We study this question in matrix

Overcoming Catastrophic Forgetting: Continual Learning for Radar Waveform Classification

arXiv:2610.18404v1 Announce Type: cross Abstract: Automated radar waveform recognition classifies the waveform and modulation type of a received signal. As new waveform variants appear over time, a de

Hardware

PACC: Protocol-Aware Cross-Layer Compression for Compact Network Traffic Representation

arXiv:2602.08331v2 Announce Type: replace-cross Abstract: Network traffic classification underpins network security and management but faces growing challenges from pervasive encryption and evolving p

hardwarearxiv-cs-lg

PaceReasoner: Label-Free Learning to Answer Briefly from Long Reasoning

arXiv:2610.17900v1 Announce Type: cross Abstract: Extended chain-of-thought reasoning improves problem-solving performance but increases inference cost and latency, motivating more accurate answers wi

PATTERN Can Be Solved from Memory: Generator-Aware Baselines for Synthetic Node Classification

arXiv:2610.15020v1 Announce Type: new Abstract: PATTERN, a synthetic node-classification benchmark still used to rank graph networks, plants a random subgraph in a random host graph and asks which nod

Perfect Reconstruction Cannot Show Whether Two Codebooks on a VAE's Latent Space Agree

arXiv:2610.14012v1 Announce Type: new Abstract: Many systems read the latent space of a variational autoencoder (VAE) as discrete codes, and rely on each latent being read back as the code it was writ

Persistence Positional Encoding: A Minimal Transformer Recipe for Persistence Diagrams

arXiv:2610.17848v1 Announce Type: new Abstract: Persistence diagrams (PDs) represent multiscale topological information as multisets of birth-death pairs (b,d). How best to use them with Transformers,

Personalized LLM Recommendation with Semantic IDs: Autoregressive Beam Search vs. Multi-Token Prediction

arXiv:2610.15864v1 Announce Type: cross Abstract: Large-scale personalization is shifting from embedding-table retrieval to LLM-based recommenders that generate the Semantic ID (SID) of the item to re

Personalized Physiological-Model-Based Neural Network for Glucose Forecasting in Type 1 Diabetes

arXiv:2610.15456v1 Announce Type: cross Abstract: Accurate, physiologically consistent glucose forecasts could help people with type 1 diabetes respond to impending excursions. We applied our physiolo