Search: “arxiv-cs-lg”

The Convergence Behavior of Adam under Heavy-Tailed Noise

arXiv:2607.27383v1 Announce Type: new Abstract: We establish the first convergence guarantees for the plain vector-form Adam optimizer under heavy-tailed stochastic noise. While several Adam variants

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

The Kinetics of Training: A Driven-Nucleation Rate Law for Emergence, Plasticity Loss, and Circuit Control in Language Models

DGX agent

arXiv:2607.27281v1 Announce Type: new Abstract: A capability appears in a language model when the last parts of its circuit align in one stochastic attempt, and getting all but one right is worth noth

safetyarxiv-cs-lg

31 Jul 2026

Agents

The Role of Causality in Algorithmic Recourse

arXiv:2607.28497v1 Announce Type: new Abstract: Algorithmic recourse aims to provide individuals with actionable changes to improve their predicted outcomes in high-stakes classification settings, suc

agentsarxiv-cs-lg

TIER-MoE: Trust-Informed Expert Routing via Conditional Modality Risk for Multimodal Fusion in Biomedical Classification

arXiv:2607.27289v1 Announce Type: new Abstract: The promise of multimodal fusion lies in combining complementary sources of evidence, yet more evidence does not always yield a better prediction. Recen

TopoFormer: Topology Meets Attention for Graph Learning

arXiv:2607.28259v1 Announce Type: new Abstract: We introduce Topoformer, a lightweight and scalable framework for graph representation learning that encodes topological structure into attention-friend

Towards joint scaling laws with optimal batch size schedules

arXiv:2607.27731v1 Announce Type: new Abstract: Modern deep learning typically keeps the batch size static throughout training, thus overlooking the joint effect of learning rate and batch size on the

Towards Stability of Parameter-Free Optimization

arXiv:2405.04376v4 Announce Type: replace Abstract: Hyperparameter tuning, particularly the selection of an appropriate learning rate in adaptive gradient training methods, remains a challenge. To add

Train Small, Deploy Large: Zero-Shot GNN Transfer Through Geometric Renormalization

arXiv:2607.27767v1 Announce Type: new Abstract: Graph neural networks (GNNs) can operate on large graphs but become infrastructure-sensitive at the scale of millions of nodes and typically require sca

Uncertainty quantification for trustworthy deep learning: Methods and measures

arXiv:2607.28248v1 Announce Type: cross Abstract: The deployment of deep neural networks in safety-critical domains demands reliable estimates of predictive confidence, yet conventional architectures

Variance-Aware Baselines and Adaptive Learning Rates for Reinforcement Learning with Verifiable Rewards

arXiv:2511.23310v3 Announce Type: replace-cross Abstract: Reinforcement learning with verifiable rewards (RLVR) has emerged as an effective paradigm for post-training large language models, yet the de

VESTIGE: A Knowledge-Guided Masking Strategy for Corruption-Aware Fine-Tuning of Genomic Transformers, Validated on Ancient DNA Reconstruction

arXiv:2607.27712v1 Announce Type: new Abstract: Standard masked-language-model fine-tuning applies a uniform masking probability across every token position, assuming reconstruction difficulty is posi

Weather Emulators at the Frontier of Heat Extremes Predictability

arXiv:2607.28220v1 Announce Type: cross Abstract: Atmospheric predictability declines rapidly beyond the next ten days, such that forecasts at longer lead times primarily convey large-scale trends rat

What Is The Performance Ceiling of My Classifier? Utilizing Category-Wise Influence Functions for Pareto Frontier Analysis

arXiv:2510.03950v2 Announce Type: replace Abstract: Data-centric learning seeks to improve model performance from the perspective of data quality, and has been drawing increasing attention in the mach

What Makes Graph Unified? Principles and Generative Sliding-Window Transformer for Graph Foundation Models

arXiv:2607.27966v1 Announce Type: new Abstract: Graph Foundation Models (GFMs) have recently emerged as a promising paradigm for general-purpose graph learning, aiming to learn reusable knowledge that

When Does Explicit View Routing Work? A Controlled Study of Multi-View Graph-Text Alignment

arXiv:2607.27530v1 Announce Type: new Abstract: Graph-text retrieval typically maps a graph and its description to a single embedding, even when a query concerns only one semantic aspect, such as a cl

When Does Muon Help Agentic Reinforcement Learning?

arXiv:2607.16169v3 Announce Type: replace Abstract: Muon is competitive with AdamW in large-scale pre-training, but its operating regime in reinforcement-learning post-training remains unclear. We map

When unlearning is free: leveraging low influence points to reduce computational costs

arXiv:2512.05254v2 Announce Type: replace Abstract: As concerns around data privacy in machine learning grow, the ability to unlearn, or remove, specific data points from trained models becomes increa

Why Are GUI Agents Correct but Late? Decode on the Decision-Time Critical Path, Tested with Pre-Compiled Policy Trees

arXiv:2607.28399v1 Announce Type: new Abstract: Computer-use agents often fail on transient GUI events because they produce the correct action only after the relevant window has already closed. We ide

Windowed thinning and query complexity for the bouncy particle and Zigzag samplers

arXiv:2607.28413v1 Announce Type: cross Abstract: Let mu(d x)propto e^{-U(x)} d x on R^d, where U is m-strongly convex and L-smooth, and denote by kappa=L/m the condition number. We consider windowed

Wiring diagram extraction and gluing: a case study in classifying figure skating jumps using 3D dataset

arXiv:2607.27598v1 Announce Type: cross Abstract: Hasse clustering is an algorithm that extracts common patterns in sequential data and represents them in graphical forms. As the number of expected cl

ZAPs: A Reward Attribution Framework for DeFi Ecosystems with Adversarial-Robust Scoring via Parallel Anomaly Ensemble Detection

arXiv:2607.27859v1 Announce Type: cross Abstract: Incentive programs are central to user acquisition in decentralized finance, but many reward systems rely on raw volume, transaction count, and wallet

ZUNA1.1: A more flexible EEG foundation model for Denoising and Super-resolution

arXiv:2607.27308v1 Announce Type: new Abstract: We introduce ZUNA1.1, a 380M-parameter diffusion autoencoder for flexible EEG signal reconstruction. ZUNA1.1 is capable of reconstructing variable lengt

A Compositional Theory of Causally Masked Transformers

arXiv:2607.26988v1 Announce Type: cross Abstract: What types of decision problems can a causally masked, finite-precision transformer solve for inputs of arbitrary length? Existing answers often rely

A Persona-based Rate Action Index

arXiv:2607.26545v1 Announce Type: cross Abstract: We propose an index for predicting the U.S. Federal Open Market Committee (FOMC) decision to hike/hold/cut the current federal funds target rate based

Actions Have Consequences: Detecting Outcome Performativity using Intervention Testing

arXiv:2607.26908v1 Announce Type: new Abstract: In many domains such as Palliative Care, Credit Assignment and Recommender Systems, predictions may causally influence the outcomes they predict. This p

Adaptive Gradient-Based Methods for a Broader Class of Optimization Problems under Performative Prediction

arXiv:2607.26562v1 Announce Type: cross Abstract: We study optimization under performative prediction, where deploying a model affects the future data distribution. For this setting, several gradient-

Local Ai

Adaptively Robust LLM Monitoring via Activation Watermarking

arXiv:2603.23171v3 Announce Type: replace-cross Abstract: Providers monitor deployed large language models (LLMs) to detect misuse that they cannot prevent. LLM monitoring is deterministic and often o

local-aiarxiv-cs-lg

AgentGFM: A Graph Foundation Model with Node-Agent Information-Flow Control

arXiv:2607.26533v1 Announce Type: new Abstract: Graph Foundation Models (GFMs) aim to learn transferable knowledge from multi-domain graphs and adapt to unseen scenarios. As a fundamental source of re

AI Alignment in Medical Imaging: Unveiling Hidden Biases Through Counterfactual Analysis

arXiv:2504.19621v2 Announce Type: replace Abstract: Machine learning (ML) systems for medical imaging have demonstrated remarkable diagnostic capabilities, but their susceptibility to biases poses sig

AIGen: Automating AI Bill of Materials Generation Through Hybrid MLOps Integration

arXiv:2607.26652v1 Announce Type: new Abstract: The responsible development and deployment of artificial intelligence (AI) systems requires rigorous documentation of their constituent artifacts, e.g.,

Amortized Moment Matching for Visual Generation

arXiv:2607.26860v1 Announce Type: new Abstract: We propose amortized moment matching, utilizing neural networks to learn data moments as distributional training signals. By casting diffusion denoisers

An Attention-Based Framework for Alzheimers Disease Classification Using Resting-State fMRI

arXiv:2607.26746v1 Announce Type: cross Abstract: Accurate identification of Alzheimers disease (AD) using resting-state functional magnetic resonance imaging (rs-fMRI) remains challenging due to the

An Informativeness-based Clustered Federated Learning Method for Reliable Traffic Prediction in Managed Wi-Fi Networks

arXiv:2607.26682v1 Announce Type: cross Abstract: Centrally-managed Wi-Fi solutions are increasingly leveraging Distributed Artificial Intelligence (AI) to predict key operational statistics of Access

Archetypes or ability? Clustering for modelling student mathematical competence

arXiv:2607.26063v1 Announce Type: cross Abstract: Personalised learning systems often assume that mathematical ability is combined of discrete abilities, acquired sequentially and dependent upon first

Automorphism-Induced Non-Canonicity in Top-k Explanations of Graph Neural Networks

arXiv:2607.26344v1 Announce Type: new Abstract: A gradient-based GNN explainer given a molecule with two chemically equivalent nitro groups assigns them attribution scores that are equal to the last b

BayesAME: Bayesian Active Model Evaluation

arXiv:2607.27023v1 Announce Type: new Abstract: Evaluating large generative models across benchmarks is time-consuming and computationally expensive. This drives the need for methods that can estimate

Benchmarking ConvLSTM for One-Day-Ahead IMDAA Rainfall-Field Prediction across Four Indian Cities

arXiv:2607.26581v1 Announce Type: new Abstract: Convolutional long short-term memory networks (ConvLSTMs) are widely used for precipitation forecasting, but most evidence for their performance comes f

Between Gradient and Natural Gradient: A Continuum of LoRA Initializations

arXiv:2607.26247v1 Announce Type: new Abstract: Low-rank adaptation (LoRA) fine-tunes large pretrained models at a fraction of the cost of full fine-tuning, but its performance depends strongly on how

Breaking the Curse with BAND: Nonparametric Distribution Estimation in High Dimensions

arXiv:2607.26955v1 Announce Type: cross Abstract: Minimax-optimal rates for multivariate distribution estimation are known to suffer from the curse of dimensionality. We propose a sparse Bayesian netw

Budget-Aware LLM Discovery via Cost-Calibrated Frontier Utility

arXiv:2607.26828v1 Announce Type: new Abstract: Large language models increasingly support scientific and algorithmic discovery through inference-time search over evaluated candidates. Existing adapti

CalTwin: Towards Calibrated, Shift-Robust Medical World Models via Fisher-Information Regularisation

arXiv:2607.26752v1 Announce Type: new Abstract: Medical world models aim to learn a latent state of patient or organ physiology and a transition function that forecasts how that state evolves under in

Agents

Can AI agents conduct open-ended AI research? Early evidence from two case studies

arXiv:2607.27191v1 Announce Type: cross Abstract: Forecasts of explosive AI progress hinge on AI agents automating AI research. But evidence on whether agents can carry out open-ended AI research is t

agentsarxiv-cs-lg

Challenges and proposed solutions in modeling multimodal medical data: A systematic review

arXiv:2505.06945v5 Announce Type: replace Abstract: Multimodal data modeling has emerged as a powerful approach in clinical research, enabling the integration of diverse data types such as imaging, ge

Chaos Is a LADDER: Domain Generalization Beyond Invariance via Reweighting

arXiv:2607.26458v1 Announce Type: cross Abstract: Domain generalization (DG) aims to learn from multiple source domains and generalize to unseen target domains. Most DG methods pursue invariance: they

ClockRoPE: Random Fourier Rotations for Temporal Routine Modeling

arXiv:2607.26369v1 Announce Type: new Abstract: Rotary Position Embedding (RoPE) has been widely adopted in transformer-based large language models. However, its log-linear frequency schedule, origina

CoCaRS: Correlation Calibration-Based Redundancy Suppression for Heterogeneous Knowledge Distillation

arXiv:2607.27054v1 Announce Type: new Abstract: Knowledge distillation (KD) enables a compact student model to learn from a powerful teacher and has become an effective paradigm for model compression.

Collaborative Weighting with Pessimistic Critic for Mitigating Overestimation in Off-Policy Reinforcement Learning

arXiv:2607.26509v1 Announce Type: new Abstract: Deep off-policy reinforcement learning algorithms for continuous control typically rely on neural value function approximation to guide policy improveme

Local Ai

Conformal Changepoint Localization and Root Cause Analysis with Corrupted Observations

arXiv:2607.26481v1 Announce Type: new Abstract: Detecting when the statistical behavior of an engineered system changes, and identifying which component is responsible, are core problems in the monito

local-aiarxiv-cs-lg