Search: “arxiv-cs-lg”

Multipole Semantic Attention: A Fast Approximation of Softmax Attention for Pretraining

arXiv:2509.10406v4 Announce Type: replace Abstract: Pretraining transformers on long sequences (entire code repositories, collections of related documents) is bottlenecked by quadratic attention costs

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Multistage Defer Trees for Hybrid Interpretability: If at First You Can't Succeed, Tree Again

DGX agent

arXiv:2606.30995v1 Announce Type: new Abstract: Recent work has shown that well-optimized individual decision trees can match complex black box models in some settings, primarily in noisy domains. For

researcharxiv-cs-lg

1 Jul 2026

Agents

Nazrin: An Atomic Neural Proof Automation Tactic in Lean 4

arXiv:2602.18767v3 Announce Type: replace-cross Abstract: In Machine-Assisted Theorem Proving, a theorem proving agent searches for a sequence of expressions and tactics that can prove a statement in

agentsarxiv-cs-lg

Nonlinearity-Aware LoRA: Structured Gate Adaptation under Low-Rank Constraints

arXiv:2606.31717v1 Announce Type: new Abstract: Low-rank adaptation (LoRA) is commonly viewed as an update-space approximation to full fine-tuning, yet this view is incomplete for self-gated Transform

Offline Reinforcement Learning for Fluid Controls: Data-based Multi-observational Policy Extraction

arXiv:2606.31025v1 Announce Type: new Abstract: Active flow control is a fundamental application in engineering. Recent advances in deep reinforcement learning have made progress in this field. Howeve

Applications

On Optimal Data Splitting for Split Conformal Prediction

arXiv:2606.31600v1 Announce Type: cross Abstract: Conformal prediction and its variants, including the split conformal prediction, provide a distribution-free framework for uncertainty quantification

applicationsarxiv-cs-lg

On Optimizing Multimodal Jailbreaks for Spoken Language Models

arXiv:2603.19127v2 Announce Type: replace Abstract: As Spoken Language Models (SLMs) integrate speech and text modalities, they inherit the safety vulnerabilities of their LLM backbone while introduci

Local Ai

Partition-Guided Distance Saliency: Bridging Decision and Objective Spaces in Many-Objective Optimization

arXiv:2606.30836v1 Announce Type: new Abstract: Explainability in Many-Objective Optimization (MaO) is currently hindered by the escalating complexity of the Pareto front, which renders the relationsh

local-aiarxiv-cs-lg

Patch-PODiff-ViT: Structured Latent Diffusion with Patchwise POD for Super-Resolution and Uncertainty Quantification

arXiv:2606.31290v1 Announce Type: new Abstract: Diffusion models enable probabilistic super-resolution and conditional generation, but pixel-space methods are computationally expensive and learned lat

Personalizing Marketplace Policies with Competing Objectives and Constrained Experiments: Evidence from a Job Marketplace

arXiv:2606.30932v1 Announce Type: new Abstract: Two-sided marketplaces connect distinct user groups whose interests often conflict -- improving outcomes on one side could degrade the other side's expe

Policy Optimization Achieves Data-Dependent Regret Bounds in MDPs with Unknown Transitions

arXiv:2606.31769v1 Announce Type: new Abstract: We study policy optimization for online episodic tabular Markov decision processes with unknown transition kernels, aiming for best-of-both-worlds guara

Predictable GRPO: A Closed-Form Model of Training Dynamics

arXiv:2606.30789v1 Announce Type: new Abstract: Group Relative Policy Optimization (GRPO) has become a standard tool for improving the reasoning ability of large language models, yet its training dyna

Pretrained Video Models as Differentiable Physics Simulators for Urban Wind Flows

arXiv:2603.21210v3 Announce Type: replace Abstract: Designing urban spaces that provide pedestrian wind comfort and safety requires time-resolved Computational Fluid Dynamics (CFD) simulations, but th

Private Rate-Constrained Optimization with Applications to Fair Learning

arXiv:2505.22703v2 Announce Type: replace Abstract: Many problems in trustworthy ML can be expressed as constraints on prediction rates across subpopulations, including group fairness constraints (dem

Probabilistic Inversion with Flow Matching

arXiv:2606.31288v1 Announce Type: new Abstract: We demonstrate the application of Flow Matching, a technique originating from generative Artificial Intelligence, to probabilistic inversion in geophysi

Probe Choice Changes Canary-Memorization Verdicts: Three Post-Hoc Disagreement Case Studies in a Text-Dominant LoRA-Tuned Autoregressive Testbed

arXiv:2606.31168v1 Announce Type: cross Abstract: We audit a fixed prefix-window mean-NLL memorization probe (K=20) on a Qwen2.5-VL-7B canary testbed and report three post-hoc cases where it disagrees

Applications

Probing Memorization of Tabular In-Context Learning

arXiv:2606.31208v1 Announce Type: new Abstract: Large tabular models (LTMs), i.e., tabular foundation models leveraging in-context learning (ICL), achieve state-of-the-art performance on tabular tasks

applicationsarxiv-cs-lg

Prompting Robot Teams with Natural Language

arXiv:2509.24575v2 Announce Type: replace-cross Abstract: This paper presents a framework to prompt multi-robot teams with high-level tasks using natural language expressions. Our objective is to use

Quality-Aware Modulation for Diffusion Transformers

arXiv:2606.30934v1 Announce Type: new Abstract: Modern text-to-image diffusion models, such as diffusion transformers (DiT), rely on timestep or prompt embeddings to modulate the strength of the denoi

Agents

Quality-Controlled Active Learning via Gaussian Processes for Robust Structure-Property Learning in Autonomous Microscopy

arXiv:2603.29135v2 Announce Type: replace Abstract: Autonomous experimental systems are increasingly used in materials research to accelerate scientific discovery, but their performance is often limit

agentsarxiv-cs-lg

Quantum Bayesian Networks Can Speed up Reinforcement Learning in Partially Observable Environments

arXiv:2507.18606v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) provides a principled framework for decision-making in partially observable environments, which can be modeled as

Random Reshuffling Dominates Stochastic Gradient Descent

arXiv:2606.32005v1 Announce Type: cross Abstract: Stochastic Gradient Descent (extsf{SGD}) is one of the most classical optimization algorithms with favorable theoretical guarantees, yet the practical

ReactionAtlas: Ab origine exploration of chemical reaction networks with machine learning

arXiv:2606.30778v1 Announce Type: new Abstract: Mapping a chemical reaction network, the graph of minima and transition states (TS) and the elementary reactions connecting them, is the natural languag

Relational and Sequential Conformal Inference for Energy Time Series over Graphs via Foundation Models

arXiv:2606.31804v1 Announce Type: new Abstract: Accurate energy demand forecasting is essential for the reliable operation and planning of modern sustainable energy systems. Spatial-temporal graph neu

Revisiting the Volume Hypothesis

arXiv:2606.31282v1 Announce Type: new Abstract: Modern deep neural networks often contain far more parameters than needed to fit their training data, yet they achieve impressive generalization. A comm

Applications

Robustness of neural networks to random noise perturbations of their inputs

arXiv:2606.31581v1 Announce Type: new Abstract: We investigate the problem of the robustness of a trained neural network to the perturbation of its input values. More specifically, we examine the inte

applicationsarxiv-cs-lg

Safe Online Learning via Smooth Safety-Structured Policy Composition

arXiv:2606.31320v1 Announce Type: new Abstract: Safe online reinforcement learning requires policies to respect safety constraints while maintaining smooth optimization dynamics. Existing approaches t

Local Ai

Scaling Storm-Resolving Atmospheric AI Simulation to the Entire Planet

arXiv:2606.31248v1 Announce Type: cross Abstract: Kilometer-scale convection shapes precipitation extremes, tropical organization, and cloud feedbacks, but most global atmospheric models approximate t

local-aiarxiv-cs-lg

Semantic Leakage and Privacy Preservation in Relay-Assisted Semantic Communications

arXiv:2606.31973v1 Announce Type: cross Abstract: Semantic communication (SemCom) has emerged as a promising paradigm in which the transmission of task-relevant information is prioritized over raw dat

Separation Capacity of Scattering Networks

arXiv:2606.30822v1 Announce Type: cross Abstract: In this paper, we attempt to enhance the theoretical understanding of convolutional neural networks (CNNs) as feature extractors in classification tas

Sequential RC-TGAN: Generating Relational Time Series with Spectral Envelope Loss

arXiv:2606.31904v1 Announce Type: new Abstract: The generation of synthetic relational databases often involves modeling complex temporal dynamics, such as transaction logs or event sequences. A signi

Sequential sparse Gaussian process quantile regression

arXiv:2606.31284v1 Announce Type: new Abstract: Quantile regression aims to estimate the conditional quantiles of a response variable from observed data. In a Bayesian setting, Gaussian process quanti

Seven-dimensional Trajectory Reconstruction for VAMOS++

arXiv:2503.18959v1 Announce Type: cross Abstract: The VAMOS++ magnetic spectrometer is characterized by a large angular and momentum acceptance and highly non-linear ion optics properties requiring th

SGD at the Edge of Stability: Stochastic Stabilization with Large Learning Rates

arXiv:2606.30930v1 Announce Type: cross Abstract: Modern deep learning has been shown to operate at the edge of stability, routinely using learning rates far larger than those justified by classical o

ShardNet: Training Neural Controllers with Hard, Non-Convex Constraints

arXiv:2606.30935v1 Announce Type: cross Abstract: While neural network control policies are powerful, their deployment on safety critical systems depends on ensuring that they obey strict constraints.

Size Doesn't Matter: Cosine-Scored Sparse Autoencoders

arXiv:2606.15054v2 Announce Type: replace Abstract: Sparse autoencoders (SAEs) detect features via inner product, so a feature's activation scales with both its directional alignment and the input's n

Structure-Regularized Interpretable TCR-Epitope Prediction

arXiv:2606.30902v1 Announce Type: cross Abstract: T cell receptor (TCR)-epitope binding prediction is essential for understanding adaptive immunity and developing immunotherapies. Existing sequence- a

Surrogate Fidelity: When Can Open LLMs Explain Closed Ones?

arXiv:2606.32008v1 Announce Type: new Abstract: Mechanistic interpretability (MI) requires full access to model internals, yet the APIs for most widely deployed language models at best expose log-prob

TabPATE: Differentially Private Tabular In-Context Learning Without Public Data

arXiv:2606.31474v1 Announce Type: new Abstract: Tabular foundation models enable accurate in-context learning (ICL) from small labeled datasets, but the private records placed in context can leak thro

Tailored minimal reservoir computing: on the bidirectional connection between nonlinearities in the reservoir and in data

arXiv:2504.17503v2 Announce Type: replace Abstract: We study how the degree of nonlinearity in the input data affects the optimal design of reservoir computers, focusing on how closely the model's non

Local Ai

Teaching LLMs to Recommend and Defer in Underrepresented Epilepsy Care

arXiv:2606.31036v1 Announce Type: new Abstract: Specialist epilepsy expertise is scarce in resource-constrained settings, making LLM-based decision support attractive for frontline clinicians managing

local-aiarxiv-cs-lg

The Calibration Turn in AI-Assisted Research: A Conceptual and Methodological Framework for Evidence-Licensed Claims

arXiv:2606.31273v1 Announce Type: new Abstract: AI-assisted research has entered a stage in which the central question is not only whether systems can generate hypotheses, run experiments, or produce

The Geometry of Efficient Nonconvex Sampling

arXiv:2603.25622v2 Announce Type: replace-cross Abstract: We present an efficient algorithm for uniformly sampling from an arbitrary compact body X subset R^n from a warm start under isoperimetry and

The Impact of Dimensionality on the Stability of Node Embeddings

arXiv:2604.08492v2 Announce Type: replace Abstract: Previous work has shown that node embedding methods can produce different representations and downstream predictions across repeated training runs,

Visualizing High-Dimensional Graph Embeddings via Informed Multi-View Projections

arXiv:2606.31119v1 Announce Type: new Abstract: Graphs are commonly visualized in 2D, where humans readily interpret spatial relationships, yet such layouts often distort higher-dimensional structure.

Warp RL: Reshaping Base Policy Distributions for Dynamics Adaptation

arXiv:2606.31043v1 Announce Type: new Abstract: Residual reinforcement learning adapts a pretrained robot policy by learning an additive correction to its actions. While effective when adaptation amou

When few labeled target data suffice: a theory of semi-supervised domain adaptation via fine-tuning from multiple adaptive starts

arXiv:2507.14661v2 Announce Type: replace-cross Abstract: Semi-supervised domain adaptation (SSDA) seeks to achieve accurate predictions in a target domain with limited labeled target data by exploiti

Zero-Shot Quantization for Object Detectors using Off-the-Shelf Generative Models

arXiv:2606.31456v1 Announce Type: new Abstract: With an increasing number of Object Detection (OD) models being deployed on edge devices, Zero-Shot Quantization for OD (ZSQ-OD) aims to quantize these