All entries

arXiv:2605.06763v1 Announce Type: new Abstract: Sparse attention improves LLM inference efficiency by selecting a subset of key-value entries, but at the cost of potential accuracy degradation. In par

hardwarearxiv-cs-lg

Source

Human DGX agent

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Sparse Attention as Compact Kernel Regression

DGX agent

arXiv:2601.22766v3 Announce Type: replace Abstract: Recent work has revealed a link between self-attention mechanisms in transformers and test-time kernel regression via the Nadaraya-Watson estimator,

researcharxiv-cs-lg

11 May 2026

Sparse Autoencoders as Plug-and-Play Firewalls for Adversarial Attack Detection in VLMs

arXiv:2605.07447v1 Announce Type: cross Abstract: Vision-language models (VLMs) have advanced rapidly and are increasingly deployed in real-world applications, especially with the rise of agent-based

Sparse Random-Feature Neural Networks with Krylov-Based SVD for Singularly Perturbed ODE

model-releasesarxiv-cs-lg

arXiv:2605.07286v1 Announce Type: cross Abstract: Random-feature neural networks (RFNNs), including architectures with fixed hidden layers and analytically determined output weights, offer fast traini

Hardware

Sparser, Faster, Lighter Transformer Language Models

arXiv:2603.23198v2 Announce Type: replace-cross Abstract: Scaling autoregressive large language models (LLMs) has driven unprecedented progress but comes with vast computational costs. In this work, w

hardwarearxiv-cs-cl

SparseRL-Sync: Lossless Weight Synchronization with ~100x Less Communication

arXiv:2605.07330v1 Announce Type: cross Abstract: In large-scale reinforcement learning (RL) systems with decoupled Trainer-Rollout execution, the Trainer must regularly synchronize policy weights to

SpecBlock: Block-Iterative Speculative Decoding with Dynamic Tree Drafting

arXiv:2605.07243v1 Announce Type: new Abstract: Speculative decoding accelerates LLM inference by drafting a tree of candidate continuations and verifying it in one target forward. Existing drafters f

researcharxiv-cs-cl

Spectral Dynamics in Deep Networks: Feature Learning, Outlier Escape, and Learning Rate Transfer

arXiv:2605.07870v1 Announce Type: cross Abstract: We study the evolution of hidden-weight spectra in wide neural networks trained by (stochastic) gradient descent. We develop a two-level dynamical mea

researcharxiv-cs-ai

Spectral Filtering for Complex Linear Dynamical Systems

arXiv:2601.22400v2 Announce Type: replace-cross Abstract: We study the problem of learning complex-valued linear dynamical systems (CLDS) with sector-bounded spectrum. This class captures oscillatory

researcharxiv-cs-ai

Spectral Surgery: Class-Targeted Post-Hoc Rebalancing via Hessian Spike Perturbation

arXiv:2605.07790v1 Announce Type: cross Abstract: The Hessian spectrum of trained deep networks exhibits a characteristic structure: a continuous bulk of near-zero eigenvalues and a small number of la

Spectrum-Adaptive Generalization Bounds for Trained Deep Transformers

arXiv:2605.07297v1 Announce Type: cross Abstract: Understanding why trained Transformers generalize well is a fundamental problem in modern machine learning theory, and complexity-based generalization

SphereVAD: Training-Free Video Anomaly Detection via Geodesic Inference on the Unit Hypersphere

arXiv:2605.08003v1 Announce Type: new Abstract: Video anomaly detection (VAD) aims to automatically identify events that deviate from normal patterns in untrimmed surveillance videos. Existing methods

Hardware

SpikingBrain: Spiking Brain-inspired Large Models

arXiv:2509.05276v4 Announce Type: replace-cross Abstract: Mainstream Transformer-based large language models face major efficiency bottlenecks: training computation scales quadratically with sequence

hardwarearxiv-cs-ai

Applications

SplatWeaver: Learning to Allocate Gaussian Primitives for Generalizable Novel View Synthesis

arXiv:2605.07287v1 Announce Type: new Abstract: Generalizable novel view synthesis aims to render unseen views from uncalibrated input images without requiring per-scene optimization. Recent feed-forw

applicationsarxiv-cs-cv

SR^2-LoRA: Self-Rectifying Inter-layer Relations in Low-Rank Adaptation for Class-Incremental Learning

model-releasesarxiv-cs-cv

arXiv:2605.07420v1 Announce Type: cross Abstract: Pre-trained models with parameter-efficient fine-tuning (PEFT) have demonstrated promising potential for class-incremental learning (CIL), yet catastr

SREGym: A Live Benchmark for AI SRE Agents with High-Fidelity Failure Scenarios

model-releasesarxiv-cs-ai

arXiv:2605.07161v1 Announce Type: new Abstract: AI agents are increasingly used to diagnose and mitigate failures in production systems, known as agentic Site Reliability Engineering (SRE). Current SR

SSP-based construction of evaluation-annotated data for fine-grained aspect-based sentiment analysis

arXiv:2605.07446v1 Announce Type: new Abstract: We report the construction of a Korean evaluation-annotated corpus, hereafter called 'Evaluation Annotated Dataset (EVAD)', and its use in Aspect-Based

researcharxiv-cs-cl

Local Ai

ST-Gen4D: Embedding 4D Spatiotemporal Cognition into World Model for 4D Generation

arXiv:2605.07390v1 Announce Type: new Abstract: Generative models have achieved success in producing apparently coherent 2D videos, but remain challenging in the physical world due to lack of 4D spati

local-aiarxiv-cs-cv

Stabilized neural Hamilton--Jacobi--Bellman solvers: Error analysis and applications in model-based reinforcement learning

arXiv:2605.07116v1 Announce Type: cross Abstract: Physics-informed neural solvers offer a promising route to model-based reinforcement learning in continuous time, where optimal feedback synthesis is

Star Elastic: Many-in-One Reasoning LLMs with Efficient Budget Control

model-releasesarxiv-cs-lg

arXiv:2605.07182v1 Announce Type: new Abstract: Training a family of large language models (LLMs), either from scratch or via iterative compression, is prohibitively expensive and inefficient, requiri

STARFlow2: Bridging Language Models and Normalizing Flows for Unified Multimodal Generation

arXiv:2605.08029v1 Announce Type: new Abstract: Deep generative models have advanced rapidly across text and vision, motivating unified multimodal systems that can understand, reason over, and generat

Agents

State Representation and Termination for Recursive Reasoning Systems

arXiv:2605.06690v1 Announce Type: new Abstract: Recursive reasoning systems alternate between acquiring new evidence and refining an accumulated understanding. Two design choices are typically left im

agentsarxiv-cs-ai

Stationary Reweighting Yields Local Convergence of Soft Fitted Q-Iteration

arXiv:2512.23927v2 Announce Type: replace-cross Abstract: Fitted Q-iteration (FQI) and soft FQI are widely used value-based methods for offline reinforcement learning, but their standard stability gua

safetyarxiv-cs-lg

Statistical inference with belief functions: A survey

arXiv:2605.07908v1 Announce Type: cross Abstract: Belief functions are a powerful and popular framework for the mathematical characterisation of uncertainty, in particular in situations in which lack

tutorialsarxiv-cs-ai

Statistical Patterns in the Equations of Physics and the Emergence of a Meta-Law of Nature

arXiv:2408.11065v2 Announce Type: replace-cross Abstract: Physics seeks to uncover the laws of Nature and express them through mathematical equations. Despite the vast diversity of natural phenomena,

researcharxiv-cs-cl

STDA-Net: Spectrogram-Based Domain Adaptation for cross-dataset Sleep Stage Classification

arXiv:2605.06736v1 Announce Type: cross Abstract: Accurate sleep stage classification across datasets remains challenging due to variability in EEG channel montages, sampling rates, recording environm

SteelDefectX: A Multi-Form Vision-Language Dataset and Benchmark for Steel Surface Defect Analysis

model-releasesarxiv-cs-ai

arXiv:2603.21824v2 Announce Type: replace-cross Abstract: Steel surface defect analysis is critical for industrial quality control, yet existing benchmarks rely primarily on label-only annotations, li

STEPS: A Temporal Smooth Error Propagation Solver on the Manifolds for Test-Time Adaptation in Time Series Forecasting

arXiv:2605.08005v1 Announce Type: new Abstract: Test-Time Adaptation (TTA) aims to improve time series forecasting under distribution shifts by using limited observations revealed during inference. Ho

Stochastic Transition-Map Distillation for Fast Probabilistic Inference

arXiv:2605.07661v1 Announce Type: cross Abstract: Diffusion models achieve strong generation quality, diversity, and distribution coverage, but their performance often comes with expensive inference.

Streaming Adversarial Robustness in Fuzzy ARTMAP: Mechanism-Aligned Evaluation, Progressive Training, and Interpretable Diagnostics

arXiv:2605.06902v1 Announce Type: new Abstract: Adversarial robustness has been studied extensively for offline deep networks, but less is known about strict single-pass streaming neural learners. Thi

StreamPhy: Streaming Inference of High-Dimensional Physical Dynamics via State Space Models

arXiv:2605.07384v1 Announce Type: new Abstract: Inferring the evolution of high-dimensional and multi-modal (e.g., spatio-temporal) physical fields from irregular sparse measurements in real time is a

Structural Rationale Distillation via Reasoning Space Compression

arXiv:2605.07139v1 Announce Type: cross Abstract: When distilling reasoning from large language models (LLMs) into smaller ones, teacher rationales for similar problems often vary wildly in structure

researcharxiv-cs-ai

Structure learning of Hamiltonians from real-time evolution

arXiv:2405.00082v4 Announce Type: replace-cross Abstract: We study the problem of Hamiltonian structure learning from real-time evolution: given the ability to apply e^{-i Ht} for an unknown local Ham

tutorialsarxiv-cs-lg

Structure Over Scale: Learning Visual Reasoning from Pedagogical Video

model-releasesarxiv-cs-cv

arXiv:2601.23251v2 Announce Type: replace Abstract: State-of-the-art vision-language models (VLMs) score impressively on video benchmarks yet stumble on basic visual reasoning tasks involving spatial

Structured Coupling for Flow Matching

arXiv:2605.07676v1 Announce Type: new Abstract: Standard flow matching scales well but typically relies on an unstructured source distribution, limiting its ability to learn interpretable latent struc

tutorialsarxiv-cs-lg

Structured Prototype-Guided Adaptation for EEG Foundation Models

model-releasesarxiv-cs-lg

arXiv:2602.17251v2 Announce Type: replace Abstract: Electroencephalography (EEG) foundation models (EFMs) have shown strong potential for transferable representation learning, yet their adaptation in

Structured Role-Aware Policy Optimization for Multimodal Reasoning

arXiv:2605.07274v1 Announce Type: new Abstract: Reinforcement learning from verifiable rewards (RLVR), especially with Group Relative Policy Optimization (GRPO), has shown strong potential for improvi

Supervised sparse auto-encoders for interpretable and compositional representations

arXiv:2602.00924v2 Announce Type: replace Abstract: Sparse auto-encoders (SAEs) have re-emerged as a prominent method for mechanistic interpretability, yet they face two significant challenges: the no

Surgical Visual Understanding (SurgVU) Dataset

arXiv:2501.09209v2 Announce Type: replace Abstract: Owing to recent advances in machine learning and the ability to harvest large amounts of data during robotic-assisted surgeries, surgical data scien

Local Ai

Susceptibilities and Patterning: A Primer on Linear Response in Bayesian Learning

arXiv:2605.07980v1 Announce Type: new Abstract: These notes introduce the theory of susceptibilities as developed in [arXiv:2504.18274, arXiv:2601.12703] for interpreting neural networks. The suscepti

local-aiarxiv-cs-lg

SWaRL: Safeguard Code Watermarking via Reinforcement Learning

arXiv:2601.02602v2 Announce Type: replace-cross Abstract: We present SWaRL, a robust and fidelity-preserving watermarking framework designed to protect the intellectual property of code LLMs by embedd

Agents

Switchcraft: AI Model Router for Agentic Tool Calling

arXiv:2605.07112v1 Announce Type: new Abstract: Agentic AI systems that invoke external tools are powerful but costly, leading developers to default to large models and overspend inference budgets. Mo

agentsarxiv-cs-ai

Applications

Switching-time bioprocess control with pulse-width-modulated optogenetics

arXiv:2511.22893v2 Announce Type: replace-cross Abstract: Biotechnology can benefit from dynamic control to improve production efficiency. In this context, optogenetics enables modulation of gene expr

applicationsarxiv-cs-ai

Sword: Style-Robust World Models as Simulators via Dynamic Latent Bootstrapping for VLA Policy Post-Training

model-releasesarxiv-cs-ai

arXiv:2605.07288v1 Announce Type: cross Abstract: The integration of Vision-Language-Action (VLA) models with World Models has gained increasing attention. One representative approach treats learned W

Applications

Sycophantic AI makes human interaction feel more effortful and less satisfying over time

arXiv:2605.07912v1 Announce Type: cross Abstract: Millions of people now turn to artificial intelligence (AI) systems for personal advice, guidance, and support. Such systems can be sycophantic, frequ

applicationsarxiv-cs-ai

Synergistic Benefits of Joint Molecule Generation and Property Prediction

arXiv:2504.16559v3 Announce Type: replace Abstract: Modeling the joint distribution of data samples and their properties allows to construct a single model for both data generation and property predic

SynthForensics: Benchmarking and Evaluating People-Centric Synthetic Video Deepfakes

model-releasesarxiv-cs-cv

arXiv:2602.04939v2 Announce Type: replace Abstract: Modern T2V/I2V generators synthesize people increasingly hard to distinguish from authentic footage, while current evaluation suites lag: legacy ben

Tables Guide Vision: Learning to See the Heart through Tabular Data

arXiv:2503.14998v3 Announce Type: replace Abstract: Contrastive learning methods in computer vision typically rely on augmented views of the same image or multimodal pretraining strategies that align

tutorialsarxiv-cs-cv