research

Smoothed Gradient Method for Nonconvex Federated Stochastic Bilevel Optimization

arXiv:2610.05290v1 Announce Type: new Abstract: In recent years, federated stochastic bilevel optimization has attracted increasing attention due to its wide range of applications in machine learning.

SO(3)-RoPE for Spherical Transformers

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2610.06229v1 Announce Type: new Abstract: Spherical data arise in many scientific applications. Often spherical transformers disregard the geometry of the underlying spherical domain, causing di

researcharxiv-cs-lg

6 Oct 2026

SOL: Measuring Gaps between Text Distributions by Double Sliced Wasserstein Metrics

arXiv:2610.06513v1 Announce Type: cross Abstract: Evaluating text generation requires measuring how well the generated distribution matches the data distribution. For autoregressive models, this is do

SoundWeaver: Compositional Warm-Starting for Text-to-Audio Diffusion Serving

arXiv:2603.07865v2 Announce Type: replace-cross Abstract: Text-to-audio (T2A) diffusion models generate high-quality audio but require tens of neural function evaluations (NFEs), resulting in substant

Spacecraft Rendezvous Trajectory Generation with Modular Constraints via Diffusion Model Composition

arXiv:2610.05642v1 Announce Type: cross Abstract: Emerging mission classes such as on-orbit servicing, satellite inspection, and active debris removal require trajectory design methods that are adapta

Sparse Calibration-Based Personalization of Kernel-Based Gait Phase and Speed Estimation Using Wearable IMUs

arXiv:2610.03931v1 Announce Type: new Abstract: This paper presents sparse calibration-based personalization for kernel-based gait phase and walking speed co-estimation from wearable inertial measurem

Sparse-GS2Mesh: 3D Gaussian Splatting Guided by Novel Stereo Views and 2DGS for Sparse View Surface Reconstruction}

arXiv:2610.04203v1 Announce Type: new Abstract: Surface reconstruction under sparse-view settings remains challenging due to limited geometric cues. Volume rendering methods based on signed distance f

Spatial Supervision Without Attribution Optimization: Improving Post-Hoc Class Activation Maps via Box-Guided Evidence Routing

arXiv:2610.05891v1 Announce Type: new Abstract: Post-hoc class activation maps (CAMs) are a standard tool for inspecting the evidence behind an image classifier's predictions, yet nothing in ordinary

SpecFold: Folding Multi-Branch Redundancy for Faster Speculative Decoding in Diffusion Language Models

arXiv:2610.04875v1 Announce Type: cross Abstract: Diffusion large language models (DLLMs) generate text through iterative block denoising, and multi-branch speculative decoding accelerates this proces

Spectral Analysis of Molecular Features: When Richer Features Do Not Guarantee Better Generalization

arXiv:2510.14217v3 Announce Type: replace Abstract: The spectral properties of feature embeddings offer critical insights into model generalization and representation quality. While deep learning mode

Spectral Geometry of Attention: From Information Routing to Uncertainty

arXiv:2610.06012v1 Announce Type: new Abstract: In this work, we study transformer attention through the lens of spectral geometry and operator theory. We view each attention head as a functional map

SPIN: Image Immunization Against Diffusion Editing via Single-Step Projection in Stochastic Neighborhoods

arXiv:2610.06334v1 Announce Type: new Abstract: Diffusion models have greatly advanced instruction-guided image editing, while also raising concerns about unauthorized image manipulation. Image immuni

Spontaneous morning chat with Juergen Schmidhuber and Jake Newfield philosophizing about AI. Sry my mic somehow disconnected but Juergen had…

researchsebastian-raschka--x

Spontaneous morning chat with Juergen Schmidhuber and Jake Newfield philosophizing about AI. Sry my mic somehow disconnected but Juergen had the more interesting points anyways! Our CEO @Jake_Newfield

Square-Root Regret for Adversarial Multiplayer Bandits without Collision Information or Shared Randomness

arXiv:2610.05688v1 Announce Type: new Abstract: We study adversarial multiplayer bandits with K arms and 2le m<K labeled players, without collision information, shared randomness, or an external commu

Stability and Generalization of Stochastic Nonconvex Optimization under Heavy-Tailed Noise: From Gradient Norm to Goldstein Stationarity

arXiv:2601.19730v2 Announce Type: replace Abstract: The empirical evidence indicates that stochastic optimization with heavy-tailed gradient noise is more appropriate to characterize the training of m

Stability-Shaped Deep Graph Learning

arXiv:2610.06344v1 Announce Type: new Abstract: In deep graph neural networks, increasing depth enlarges the receptive field but often leads to over-smoothing, where node representations tend to align

SteadySplats: Resampling of Low-Variance Gaussians for High-Fidelity Stochastic Rendering

arXiv:2610.05576v1 Announce Type: new Abstract: Stochastic order-independent transparency enables efficient and elegant rendering of primitive-based radiance fields like 3D Gaussian Splatting models,

Steering by Influence: Curvature Aware Data Weighting for Activation Steering

arXiv:2610.06383v1 Announce Type: new Abstract: Inference-time steering offers cheap, fine-grained control over a language model's outputs by estimating a concept's representation in activation space

Structured Neural Modeling of Daily Arctic Sea-Ice Concentration Evolution: Physical-Trajectory-Driven Learning and Forecast-Domain Adaptation

arXiv:2610.03743v1 Announce Type: cross Abstract: Accurate modeling of the daily evolution of sea ice concentration (SIC) is central to improving the credibility and operational forecasting capability

Studying the Soupability of Documents in State Space Models

arXiv:2505.24033v3 Announce Type: replace-cross Abstract: We investigate whether hidden states from Structured State Space Models (SSMs) can be merged post hoc to support downstream reasoning. Inspire

Synthesizing Physics Formulae with Transformers

arXiv:2610.03947v1 Announce Type: new Abstract: Finding a compact formula that fits a set of input-output pairs and predicts outputs on unseen inputs is a fundamental problem in science. Symbolic regr

Systematic Hazard Sampling: Minimal-Variance Inference for Discrete Diffusion and Flow Models

arXiv:2601.02799v3 Announce Type: replace Abstract: Uniform-noise discrete diffusion and flow models generate sequences non-autoregressively through iterative, context-dependent token replacements. Ho

T-JEPA: A Temporal Joint-Embedding Predictive Architecture for Learning Better Remote Sensing Representations

arXiv:2610.05731v1 Announce Type: new Abstract: Earth observation (EO) data provide rich temporal supervision, yet existing remote sensing foundation models mainly exploit sequential observations thro

TacGELLO: Tactile Contact Feedback for a 3D-Printed Teleoperation Leader

arXiv:2610.05583v1 Announce Type: new Abstract: Passive leader arms transmit an operator's motion without returning remote contact or load cues. TacGELLO uses the existing servos of a 3D-printed leade

Tackling Sim-to-Real Mismatch Through Sampling-Based Disturbance Observers: From Analytical Models to Learned World Models

arXiv:2610.04896v1 Announce Type: new Abstract: Robotic controllers increasingly rely on analytical models, simulators, cost-query interfaces, and learned world models. However, physical deployment ca

Tactile Perception through Fluid-Solid Interaction

arXiv:2610.03773v1 Announce Type: cross Abstract: Soft tactile sensors elevate robotic touch through enhanced flexibility and adaptability, yet most existing designs depend on embedded electronics tha

Talk Like You: Imitating How You Speak in Real-Time Talking Head Generation

arXiv:2610.06658v1 Announce Type: new Abstract: In daily life, each person exhibits unique speaking habits, leading to subtle yet consistent lip-shape variations even when pronouncing the same word. A

Task-Error Residual Learning for Real-Robot Five-Ball Juggling

arXiv:2606.16978v2 Announce Type: replace-cross Abstract: For residual learning that refines existing behavior, sample efficiency depends on two things: how much information each rollout returns, and

TasteRoute: Personalized Routing for Video Generation

arXiv:2610.05896v1 Announce Type: new Abstract: Rapid progress in video generation has led to a plethora of models that differ substantially in capability and generation cost. This raises a natural qu

Tensor-based computation of the Koopman generator via operator logarithm

arXiv:2604.07685v2 Announce Type: replace Abstract: Identifying governing equations of nonlinear dynamical systems from data is challenging. While sparse identification of nonlinear dynamics (SINDy) a

Terrain-Dependent Intra-Cycle Leg Timing for Effective Locomotion on Granular Slopes

arXiv:2610.04144v1 Announce Type: new Abstract: Locomotion on granular slopes such as sand dunes remains a fundamental challenge for legged robots due to reduced shear strength and gravity-induced ani

Textual Echo Cancellation

arXiv:2008.06006v5 Announce Type: replace-cross Abstract: In this paper, we propose Textual Echo Cancellation (TEC) - a framework for cancelling the text-to-speech (TTS) playback echo from overlapping

The Birkhoff Geometry of Manifold-Constrained Hyper-Connections: Two Channels, Vertex Viscosity, and Sinkhorn as a Retraction

arXiv:2610.06653v1 Announce Type: new Abstract: Hyper-connections widen the residual stream of a Transformer to n parallel streams. Their manifold-constrained version (mHC) mixes the streams at each l

The Blind Spot Paradox: When Adaptive Classifiers Defeat Drift Detectors

arXiv:2610.05853v1 Announce Type: new Abstract: Monitoring concept drift from an adaptive classifier's error stream creates an operational conflict with the model's own update loop. When internal adap

The Dynamics of Discoverability: How Trajectories and Priors Shape Equation Recovery

arXiv:2607.18490v2 Announce Type: replace Abstract: How the dynamical regime of the observed system affects equation discovery has mainly been investigated through comparisons across systems. However,

The Effect of Missingness-Pattern Mismatch on Method Selection for Time-Series Classification: A Controlled Empirical Study

arXiv:2610.05368v1 Announce Type: new Abstract: Classifiers for time-series classification are commonly selected on validation data, but the temporal pattern of missing observations at deployment may

The Numerical Linear Algebra of Large Language Models

arXiv:2610.04631v1 Announce Type: new Abstract: Numerical Linear Algebra (NLA) has consistently played a vital role in advancing science by providing tools to solve fundamental problems encountered in

The Value of Information in Resource-Constrained Pricing

arXiv:2603.24974v2 Announce Type: replace-cross Abstract: Firms that price perishable resources -- airline seats, hotel rooms, seasonal inventory -- now routinely use demand predictions, but these pre

ThyCLIPNet: A BiomedCLIP-Guided Lightweight Attention-Enhanced DeepLabV3+ Framework for Robust Thyroid Nodule Segmentation

arXiv:2610.04743v1 Announce Type: new Abstract: Accurate thyroid ultrasound segmentation is often challenged by low contrast, speckle noise, and unclear boundaries. Although recent methods have improv

TIMBRE: Teaching Time Series Forecasters to Read, Remember, and Reconcile

arXiv:2610.04795v1 Announce Type: new Abstract: Event-informed forecasting requires translating reports and historical responses into changes to a numerical forecast. We propose TIMBRE (Temporal Integ

Time-series Foundation Models for Predictive Control: The Role of Excitation

arXiv:2610.06447v1 Announce Type: new Abstract: Deploying model predictive control (MPC) requires constructing or identifying a predictive model for each target system. Time-series foundation models (

ToDRE: Effective Visual Token Pruning via Token Diversity and Task Relevance

arXiv:2505.18757v3 Announce Type: replace Abstract: Visual token pruning, which aims to compress and prune redundant visual tokens, plays a critical role in efficient inference with large vision-langu

Topology-Informed Prompt-Conditioned Universal Segmentation of Uterine Structures from Ultrasound and MRI

arXiv:2610.06494v1 Announce Type: new Abstract: Multi-structure segmentation of the uterus is important for computer-assisted screening, diagnosis, and treatment planning of uterine diseases, where ul

Towards Optimal Valve Prescription for Transcatheter Aortic Valve Replacement (TAVR) Surgery: A Machine Learning Approach

arXiv:2512.09198v2 Announce Type: replace Abstract: Transcatheter Aortic Valve Replacement (TAVR) has emerged as a prominent, minimally invasive treatment for patients with severe aortic stenosis, a l

Towards Robust Prehensile Manipulation in Open-Ended Environments

arXiv:2610.06376v1 Announce Type: new Abstract: We propose to use Quality-Diversity (QD) algorithms to solve robotic prehensile manipulation tasks in open-ended environments. Our approach enables the

Towards Subject-Oriented Video Captioning via User-Specified Targets

arXiv:2312.13330v3 Announce Type: replace Abstract: Describing video content according to users' needs is a long-held goal. Although existing video captioning methods have made significant progress, t

TRACE: Time-Adaptive Residual Attention Control with Content-Style Decomposition for Training-Free Diffusion Style Transfer

arXiv:2610.04922v1 Announce Type: new Abstract: Reference-guided style transfer aims to preserve the semantic structure of a content image while transferring the visual appearance of a style reference

Training and Scaling Compute-Optimal Physiological Waveform Foundation Models

arXiv:2610.05649v1 Announce Type: new Abstract: We investigate the scaling laws and compute-optimal training of physiological waveform foundation models (FMs). We train Aether, a family of over one hu