research

Stochastic Bilevel Optimization with Heavy-Tailed Noise

arXiv:2509.14952v3 Announce Type: replace Abstract: This paper considers the smooth bilevel optimization in which the lower-level problem is strongly convex and the upper-level problem is possibly non

Strategically Diverse Sampling for Self-Training

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2609.31571v1 Announce Type: new Abstract: Many LLM training and inference methods, including RL and test-time scaling, depend on repeated sampling, but benefit only when the responses meaningful

researcharxiv-cs-cl

28 Sept 2026

Structured-Diffuser: Diffusion with Task-Conditioned Structured Priors for Motion Planning

arXiv:2509.25685v3 Announce Type: replace Abstract: We propose Structured-Diffuser, a diffusion planner that embeds task and motion structure directly into the noise model. Unlike standard diffusion-b

Subject-Invariant Cross-Modal Decoding of Perceived Speech from Brain Recordings

arXiv:2609.30832v1 Announce Type: cross Abstract: Perceived speech decoding based on non-invasive brain-computer interface (BCI) signals has been extensively studied in recent years. Research in this

Symbiotic Architecture for Post-Hoc Audio Extension of Frozen Language Models

arXiv:2609.30784v1 Announce Type: cross Abstract: This paper proposes an architecture for equipping large language models (LLMs) with audio-understanding capabilities without fine-tuning their weights

Tactile Sensing Array for Multi-Phalanx Sensing in Humanoid Hands

arXiv:2609.30506v1 Announce Type: new Abstract: Humanoid hands require tactile feedback across the whole finger, not just the fingertip, to grasp and manipulate objects properly. Vision and propriocep

Testing the Utility of Using Large Language Models to Create Personalized Networks From Therapy Session Transcripts: A Proof of Concept Study

arXiv:2512.05836v2 Announce Type: replace Abstract: Recent advances in psychotherapy have focused on treatment personalization, such as by selecting treatment modules based on individual networks. How

THA: Weighted Finite-State Text Normalization and Inverse Text Normalization for Khmer

arXiv:2609.30984v1 Announce Type: new Abstract: Text-to-speech needs written text in spoken form, and speech recognition output needs the reverse. For Khmer, neither direction has a maintained open-so

The N-5 Scaling Law: Topological Dimensionality Reduction in the Optimal Design of Fully-actuated Multirotors

arXiv:2512.23619v3 Announce Type: replace Abstract: We investigate the topological structure of the optimal actuation landscape for fully-actuated N-rotor aerial vehicles. By formulating the design pr

The Residual Stream's Effective Depth

arXiv:2609.31098v1 Announce Type: new Abstract: We introduce effective depth (Deff), a scalar diagnostic that treats the layer-wise residual stream of a transformer as a discrete-time process, measure

TinyCVIO: A Constellation-Aided Visual-Inertial Odometry System for Nanodrones

arXiv:2609.30358v1 Announce Type: new Abstract: Nanodrones require accurate, real-time state estimation under severe sensing and computational constraints. We present TinyCVIO, a visual-inertial odome

Toward AI-Augmented Cooperative Engineering Workflows: Requirements and Architecture the European Rover Challenge

arXiv:2609.31136v1 Announce Type: new Abstract: The growing availability of Artificial Intelligence (AI) tools creates new opportunities to support engineering design processes, yet their current use

Towards Automated Lexicography: Generating and Evaluating Definitions for Learner's Dictionaries

arXiv:2601.01842v2 Announce Type: replace Abstract: Dictionary definitions are an essential resource for learning word senses, but manually creating them is costly. We thus study dictionary definition

Towards Understanding Momentum Acceleration in River-Valley Loss Landscape

arXiv:2609.30957v1 Announce Type: new Abstract: The empirical success of pretraining large language models has inspired a deeper investigation into the underlying loss landscapes and the optimization

Towards Whole-Study Screening for Congenital Heart Disease in Fetal Ultrasound Using Multiple Instance Learning

arXiv:2609.31376v1 Announce Type: cross Abstract: Congenital heart disease (CHD) is the most common birth defect, yet a large fraction of cases remain undetected on prenatal ultrasound, in part becaus

Training-Free Pronunciation Transcription via Text-Constrained Acoustic Rescoring

arXiv:2609.30924v1 Announce Type: new Abstract: Accurate and efficient pronunciation transcription is essential for preparing text-to-speech training data at scale. Existing approaches have different

Training Graph Foundation Models on The Web Graph

arXiv:2609.30894v1 Announce Type: new Abstract: We introduce Acacia, a graph foundation model, trained on the web graph. Acacia (i) supports arbitrary feature dimensionalities and semantics without ad

Trust Guided Decision Transformer

arXiv:2609.31586v1 Announce Type: new Abstract: Decision Transformer performance degrades on long rollouts because the conditioning context drifts out of the training distribution. We show that this d

Uncertainty-Aware Federated Learning for Infant Movement Analysis

arXiv:2609.31463v1 Announce Type: cross Abstract: Infant movement analysis provides valuable biomarkers for the early identification of neurodevelopmental disorders. Recent advances in deep learning h

UniPrefill: Universal Long-Context Prefill Acceleration via Block-wise Dynamic Sparsification

arXiv:2605.06221v2 Announce Type: replace Abstract: As large language models (LLMs) continue to advance rapidly, they are becoming increasingly capable while simultaneously demanding ever-longer conte

Unsupervised Methods for Video Quality Improvement: A Survey of Restoration and Enhancement Techniques

arXiv:2507.08375v2 Announce Type: replace Abstract: Video restoration and enhancement are critical not only for improving visual quality, but also as essential pre-processing steps to boost the perfor

UQ-LOB: Uncertainty-Aware Limit Order Book Mid-Price Forecasting

arXiv:2609.31491v1 Announce Type: new Abstract: Forecasting short-horizon mid-price movements from limit order book (LOB) data is central to algorithmic trading, yet most deep LOB forecasters are poin

Vision-Based 6-DoF Grasp Pose Estimation for Robot Cloth Unfolding

arXiv:2609.31452v1 Announce Type: cross Abstract: Cloth manipulation is a challenging task due to the deformable and high-dimensional nature of cloth, which leads to complex interaction dynamics and p

Weight Pair Encoding: Inducing a Smaller Grammar in Neural Network Weights

arXiv:2609.31564v1 Announce Type: new Abstract: We show that neural network weights can be explicilty fintuned to admit a smaller grammar. Weight Pair Encoding (WeightPE) does so by placing a lossy Re

What Do They Fix? LLM-Aided Categorization of Security Patches for Critical Memory Bugs

arXiv:2509.22796v2 Announce Type: replace-cross Abstract: Open-source software projects are foundational to modern software ecosystems, with the Linux kernel standing out as a critical exemplar due to

When 10,000 Windows Are Not 10,000 Tests: Auditing Statistical Confidence in Sliding-Window Time-Series Classification

arXiv:2609.30721v1 Announce Type: new Abstract: Sliding-window classifiers are often evaluated on thousands of overlapping test windows, even though neighboring predictions share observations and rema

When Does Advection-Aware Graph Nowcasting Help? A Controlled Study of Distributed Solar Ramp Forecasting with a Self-Supervised Cloud-Motion Estimator

arXiv:2609.30286v1 Announce Type: cross Abstract: Short-term forecasting of cloud-induced power ramps across a network of distributed photovoltaic (PV) or irradiance sensors is a recognised pain point

Where a Model Sends Its Own Repeated Token

arXiv:2609.31181v1 Announce Type: new Abstract: Black-box model identification works by scoring a model's response to natural-language prompts. One line of work feeds models a degenerate input -- thei

Where and When to Force: Routed Forcing for Streaming Avatars

arXiv:2609.30963v1 Announce Type: new Abstract: Audio-driven streaming avatar generation requires real-time synthesis of speech-synchronized videos with dynamic and diverse motion. Self Forcing uses D

Who Says What: Symbolic Trimodal Binding Mechanisms in Audio-Visual LLMs

arXiv:2609.31193v1 Announce Type: new Abstract: Current Audio-Visual LLMs (AVLLMs) struggle with reasoning over videos featuring multi-speaker dialogues. In such videos, resolving 'who says what' is c

Why Alzheimer's Speech Screening Fails to Generalize: Bridging the Deployment Gap via Cross-Corpus Evidence Anchoring

arXiv:2609.31293v1 Announce Type: cross Abstract: Speech-based screening is a promising, non-invasive approach for detecting Alzheimer's disease and related cognitive risks. However, models trained on

XPhysICS: Cross-Physical-Domain Threat Grounding for Industrial Control Systems Security

arXiv:2609.30805v1 Announce Type: cross Abstract: Industrial control system (ICS) threats documented for one plant can express cyber-physical effects relevant to another, but semantic similarity alone

A little Ember-1 tl;dr. Seems like a great model! (Was recently asked on a podcast, given $ xx million, what's the best way to develop a fro…

researchsebastian-raschka--x

A little Ember-1 tl;dr. Seems like a great model! (Was recently asked on a podcast, given $ xx million, what's the best way to develop a frontier LLM today? My recommendation was: start with an existi

27 Sept 2026

I've been suspicious of the philosophers hired by Anthropic who specialize in AI ethics for similar reasons that I'm skeptical of those who …

I've been suspicious of the philosophers hired by Anthropic who specialize in AI ethics for similar reasons that I'm skeptical of those who went into 'bioethics': they form a closed subculture that de

researchyann-lecun--x

27 Sept 2026

Two-stage shelf audit: YOLO finds the products, embeddings can't tell sibling SKUS apart. What should Stage 2 be? [P]

researchr-machinelearning

Help: Project l'm building a shelf audit tool. A photo goes through YOLO, which crops each product, and then I embed the crop and search a small gallery of reference photos to get the SKU. New product

27 Sept 2026

Reasoning from scratch, round number 5! This time, talking about log-probability scoring (also a great fundamental concept for loss function…

researchsebastian-raschka--x

Reasoning from scratch, round number 5! This time, talking about log-probability scoring (also a great fundamental concept for loss functions like cross-entropy in pre-training and distillation) and s

26 Sept 2026

Yann LeCun, Executive Chairman of AMI Labs, explains why LLMs are mostly retrieving human knowledge rather than thinking for themselves: LeC…

Yann LeCun, Executive Chairman of AMI Labs, explains why LLMs are mostly retrieving human knowledge rather than thinking for themselves: LeCun starts with why so many people misread what these systems

researchyann-lecun--x

26 Sept 2026

A General Framework for Budgeted Threshold Incentives on Request

arXiv:2609.29724v1 Announce Type: new Abstract: On-demand delivery platforms pay riders through incentive activities whose tiers are set from recent completions of riders with a similar history. Opera

A Harness for Synthesizing Diverse Naturalistic Full-Duplex Conversations

arXiv:2609.28806v1 Announce Type: cross Abstract: Full-duplex dialogue systems, which listen while speaking, must distinguish a completed turn from a pause within a turn and an interruption that reque

A Manifold-Aware Topic Modeling Approach via Rank-Based Prototypes

arXiv:2609.29630v1 Announce Type: cross Abstract: Recent topic models leverage pretrained embeddings, but neural architectures produce latent representations without grounding in specific texts, and c

A Multimodal Dataset for Survival Prediction in Resected Pancreatic Ductal Adenocarcinoma

arXiv:2609.29726v1 Announce Type: new Abstract: Survival research in pancreatic ductal adenocarcinoma (PDAC) is limited by the scarcity of datasets linking whole-slide histology with clinical, molecul

A Native-Reference Phone-Class Geometry for Second-Language Pronunciation Analysis

arXiv:2609.30075v1 Announce Type: new Abstract: Automatic speaking assessment systems can provide holistic proficiency scores, but often lack interpretable measures that characterize pronunciation qua

A Nearly Quadratic Lower Bound for Linear Optimization over Convex Bodies in the Membership Oracle Model

arXiv:2609.30215v1 Announce Type: cross Abstract: We prove nearly quadratic lower bounds for randomized algorithms for linear optimization and uniform sampling over convex bodies in the membership ora

A New Gap Sequence for Shellsort: RL-Driven Algorithm Discovery Beyond N^{4/3}

arXiv:2609.29881v1 Announce Type: cross Abstract: Choosing Shellsort gaps is a well-known open problem. For over sixty years, successful sequences have relied on human-designed formulas, numerical sea

A Vision-Language Framework for Measuring Social Life on Sidewalks

arXiv:2609.28476v1 Announce Type: cross Abstract: While a number of methods exist for counting pedestrians in street-view imagery, these mostly ignore the social dimensions of pedestrian activity. A s

Accent Analogy Guidance: More Speaker Similarity at Equal Accent in Cross-Lingual Voice Cloning

arXiv:2609.29123v1 Announce Type: cross Abstract: In cross-lingual zero-shot text-to-speech, the accent of the reference leaks into the target speech. We propose accent analogy guidance (AAG), a train

AD-WM: Action-Discriminative World Models for Counterfactual Model Predictive Control

arXiv:2609.30264v1 Announce Type: new Abstract: Latent world models are typically trained to predict factual transitions, whereas model predictive control (MPC) must compare alternative actions from t

Adaptive Tiling for Least-Squares Phase Unwrapping: Runtime and Accuracy

arXiv:2609.28541v1 Announce Type: cross Abstract: Phase unwrapping estimates the missing multiples of 2pi in measured phase images. For large images, tiling limits the size of local reconstruction pro