research

USEMA: a Scalable Efficient Mamba Like Attention for Medical Image Segmentation

arXiv:2605.11131v1 Announce Type: new Abstract: Accurate medical image segmentation is an integral part of the medical image analysis pipeline that requires the ability to merge local and global infor

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Variational Linear Attention: Stable Associative Memory for Long-Context Transformers

DGX agent

arXiv:2605.11196v1 Announce Type: new Abstract: Linear attention reduces the quadratic cost of softmax attention to O(T), but its memory state grows as O(T) in Frobenius norm, causing progressive inte

researcharxiv-cs-lg

13 May 2026

Vector Scaffolding: Inter-Scale Orchestration for Differentiable Image Vectorization

arXiv:2605.11913v1 Announce Type: new Abstract: Differentiable vector graphics have enabled powerful gradient-based optimization of vector primitives directly from raster images. However, existing fra

Vertex-Softmax: Tight Transformer Verification via Exact Softmax Optimization

arXiv:2605.10974v1 Announce Type: new Abstract: Certified verification of transformer attention requires bounding the softmax function over interval constraints on the pre-softmax scores. Existing ver

Video-Language Understanding: A Survey from Model Architecture, Model Training, and Data Perspectives

arXiv:2406.05615v4 Announce Type: replace Abstract: Humans use multiple senses to comprehend the environment. Vision and language are two of the most vital senses since they allow us to easily communi

VidSplat: Gaussian Splatting Reconstruction with Geometry-Guided Video Diffusion Priors

arXiv:2605.11424v1 Announce Type: new Abstract: Gaussian Splatting has achieved remarkable progress in multi-view surface reconstruction, yet it exhibits notable degradation when only few views are av

Vision-aligned Latent Reasoning for Multi-modal Large Language Model

arXiv:2602.04476v2 Announce Type: replace Abstract: Despite recent advancements in Multi-modal Large Language Models (MLLMs) on diverse understanding tasks, these models struggle to solve problems whi

Welfare as a Guiding Principle for Machine Learning -- From Compass, to Lens, to Roadmap

arXiv:2502.11981v3 Announce Type: replace Abstract: Decades of research in machine learning have given us powerful tools for making accurate predictions. But when used in social settings and on human

What we find most useful about TST is the decoupling. The training-time efficiency is fully separated from the inference-time architecture, …

What we find most useful about TST is the decoupling. The training-time efficiency is fully separated from the inference-time architecture, which makes TST a clean addition on top of other pretraining

researchnous-research--x

When Brains Disagree: Biological Ambiguity Underlies the Challenge of Amyloid PET Synthesis from Structural MRI

arXiv:2605.11867v1 Announce Type: new Abstract: Structural MRI-to-amyloid PET synthesis has been proposed as a non-invasive alternative for amyloid assessment in Alzheimer's disease (AD). However, rep

When Emotion Becomes Trigger: Emotion-style dynamic Backdoor Attack Parasitising Large Language Models

arXiv:2605.11612v1 Announce Type: new Abstract: Backdoor vulnerabilities widely exist in the fine-tuning of large language models(LLMs). Most backdoor poisoning methods operate mainly at the token lev

When Looking Is Not Enough: Visual Attention Structure Reveals Hallucination in MLLMs

arXiv:2605.11559v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have become a key interface for visual reasoning and grounded question answering, yet they remain vulnerable to

When the Gold Standard Isn't Necessarily Standard: Challenges of Evaluating the Translation of User-Generated Content

arXiv:2512.17738v2 Announce Type: replace Abstract: User-generated content (UGC) is characterised by frequent use of non-standard language, from spelling errors to expressive choices such as slang, ch

WorldComp2D: Spatio-semantic Representations of Object Identity and Location from Local Views

arXiv:2605.11743v1 Announce Type: new Abstract: Learning latent representations that capture both semantic and spatial information is central to efficient spatio-semantic reasoning. However, many exis

xi-DPO: Direct Preference Optimization via Ratio Reward Margin

arXiv:2605.10981v1 Announce Type: new Abstract: Reference-free preference optimization has emerged as an efficient alternative to reinforcement learning from human feedback, with Simple Preference Opt

Zero-shot Human Pose Estimation using Diffusion-based Inverse solvers

arXiv:2510.02043v2 Announce Type: replace Abstract: Pose estimation refers to tracking a human's full body posture, including their head, torso, arms, and legs. The problem is challenging in practical

10 days wasn't enough. Step 3.5 Flash⚡ is back on @NousResearch Portal free for the next 15 days!

Nous Research has made Step 3.5 Flash, a faster AI model variant, available again on their portal at no cost for a 15-day period following popular demand after an initial 10-day availability window. T

researchnous-research--x

4D Neural Voxel Splatting: Dynamic Scene Rendering with Voxelized Guassian Splatting

arXiv:2511.00560v2 Announce Type: replace Abstract: Although 3D Gaussian Splatting (3D-GS) achieves efficient rendering for novel view synthesis, extending it to dynamic scenes still results in substa

A Call to Lagrangian Action: Learning Population Mechanics from Temporal Snapshots

arXiv:2605.08550v1 Announce Type: new Abstract: The population dynamics of molecules, cells, and organisms are governed by a number of unknown forces. In the last decade, population dynamics have pred

A cell-decomposition based path planner for 3D navigation in constrained workspaces

arXiv:2605.10086v1 Announce Type: new Abstract: This paper proposes a cell decomposition algorithm for binary occupancy grids that ensures mutual complete visibility from each cell to at least one adj

researcharxiv-cs-ro

A Computational Operationalisation of Competing Maturational Theories of Syntactic Development via Statistical Grammar Induction

arXiv:2605.08476v1 Announce Type: new Abstract: This paper is concerned with what intermediate syntactic categories children acquire during first language development, and in what order. Maturational

A Controlled Diagnostic Study of Hardware-Induced Distortions in Hardware-Aware Training

arXiv:2605.09416v1 Announce Type: new Abstract: Hardware-aware training (HAT) is widely used to improve the robustness of neural networks on non-ideal AI accelerators, such as analog in-memory computi

A low-cost mockup to simulate robotic laser cutting in nuclear decommissioning

arXiv:2605.08947v1 Announce Type: new Abstract: This paper introduces a low-cost experimental mockup to simulate the laser cutting process of containers in nuclear decommissioning. It is composed of a

researcharxiv-cs-ro

A Market-Rule-Informed Neural Network for Efficient Imbalance Electricity Price Forecasting

arXiv:2605.09061v1 Announce Type: cross Abstract: Accurate and efficient imbalance electricity price forecasting is critical for industrial energy trading systems, especially as battery assets and aut

A Minimum Variance Path Principle for Accurate and Stable Score-Based Density Ratio Estimation

arXiv:2602.00834v4 Announce Type: replace-cross Abstract: Score-based methods are powerful across machine learning, but they face a paradox: theoretically path-independent, yet practically path-depend

A Paired Point-of-Care Ultrasound Dataset for Image Quality Enhancement and Benchmarking via a cGAN Baseline

arXiv:2605.08282v1 Announce Type: cross Abstract: Purpose: We aim to enhance the image quality of point-of-care ultrasound (POCUS) devices using deep learning and a novel paired dataset of POCUS and h

A PyTorch Library of Turing-Complete Neural Networks

arXiv:2605.08150v1 Announce Type: new Abstract: We present a PyTorch package that compiles neural networks and their weights from Turing machine descriptions, producing models that exactly simulate th

A Qualitative Test-Risk Mechanism for Scaling Behavior in Normalized Residual Networks

arXiv:2605.08297v1 Announce Type: cross Abstract: The scaling behavior, in which test performance often improves as model size and data increase, is a central empirical phenomenon in modern deep learn

A Random-Matrix Criterion for Initializing Gated Recurrent Neural Networks

arXiv:2605.10650v1 Announce Type: new Abstract: Proper weight initialization prior to training has historically been one of the key factors that helped kick off the deep learning revolution. Initializ

A Resilient Solution for Sewer Overflow Monitoring across Cloud and Edge

arXiv:2605.10592v1 Announce Type: new Abstract: Aging combined sewer systems in many historical cities are increasingly stressed by extreme rainfall events, which can trigger combined sewer overflows

A Robust Out-of-Distribution Detection Framework via Synergistic Smoothing

arXiv:2605.08191v1 Announce Type: cross Abstract: Reliable out-of-distribution (OOD) detection is a critical requirement for the safe deployment of machine learning systems. Despite recent progress, s

A Single-Layer Model Can Do Language Modeling

arXiv:2605.10643v1 Announce Type: new Abstract: Modern language models scale depth by stacking layers, each holding its own state - a per-layer KV cache in transformers, a per-layer matrix in Mamba, G

A Single Layer to Explain Them All:Understanding Massive Activations in Large Language Models

arXiv:2605.08504v1 Announce Type: new Abstract: We investigate the origins of massive activations in large language models (LLMs) and identify a specific layer named the extbf{Massive Emergence Layer

A Spectral Framework for Closed-Form Relative Density Estimation

arXiv:2605.10668v1 Announce Type: new Abstract: We propose a closed-form spectral framework for relative log-density estimation in linearly parameterized probabilistic models, including unnormalized a

A Tale of Two Problems: Multi-Task Bilevel Learning Meets Equality Constrained Multi-Objective Optimization

arXiv:2605.09094v1 Announce Type: new Abstract: In recent years, bilevel optimization (BLO) has attracted significant attention for its broad applications in machine learning. However, most existing w

A Two-Stage Motion-Aware Framework for mmWave-based Human Mesh Recovery

arXiv:2605.08530v1 Announce Type: new Abstract: Millimeter-wave (mmWave) radar has emerged as a promising sensing modality for human perception due to its robustness under challenging environmental co

A Unified Lyapunov-IQC Framework for Uniform Stability of Smooth Quadratic First-Order Accelerated Optimizers

arXiv:2605.08488v1 Announce Type: cross Abstract: We develop a unified Lyapunov-integral quadratic constraint (IQC) framework for establishing uniform stability of first-order accelerated optimization

A Visuo-Tactile Data Collection System with Haptic Feedback for Coarse-to-Fine Imitation Learning

arXiv:2605.08757v1 Announce Type: new Abstract: We present a visuo-tactile data-collection system that generates temporally structured, contact-rich demonstrations for imitation learning. Conventional

researcharxiv-cs-ro

Achieving Better Local Regret Bound for Online Non-Convex Bilevel Optimization

arXiv:2602.06457v2 Announce Type: replace Abstract: Online bilevel optimization (OBO) has emerged as a powerful framework for many machine learning problems. Prior works have developed several algorit

Active Testing of Large Language Models via Approximate Neyman Allocation

arXiv:2605.10075v1 Announce Type: new Abstract: Large language models (LLMs) require reliable evaluation from pre-training to test-time scaling, making evaluation a recurring rather than one-off cost.

Adaptive 3D Convolution for Remote Sensing Image Fusion

arXiv:2605.09455v1 Announce Type: new Abstract: Remote sensing image fusion aims to create a high-resolution multi/hyper-spectral image from a high-resolution image with limited spectral information a

Adaptive DNN Partitioning and Offloading in Heterogeneous Edge-Cloud Continuum

arXiv:2605.09623v1 Announce Type: cross Abstract: In recent years, the use of artificial intelligence on resource-constrained IoT devices has grown significantly. However, existing approaches to DNN p

Adaptive Memory Momentum via a Model-Based Framework for Deep Learning Optimization

arXiv:2510.04988v3 Announce Type: replace Abstract: The vast majority of modern deep learning models are trained with momentum-based first-order optimizers. The momentum term governs the optimizer's m

AdaptSplat: Adapting Vision Foundation Models for Feed-Forward 3D Gaussian Splatting

arXiv:2605.10239v1 Announce Type: new Abstract: This work explores a simple yet powerful lightweight adapter design for feed-forward 3D Gaussian Splatting (3DGS). Existing methods typically apply comp

Additive Atomic Forests for Symbolic Function and Antiderivative Discovery

arXiv:2605.08130v1 Announce Type: new Abstract: We present a framework for the simultaneous symbolic recovery of a function and its antiderivative from data. The framework rests on three ideas. First,

Advanced Tumor Segmentation in PET/CT Imaging: A Training Strategy Study with nnU-Net for AutoPET III

arXiv:2605.08161v1 Announce Type: new Abstract: Tumor segmentation in whole-body PET/CT imaging is crucial for precise disease evaluation and treatment planning. However, it remains challenging due to

Advancing AI for materials with MatterSim: experimental synthesis, faster simulation, and multi-task models

researchmicrosoft-research

MatterSim is expanding what AI can do for materials science—from faster large-scale simulations to MatterSim-MT, a new multi-task model for simulating properties beyond potential energy surfaces alone

Affine Tracing: A New Paradigm for Probabilistic Linear Solvers

arXiv:2605.10566v1 Announce Type: cross Abstract: Probabilistic linear solvers (PLSs) return probability distributions that quantify uncertainty due to limited computation in the solution of linear sy