Search: “research”

LoopUS: Recasting Pretrained LLMs into Looped Latent Refinement Models

arXiv:2605.11011v1 Announce Type: new Abstract: Looped computation shows promise in improving the reasoning-oriented performance of LLMs by scaling test-time compute. However, existing approaches typi

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Lower bounds for one-layer transformers that compute parity

DGX agent

arXiv:2605.12171v1 Announce Type: new Abstract: This note shows that no self-attention layer post-processed by a rational function can sign-represent the parity function unless the product of the numb

researcharxiv-cs-lg

13 May 2026

Machine Learning for neutron source distributions

arXiv:2605.12165v1 Announce Type: cross Abstract: In light of the recent advancements in machine learning, we propose a novel approach to neutron source distribution estimation through the utilisation

MambaNetBurst: Direct Byte-level Network Traffic Classification without Tokenization or Pretraining

arXiv:2605.11034v1 Announce Type: cross Abstract: We present MambaNetBurst, a compact tokenizer-free byte-level sequence classifier for network burst classification based on a Mamba-2 backbone. In con

Manifold Sampling via Entropy Maximization

arXiv:2605.12338v1 Announce Type: new Abstract: Sampling from constrained distributions has a wide range of applications, including in Bayesian optimization and robotics. Prior work establishes conver

Mapping Embodied Affective Touch Strategies on a Humanoid Robot

arXiv:2605.11825v1 Announce Type: new Abstract: Affective touch in human-robot interaction is shaped not only by emotional intent, but also by robot embodiment, including touch location, physical cons

researcharxiv-cs-ro

Martingale-Consistent Self-Supervised Learning

arXiv:2605.11846v1 Announce Type: new Abstract: Self-supervised learning (SSL) is often deployed under changing information, such as shorter histories, missing features, or partially observed images.

MetaColloc: Optimization-Free PDE Solving via Meta-Learned Basis Functions

arXiv:2605.12368v1 Announce Type: new Abstract: Solving partial differential equations (PDEs) with machine learning typically requires training a new neural network for every new equation. This optimi

MieDB-100k: A Comprehensive Dataset for Medical Image Editing

arXiv:2602.09587v2 Announce Type: replace Abstract: The scarcity of high-quality data remains a primary bottleneck in adapting multimodal generative models for medical image editing. Existing medical

Minimax Rates and Spectral Distillation for Tree Ensembles

arXiv:2605.11841v1 Announce Type: cross Abstract: Tree ensembles such as random forests (RFs) and gradient boosting machines (GBMs) are among the most widely used supervised learners, yet their theore

Missingness-MDPs: Bridging the Theory of Missing Data and POMDPs

arXiv:2605.12262v1 Announce Type: cross Abstract: We introduce missingness-MDPs (miss-MDPs), a novel subclass of partially observable Markov decision processes (POMDPs) that incorporates the theory of

MIST: Reliable Streaming Decision Trees for Online Class-Incremental Learning via McDiarmid Bound

arXiv:2605.11617v1 Announce Type: new Abstract: Streaming decision trees are natural candidates for open-world continual learning, as they perform local updates, enjoy bounded memory, and static decis

Mobile Traffic Camera Calibration from Road Geometry for UAV-Based Traffic Surveillance

arXiv:2605.11900v1 Announce Type: new Abstract: Unmanned aerial vehicles (UAVs) can provide flexible traffic surveillance where fixed roadside cameras are unavailable, costly, or impractical. However,

Modeling Narrative Structure in Latin Epic Poetry with Automatically Generated Story Grammars

arXiv:2502.12276v2 Announce Type: replace Abstract: Computational methods for analyzing prose and poetry utilize word embeddings and other abstract representations that sometimes obscure context-rich

Molecular Design beyond Training Data with Novel Extended Objective Functionals of Generative AI Models Driven by Quantum Annealing Computer

arXiv:2602.15451v3 Announce Type: replace-cross Abstract: Deep generative modeling to stochastically design small molecules is an emerging technology for accelerating drug discovery and development. H

Monitoring access to piped water and sanitation infrastructure in Africa at disaggregated scales using satellite imagery and self-supervised learning

arXiv:2411.19093v4 Announce Type: replace Abstract: Access to drinking water and sanitation services is essential for health and well-being, yet large global disparities persist. Sustainable Developme

more demos on Interaction Models collaboratively doing system design, reading papers, fact-checking with live generative UI

researchsoumith-chintala--x

more demos on Interaction Models collaboratively doing system design, reading papers, fact-checking with live generative UI 1. (System design) - The Interaction Models see your screen and collaborates

Much of Geospatial Web Search Is Beyond Traditional GIS

arXiv:2605.11336v1 Announce Type: cross Abstract: Web search queries concern place far more often than existing labelling schemes suggest, yet the landscape of geospatial web search queries - what peo

Multi-Timescale Conductance Spiking Networks: A Sparse, Gradient-Trainable Framework with Rich Firing Dynamics for Enhanced Temporal Processing

arXiv:2605.11835v1 Announce Type: cross Abstract: Spiking neural networks (SNNs) promise low-power event-driven computation for temporally rich tasks, but commonly used neuron models often trade off g

Not Worth Mentioning? A Pilot Study on Salient Proposition Annotation

arXiv:2603.27358v2 Announce Type: replace Abstract: Despite a long tradition of work on extractive summarization, which by nature aims to recover the most important propositions in a text, little work

On Predicting the Post-training Potential of Pre-trained LLMs

arXiv:2605.11978v1 Announce Type: new Abstract: The performance of Large Language Models (LLMs) on downstream tasks is fundamentally constrained by the capabilities acquired during pre-training. Howev

On the Approximation Complexity of Matrix Product Operator Born Machines

arXiv:2605.11471v1 Announce Type: new Abstract: Matrix product operator Born machines (MPO-BMs) are tractable tensor-network models for probabilistic modeling, but their efficient approximation capabi

One-Step Generative Modeling via Wasserstein Gradient Flows

arXiv:2605.11755v1 Announce Type: cross Abstract: Diffusion models and flow-based methods have shown impressive generative capability, especially for images, but their sampling is expensive because it

Operator Spectroscopy of Trained Lattice Samplers

arXiv:2605.11199v1 Announce Type: cross Abstract: Trained lattice samplers are usually judged by the ensembles they generate. Here we instead analyze the trained field-space function itself: a flow-ma

Optimal Representations for Generalized Contrastive Learning with Imbalanced Datasets

arXiv:2605.11291v1 Announce Type: new Abstract: In this paper, we provide a computable characterization of the geometry of optimal representations in Contrastive Learning (CL) when the classes are imb

Optimistic Dual Averaging Unifies Modern Optimizers

arXiv:2605.11172v1 Announce Type: new Abstract: We introduce SODA, a generalization of Optimistic Dual Averaging, which provides a common perspective on state-of-the-art optimizers like Muon, Lion, Ad

ORBIT: Preserving Foundational Language Capabilities in GenRetrieval via Origin-Regulated Merging

arXiv:2605.12419v1 Announce Type: new Abstract: Despite the rapid advancements in large language model (LLM) development, fine-tuning them for specific tasks often results in the catastrophic forgetti

Oscillators Are All You Need: Irregular Time Series Modelling via Damped Harmonic Oscillators with Closed-Form Solutions

arXiv:2602.12139v2 Announce Type: replace Abstract: Transformers excel at time series modelling through attention mechanisms that capture long-term temporal patterns. However, they assume uniform time

OTT-Vid: Optimal Transport Temporal Token Compression for Video Large Language Models

arXiv:2605.11803v1 Announce Type: new Abstract: As Video Large Language Models (Video-LLMs) scale to longer and more complex videos, their inference cost grows rapidly due to the large volume of visua

Overparametrized models with posterior drift

arXiv:2506.23619v2 Announce Type: replace-cross Abstract: This paper investigates the impact of posterior drift on out-of-sample forecasting accuracy in overparametrized machine learning models. We do

PairDropGS: Paired Dropout-Induced Consistency Regularization for Sparse-View Gaussian Splatting

arXiv:2605.12072v1 Announce Type: new Abstract: Dropout-based sparse-view 3D Gaussian Splatting (3DGS) methods alleviate overfitting by randomly suppressing Gaussian primitives during training. Existi

Parabolic Position Encoding: Vision-Centric, Principled, Extrapolatable, General

arXiv:2602.01418v2 Announce Type: replace Abstract: We propose Parabolic Position Encoding (PaPE), a parabola-based position encoding for vision modalities in attention-based architectures. Given a se

Partial Model Sharing Improves Byzantine Resilience in Federated Conformal Prediction

arXiv:2605.11684v1 Announce Type: new Abstract: We propose a Byzantine-resilient federated conformal prediction (FCP) method that leverages partial model sharing, where only a subset of model paramete

Partition Tree: Conditional Density Estimation over General Outcome Spaces

arXiv:2602.04042v2 Announce Type: replace Abstract: We propose Partition Tree, a novel tree-based framework for conditional density estimation over general outcome spaces that supports both continuous

PENEX: AdaBoost-Inspired Neural Network Regularization

arXiv:2510.02107v4 Announce Type: replace Abstract: AdaBoost sequentially fits so-called weak learners to minimize an exponential loss, which penalizes misclassified data points more severely than oth

Physics Aware Neural Networks: Denoising for Magnetic Navigation

arXiv:2602.13690v2 Announce Type: replace Abstract: Magnetic-anomaly navigation, leveraging small-scale variations in the Earth's magnetic field, is a promising alternative when GPS is unavailable or

Pion: A Spectrum-Preserving Optimizer via Orthogonal Equivalence Transformation

arXiv:2605.12492v1 Announce Type: new Abstract: We introduce Pion, a spectrum-preserving optimizer for large language model (LLM) training based on orthogonal equivalence transformation. Unlike additi

PointCaM: Cut-and-Mix for Open-Set Point Cloud Learning

arXiv:2212.02011v3 Announce Type: replace Abstract: Point cloud learning is receiving increasing attention. However, most existing point cloud models lack the practical ability to deal with the unavoi

Predicting Disagreement with Human Raters in LLM-as-a-Judge Difficulty Assessment without Using Generation-Time Probability Signals

arXiv:2605.12422v1 Announce Type: new Abstract: Automatic generation of educational materials using large language models (LLMs) is becoming increasingly common, but assigning difficulty levels to suc

Pretraining Strategies and Scaling for ECG Foundation Models: A Systematic Study

arXiv:2605.12241v1 Announce Type: cross Abstract: Specialized foundation models are beginning to emerge in various medical subdomains, but pretraining methodologies and parametric scaling with the siz

Principle-Guided Supervision for Interpretable Uncertainty in Medical Image Segmentation

arXiv:2605.10984v1 Announce Type: new Abstract: Uncertainty quantification complements model predictions by characterizing their reliability, which is essential for high-stakes decision making such as

Principled Design of Diffusion-based Optimizers for Inverse Problems

arXiv:2605.11506v1 Announce Type: new Abstract: Score-based diffusion models achieve state-of-the-art performance for inverse problems, but their practical deployment is hindered by long inference tim

Principled Latent Diffusion for Graphs via Laplacian Autoencoders

arXiv:2601.13780v3 Announce Type: replace Abstract: Graph diffusion models achieve state-of-the-art performance in graph generation but suffer from quadratic complexity in the number of nodes -- and m

Pure Exploration Beyond Reward Feedback: The Role of Post-Action Context

arXiv:2502.03061v2 Announce Type: replace Abstract: We introduce the problem of best arm identification (BAI) with post-action context, a new BAI problem in a stochastic multi-armed bandit environment

Quantifying Rodda and Graham Gait Classification from 3D Makerless Kinematics derived from a Single-view Video in a Heterogeneous Pediatric Clinical Cohort

arXiv:2605.11314v1 Announce Type: new Abstract: Cerebral Palsy (CP) is a neurological disorder of movement and the most common cause of lifelong physical disability in childhood. Approximately 75% of

Read, Extract, Classify: A Tool for Smarter Requirements Engineering

arXiv:2605.11045v1 Announce Type: cross Abstract: This paper presents the ReXCL tool, which automates the extraction and classification processes in requirements engineering, enhancing the software de

ReAD: Reinforcement-Guided Capability Distillation for Large Language Models

arXiv:2605.11290v1 Announce Type: new Abstract: Capability distillation applies knowledge distillation to selected model capabilities, aiming to compress a large language model (LLM) into a smaller on

RealDiffusion: Physics-informed Attention for Multi-character Storybook Generation

arXiv:2605.11927v1 Announce Type: new Abstract: While modern diffusion models excel at generating diverse single images, extending this to sequential generation reveals a fundamental challenge: balanc