research

RAT+: Train Dense, Infer Sparse -- Recurrence Augmented Attention for Dilated Inference

arXiv:2602.18196v3 Announce Type: replace Abstract: Structured dilated attention has an appealing inference-time efficiency knob: it reduces the FLOPs of attention and the KV cache size by a factor of

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

REALM: An RGB and Event Aligned Latent Manifold for Cross-Modal Perception

DGX agent

arXiv:2605.00271v1 Announce Type: new Abstract: Event cameras provide several unique advantages over standard frame-based sensors, including high temporal resolution, low latency, and robustness to ex

researcharxiv-cs-cv

4 May 2026

Representation in large language models

arXiv:2501.00885v2 Announce Type: replace Abstract: The extraordinary success of recent Large Language Models (LLMs) on a diverse array of tasks has led to an explosion of scientific and philosophical

Rethinking LLM Ensembling from the Perspective of Mixture Models

arXiv:2605.00419v1 Announce Type: cross Abstract: Model ensembling is a well-established technique for improving the performance of machine learning models. Conventionally, this involves averaging the

Revealing graph bandits for maximizing local influence

arXiv:2605.00489v1 Announce Type: new Abstract: We study a graph bandit setting where the objective of the learner is to detect the most influential node of a graph by requesting as little information

Reward Modeling from Natural Language Human Feedback

arXiv:2601.07349v3 Announce Type: replace Abstract: Reinforcement Learning with Verifiable reward (RLVR) on preference data has become the mainstream approach for training Generative Reward Models (GR

Riemannian MeanFlow

arXiv:2602.07744v3 Announce Type: replace Abstract: Diffusion and flow models have become the dominant paradigm for generative modeling on Riemannian manifolds, with successful applications in protein

ROSA: Robust and Energy-Efficient Microring-Based Optical Neural Networks via Optical Shift-and-Add and Layer-Wise Hybrid Mapping

arXiv:2605.00032v1 Announce Type: cross Abstract: This work presents ROSA, a microring-based optical neural network architecture that improves robustness and energy efficiency using an optical shift-a

RouteProfile: Elucidating the Design Space of LLM Profiles for Routing

arXiv:2605.00180v1 Announce Type: cross Abstract: As the large language model (LLM) ecosystem expands, individual models exhibit varying capabilities across queries, benchmarks, and domains, motivatin

Scale-Aware Adversarial Analysis: A Diagnostic for Generative AI in Multiscale Complex Systems

arXiv:2605.00510v1 Announce Type: cross Abstract: Complex physical systems, from supersonic turbulence to the macroscopic structure of the universe, are governed by continuous multiscale dynamics. Whi

Scaling Reasoning Hop Exposes Weaknesses: Demystifying and Improving Hop Generalization in Large Language Models

arXiv:2601.21214v2 Announce Type: replace Abstract: Chain-of-thought (CoT) reasoning has become the standard paradigm for enabling Large Language Models (LLMs) to solve complex problems. However, rece

SCAN: Structured Capability Assessment and Navigation for LLMs

arXiv:2505.06698v4 Announce Type: replace Abstract: Evaluating Large Language Models (LLMs) has become increasingly important, with automatic evaluation benchmarks gaining prominence as alternatives t

Score-based Greedy Search for Structure Identification of Partially Observed Linear Causal Models

arXiv:2510.04378v2 Announce Type: replace Abstract: Identifying the structure of a partially observed causal system is essential to various scientific fields. Recent advances have focused on constrain

Short Chains, Deep Thoughts: Balancing Reasoning Efficiency and Intra-Segment Capability via Split-Merge Optimization

arXiv:2602.03141v3 Announce Type: replace Abstract: While Large Reasoning Models (LRMs) have demonstrated impressive capabilities in solving complex tasks through the generation of long reasoning chai

SketchGuard: Scaling Byzantine-Robust Decentralized Federated Learning via Sketch-Based Screening

arXiv:2510.07922v4 Announce Type: replace Abstract: Decentralized Federated Learning (DFL) enables privacy-preserving collaborative training without centralized servers but remains vulnerable to Byzan

Smart Ensemble Learning Framework for Predicting Groundwater Heavy Metal Pollution

arXiv:2605.00056v1 Announce Type: new Abstract: Groundwater in the Densu Basin is increasingly threatened by heavy metal contamination, but conventional methods fail to capture the statistical complex

Something from Nothing: Data Augmentation for Robust Severity Level Estimation of Dysarthric Speech

arXiv:2603.15988v2 Announce Type: replace-cross Abstract: Dysarthric speech quality assessment (DSQA) is critical for clinical diagnostics and inclusive speech technologies. However, subjective evalua

Sparse VideoGen2: Accelerate Video Generation with Sparse Attention via Semantic-Aware Permutation

arXiv:2505.18875v4 Announce Type: replace Abstract: Diffusion Transformers (DiTs) are essential for video generation but suffer from significant latency due to the quadratic complexity of attention. B

Spiking Sequence Machines and Transformers

arXiv:2605.00662v1 Announce Type: cross Abstract: Sequence learning reduces to similarity-based retrieval over a temporally indexed representation space, a constraint on any sequence model, not a prop

SPLICE: Latent Diffusion over JEPA Embeddings for Conformal Time-Series Inpainting

arXiv:2605.00126v1 Announce Type: new Abstract: Generative models for time-series imputation achieve strong reconstruction accuracy, yet provide no finite-sample reliability guarantees, a critical lim

Statistical Testing Framework for Clustering Pipelines by Selective Inference

arXiv:2603.18413v3 Announce Type: replace-cross Abstract: A data analysis pipeline is a structured sequence of steps that transforms raw data into meaningful insights by integrating multiple analysis

Stepper: Stepwise Immersive Scene Generation with Multiview Panoramas

arXiv:2603.28980v2 Announce Type: replace Abstract: The synthesis of immersive 3D scenes from text is rapidly maturing, driven by novel video generative models and feed-forward 3D reconstruction, with

Structural Prognostic Event Modeling for Multimodal Cancer Survival Analysis

arXiv:2512.01116v3 Announce Type: replace Abstract: The integration of histology images and gene profiles has shown great promise for improving survival prediction in cancer. However, current approach

Structure Liberates: How Constrained Sensemaking Produces More Novel Research Output

arXiv:2605.00557v1 Announce Type: new Abstract: Scientific discovery is an extended process of ideation--surveying prior work, forming hypotheses, and refining reasoning--yet existing approaches treat

Sure About That Line? Approaching Confidence-Based, Real-Time Line Assignment in Reading Gaze Data

arXiv:2605.00033v1 Announce Type: cross Abstract: Remote and webcam-based eye tracking in multi-line reading suffers from various noise factors and layout ambiguity, precisely where real-time reading

Surprisingly High Redundancy in Electronic Structure Data Across Materials Explained by Low Intrinsic Dimensionality

arXiv:2507.09001v3 Announce Type: replace-cross Abstract: Machine learning (ML) models for electronic structure typically rely on large datasets generated by computationally expensive Kohn-Sham densit

Tailoring AI solutions for health care needs

The AI market is full of big promises of grand transformation. Health care is a prime target for those promises, beset as it is by financial pressures, labor shortages, and the growing burden of carin

researchmit-tech-review

Technical Report: Activation Residual Hessian Quantization (ARHQ) for Low-Bit LLM Quantization

arXiv:2605.00140v1 Announce Type: cross Abstract: We present Activation Residual Hessian Quantization (ARHQ), a post-training weight splitting method designed to mitigate error propagation in low-bit

Temporal Data Requirement for Predicting Unplanned Hospital Readmissions

arXiv:2605.00738v1 Announce Type: new Abstract: With the proliferation of Electronic Health Records (EHRs), a critical challenge in building predictive models is determining the optimal historical dat

The Algorithmic Gaze of Image Quality Assessment: An Audit and Trace Ethnography of the LAION-Aesthetics Predictor

arXiv:2601.09896v4 Announce Type: replace-cross Abstract: Visual generative AI models are trained using a one-size-fits-all measure of aesthetic appeal. However, what is deemed 'aesthetic' is inextric

The distillation panic

The article discusses concerns about the widespread use of knowledge distillation in AI development, where larger models' outputs are used to train smaller models, potentially creating a cycle of degr

researchinterconnects

The Hermes Kanban now supports unlimited boards/projects, and you can now subscribe to updates from a project to your home channel across th…

The Hermes Kanban now supports unlimited boards/projects, and you can now subscribe to updates from a project to your home channel across the gateway messengers you have setup! Just run `hermes update

researchnous-research--x

The Seismic Wavefield Common Task Framework

arXiv:2512.19927v2 Announce Type: replace Abstract: Seismology faces fundamental challenges in state forecasting and reconstruction (e.g., earthquake early warning and ground motion prediction) and ma

The Silent Thought: Modeling Internal Cognition in Full-Duplex Spoken Dialogue Models via Latent Reasoning

arXiv:2603.17837v3 Announce Type: replace-cross Abstract: During conversational interactions, humans subconsciously engage in concurrent thinking while listening to a speaker. Although this internal c

This could have covered the entire budget of the National Science Foundation for 10 years. Instead, Trump wants to reduce the NSF budget by …

This could have covered the entire budget of the National Science Foundation for 10 years. Instead, Trump wants to reduce the NSF budget by 50% (5B a year instead of 9B), which would decimate the Amer

researchyann-lecun--x

Thought Graph Traversal for Test-time Scaling in Chest X-ray VLLMs

arXiv:2506.11989v3 Announce Type: replace Abstract: Test-time scaling offers a promising way to improve the reasoning performance of vision-language large models (VLLMs) without additional training. I

Timing is Everything: Temporal Scaffolding of Semantic Surprise in Humor

arXiv:2605.00143v1 Announce Type: new Abstract: Humor is a fundamental cognitive phenomenon in which humans derive pleasure from the expectation violations and their resolution, exemplifying the brain

Token Sparse Attention: Efficient Long-Context Inference with Interleaved Token Selection

arXiv:2602.03216v2 Announce Type: replace Abstract: The quadratic complexity of attention remains the central bottleneck in long-context inference for large language models. Prior acceleration methods

Trading off rewards and errors in multi-armed bandits

arXiv:2605.00488v1 Announce Type: new Abstract: In multi-armed bandits, the most-explored arms are the most informative, while reward maximization typically pulls only the best arm. We study the trade

Trees to Flows and Back: Unifying Decision Trees and Diffusion Models

arXiv:2605.00414v1 Announce Type: new Abstract: Decision trees and diffusion models are ostensibly disparate model classes, one discrete and hierarchical, the other continuous and dynamic. This work u

Trident: Improving Malware Detection with LLMs and Behavioral Features

arXiv:2605.00297v1 Announce Type: cross Abstract: Traditionally, machine learning methods for PE malware detection have relied on static features like byte histograms, string information, and PE heade

Two-View Accumulation as the Primary Training Lever for Hybrid-Capture Gaussian Splatting: A Variance-Decomposition View of When Gradient Surgery Helps

arXiv:2605.00052v1 Announce Type: new Abstract: Hybrid-capture novel view synthesis combines images at substantially different camera distances (e.g., aerial drone and ground-level views). Standard 3D

Uncertainty Modeling for Multi-Objective RTA Interception with Distillation Acceleration

arXiv:2511.05582v2 Announce Type: replace Abstract: Real-Time Auction (RTA) Interception aims to filter out invalid or irrelevant traffic to enhance the integrity and reliability of downstream data. H

Understanding Cognitive States from Head & Hand Motion Data

arXiv:2509.24255v2 Announce Type: replace-cross Abstract: As virtual reality (VR) becomes widespread, head and hand motion data captured by consumer systems has become substantially more common. Howev

Unlearning Offline Stochastic Multi-Armed Bandits

arXiv:2605.00638v1 Announce Type: new Abstract: Machine unlearning aims to unlearn data points from a learned model, offering a principled way to process data-deletion requests and mitigate privacy ri

Unsupervised Denoising of Real Clinical Low Dose Liver CT with Perceptual Attention Networks

arXiv:2605.00793v1 Announce Type: cross Abstract: With the development of deep learning, medical image processing has been widely used to assist clinical research. This paper focuses on the denoising

VANISHING CULTURE is out now! From Internet Archive, this book looks at what is disappearing online. 🌐 Websites vanish 🗞️ News archives go…

VANISHING CULTURE is out now! From Internet Archive, this book looks at what is disappearing online. 🌐 Websites vanish 🗞️ News archives go offline 🎮 Games become unplayable 📼 Personal media breaks & b

researchyann-lecun--x

VecSet-Edit: Unleashing Pre-trained LRM for Mesh Editing from Single Image

arXiv:2602.04349v2 Announce Type: replace Abstract: 3D editing has emerged as a critical research area to provide users with flexible control over 3D assets. While current editing approaches predomina