research

The Expert Strikes Back: Interpreting Mixture-of-Experts Language Models at Expert Level

arXiv:2604.02178v2 Announce Type: replace-cross Abstract: Mixture-of-Experts (MoE) architectures have become the dominant choice for scaling Large Language Models (LLMs), activating only a subset of p

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

The Frequency Confound in Language-Model Surprisal and Metaphor Novelty

DGX agent

arXiv:2605.06506v2 Announce Type: replace Abstract: Language-model (LM) surprisal is widely used as a proxy for contextual predictability and has been reported to correlate with metaphor novelty judgm

researcharxiv-cs-cl

19 May 2026

The Geometry of Projection Heads: Conditioning, Invariance, and Collapse

arXiv:2605.17180v1 Announce Type: new Abstract: We develop a geometric theory of projection heads in self-supervised learning by modeling the head as a trainable Riemannian metric on the backbone repr

The IsalProgram Programming Language

arXiv:2605.17008v1 Announce Type: cross Abstract: We introduce IsalProgram (Instruction Set and Language for Programming), a novel assembly-like programming language with three distinctive theoretical

The Lattice Representation Hypothesis of Large Language Models

arXiv:2603.01227v2 Announce Type: replace Abstract: We propose the Lattice Representation Hypothesis of large language models: a symbolic backbone that grounds conceptual hierarchies and logical opera

The Loupe: A Plug-and-Play Attention Module for Amplifying Discriminative Features in Vision Transformers

arXiv:2508.16663v2 Announce Type: replace-cross Abstract: Fine-Grained Visual Classification (FGVC) requires models to focus on subtle, task-relevant regions rather than broad object context. We prese

The Score Kalman Filter

arXiv:2605.16644v1 Announce Type: cross Abstract: A central obstacle in nonlinear Bayesian filtering is representing the belief distribution. Moment-based filters address this by propagating polynomia

The Token Games: Evaluating Language Model Reasoning with Puzzle Duels

arXiv:2602.17831v2 Announce Type: replace Abstract: Evaluating the reasoning capabilities of Large Language Models is increasingly challenging as models improve. Human curation of hard questions is hi

The Unlearnability Phenomenon in RLVR for Language Models

arXiv:2605.16787v1 Announce Type: cross Abstract: Reinforcement Learning with Verifiable Reward (RLVR) has proven effective in improving Large Language Model's (LLM) reasoning ability. However, the le

This is INSANE: Trump’s DOJ says the government is now “FOREVER BARRED” from pursuing tax claims against Trump or his family as part of the …

This is INSANE: Trump’s DOJ says the government is now “FOREVER BARRED” from pursuing tax claims against Trump or his family as part of the “settlement.” The one-page document, signed by Deputy AG Tod

researchyann-lecun--x

To MRL or not to MRL: Text Embeddings are Robust to Truncation Without Matryoshka Embeddings, Except In Heavy Truncation Scenarios

arXiv:2605.16608v1 Announce Type: cross Abstract: Matryoshka Representation Learning (MRL) is a widely adopted approach for training text encoders so they provide useful text representations at variou

To Trust or Not to Trust: Authors' Response to AI-based Reviews

arXiv:2605.16623v1 Announce Type: cross Abstract: Large language models are increasingly discussed and used as tools that may assist with scholarly peer review, but empirical evidence regarding how au

Topo-GS: Continuous Volumetric Embedding of High-Dimensional Data via Topological Gaussian Splatting

arXiv:2605.17011v1 Announce Type: cross Abstract: Dimensionality reduction algorithms map high-dimensional data into visualizable 2D or 3D spaces, but traditionally rely on a discrete point-cloud para

Topological Data Analysis combined with Machine Learning for Predicting Permeability of Porous Media

arXiv:2605.17581v1 Announce Type: cross Abstract: Flow in porous media is difficult to address using standard analytical or numerical methods due to its complexity. However, since synthetic representa

TouchMap-OR: Multi-View 3D Mapping of Hand-Surface Contacts

arXiv:2605.17638v1 Announce Type: new Abstract: Hand-surface interactions between clinicians, patients, and medical equipment play a central role in pathogen transmission during medical procedures. Ho

Toward Near-Real-Time Marine Oil Spill Detection in SAR Imagery using Quantum-Assisted SVM

arXiv:2605.17217v1 Announce Type: cross Abstract: Marine oil spills require rapid detection to mitigate severe ecological and economic damage. While satellite-based Synthetic Aperture Radar (SAR) prov

Toward Template-Free Explainability for Monte Carlo Tree Search

arXiv:2605.16524v1 Announce Type: cross Abstract: Probabilistic search algorithms, such as Monte Carlo Tree Search (MCTS), have proven very effective in solving sequential decision-making tasks under

Towards Migrating Neural Network Implementations

arXiv:2511.02610v2 Announce Type: replace Abstract: The development of smart systems (i.e., systems enhanced with AI components) has thrived thanks to the rapid advancements in neural networks (NNs).

Towards Principled Test-Time Adaptation for Time Series Forecasting

arXiv:2605.17250v1 Announce Type: new Abstract: Test-time adaptation (TTA) has recently emerged as a promising approach for improving time series forecasting (TSF) under distribution shift. Existing T

Towards Robust Argumentative Essay Understanding via TIDE: An Interactive Framework with Trial and Debate

arXiv:2605.17247v1 Announce Type: new Abstract: Argumentative essays serve as a vital medium for assessing critical thinking and reasoning skills, yet there is limited works on accurately understandin

Towards Ubiquitous Mapping and Localization for Dynamic Indoor Environments

arXiv:2605.18385v1 Announce Type: cross Abstract: We present UbiSLAM, an innovative solution for real-time mapping and localization in dynamic indoor environments. By deploying a network of fixed RGB-

Toy Combinatorial Interpretability Models Reveal Lottery Tickets in Early Feature Space

arXiv:2605.17704v1 Announce Type: new Abstract: The lottery ticket hypothesis posits that dense networks contain sparse subnetworks, ``winning tickets,'' that, when rewound to their initial weights an

TRACE: Trajectory Correction from Cross-layer Evidence for Hallucination Reduction

arXiv:2605.18163v1 Announce Type: new Abstract: Hallucination correction is not a one-direction problem. We show that intermediate layers are neither uniformly more truthful than final layers nor unif

Training Infinitely Deep and Wide Transformers

arXiv:2605.17660v1 Announce Type: cross Abstract: Transformers have become the dominant architecture in modern machine learning, yet the theoretical understanding of their training dynamics remains li

Trump’s “Great” Economy: -7% mortgage rates -6% inflation -$5 gas -More unemployed than job openings for 1st time since pandemic -Lowest Con…

Trump’s “Great” Economy: -7% mortgage rates -6% inflation -$5 gas -More unemployed than job openings for 1st time since pandemic -Lowest Consumer Sentiment in 74 years -CC Delinquencies highest since

researchyann-lecun--x

Two-Valued Symmetric Circulant Matrices: Applications in Deep Learning

arXiv:2605.16443v1 Announce Type: cross Abstract: Despite the success of deep neural networks in vision, medical diagnosis, and IoT scenarios, their deployment on resource-limited platforms poses seri

UB-SMoE: Universally Balanced Sparse Mixture-of-Experts for Resource-adaptive Federated Fine-tuning of Foundation Models

arXiv:2605.16690v1 Announce Type: new Abstract: Heterogeneous LoRA-rank methods address system heterogeneity in federated fine-tuning of foundation models by assigning client-specific ranks based on c

Understanding In-Context Learning on Structured Manifolds: Bridging Attention to Kernel Methods

arXiv:2506.10959v3 Announce Type: replace-cross Abstract: While in-context learning (ICL) has achieved remarkable success in natural language and vision domains, its theoretical understanding-particul

Universal Adversarial Triggers

arXiv:2605.17936v1 Announce Type: new Abstract: Recent works have illustrated that modern NLP models trained for diverse tasks ranging from sentiment analysis to language generation succumb to univers

Universal Graph Backdoor Defense: A Feature-based Homophily Perspective

arXiv:2605.16815v1 Announce Type: cross Abstract: Graph neural networks (GNNs) have achieved remarkable success in relational learning. However, their vulnerability to graph backdoor attacks (GBAs) po

Universal Inverse Distillation for Matching Models with Real-Data Supervision (No GANs)

arXiv:2509.22459v4 Announce Type: replace-cross Abstract: While achieving exceptional generative quality, modern diffusion, flow, and other matching models suffer from slow inference, as they require

Unleashing Vision Transformer Potential In Image Quality Assessment via Global-Local Adaptive Interaction

arXiv:2605.17748v1 Announce Type: new Abstract: In the field of Blind Image Quality Assessment (BIQA), accurately predicting the perceptual quality of authentically distorted images remains highly cha

Unlocking the Potential of Diffusion Language Models through Template Infilling

arXiv:2510.13870v3 Announce Type: replace-cross Abstract: Diffusion Language Models (DLMs) have emerged as a promising alternative to Autoregressive Language Models, yet their inference strategies rem

UNR-Explainer: Counterfactual Explanations for Unsupervised Node Representation Learning Models

arXiv:2605.17285v1 Announce Type: cross Abstract: Node representation learning, such as Graph Neural Networks (GNNs), has emerged as a pivotal method in machine learning. The demand for reliable expla

UST-Hand: An Uncertainty-aware Spatiotemporal Point Cloud Interaction Network for 3D Self-supervised Hand Pose Estimation

arXiv:2605.17742v1 Announce Type: new Abstract: Manually annotating accurate 3D hand poses is extremely time-consuming and labor-intensive. Existing self-supervised hand pose estimation methods levera

VA-Adapter: Adapting Ultrasound Foundation Model to Echocardiography Probe Guidance

arXiv:2510.06809v3 Announce Type: replace Abstract: Echocardiography is a critical tool for detecting heart diseases, yet its steep operational difficulty causes a shortage of skilled personnel. Probe

Variational Optimality of Follmer Processes in Generative Diffusions

arXiv:2602.10989v2 Announce Type: replace-cross Abstract: We construct and analyze generative diffusions that transport a point mass to a prescribed target distribution over a finite time horizon usin

Vector RAG vs LLM-Compiled Wiki: A Preregistered Comparison on a Small Multi-Domain Research

arXiv:2605.18490v1 Announce Type: new Abstract: We preregistered a comparison of two ways to help an LLM answer questions over a small research corpus: a single-round Vector RAG system and an LLM-comp

Velocity and stroke rate reconstruction of canoe sprint team boats based on panned and zoomed video recordings

arXiv:2602.22941v2 Announce Type: replace Abstract: Pacing strategies, defined by velocity and stroke rate profiles, are essential for peak performance in canoe sprint. While GPS is the gold standard

VeriHGN: Heterogeneous Graph-Based Congestion Prediction for Chip Layout Verification

arXiv:2603.11075v2 Announce Type: replace-cross Abstract: As Very Large Scale Integration (VLSI) designs continue to scale in size and complexity, layout verification has become a central challenge in

VideoNeuMat: Neural Material Extraction from Generative Video Models

arXiv:2602.07272v2 Announce Type: replace Abstract: Creating photorealistic materials for 3D rendering requires exceptional artistic skill. Generative models for materials could help, but are currentl

Vidya: An AI-Driven Modular Pipeline for Archival Automation and Semantic Metadata Enrichment

arXiv:2605.16338v1 Announce Type: cross Abstract: The large-scale digitization of historical archives has created a paradox: 'dark data'-digital objects lacking metadata for retrieval. Manual archival

Virtual Nodes Guided Dynamic Graph Neural Network for Brain Tumor Segmentation with Missing Modalities

arXiv:2605.16880v1 Announce Type: new Abstract: Multimodal magnetic resonance imaging (MRI) is crucial for brain tumor segmentation, with many methods leveraging its four key modalities to capture com

Virtues of Ordered Chaos: Planning with Topple Actions in Tabletop Stack Rearrangement

arXiv:2605.17815v1 Announce Type: cross Abstract: Efficient object manipulation strategies have significant impact in automation applications. In this work, the stack rearrangement in tabletop setting

Vision Foundation Models as Generalist Tokenizers for Image Generation

arXiv:2605.18390v1 Announce Type: new Abstract: In this work, we explore the largely unexplored direction of building a generalist image tokenizer directly on top of a frozen vision foundation model (

VISTA: Triplet-Supervised Video Style Transfer with Diffusion Transformers

arXiv:2605.17312v1 Announce Type: new Abstract: Video style transfer aims to render videos in a target artistic style while preserving content, structure, and motion. While image stylization has advan

Visual Search Patterns in 3D Pancreatic Imaging: An Eye Tracking Study

arXiv:2605.16408v1 Announce Type: new Abstract: Eye tracking has emerged as a powerful tool for examining visual perception and search strategies in various domains, including medicine. While it is re

Visual Timelines of Police Encounters in Body-Worn Camera Footage: Operational Context and Activity Cataloging for Training and Analysis in OpenBWC

arXiv:2605.17095v1 Announce Type: cross Abstract: Law enforcement agencies are accumulating vast amounts of body-worn camera (BWC) footage. However, this remains operationally opaque. That is, analyst