All entries

@ivanfioravanti @Prince_Canuma @huggingface this is a fully local stack to get your Reachy Mini running (with vision/tts/stt) on a mac. Uses…

@ivanfioravanti @Prince_Canuma @huggingface this is a fully local stack to get your Reachy Mini running (with vision/tts/stt) on a mac. Uses mlx-vlm, mlx-audio, gemma4 It contains some examples to run

local-aiclem-delangue--x

Content type

All Blog X Post Paper YouTube Reddit GitHub

Model Releases

jina-embeddings-v5-omni: Text-Geometry-Preserving Multimodal Embeddings via Frozen-Tower Composition

DGX agent

arXiv:2605.08384v1 Announce Type: new Abstract: In this work, we introduce frozen-encoder model composition, a novel approach to multimodal embedding models. We build on the VLM-style architecture, in

model-releasesarxiv-cs-cl

12 May 2026

jNO: A JAX Library for Neural Operator and Foundation Model Training

model-releasesarxiv-cs-lg

arXiv:2605.10159v1 Announce Type: new Abstract: jNO (jax Neural Operators) is a JAX-native library for neural operators and foundation models with unified support for both data-driven and physics-info

JODA: Composable Joint Dynamics for Articulated Objects

model-releasesarxiv-cs-cv

arXiv:2605.09954v1 Announce Type: cross Abstract: Articulated objects used in simulation and embodied AI are typically specified by geometry and kinematic structure, but lack the fine-grained dynamica

Join us for a live build session exploring Hermes Agent integrated with ComfyUI. If you're already comfortable navigating ComfyUI workflows …

Join us for a live build session exploring Hermes Agent integrated with ComfyUI. If you're already comfortable navigating ComfyUI workflows and want to understand what an agent layer brings to the tab

agentscomfyui--x

Joint sparse coding and temporal dynamics support context reconfiguration

arXiv:2605.10178v1 Announce Type: cross Abstract: Adaptive behavior requires the brain to transition between distinct contexts while maintaining representations of prior experience. The ability to rec

JUST-DUB-IT: Video Dubbing via Joint Audio-Visual Diffusion

arXiv:2601.22143v2 Announce Type: replace-cross Abstract: Audio-Visual Foundation Models, which are pretrained to jointly generate sound and visual content, have recently shown an unprecedented abilit

applicationsarxiv-cs-cv

Industry

Just ordered Reachy! Can't wait to do some fun projects with my kids.

Just ordered Reachy! Can't wait to do some fun projects with my kids. Reachy is mad, but RAM costs + tariffs are forcing our hand. Prices will go up on June 1st! Still at the early bird price until th

industryclem-delangue--x

K12-KGraph: A Curriculum-Aligned Knowledge Graph for Benchmarking and Training Educational LLMs

arXiv:2605.09635v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used in K-12 education, yet existing benchmarks such as C-Eval, CMMLU, GaokaoBench, and EduEval mainly eva

Kaczmarz Linear Attention

arXiv:2605.08587v1 Announce Type: cross Abstract: Long-context language modeling remains central to modern sequence modeling, but the quadratic cost of Transformer attention makes scaling computationa

KAN Text to Vision? The Exploration of Kolmogorov-Arnold Networks for Multi-Scale Sequence-Based Pose Animation from Sign Language Notation

arXiv:2605.09572v1 Announce Type: cross Abstract: Sign language production from symbolic notation offers a scalable route to accessible sign animation. We present KANMultiSign, a multi-scale sequence

KARMA-MV: A Benchmark for Causal Question Answering on Music Videos

arXiv:2605.08175v1 Announce Type: cross Abstract: While significant progress has been made in Video Question Answering and cross-modal understanding, causal reasoning about how visual dynamics drive m

KEPIL: Knowledge-Enhanced Prompt-Image Learning for Prompt-Robust Disease Detection

model-releasesarxiv-cs-cv

arXiv:2605.09132v1 Announce Type: new Abstract: Vision--language models (VLMs) show promise for clinical decision support in radiology because they enable joint reasoning over radiological images and

Kernel-Gradient Drifting Models

arXiv:2605.10727v1 Announce Type: new Abstract: We propose kernel-gradient drifting, a one-step generative modeling framework that replaces the fixed Euclidean displacement direction in drifting model

Key Coverage Matters: Semi-Structured Extraction of OCR Clinical Reports

arXiv:2605.09440v1 Announce Type: cross Abstract: Clinical reports are often fragmented across healthcare institutions because privacy regulations and data silos limit direct information sharing. When

applicationsarxiv-cs-ai

Key-Value Means

arXiv:2605.09877v1 Announce Type: cross Abstract: We present Key-Value Means ('KVM'), a novel block-recurrence for attention that can accommodate either fixed-size or growing state. Equipping a strong

KeyframeFace: Language-Driven Facial Animation via Semantic Keyframes

arXiv:2512.11321v3 Announce Type: replace Abstract: Facial animation is a core component for creating digital characters in Computer Graphics (CG) industry. A typical production workflow relies on spa

safetyarxiv-cs-cv

Kinematics-Driven Gaussian Shape Deformation for Blurry Monocular Dynamic Scenes

arXiv:2605.08635v1 Announce Type: new Abstract: Reconstructing dynamic 3D scenes from blurry monocular videos is challenging as motion-induced blur entangles object motion and geometry, hindering geom

applicationsarxiv-cs-cv

Kinetic-Optimal Scheduling with Moment Correction for Metric-Induced Discrete Flow Matching in Zero-Shot Text-to-Speech

arXiv:2605.09386v1 Announce Type: cross Abstract: Metric-induced discrete flow matching (MI-DFM) exploits token-latent geometry for discrete generation, but its practical use is limited by two issues:

Kinetic theory for Transformers and the lost-in-the-middle phenomenon

arXiv:2605.09213v1 Announce Type: cross Abstract: We study causal self-attention dynamics -- a toy model for decoder Transformers -- which we interpret as a non-exchangeable interacting particle syste

Kintsugi: Learning Policies by Repairing Executable Knowledge Bases

arXiv:2605.09487v1 Announce Type: new Abstract: Modern embodied agents achieve impressive performance, but their task knowledge is often stored in neural weights, latent state, or prompt-bound memory,

local-aiarxiv-cs-lg

Knowledge is Not Enough: Injecting RL Skills for Continual Adaptation

arXiv:2601.11258v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) face the 'knowledge cutoff' challenge, where their frozen parametric memory prevents direct internalization of ne

Knowledge Poisoning Attacks on Medical Multi-Modal Retrieval-Augmented Generation

arXiv:2605.10253v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG) is a widely adopted paradigm for enhancing LLMs in medical applications by incorporating expert multimodal knowle

KV-RM: Regularizing KV-Cache Movement for Static-Graph LLM Serving

arXiv:2605.09735v1 Announce Type: cross Abstract: Static-graph LLM decoders provide predictable launches, fixed tensor shapes, and low submission overhead, but online decoding exposes highly irregular

L2A: Learning to Accumulate Pose History for Accurate 3D Human Pose Estimation

arXiv:2605.08806v1 Announce Type: new Abstract: Existing 2D-3D lifting human pose estimation methods have achieved strong performance. But the utilization of historical pose representations across net

researcharxiv-cs-cv

LAGO: Language-Guided Adaptive Object-Region Focus for Zero-Shot Visual-Text Alignment

arXiv:2605.08156v1 Announce Type: cross Abstract: Zero-shot recognition aims to classify an image by selecting the most compatible label description from a set of candidate classes without any task-sp

local-aiarxiv-cs-ai

LagrangianSplats: Divergence-Free Transport of Gaussian Primitives for Fluid Reconstruction

arXiv:2605.09299v1 Announce Type: cross Abstract: Reconstructing 3D fluid velocity fields from sparse 2D video observations is a highly ill-posed inverse problem, demanding both transport consistency

applicationsarxiv-cs-lg

Lakestream: A Consistent and Brokerless Data Plane for Large Foundation Model Training

arXiv:2605.09994v1 Announce Type: cross Abstract: Modern Large Foundation Model (LFM) training has transformed the data pipeline from a static ingestion layer into a dynamic component that must co-evo

Language Conditioned Multi-Finger Dexterous Manipulation Enabled by Physical Compliance and Switching of Controllers

arXiv:2410.14022v2 Announce Type: replace-cross Abstract: Human dexterity arises from combining high-level task reasoning with finger-level dexterity control and physical compliance at the muscle and

Language-Conditioned Visual Grounding with CLIP Multilingual

arXiv:2605.09060v1 Announce Type: new Abstract: Multilingual vision-language models exhibit systematic performance gaps across languages, but the mechanism remains ambiguous: cross-language divergence

researcharxiv-cs-cl

Language Models Without a Trainable Input Embedding Table: Learning from Fixed Minimal Binary Token Codes

arXiv:2605.09751v1 Announce Type: new Abstract: Trainable input embedding tables are a standard component of modern language models. We ask whether they are actually necessary at the input interface.

Laplacian Heads Improve Transformers by Smoothing Token Representations

arXiv:2602.09297v2 Announce Type: replace Abstract: Transformers update token representations through multi-head attention and residual connections as X leftarrow X + sum_{i} P^{(i)}XW_{V_i}W_{o_i}, w

LAQuant: A Simple Overhead-free Large Reasoning Model Quantization by Layer-wise Lookahead Loss

arXiv:2605.08755v1 Announce Type: new Abstract: Large reasoning models (LRMs) reach competition-level math and coding accuracy via long autoregressive decoding, making per-token decoding cost a primar

safetyarxiv-cs-lg

Large Language Models as Students Who Think Aloud: Overly Coherent, Verbose, and Confident

arXiv:2602.01015v2 Announce Type: replace Abstract: Large language models (LLMs) are increasingly embedded in AI-based tutoring systems. Can they faithfully model novice reasoning and metacognitive ju

Large Language Models for Sequential Decision-Making: Improving In-Context Learning via Supervised Fine-Tuning

arXiv:2605.09009v1 Announce Type: cross Abstract: Large language models (LLMs) have shown remarkable in-context learning (ICL) capabilities, yet their potential for sequential decision-making remains

Large Language Models over Networks: Collaborative Intelligence under Resource Constraints

arXiv:2605.08626v1 Announce Type: cross Abstract: Large language models (LLMs) are transforming society, powering applications from smartphone assistants to autonomous driving. Yet cloud-based LLM ser

local-aiarxiv-cs-lg

LASSA Architecture-Based Autonomous Fault-Tolerant Control of Unmanned Underwater Vehicles

arXiv:2605.09494v1 Announce Type: cross Abstract: Unmanned underwater vehicles (UUVs) operate persistently in communication-constrained environments, thus requiring high-level autonomous fault-toleran

agentsarxiv-cs-ai

Latency Analysis and Optimization of Alpamayo 1 via Efficient Trajectory Generation

arXiv:2605.08975v1 Announce Type: new Abstract: Reasoning-based end-to-end (E2E) autonomous driving has recently emerged as a promising approach to improving the interpretability of driving decisions

agentsarxiv-cs-ai

Latent Geometry Beyond Search: Amortizing Planning in World Models

model-releasesarxiv-cs-lg

arXiv:2605.08732v1 Announce Type: cross Abstract: Modern vision-based world models can represent observations as compact yet expressive latent manifolds, but fast goal-oriented planning in these space

Latent Personality Alignment: Improving Harmlessness Without Mentioning Harms

arXiv:2605.08496v1 Announce Type: new Abstract: Current adversarial robustness methods for large language models require extensive datasets of harmful prompts (thousands to hundreds of thousands of ex

Lattice Deduction Transformers

arXiv:2605.08605v1 Announce Type: cross Abstract: We introduce the Lattice Deduction Transformer (LDT), a recurrent transformer that approximates logically sound deduction by projecting its latent sta

LaWM: Least Action World Models for Long-Horizon Physical Consistency from Visual Observations

arXiv:2605.08279v1 Announce Type: cross Abstract: Learning predictive world models from visual observations is a core problem in embodied AI, with applications to model-based reinforcement learning an

Layer Collapse in Diffusion Language Models

model-releasesarxiv-cs-lg

arXiv:2605.06366v2 Announce Type: replace Abstract: Diffusion language models (DLMs) have recently emerged as competitive alternatives to autoregressive (AR) language models, yet differences in their

LBI: Parallel Scan Backpropagation via Latent Bounded Interfaces

arXiv:2605.09204v1 Announce Type: new Abstract: Backpropagation is inherently sequential across depth, creating an O(K)-deep dependency chain that bottlenecks parallel training. While parallel-scan fo

LCGNav: Local Candidate-Aware Geometric Enhancement for General Topological Planning in Vision-Language Navigation

arXiv:2605.09053v1 Announce Type: new Abstract: Online topological planning has become an effective paradigm for Vision-Language Navigation in Continuous Environments (VLN-CE), but existing methods st

agentsarxiv-cs-cv

LE-PAVD: Learning-Enhanced Physics-Aware Vehicle Dynamics for High-Speed Autonomous Navigation

arXiv:2605.08489v1 Announce Type: new Abstract: Accurate modeling of nonlinear vehicle dynamics is essential for high-speed autonomous racing, where controllers operate at the handling limits. Model-b

agentsarxiv-cs-ro

LEAD: Length-Efficient Adaptive and Dynamic Reasoning for Large Language Models

arXiv:2605.09806v1 Announce Type: cross Abstract: Large reasoning models, such as OpenAI o1 and DeepSeek-R1, tend to become increasingly verbose as their reasoning capabilities improve. These inflated

LEAF-SQL: Level-wise Exploration with Adaptive Fine-graining for Text-to-SQL Skeleton Prediction

arXiv:2605.09295v1 Announce Type: new Abstract: Text-to-SQL translates natural language questions into executable SQL queries, enabling intuitive database access for non-experts. While large language