Search: “multimodal”

Hyperbolic Distillation: Geometry-Guided Cross-Modal Transfer for Robust 3D Object Detection

arXiv:2605.09899v1 Announce Type: cross Abstract: Cross-modal knowledge distillation has emerged as an effective strategy for integrating point cloud and image features in 3D perception tasks. However

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

JODA: Composable Joint Dynamics for Articulated Objects

DGX agent

arXiv:2605.09954v1 Announce Type: cross Abstract: Articulated objects used in simulation and embodied AI are typically specified by geometry and kinematic structure, but lack the fine-grained dynamica

model-releasesarxiv-cs-cv

12 May 2026

KeyframeFace: Language-Driven Facial Animation via Semantic Keyframes

arXiv:2512.11321v3 Announce Type: replace Abstract: Facial animation is a core component for creating digital characters in Computer Graphics (CG) industry. A typical production workflow relies on spa

Lakestream: A Consistent and Brokerless Data Plane for Large Foundation Model Training

arXiv:2605.09994v1 Announce Type: cross Abstract: Modern Large Foundation Model (LFM) training has transformed the data pipeline from a static ingestion layer into a dynamic component that must co-evo

researcharxiv-cs-lg

Learning More from Less: Exploiting Counterfactuals for Data-Efficient Chart Understanding

arXiv:2605.10855v1 Announce Type: new Abstract: Vision-Language Models (VLMs) have demonstrated remarkable progress in chart understanding, largely driven by supervised fine-tuning (SFT) on increasing

researcharxiv-cs-cl

LoopVLA: Learning Sufficiency in Recurrent Refinement for Vision-Language-Action Models

arXiv:2605.09948v1 Announce Type: new Abstract: Current Vision-Language-Action (VLA) models typically treat the deepest representation of a vision-language backbone as universally optimal for action p

safetyarxiv-cs-ai

MaD Physics: Evaluating information seeking under constraints in physical environments

arXiv:2605.10820v1 Announce Type: new Abstract: Scientific discovery is fundamentally a resource-constrained process that requires navigating complex trade-offs between the quality and quantity of mea

MemQ: Integrating Q-Learning into Self-Evolving Memory Agents over Provenance DAGs

arXiv:2605.08374v1 Announce Type: new Abstract: Episodic memory allows LLM agents to accumulate and retrieve experience, but current methods treat each memory independently, i.e., evaluating retrieval

Omni-DeepSearch: A Benchmark for Audio-Driven Omni-Modal Deep Search

model-releasesarxiv-cs-lg

arXiv:2605.08762v1 Announce Type: cross Abstract: Current omni-modal benchmarks mainly evaluate models under settings where multiple modalities are provided simultaneously, while the ability to start

ORICF -- Open Robotics Inference and Control Framework

arXiv:2605.09656v1 Announce Type: new Abstract: Recent advances in artificial intelligence (AI) have enabled effective perception and language models for robots, but their deployment remains computati

researcharxiv-cs-ro

RoboMemArena: A Comprehensive and Challenging Robotic Memory Benchmark

model-releasesarxiv-cs-ro

arXiv:2605.10921v1 Announce Type: new Abstract: Memory is a critical component of robotic intelligence, as robots must rely on past observations and actions to accomplish long-horizon tasks in partial

Agents

SAGE: Agentic Framework for Interpretable and Clinically Translatable Computational Pathology Biomarker Discovery

arXiv:2602.00953v2 Announce Type: replace Abstract: Engineered image-based biomarkers offer a clinically interpretable alternative to black-box AI in computational pathology, yet their discovery remai

agentsarxiv-cs-lg

SEMASIA: A Large-Scale Dataset of Semantically Structured Latent Representations

model-releasesarxiv-cs-lg

arXiv:2605.09485v1 Announce Type: new Abstract: Latent representations learned by neural networks often exhibit semantic structure, where concept similarity is reflected by geometric proximity in embe

Sens-VisualNews: A Benchmark Dataset for Sensational Image Detection

arXiv:2605.10394v1 Announce Type: new Abstract: The detection of sensational content in media items can be a critical filtering mechanism for identifying check-worthy content and flagging potential di

SGC-RML: A reliable and interpretable longitudinal assessment for PD in real-world DNS

arXiv:2605.08302v1 Announce Type: cross Abstract: Real-world digital Parkinson's disease assessment faces challenges such as heterogeneous modalities, cross-device bias, and incomplete labeling. Exist

safetyarxiv-cs-ai

Talk to Your Slides: High-Efficiency Slide Editing via Language-Driven Structured Data Manipulation

model-releasesarxiv-cs-cl

arXiv:2505.11604v5 Announce Type: replace Abstract: Editing presentation slides is a frequent yet tedious task, ranging from creative layout design to repetitive text maintenance. While recent GUI-bas

Text-Guided Multi-Scale Frequency Representation Adaptation

arXiv:2605.08181v1 Announce Type: cross Abstract: Parameter-efficient fine-tuning methods introduce a small number of training parameters, enabling pre-trained models to adapt rapidly to new data dist

Industry

Thinking Machines drops a new, highly responsive model designed for humanlike interactions in real time

Thinking Machines Lab Inc., the artificial intelligence research startup founded by former OpenAI Group PBC Chief Technology Officer Mira Murati, wants to move beyond the era of “turn-based” AI intera

industrysiliconangle

Unison: Harmonizing Motion, Speech, and Sound for Human-Centric Audio-Video Generation

arXiv:2605.08729v1 Announce Type: new Abstract: Motion, speech, and sound effects are fundamental elements of human-centric videos, yet their heterogeneous temporal characteristics make joint generati

Visual-ERM: Reward Modeling for Visual Equivalence

arXiv:2603.13224v2 Announce Type: replace-cross Abstract: Vision-to-code tasks require models to reconstruct structured visual inputs, such as charts, tables, and SVGs, into executable or structured r

Local Ai

WavesFM: Hierarchical Representation Learning for Longitudinal Wearable Sensor Waveforms

arXiv:2605.09173v1 Announce Type: cross Abstract: Wearable sensors enable the continuous acquisition of high-resolution physiological waveforms, such as photoplethysmography and accelerometry, under f

local-aiarxiv-cs-ai

WildClawBench: A Benchmark for Real-World, Long-Horizon Agent Evaluation

model-releasesarxiv-cs-cl

arXiv:2605.10912v1 Announce Type: new Abstract: Large language and vision-language models increasingly power agents that act on a user's behalf through command-line interface (CLI) harnesses. However,

A^2RD: Agentic Autoregressive Diffusion for Long Video Consistency

arXiv:2605.06924v1 Announce Type: cross Abstract: Synthesizing consistent and coherent long video remains a fundamental challenge. Existing methods suffer from semantic drift and narrative collapse ov

Adapting Vision-Language Models for Neutrino Event Classification in High-Energy Physics

arXiv:2509.08461v3 Announce Type: replace-cross Abstract: Recent advances in Large Language Models (LLMs) have demonstrated their remarkable capacity to process and reason over structured and unstruct

BalCapRL: A Balanced Framework for RL-Based MLLM Image Captioning

arXiv:2605.07394v1 Announce Type: cross Abstract: Image captioning is one of the most fundamental tasks in computer vision. Owing to its open-ended nature, it has received significant attention in the

Bi3: A Biplatform, Bicultural, Biperson Dataset for Social Robot Navigation

model-releasesarxiv-cs-ro

arXiv:2605.06863v1 Announce Type: new Abstract: We contribute Bi3, a dataset of social robot navigation among groups of people in a constrained lab space. Compared to prior data collection efforts for

CSMCIR: CoT-Enhanced Symmetric Alignment with Memory Bank for Composed Image Retrieval

arXiv:2601.03728v3 Announce Type: replace-cross Abstract: Composed Image Retrieval (CIR) enables users to search for target images using both a reference image and manipulation text, offering substant

Local Ai

DeCo-DETR: Decoupled Cognition DETR for efficient Open-Vocabulary Object Detection

arXiv:2604.02753v2 Announce Type: replace Abstract: Open-vocabulary Object Detection (OVOD) enables models to recognize objects beyond predefined categories, but existing approaches remain limited in

local-aiarxiv-cs-cv

Do Joint Audio-Video Generation Models Understand Physics?

arXiv:2605.07061v1 Announce Type: cross Abstract: Joint audio-video generation models are rapidly approaching professional production quality, raising a central question: do they understand audio-visu

EyeCue: Driver Cognitive Distraction Detection via Gaze-Empowered Egocentric Video Understanding

arXiv:2605.07859v1 Announce Type: new Abstract: Driver cognitive distraction is a major cause of road collisions and remains difficult to detect. Unlike manual or visual distraction, cognitive distrac

researcharxiv-cs-cv

Local Ai

Federated Spatiotemporal Graph Learning for Passive Attack Detection in Smart Grids

arXiv:2510.02371v2 Announce Type: replace-cross Abstract: Smart grids are exposed to passive eavesdropping, where attackers listen silently to communication links. Although no data is actively altered

local-aiarxiv-cs-ai

GPO-V: Jailbreak Diffusion Vision Language Model by Global Probability Optimization

arXiv:2605.07399v1 Announce Type: new Abstract: Diffusion Vision-Language Models (dVLMs), built upon the non-causal foundations of Diffusion Large Language Models (dLLMs), have demonstrated remarkable

Applications

Large Video Planner Enables Generalizable Robot Control

arXiv:2512.15840v2 Announce Type: replace-cross Abstract: General-purpose robots require decision-making models that generalize across diverse tasks and environments. Recent works build robot foundati

applicationsarxiv-cs-cv

LensVLM: Selective Context Expansion for Compressed Visual Representation of Text

arXiv:2605.07019v1 Announce Type: cross Abstract: Vision Language Models (VLMs) offer the exciting possibility of processing text as rendered images, bypassing the need for tokenizing the text into lo

LLM-Based Agents for Competitive Landscape Mapping in Drug Asset Due Diligence

arXiv:2508.16571v4 Announce Type: replace Abstract: In this paper, we describe and benchmark a competitor-discovery component used within an agentic AI system for fast drug asset due diligence. A comp

Hardware

Physics-Based Flow Matching for Full-Field Prediction of Silicon Photonic Devices

arXiv:2605.06929v1 Announce Type: cross Abstract: Designing photonic integrated circuits requires accurate electromagnetic field simulations, which remain computationally expensive even for simple dev

hardwarearxiv-cs-lg

PolarVLM: Bridging the Semantic-Physical Gap in Vision-Language Models

arXiv:2605.07574v1 Announce Type: new Abstract: Mainstream vision-language models (VLMs) fundamentally struggle with severe optical ambiguities, such as reflections and transparent objects, due to the

PRIMED: Adaptive Modality Suppression for Referring Audio-Visual Segmentation via Biased Competition

arXiv:2605.07154v1 Announce Type: new Abstract: Referring Audio-Visual Segmentation (Ref-AVS) seeks to localize and segment target objects in video frames based on visual, auditory, and textual referr

R^3L: Reasoning 3D Layouts from Relative Spatial Relations

arXiv:2605.06758v1 Announce Type: cross Abstract: Relative spatial relations provide a compact representation of spatial structure and are fundamental to relative spatial reasoning in 3D layout genera

Real-IAD MVN: A Multi-View Normal Vector Dataset and Benchmark for High-Fidelity Industrial Anomaly Detection

arXiv:2605.07149v1 Announce Type: new Abstract: Industrial Anomaly Detection (IAD) is critical for quality control, but existing methods struggle with subtle, geometric defects. Standard 2D (RGB) imag

ReasonEdit: Towards Interpretable Image Editing Evaluation via Reinforcement Learning

arXiv:2605.07477v1 Announce Type: new Abstract: Recent text-guided image editing (TIE) models have achieved remarkable progress, however, many edited results still suffer from artifacts, unintended mo

RuleSafe-VL: Evaluating Rule-Conditioned Decision Reasoning in Vision-Language Content Moderation

arXiv:2605.07760v1 Announce Type: new Abstract: Platform content moderation applies explicit policy rules and context-dependent conditions to decide whether user content is allowed, restricted, or rem

ShellfishNet: A Domain-Specific Benchmark for Visual Recognition of Marine Molluscs

arXiv:2605.07338v1 Announce Type: new Abstract: The decline of global shellfish biodiversity poses a severe threat to coastal ecosystems. Although artificial intelligence (AI) technologies show potent

Skip-It? Theoretical Conditions for Layer Skipping in Vision-Language Models

arXiv:2509.25584v2 Announce Type: replace Abstract: Vision-language models achieve incredible performance across a wide range of tasks, but their large size makes inference costly. Recent work has sho

SphereVAD: Training-Free Video Anomaly Detection via Geodesic Inference on the Unit Hypersphere

arXiv:2605.08003v1 Announce Type: new Abstract: Video anomaly detection (VAD) aims to automatically identify events that deviate from normal patterns in untrimmed surveillance videos. Existing methods

researcharxiv-cs-cv

TextLDM: Language Modeling with Continuous Latent Diffusion

arXiv:2605.07748v1 Announce Type: new Abstract: Diffusion Transformers (DiT) trained with flow matching in a VAE latent space have unified visual generation across images and videos. A natural next st

safetyarxiv-cs-cl

Hardware

Towards Billion-scale Multi-modal Biometric Search

arXiv:2605.07655v1 Announce Type: cross Abstract: Searching a multi-biometric database of a billion records for a country-level identity system requires pushing the limits of all aspects of a biometri

hardwarearxiv-cs-ai

TRACE: Transport Alignment Conformal Prediction via Diffusion and Flow Matching Models

arXiv:2605.07100v1 Announce Type: cross Abstract: Constructing valid and informative conformal prediction regions for multi-dimensional outputs remains a fundamental challenge. While conformal predict

safetyarxiv-cs-lg