Search: “multimodal”

Learning Deep Modality-Shared Self-Expressiveness for Image Clustering with Textual Information

arXiv:2608.08418v1 Announce Type: new Abstract: Leveraging textual information for image clustering has emerged as a promising direction, largely owing to the powerful representations learned by Visio

safetyarxiv-cs-cv

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Learning When to See and When to Feel: Adaptive Vision-Torque Fusion for Contact-Aware Manipulation

DGX agent

arXiv:2604.01414v2 Announce Type: replace Abstract: Vision-based policies have achieved a good performance in robotic manipulation due to the accessibility and richness of visual observations. However

safetyarxiv-cs-ro

11 Aug 2026

LEGO-Puzzles: How Good Are MLLMs at Multi-Step Spatial Reasoning?

arXiv:2503.19990v4 Announce Type: replace Abstract: Many real-world applications of spatial intelligence, such as robotic control, autonomous driving, and automated assembly, require spatial reasoning

Tutorials

Leveraging generative models to assist Monte Carlo sampling

arXiv:2608.07648v1 Announce Type: cross Abstract: Sampling high-dimensional probability distributions is a central task in scientific computing, with applications ranging from Bayesian inference to st

tutorialsarxiv-cs-lg

LogiShot: Logically Coherent Cross-Shot Video Generation

arXiv:2608.08820v1 Announce Type: new Abstract: Generating cross-shot videos that are logically connected is essential for content creation. Currently, most cross-shot video-generation workflows, such

MADBench: A Benchmark for Modality-Aware Audio Deepfake Detection

arXiv:2608.09593v1 Announce Type: cross Abstract: Recent advances in speech synthesis and audio generation have made high-fidelity acoustic forgery low-cost and difficult to attribute, enabling a real

MetaSpace: Metamorphic Testing for Spatial Cognition in Embodied Agents

arXiv:2608.07533v1 Announce Type: new Abstract: An embodied agent is an intelligent entity that interacts with its environment through a physical body. Currently, the evaluation of embodied agents pri

MultiShadow: Multi-Object Shadow Generation for Image Compositing via Diffusion Model

arXiv:2603.02743v4 Announce Type: replace Abstract: Realistic shadow generation is crucial for achieving seamless image compositing, yet existing methods primarily focus on single-object insertion and

safetyarxiv-cs-cv

Multitask Scanning Probe Microscopy

arXiv:2608.09104v1 Announce Type: cross Abstract: Scanning probe microscopy provides nanoscale access to structural, electrical, electromechanical, magnetic, and mechanical properties of materials. It

agentsarxiv-cs-lg

Particle-Based Conformal Prediction for Contact-Aware Uncertainty Calibration in Stratified Configuration Spaces

arXiv:2608.09166v1 Announce Type: cross Abstract: Reliable uncertainty representation is essential for deploying autonomous systems that interact with their environment, as robots must reason about ho

agentsarxiv-cs-lg

PressureMesh: 3D Human Mesh Estimation from Multi-Device Pressure Images

arXiv:2608.09550v1 Announce Type: new Abstract: Human pose monitoring is crucial in fields such as rehabilitation assessment and human-computer interaction. Due to its privacy-preserving nature, press

researcharxiv-cs-cv

RAGMesh with FaME-G2E: Long-Form Text-Driven 3D Face Generation and Editing

arXiv:2608.09186v1 Announce Type: new Abstract: Text-driven 3D face generation and editing remains challenging due to the difficulty of translating long-form descriptions into fine-grained facial geom

REFRAMED: Towards Realistic Audio Description Generation for Movies

model-releasesarxiv-cs-cl

arXiv:2608.09765v1 Announce Type: new Abstract: Audio Description (AD) is a verbal narration of key visual content in videos, enabling access for visually impaired audiences. Unlike standard video cap

REVEAL: A Rubric-Guided Agent for Explicit Evidence Sufficiency Verificationin Long-Video Question Answering

arXiv:2608.08612v1 Announce Type: cross Abstract: Recently, retrieval-augmented and memory-augmented methods have emerged as two promising paradigms for long-video question answering. However, existin

agentsarxiv-cs-ai

Scaling Audio Models Efficiently: A Joint Study of Compute Constraints and Optimization Behavior

arXiv:2606.22790v2 Announce Type: replace-cross Abstract: In this paper, we investigate the tradeoffs between compute allocation and model performance for two speech processing tasks: Automatic Speech

researcharxiv-cs-ai

SCOUT: Self-Checking and Recovery-Aware Tool-Thought Agents for Ultra-Long Egocentric Video Reasoning

arXiv:2608.07959v1 Announce Type: new Abstract: Ultra-long egocentric video understanding requires reasoning over temporally sparse evidence distributed across hours or days, challenging current multi

SI-Edit: Toward Sketch-Instruction Guided Local Image Editing with Pixel-Level Precision

arXiv:2608.09097v1 Announce Type: new Abstract: Despite rapid advances in generative models, achieving pixel-level precision in sketch-based image editing remains a persistent challenge, particularly

Skills in Weights, Memory in Code: Hybrid Learning for Memory-Dependent Robot Manipulation

arXiv:2608.09410v1 Announce Type: new Abstract: Modern vision-language-action (VLA) policies have acquired broad manipulation skills, but typically generate each action chunk from the current observat

agentsarxiv-cs-ro

Local Ai

SportsGrounder: Proposal-Aided Interleaved Grounding for Dense Sports Video Reasoning

arXiv:2608.07932v1 Announce Type: new Abstract: Sports video analysis is crucial for athletic analytics and broadcasting enhancement. Dense sports video reasoning, however, demands a fine-grained unde

local-aiarxiv-cs-cv

TongGuOCR: A Layout-Aware and Token-Augmented OCR Framework for Chinese Historical Documents

arXiv:2608.07917v1 Announce Type: new Abstract: Chinese historical documents preserve valuable cultural heritage, but many collections remain accessible only as scanned page images, preventing full-te

UnsDrive: Towards Robust End-to-End Autonomous Driving in Unstructured Scenes

arXiv:2608.09098v1 Announce Type: new Abstract: End-to-end planning has shown strong promise for autonomous driving, but most existing methods are designed for structured urban roads and generalize po

safetyarxiv-cs-ro

Local Ai

Verifiably grounded machine interpretation of lunar geology

arXiv:2608.09276v1 Announce Type: new Abstract: Planetary geology relies on historical, interpretive reasoning to reconstruct past events from diverse observations. Here, we present a step toward an a

local-aiarxiv-cs-cl

VOICE: A Vision-Omics Foundation Model Integrating Direct and Retrieval-Based Prediction of In-situ Single-Cell Gene Expression

arXiv:2608.08366v1 Announce Type: new Abstract: Spatial transcriptomics can resolve gene expression at single-cell resolution, but it is costly, limited to targeted panels of a few hundred to a few th

researcharxiv-cs-cv

VTO: Visual Tool Orchestration for Video Anomaly Detection

arXiv:2608.08219v1 Announce Type: cross Abstract: Video anomaly detection (VAD) is a critical yet challenging task due to the complex and diverse nature of real-world scenarios. Traditional deep learn

XFeat Revisited: Reproducibility and Evaluation of a Lightweight Image Matcher

arXiv:2608.09519v1 Announce Type: new Abstract: We present a reproducibility study of XFeat, a lightweight local feature extractor and matcher designed to identify corresponding points across images e

A Haptic Robot Finger Designed for Guqin Instrument Playing

arXiv:2608.07002v1 Announce Type: new Abstract: With the rapid advancement of humanoid robotics and embodied intelligence technologies, numerous musical instrument-playing robots have emerged in recen

researcharxiv-cs-ro

Applications

CANIS: Generation-Assisted 3D Canonicalization via an Image-Semantic Bridge

arXiv:2608.07256v1 Announce Type: new Abstract: Canonicalizing 3D object orientation is fundamental to 3D understanding and analysis. Existing approaches often rely on geometric cues, although 3D cano

applicationsarxiv-cs-cv

Does More Retrieved Evidence Help Visual Retrieval-Augmented Generation with Diffusion Language Models?

arXiv:2608.07006v1 Announce Type: new Abstract: Visual retrieval-augmented generation (RAG) commonly expands the retrieved evidence set to improve answer-page coverage, implicitly assuming that all av

researcharxiv-cs-cl

Gaze Behavior in Visual World Experiments Can be Modeled With Off-the-shelf Language-Vision Encoders

arXiv:2608.07282v1 Announce Type: new Abstract: The recent advances in neural language models have also spurred much work in computational psycholinguistics, asking whether neural LMs are also promisi

researcharxiv-cs-cl

Geo-Spatial Concept Probing of Large Language Models: Abstraction, Compositionality, and Grounding

arXiv:2608.07353v1 Announce Type: cross Abstract: Understanding concepts is fundamental to generalization. Despite their impressive performance on a wide range of tasks, Large Language Models (LLMs) s

HFS: Holistic Query-Aware Frame Selection for Efficient Video Understanding

arXiv:2512.11534v2 Announce Type: replace-cross Abstract: Key frame selection is essentially a set-level optimization problem: the quality of the selected subset depends on the interactions among fram

researcharxiv-cs-cl

Identity as Presence: Towards Appearance and Voice Personalized Joint Audio-Video Generation

arXiv:2603.17889v4 Announce Type: replace Abstract: Recent advances in video synthesis have enabled realistic integration of real individuals, driving demand for identity-aware generation. While emerg

safetyarxiv-cs-cv

LSEAD: A Privacy-Preserving LLM-Based Speech Analysis Framework for Early Alzheimer's Disease Screening

arXiv:2608.07378v1 Announce Type: cross Abstract: Early diagnosis of Alzheimer's disease (AD) is critical for enabling timely interventions that may slow disease progression and improve patient outcom

Multi-Agent Forensic Reasoning for Generalizable Deepfake Video Detection

arXiv:2608.06865v1 Announce Type: cross Abstract: The malicious use of generative artificial intelligence to create highly realistic deepfake videos raises serious ethical concerns and poses substanti

Natural Language Processing Psychometrics

arXiv:2608.07316v1 Announce Type: cross Abstract: Natural Language Processing (NLP) models predicting mental health outcomes rarely specify what they measure: contextual knowledge, emotional content,

researcharxiv-cs-ai

Progressive Alignment of Recommender Foundation Model through Multi-Phase Post-Training

arXiv:2608.06792v1 Announce Type: cross Abstract: Foundation model(FM) for recommendation has shown strong ability to model long-horizon sequential user behavior. In practice, a single pretrained foun

Representation-driven Endoscopic Visual Embedding Alignment for Latent Generation

arXiv:2608.07176v1 Announce Type: cross Abstract: Developing foundation generative models for endoscopy is limited by the gap between natural and clinical images and the computational cost of training

SABRE: Scalable and Automated Benchmarking of VLMs under Stress

arXiv:2608.07435v1 Announce Type: cross Abstract: Vision-language models (VLMs) are improving rapidly, but benchmark development lags behind, making weaknesses hard to identify. Building stress tests

Sampling via Stochastic Interpolants by Langevin-based Velocity and Initialization Estimation in Flow ODEs

arXiv:2601.08527v3 Announce Type: replace-cross Abstract: We propose a novel method for sampling from unnormalized Boltzmann densities based on a probability flow ordinary differential equation (ODE)

researcharxiv-cs-lg

Shape Your Feed: An LLM-based Agentic System for Conversational Recommendation

arXiv:2608.06632v1 Announce Type: new Abstract: Industrial recommendation systems predominantly adopt a passive ranking paradigm that infers user preferences from implicit behavioral signals (e.g., cl

TransSLR: A Lightweight Transformer for Sign Language Recognition

arXiv:2608.06407v1 Announce Type: cross Abstract: Automated Sign Language Recognition for under-represented languages remains a largely unsolved problem. Central African Sign Language (CASL) exemplifi

Understand Before Detect: Vision--Language Learning for Omni-Domain Infrared Small Target Detection

arXiv:2608.07015v1 Announce Type: new Abstract: Omni-domain infrared small target (IRST) detection is crucial for infrared surveillance, yet remains challenging due to heterogeneous imaging domains an

researcharxiv-cs-cv

UniREditBench: A Unified Reasoning-based Image Editing Benchmark

arXiv:2511.01295v3 Announce Type: replace Abstract: Recent advances in multi-modal generative models have driven substantial improvements in image editing. However, current generative models still str

Applications

Unordered Landmark Visual Navigation

arXiv:2608.06833v1 Announce Type: new Abstract: Image-goal navigation is a fundamental capability for embodied AI, yet its practical deployment is strained by strong prior assumptions. Existing method

applicationsarxiv-cs-ro

A Master-Salve Robot Manipulator for Needle-Based Teleoperation in MRI Chamber

arXiv:2608.06354v1 Announce Type: new Abstract: We present a MR safe, master-slave robot manipulator for abdominal interventions in the MRI chamber. A human operated 2+1-DoF master controller manipula

researcharxiv-cs-ro

Bias Analysis of L2 Speaking Assessment Systems Using Concept Activation Vectors

arXiv:2608.06300v1 Announce Type: new Abstract: Automatic speaking assessment systems are increasingly deployed in high-stakes settings to mark second language (L2) learners' speaking tests, making it

Tutorials

BioKD: Selective Physiology-to-Video Knowledge Distillation via Reliability Gate for Emotion Recognition

arXiv:2608.06023v1 Announce Type: new Abstract: To address the limitations of video-based emotion recognition under ambiguous or socially masked behavioral cues, as well as the poor deployability of p

tutorialsarxiv-cs-lg

ECHO: A Locally-Deployable Agentic Health Assistant with Temporal Memory, Safety Guardrails, and Speech Assessment

arXiv:2608.06110v1 Announce Type: new Abstract: This paper presents ECHO (Enhanced Care & Health Observer), a locally-deployable conversational health assistant for long-term chronic care management.