Search: “multimodal”

A Multimodal Data Collection Framework for Dialogue-Driven Assistive Robotics to Clarify Ambiguities: A Wizard-of-Oz Pilot Study

arXiv:2601.16870v2 Announce Type: replace Abstract: Integrated control of wheelchairs and wheelchair-mounted robotic arms (WMRAs) has strong potential to increase independence for users with severe mo

researcharxiv-cs-ro

17 Apr 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

MEME-Fusion@CHiPSAL 2026: Multimodal Ablation Study of Hate Detection and Sentiment Analysis on Nepali Memes

DGX agent

arXiv:2604.14218v1 Announce Type: new Abstract: Hate speech detection in Devanagari-scripted social media memes presents compounded challenges: multimodal content structure, script-specific linguistic

researcharxiv-cs-cl

17 Apr 2026

MM-WebAgent: A Hierarchical Multimodal Web Agent for Webpage Generation

arXiv:2604.15309v1 Announce Type: cross Abstract: The rapid progress of Artificial Intelligence Generated Content (AIGC) tools enables images, videos, and visualizations to be created on demand for we

17 Apr 2026

Free Lunch for Unified Multimodal Models: Enhancing Generation via Reflective Rectification with Inherent Understanding

arXiv:2604.13540v1 Announce Type: new Abstract: Unified Multimodal Models (UMMs) aim to integrate visual understanding and generation within a single structure. However, these models exhibit a notable

16 Apr 2026

KMMMU: Evaluation of Massive Multi-discipline Multimodal Understanding in Korean Language and Context

arXiv:2604.13058v1 Announce Type: new Abstract: We introduce KMMMU, a native Korean benchmark for evaluating multimodal understanding in Korean cultural and institutional settings. KMMMU contains 3,46

16 Apr 2026

Agents

RadAgents: Multimodal Agentic Reasoning for Chest X-ray Interpretation with Radiologist-like Workflows

arXiv:2509.20490v4 Announce Type: replace-cross Abstract: Agentic systems offer a potential path to solve complex clinical tasks through collaboration among specialized agents, augmented by tool use a

agentsarxiv-cs-cl

16 Apr 2026

CLASP: Class-Adaptive Layer Fusion and Dual-Stage Pruning for Multimodal Large Language Models

arXiv:2604.12767v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) suffer from substantial computational overhead due to the high redundancy in visual token sequences. Existing

EEG-Based Multimodal Learning via Hyperbolic Mixture-of-Curvature Experts

model-releasesarxiv-cs-lg

arXiv:2604.12579v1 Announce Type: new Abstract: Electroencephalography (EEG)-based multimodal learning integrates brain signals with complementary modalities to improve mental state assessment, provid

Enabling Ultra-Fast Cardiovascular Imaging Across Heterogeneous Clinical Environments with A Generalist Foundation Model and Multimodal Database

arXiv:2512.21652v2 Announce Type: replace-cross Abstract: Multimodal cardiovascular magnetic resonance (CMR) imaging provides comprehensive and non-invasive insights into cardiovascular disease (CVD)

Enhance-then-Balance Modality Collaboration for Robust Multimodal Sentiment Analysis

arXiv:2604.12518v1 Announce Type: new Abstract: Multimodal sentiment analysis (MSA) integrates heterogeneous text, audio, and visual signals to infer human emotions. While recent approaches leverage c

researcharxiv-cs-cl

Modality-Native Routing in Agent-to-Agent Networks: A Multimodal A2A Protocol Extension

arXiv:2604.12213v1 Announce Type: new Abstract: Preserving multimodal signals across agent boundaries is necessary for accurate cross-modal reasoning, but it is not sufficient. We show that modality-n

A Dual Cross-Attention Graph Learning Framework For Multimodal MRI-Based Major Depressive Disorder Detection

arXiv:2604.10116v1 Announce Type: cross Abstract: Major depressive disorder (MDD) is a prevalent mental disorder associated with complex neurobiological changes that cannot be fully captured using a s

Anthropogenic Regional Adaptation in Multimodal Vision-Language Model

arXiv:2604.11490v1 Announce Type: new Abstract: While the field of vision-language (VL) has achieved remarkable success in integrating visual and textual information across multiple languages and doma

DERM-3R: A Resource-Efficient Multimodal Agents Framework for Dermatologic Diagnosis and Treatment in Real-World Clinical Settings

arXiv:2604.09596v1 Announce Type: new Abstract: Dermatologic diseases impose a large and growing global burden, affecting billions and substantially reducing quality of life. While modern therapies ca

Dynamic Summary Generation for Interpretable Multimodal Depression Detection

arXiv:2604.11334v1 Announce Type: new Abstract: Depression remains widely underdiagnosed and undertreated because stigma and subjective symptom ratings hinder reliable screening. To address this chall

EmergentBridge: Improving Zero-Shot Cross-Modal Transfer in Unified Multimodal Embedding Models

arXiv:2604.11043v1 Announce Type: new Abstract: Unified multimodal embedding spaces underpin practical applications such as cross-modal retrieval and zero-shot recognition. In many real deployments, h

GIF: A Conditional Multimodal Generative Framework for IR Drop Imaging in Chip Layouts

arXiv:2604.09999v1 Announce Type: new Abstract: IR drop analysis is essential in physical chip design to ensure the power integrity of on-chip power delivery networks. Traditional Electronic Design Au

tutorialsarxiv-cs-cv

Interpretable Alzheimer's Diagnosis via Multimodal Fusion of Regional Brain Experts

arXiv:2512.10966v2 Announce Type: replace-cross Abstract: Accurate and early diagnosis of Alzheimer's disease (AD) is critical for effective intervention and requires integrating complementary informa

LAST: Leveraging Tools as Hints to Enhance Spatial Reasoning for Multimodal Large Language Models

arXiv:2604.09712v1 Announce Type: cross Abstract: Spatial reasoning is a cornerstone capability for intelligent systems to perceive and interact with the physical world. However, multimodal large lang

M2-Verify: A Large-Scale Multidomain Benchmark for Checking Multimodal Claim Consistency

arXiv:2604.01306v2 Announce Type: replace Abstract: Evaluating scientific arguments requires assessing the strict consistency between a claim and its underlying multimodal evidence. However, existing

MEDSYN: Benchmarking Multi-EviDence SYNthesis in Complex Clinical Cases for Multimodal Large Language Models

arXiv:2602.21950v2 Announce Type: replace Abstract: Multimodal large language models (MLLMs) have shown great potential in medical applications, yet existing benchmarks inadequately capture real-world

Multimodal Diffusion Forcing for Forceful Manipulation

arXiv:2511.04812v2 Announce Type: replace-cross Abstract: Given a dataset of expert trajectories, standard imitation learning approaches typically learn a direct mapping from observations (e.g., RGB i

Toward Accountable AI-Generated Content on Social Platforms: Steganographic Attribution and Multimodal Harm Detection

arXiv:2604.10460v1 Announce Type: cross Abstract: The rapid growth of generative AI has introduced new challenges in content moderation and digital forensics. In particular, benign AI-generated images

FashionStylist: An Expert Knowledge-enhanced Multimodal Dataset for Fashion Understanding

arXiv:2604.09249v1 Announce Type: new Abstract: Fashion understanding requires both visual perception and expert-level reasoning about style, occasion, compatibility, and outfit rationale. However, ex

13 Apr 2026

LMGenDrive: Bridging Multimodal Understanding and Generative World Modeling for End-to-End Driving

arXiv:2604.08719v1 Announce Type: cross Abstract: Recent years have seen remarkable progress in autonomous driving, yet generalization to long-tail and open-world scenarios remains a major bottleneck

13 Apr 2026

TRU: Targeted Reverse Update for Efficient Multimodal Recommendation Unlearning

arXiv:2604.02183v2 Announce Type: replace Abstract: Multimodal recommendation systems (MRS) jointly model user-item interaction graphs and rich item content, but this tight coupling makes user data di

13 Apr 2026

A Clinical Point Cloud Paradigm for In-Hospital Mortality Prediction from Multi-Level Incomplete Multimodal EHRs

arXiv:2604.04614v2 Announce Type: replace-cross Abstract: Deep learning-based modeling of multimodal Electronic Health Records (EHRs) has become an important approach for clinical diagnosis and risk p

MM-MoralBench: A MultiModal Moral Evaluation Benchmark for Large Vision-Language Models

arXiv:2412.20718v2 Announce Type: replace Abstract: The rapid integration of Large Vision-Language Models (LVLMs) into critical domains necessitates comprehensive moral evaluation to ensure their alig

PolySLGen: Online Multimodal Speaking-Listening Reaction Generation in Polyadic Interaction

arXiv:2604.08125v1 Announce Type: new Abstract: Human-like multimodal reaction generation is essential for natural group interactions between humans and embodied AI. However, existing approaches are l

safetyarxiv-cs-cv

The Persistence of Cultural Memory: Investigating Multimodal Iconicity in Diffusion Models

arXiv:2511.11435v3 Announce Type: replace Abstract: The ambiguity between generalization and memorization in TTI diffusion models becomes pronounced when prompts invoke culturally shared visual refere

A Multimodal Emotion Recognition System: Integrating Facial Expressions, Body Movement, Speech, and Spoken Language

arXiv:2412.17907v2 Announce Type: replace-cross Abstract: Psychological evaluation relies on clinicians' observation and interpretation of a patient's emotional expression, which is susceptible to sub

Can Visual Generation Expand What Unified Multimodal Models Know?

arXiv:2610.21459v1 Announce Type: cross Abstract: Unified multimodal models (UMMs) receive image-generation supervision that exposes them to visual information not fully documented in text. Can learni

FusionAudit: Pathway-Conditioned Robustness Auditing for Native Multimodal Models

arXiv:2610.21667v1 Announce Type: new Abstract: As vision-language models (VLMs) transition from frozen-encoder pipelines to native multimodal architectures, the visual channel increasingly serves as

ReasonUni: Reasoning-Augmented Reconstruction Advances Unified Multimodal Models

arXiv:2610.20781v1 Announce Type: cross Abstract: Image-to-text (I2T) understanding and text-to-image (T2I) generation are dual tasks in unified multimodal models (UMMs). Reconstructive post-training

MemeTrace: A Multimodal LLM-Based Agent for Safety-Aware Meme Provenance Analysis

arXiv:2610.19267v1 Announce Type: cross Abstract: Online memes are often carriers of unsafe content such as disinformation and propaganda. Their rapid evolution in response to news events and strong d

safetyarxiv-cs-cl

15 Oct 2026

Agents

Multi-agent Undercover Gaming: Hallucination Removal via Counterfactual Test for Multimodal Reasoning

arXiv:2511.11182v2 Announce Type: replace Abstract: Hallucination continues to pose a major obstacle in the reasoning capabilities of large language models (LLMs). Although the Multi-Agent Debate (MAD

agentsarxiv-cs-ai

15 Oct 2026

Agents

Context-aware Bayesian Fusion for Multimodal Object Detection

arXiv:2610.18741v1 Announce Type: new Abstract: Reliable detection of pedestrians and road users is essential for the safe operation of autonomous vehicles. However, this task becomes increasingly cha

agentsarxiv-cs-cv

HYDRA: Representation Harmonized Tokenization for Multimodal Generation and Understanding

arXiv:2603.15228v3 Announce Type: replace Abstract: Unified Multimodal Models struggle to bridge the fundamental gap between the abstract representations needed for visual understanding and the detail

Imitation Learning of Avoidance Modes for Efficient Multimodal Model Predictive Control

arXiv:2610.16326v1 Announce Type: new Abstract: Multimodal model predictive control (MM-MPC) avoids local minima among moving obstacles by solving one optimal control problem (OCP) per combination of

researcharxiv-cs-ro

Learning Multimodal Sensor Fusion with JEPA Representations for Breathing Activity and Pose Recognition

arXiv:2610.15891v1 Announce Type: new Abstract: Predictive video representations do not by themselves specify how a multimodal system should handle missing sensors. We transfer frozen V-JEPA2 features

PolUR: Polarization Aware Multimodal Degradation Perception for Underwater Image Restoration

arXiv:2610.17991v1 Announce Type: new Abstract: Recovering high-quality images from degraded underwater observations is crucial for underwater exploration. Polarization observations show promise as an

Reference-Efficient Multimodal Bitstream-Corrupted Video Recovery via Depth-Conditioned Adaptation

arXiv:2610.15806v1 Announce Type: new Abstract: Recovering visually faithful content from damaged video bitstreams is important for reliable multimedia communication and storage. Existing methods expl

Sampling from multimodal distributions with warm starts: Non-asymptotic bounds for the Reweighted Annealed Leap-Point Sampler

arXiv:2512.17977v2 Announce Type: replace-cross Abstract: Sampling from multimodal distributions is a central challenge in Bayesian inference and machine learning. In light of hardness results for sam

tutorialsarxiv-cs-lg

Monarch-MoE: Structured Experts for Multimodal Continual Instruction Tuning

arXiv:2610.13215v1 Announce Type: new Abstract: Learning new tasks in multimodal continual instruction tuning can cause catastrophic forgetting of previously acquired knowledge. Although multi-expert

researcharxiv-cs-lg

12 Oct 2026

Leakage-Controlled Multimodal Learning for Diagnosis and Progression Prediction in Alzheimer's Disease Research

arXiv:2610.10648v1 Announce Type: new Abstract: Alzheimer's disease prediction involves irregular visits, heterogeneous measurements and incomplete modalities. This study presents a multimodal multita

researcharxiv-cs-lg

Look Back, Think Ahead: Visual Memory on Demand for Efficient Multimodal Reasoning

arXiv:2610.12060v1 Announce Type: new Abstract: Processing long visual token sequences from high-resolution images makes multi-step reasoning computationally expensive for multimodal Large Language Mo

MetaEncoder: Exploring the Limit of Bi-Encoders for Multimodal System One Decision Making with Natural Language Interface

arXiv:2610.11316v1 Announce Type: cross Abstract: System One models output constrained decisions and probability distributions rather than free-form text generation. While prevailing paradigms rely on

Applications

Multimodal Large Language Models as Image Classifiers

arXiv:2603.06578v3 Announce Type: replace Abstract: Multimodal Large Language Model (MLLM) classification performance depends critically on evaluation protocol and ground truth quality. Studies compar

applicationsarxiv-cs-cv