Search: “multimodal”

Balanced Diffusion-Guided Fusion for Multimodal Remote Sensing Classification

arXiv:2509.23310v3 Announce Type: replace Abstract: Deep learning-based techniques for the analysis of multimodal remote sensing data have become popular due to their ability to effectively integrate

tutorialsarxiv-cs-cv

10 Apr 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Brain3D: EEG-to-3D Decoding of Visual Representations via Multimodal Reasoning

DGX agent

arXiv:2604.08068v1 Announce Type: new Abstract: Decoding visual information from electroencephalography (EEG) has recently achieved promising results, primarily focusing on reconstructing two-dimensio

safetyarxiv-cs-cv

10 Apr 2026

Applications

QA-MoE: Towards a Continuous Reliability Spectrum with Quality-Aware Mixture of Experts for Robust Multimodal Sentiment Analysis

arXiv:2604.05704v2 Announce Type: replace Abstract: Multimodal Sentiment Analysis (MSA) aims to infer human sentiment from textual, acoustic, and visual signals. In real-world scenarios, however, mult

applicationsarxiv-cs-ai

10 Apr 2026

Loud and Clear: Making Visual Evidence Count in Multimodal Document RAG

arXiv:2610.21318v1 Announce Type: cross Abstract: Multimodal document retrieval-augmented generation (RAG) has focused largely on retrieval, yet its answers depend on how well a vision-language model

researcharxiv-cs-ai

16 Oct 2026

Applications

Task-Centric Multimodal Learning for Cognitive Impairment Detection

arXiv:2610.20906v1 Announce Type: cross Abstract: Dementia affects millions of older adults worldwide, yet early detection remains difficult outside clinical settings. Traditional models primarily rel

applicationsarxiv-cs-cl

16 Oct 2026

When Reasoning Is Not Enough: Proactive Inquiry for Cross-Modal Safety in Multimodal Large Language Models

arXiv:2610.22068v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) can act unsafely when individually benign images and texts are interpreted jointly. Beyond implicit reasoning r

16 Oct 2026

Are We Really Measuring Forgetting? Pitfalls in Evaluating Machine Unlearning for Multimodal LLMs

arXiv:2610.19613v1 Announce Type: new Abstract: As machine unlearning for multimodal large language models (MLLMs) rapidly advances, rigorous evaluation of its effectiveness becomes increasingly impor

15 Oct 2026

Clinical value claims in multimodal AI outpace supporting evidence

arXiv:2610.14395v1 Announce Type: new Abstract: Multimodal prediction models add a data source, such as imaging or an assay, to clinical information, and health systems must decide whether that added

researcharxiv-cs-lg

GeoMER: A Joint Euclidean-Hyperbolic Geometry Framework for Multimodal Emotion Recognition

arXiv:2610.18587v1 Announce Type: cross Abstract: Multimodal Emotion Recognition (MER) aims to understand human emotions by integrating information from multiple modalities such as speech and text. Ps

MMTA: Benchmarking Multimodal Temporal Analysis with Time Series, Text, and Vision

arXiv:2610.17856v1 Announce Type: new Abstract: Time-series analysis is increasingly studied in multimodal settings, yet most benchmarks pair temporal signals with text or with visualizations derived

PixSearch: Region-Grounded Retrieval for Knowledgeable Large Multimodal Models

arXiv:2601.19060v2 Announce Type: replace Abstract: Multimodal Retrieval-Augmented Generation (MM-RAG) augments visual question answering (VQA) with external knowledge, but many systems rely on modula

tutorialsarxiv-cs-cv

Agents

SpikeOcc: Towards Resilient Multimodal 3D Occupancy Perception via Spiking Experts

arXiv:2610.15745v1 Announce Type: new Abstract: Multimodal 3D occupancy prediction underpins safe autonomous driving through comprehensive scene understanding. However, existing methods have largely p

agentsarxiv-cs-cv

UkrMeme: Multimodal Explainable Persuasion Detection in Ukrainian Memes

arXiv:2610.13783v1 Announce Type: new Abstract: Memes play a central role in modern online communication, especially in contexts of political conflict where visual and textual cues combine to convey p

12 Oct 2026

Addressing Overcommitment in the Reasoning of Gendered Economic Memes under Multimodal Ambiguity

arXiv:2610.11724v1 Announce Type: new Abstract: Multimodal meme understanding is increasingly used to analyze socially sensitive content, yet existing models often exhibit biased behavior when interpr

safetyarxiv-cs-lg

From Sparse Representations to Behavioral Insights for Multimodal Depression Assessment

arXiv:2610.11787v1 Announce Type: new Abstract: Multimodal depression assessment offers a promising approach to analyzing behavioral patterns associated with depression. However, existing methods ofte

researcharxiv-cs-cl

Multimodal Graph Retrieval-Augmented Sequential Recommendation via Collaborative Filtering Paths

arXiv:2610.11228v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have demonstrated strong potential for sequential recommendation through their ability to reason over complex m

Multimodal Remote Sensing Image Registration: A Comprehensive Review, Challenges and Prospects

arXiv:2610.11176v1 Announce Type: new Abstract: Multimodal remote sensing image registration is a crucial prerequisite for the collaborative processing and downstream application of remote sensing dat

researcharxiv-cs-cv

TopoGraphRAG-Bench: Evaluating Multimodal GraphRAG on Layout-Grounded Evidence Reasoning

arXiv:2610.09360v1 Announce Type: cross Abstract: Real-world documents distribute evidence across text, tables, figures, and captions within complex page layouts. Answering complex questions over such

8 Oct 2026

BoT-Feedback: Grounding Multimodal Reasoning in Biomechanical Evidence for Explainable Human Action Feedback

arXiv:2610.06972v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in visual understanding and multimodal reasoning, yet they remain fun

Medical Image Alignment Assessment as a Test of Generalist Visual Reasoning in Frontier Multimodal Models

arXiv:2610.06896v1 Announce Type: new Abstract: Frontier multimodal large language models (MLLMs) are increasingly positioned as general purpose visual reasoners as part of the quest for artificial ge

Quantifying the Gap between Understanding and Generation within Unified Multimodal Models

arXiv:2602.02140v2 Announce Type: replace Abstract: Recent advances in unified multimodal models (UMM) have demonstrated remarkable progress in both understanding and generation tasks. However, whethe

SAE++: Cascaded Sparse Autoencoders Learn Multi-Level Visual Concepts in Multimodal LLMs

arXiv:2606.16193v2 Announce Type: replace-cross Abstract: Multimodal Large Language Models (MLLMs) have demonstrated strong performance on vision-language tasks, yet their internal visual representati

MagiC: Evaluating Multimodal Cognition Toward Grounded Visual Reasoning

arXiv:2507.07297v2 Announce Type: replace Abstract: Recent advances in large vision-language models have led to impressive performance in visual question answering and multimodal reasoning. However, i

Masked Privileged-Information Distillation for Multimodal Skin Lesion Classification Under Missing Clinical Metadata

arXiv:2610.03991v1 Announce Type: new Abstract: Multimodal skin lesion classification combines clinical images with patient metadata to improve diagnostic accuracy. However, complete metadata availabl

researcharxiv-cs-cv

MTOR: Generalizable AI-Generated Video Detection with Multimodal Semantics and Temporal Over-Regularity

arXiv:2610.06378v1 Announce Type: new Abstract: The rapid evolution of video generation has narrowed the perceptual gap between authentic and synthetic videos, making generalizable AI-generated video

Pythia: Toward Foundation World Models for Multimodal Time Series

arXiv:2610.05240v1 Announce Type: new Abstract: Time-series foundation models offer a unified approach to forecasting across heterogeneous domains. Textual context and auxiliary observations provide c

tutorialsarxiv-cs-lg

Local Ai

The Poisoned Conversation: Privacy-Leaking Watermarks in Unified Multimodal Models

arXiv:2610.05453v1 Announce Type: cross Abstract: Multimodal models are increasingly shifting toward unified architectures that understand and generate text, images, and other modalities within a shar

local-aiarxiv-cs-cv

CLIMB: Confidence-Guided Complementary Evidence for Multimodal Retrieval-Augmented Generation

arXiv:2610.03421v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have shown strong visual reasoning abilities, but knowledge-intensive visual question answering often requires

safetyarxiv-cs-cl

5 Oct 2026

Textualized and Feature-based Models for Compound Multimodal Emotion Recognition in the Wild

arXiv:2407.12927v4 Announce Type: replace Abstract: Systems for multimodal emotion recognition (ER) are commonly trained to extract features from different modalities (e.g., visual, audio, and textual

5 Oct 2026

VisAudit: Evaluating Multimodal Agents for Visual Diagnosis and Repair

arXiv:2610.02399v1 Announce Type: new Abstract: Multimodal agents are increasingly used for data visualization tasks but remain limited in autonomous review. Unlike humans, they may fail to recognize

5 Oct 2026

LEGO-OPD: Factorized Teacher Composition for Multimodal On-Policy Distillation

arXiv:2610.00333v1 Announce Type: cross Abstract: Multimodal on-policy distillation (OPD) aims to improve visual grounding while preserving the strong reasoning capabilities of language models. Recent

safetyarxiv-cs-ai

2 Oct 2026

Prototype-guided Bilateral Alignment Multimodal Federated Learning

arXiv:2609.38925v1 Announce Type: new Abstract: Multimodal federated learning (MFL) has emerged as a pivotal paradigm for leveraging distributed data to enhance model performance. However, existing me

safetyarxiv-cs-ai

1 Oct 2026

SceneJail: Exploiting Video Scenario Context to Jailbreak Multimodal LLMs

arXiv:2609.38899v1 Announce Type: cross Abstract: Video Multimodal Large Language Models (Video-MLLMs) support reasoning over video inputs, yet remain vulnerable to jailbreak attacks that elicit polic

1 Oct 2026

GeoOutageBench: Benchmarking Ambiguity-aware, Ontology-grounded Geospatiotemporal KGQA for Multimodal Power Outage and Resilience Analysis

arXiv:2609.36082v1 Announce Type: new Abstract: We introduce GeoOutageBench, a benchmark for assessing LLM-based geospatiotemporal KGQA for multimodal outage and resilience analysis. Unlike existing K

30 Sept 2026

ReCAP: Retrieval-Guided Capability Reuse for Multimodal Continual Instruction Tuning

arXiv:2609.37889v1 Announce Type: new Abstract: Multimodal continual instruction tuning (MCIT) aims to enable multimodal large language models to acquire new capabilities from sequential tasks while p

30 Sept 2026

ThinkingGuard: Decoding Implicit Hazards via Step-by-Step Risk Attribution in Multimodal Large Language Models

arXiv:2609.36562v1 Announce Type: cross Abstract: While Multimodal Large Language Models (MLLMs) are increasingly deployed in safety-critical domains, their reliability is threatened by multimodal imp

safetyarxiv-cs-ai

30 Sept 2026

How Far Are We from Removing the Visual Encoder? Scaling Laws for Encoder-Free Multimodal Pretraining

arXiv:2609.35457v1 Announce Type: new Abstract: Most modern multimodal large language models (MLLMs) build on a pretrained visual encoder that provides a strong visual prior. Encoder-free MLLMs instea

tutorialsarxiv-cs-cv

29 Sept 2026

Structured Latent Modeling for Supervised Multimodal Information Decomposition

arXiv:2609.35502v1 Announce Type: new Abstract: Multimodal prediction relies on diverse forms of evidence: information repeated across modalities, cues specific to a single source, and complex cross-m

researcharxiv-cs-lg

29 Sept 2026

ChemMLLM: Chemical Multimodal Large Language Model

arXiv:2505.16326v3 Announce Type: replace Abstract: Recent years have seen rapid progress in multimodal large language models (MLLMs) in the field of chemistry. However, chemical MLLMs that can handle

28 Sept 2026

MM-VeriAgent: Learning to Use Extensive Tools to Verify Multimodal Misinformation with Reinforcement Learning

arXiv:2609.30698v1 Announce Type: new Abstract: Real-world multimodal misinformation often involves mixed forgery sources, requiring sample-specific detection strategies. Existing tool-augmented metho

safetyarxiv-cs-cv

28 Sept 2026

Multimodal Voice Activity Projection for Social Robot Mediation: Expected Behavior and Deployment Constraints

arXiv:2609.28317v1 Announce Type: new Abstract: Turn-taking prediction is especially relevant for social robots that act as mediators in human-human interaction, where the expected action is often not

researcharxiv-cs-ro

24 Sept 2026

PhyMo: A Physical-Field Modality for Multimodal AI4Physics

arXiv:2609.27554v1 Announce Type: cross Abstract: Multimodal learning is emerging as a powerful paradigm for AI for Physics (AI4Physics), where predicting physical systems requires the joint interpret

researcharxiv-cs-ai

24 Sept 2026

VMMU: A Vietnamese Multitask Multimodal Understanding and Reasoning Benchmark

arXiv:2508.13680v5 Announce Type: replace Abstract: We introduce VMMU, a Vietnamese Multitask Multimodal Understanding and Reasoning Benchmark designed to evaluate how vision-language models (VLMs) in

24 Sept 2026

FusionMMT: A Unified Multimodal and Multitask Learning Framework for Nuclear Fusion

arXiv:2609.26095v1 Announce Type: cross Abstract: With the growing global demand for energy, nuclear fusion has emerged as a promising direction for future clean energy. Tokamaks represent one of the

23 Sept 2026

MMAP: Multimodal Missing-Aware Pretraining for Longitudinal Alzheimer's Prediction

arXiv:2609.26617v1 Announce Type: cross Abstract: Clinical decision making heavily relies on predicting the disease progression trajectory by seeking to understand patient's health status which is cha

safetyarxiv-cs-lg

23 Sept 2026

Cognitive Action Reasoning for Proactive Robots from Human-Centered Multimodal Observations

arXiv:2609.23486v1 Announce Type: cross Abstract: Robots operating in human-centered environments are typically designed to execute explicit instructions, and most robot-learning datasets likewise pai

22 Sept 2026

Dissecting Training-Free Uncertainty Estimation in Multimodal Large Language Models

arXiv:2609.22206v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have achieved remarkable performance across a wide range of multimodal tasks, yet understanding and quantifying

22 Sept 2026

Enabling Vision and Cross-Modal Learning for Multimodal Stroke Recurrence Prediction: An Interpretable Two-Step Framework

arXiv:2609.22271v1 Announce Type: new Abstract: Multimodal stroke recurrence prediction requires effective integration of heterogeneous clinical and imaging data, yet modality imbalance often causes m