Search: “multimodal”

Knowing When Not to Answer: Evaluating Abstention in Multimodal Reasoning Systems

arXiv:2604.14799v1 Announce Type: new Abstract: Effective abstention (EA), recognizing evidence insufficiency and refraining from answering, is critical for reliable multimodal systems. Yet existing e

17 Apr 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

MixAtlas: Uncertainty-aware Data Mixture Optimization for Multimodal LLM Midtraining

DGX agent

arXiv:2604.14198v1 Announce Type: cross Abstract: Domain reweighting can improve sample efficiency and downstream generalization, but data-mixture optimization for multimodal midtraining remains large

model-releasesarxiv-cs-cl

17 Apr 2026

A Domain-Specific Language for LLM-Driven Trigger Generation in Multimodal Data Collection

arXiv:2604.13046v1 Announce Type: cross Abstract: Data-driven systems depend on task-relevant data, yet data collection pipelines remain passive and indiscriminate. Continuous logging of multimodal se

local-aiarxiv-cs-cl

Dental-TriageBench: Benchmarking Multimodal Reasoning for Hierarchical Dental Triage

arXiv:2604.13060v1 Announce Type: new Abstract: Dental triage is a safety-critical clinical routing task that requires integrating multimodal clinical information (e.g., patient complaints and radiogr

Indexing Multimodal Language Models for Large-scale Image Retrieval

arXiv:2604.13268v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) have demonstrated strong cross-modal reasoning capabilities, yet their potential for vision-only tasks remain

researcharxiv-cs-cl

PersonaVLM: Long-Term Personalized Multimodal LLMs

arXiv:2604.13074v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) serve as daily assistants for millions. However, their ability to generate responses aligned with individual pr

AGMA: Adaptive Gaussian Mixture Anchors for Prior-Guided Multimodal Human Trajectory Forecasting

arXiv:2602.04204v2 Announce Type: replace Abstract: Human trajectory forecasting requires capturing the multimodal nature of pedestrian behavior. However, existing approaches suffer from prior misalig

15 Apr 2026

MultiDocFusion: Hierarchical and Multimodal Chunking Pipeline for Enhanced RAG on Long Industrial Documents

arXiv:2604.12352v1 Announce Type: new Abstract: RAG-based QA has emerged as a powerful method for processing long industrial documents. However, conventional text chunking approaches often neglect com

researcharxiv-cs-ai

15 Apr 2026

SEATrack: Simple, Efficient, and Adaptive Multimodal Tracker

arXiv:2604.12502v1 Announce Type: cross Abstract: Parameter-efficient fine-tuning (PEFT) in multimodal tracking reveals a concerning trend where recent performance gains are often achieved at the cost

15 Apr 2026

GAMBIT: A Gamified Jailbreak Framework for Multimodal Large Language Models

arXiv:2601.03416v2 Announce Type: replace Abstract: Multimodal Large Language Models (MLLMs) have become widely deployed, yet their safety alignment remains fragile under adversarial inputs. Previous

MMRareBench: A Rare-Disease Multimodal and Multi-Image Medical Benchmark

arXiv:2604.10755v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have advanced clinical tasks for common conditions, but their performance on rare diseases remains largely unte

Seeing Through Deception: Uncovering Misleading Creator Intent in Multimodal News with Vision-Language Models

arXiv:2505.15489v4 Announce Type: replace-cross Abstract: The impact of multimodal misinformation arises not only from factual inaccuracies but also from the misleading narratives that creators delibe

Sense Less, Infer More: Agentic Multimodal Transformers for Edge Medical Intelligence

arXiv:2604.10404v1 Announce Type: cross Abstract: Edge-based multimodal medical monitoring requires models that balance diagnostic accuracy with severe energy constraints. Continuous acquisition of EC

safetyarxiv-cs-lg

AssemLM: Spatial Reasoning Multimodal Large Language Models for Robotic Assembly

model-releasesarxiv-cs-ro

arXiv:2604.08983v1 Announce Type: new Abstract: Spatial reasoning is a fundamental capability for embodied intelligence, especially for fine-grained manipulation tasks such as robotic assembly. While

13 Apr 2026

Visually-Guided Policy Optimization for Multimodal Reasoning

arXiv:2604.09349v1 Announce Type: cross Abstract: Reinforcement learning with verifiable rewards (RLVR) has significantly advanced the reasoning ability of vision-language models (VLMs). However, the

safetyarxiv-cs-ai

13 Apr 2026

A Spatial-Spectral-Frequency Interactive Network for Multimodal Remote Sensing Classification

arXiv:2510.04628v2 Announce Type: replace Abstract: Deep learning-based methods have achieved significant success in remote sensing Earth observation data analysis. Numerous feature fusion techniques

ABMAMBA: Multimodal Large Language Model with Aligned Hierarchical Bidirectional Scan for Efficient Video Captioning

arXiv:2604.08050v1 Announce Type: new Abstract: In this study, we focus on video captioning by fully open multimodal large language models (MLLMs). The comprehension of visual sequences is challenging

Applications

DBMF: A Dual-Branch Multimodal Framework for Out-of-Distribution Detection

arXiv:2604.08261v1 Announce Type: new Abstract: The complex and dynamic real-world clinical environment demands reliable deep learning (DL) systems. Out-of-distribution (OOD) detection plays a critica

applicationsarxiv-cs-cv

Equivariant Multi-agent Reinforcement Learning for Multimodal Vehicle-to-Infrastructure Systems

arXiv:2604.06914v1 Announce Type: new Abstract: In this paper, we study a vehicle-to-infrastructure (V2I) system where distributed base stations (BSs) acting as road-side units (RSUs) collect multimod

safetyarxiv-cs-lg

Faithful-First Reasoning, Planning, and Acting for Multimodal LLMs

arXiv:2511.08409v4 Announce Type: replace Abstract: Multimodal Large Language Models (MLLMs) frequently suffer from unfaithfulness, generating reasoning chains that drift from visual evidence or contr

researcharxiv-cs-ai

Faithful GRPO: Improving Visual Spatial Reasoning in Multimodal Language Models via Constrained Policy Optimization

arXiv:2604.08476v1 Announce Type: new Abstract: Multimodal reasoning models (MRMs) trained with reinforcement learning with verifiable rewards (RLVR) show improved accuracy on visual reasoning benchma

safetyarxiv-cs-cv

GameWorld: Towards Standardized and Verifiable Evaluation of Multimodal Game Agents

arXiv:2604.07429v1 Announce Type: new Abstract: Towards an embodied generalist for real-world interaction, Multimodal Large Language Model (MLLM) agents still suffer from challenging latency, sparse f

Lost in the Hype: Revealing and Dissecting the Performance Degradation of Medical Multimodal Large Language Models in Image Classification

arXiv:2604.08333v1 Announce Type: new Abstract: The rise of multimodal large language models (MLLMs) has sparked an unprecedented wave of applications in the field of medical imaging analysis. However

Towards Effective Long Video Understanding of Multimodal Large Language Models via One-shot Clip Retrieval

arXiv:2512.08410v2 Announce Type: replace Abstract: Due to excessive memory overhead, most Multimodal Large Language Models (MLLMs) can only process videos of limited frames. In this paper, we propose

Beyond Invariance: Factor-wise Selective Treatment of Shifts for Multimodal Learning

arXiv:2610.21403v1 Announce Type: new Abstract: Distribution shifts pose a fundamental challenge to robust multimodal learning. Existing methods typically promote invariance by suppressing environment

researcharxiv-cs-cl

16 Oct 2026

Enhancing Multimodal RLVR with Pairwise Token Contrast and Adaptive Trajectory Confidence

arXiv:2610.21671v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) improves multimodal reasoning, but group-relative policy optimization broadcasts a single sequence

safetyarxiv-cs-cl

16 Oct 2026

GesBench: When and Where Do Multimodal Language Models Perceive Social Meaning?

arXiv:2610.15129v1 Announce Type: new Abstract: Human social perception is incremental: we infer intent before an utterance is complete, revise our interpretation as new cues arrive, and attend to spe

Learning Navigation from Multimodal Demonstrations with Geometric Candidate Modes

arXiv:2610.20241v1 Announce Type: new Abstract: Offline navigation demonstrations are multimodal, because one observation often allows several valid actions, such as passing an obstacle on either side

safetyarxiv-cs-ro

MARS: Harmonizing Multimodal Convergence via Adaptive Rank Search

model-releasesarxiv-cs-lg

arXiv:2603.00720v2 Announce Type: replace Abstract: Fine-tuning Multimodal Large Language Models (MLLMs) with parameter-efficient methods like Low-Rank Adaptation (LoRA) is crucial for task adaptation

MultiFlow: Vision-Driven Multimodal fMRI Encoding via Stimulus-Informed Source Flow Matching

arXiv:2610.15339v1 Announce Type: new Abstract: Current fMRI encoding models frame prediction as deterministic regression, yet identical stimuli evoke a distribution of neural responses (arising from

researcharxiv-cs-ai

Reliability-Aware Multimodal Sentiment Prediction Under Local Modality Missingness

arXiv:2610.20543v1 Announce Type: new Abstract: Multimodal sentiment models are usually evaluated on complete utterances, yet streams often lose a contiguous span of text, audio, or video. We study lo

ChemExplain: A Multimodal Benchmark for Explanatory Chemical Reasoning

arXiv:2610.17183v1 Announce Type: cross Abstract: Current chemistry benchmarks primarily evaluate outcome prediction or reaction pathway generation, but rarely test whether a model can explain why an

GReFEM: Multimodal LLMs as Zero-Shot Semantic Assistants for Physics-Guided 3D Mesh Refinement

arXiv:2607.08798v2 Announce Type: replace-cross Abstract: Adaptive volumetric finite element meshing traditionally requires iterative PDE solvers or heavily supervised, data-driven surrogates trained

Rethinking Projector Training in Multimodal LLMs

arXiv:2610.18598v1 Announce Type: new Abstract: Multimodal LLMs are typically trained by first aligning a vision encoder with a language model via projector training on large image-caption datasets, f

safetyarxiv-cs-cv

SOVABench: A Vehicle Surveillance Action Retrieval Benchmark for Multimodal Large Language Models

arXiv:2601.04824v3 Announce Type: replace Abstract: Automatic identification of events and recurrent behavior analysis are critical for video surveillance. However, most existing content-based video r

VIEWCRAFT: Evolving What Multimodal Agents See and How They Read It

arXiv:2610.15915v1 Announce Type: new Abstract: Reusable skills improve multimodal agents without updating model weights, but their effectiveness depends on both the evidence presented and the procedu

Visual Tokens on Demand: Visual Budgeting for Scalable and Efficient Multi-Image Reasoning in Multimodal LLMs

arXiv:2610.18858v1 Announce Type: new Abstract: Multimodal large language models have advanced rapidly, but most remain optimized for single-image inputs. Multi-image reasoning is costly because each

EmoGavel: Grounding-Aware Reinforcement Learning with Verifiable Rewards for Multimodal Emotion Preference Learning

model-releasesarxiv-cs-lg

arXiv:2610.13353v1 Announce Type: cross Abstract: Multimodal emotion preference learning uses pairwise comparisons to identify which open-ended emotion descriptions align more closely with human judgm

MotionCoach: Constructing Multimodal Guidance for Video Professional Motion Editing

arXiv:2610.12963v1 Announce Type: cross Abstract: Video editing models achieve strong performance in modifying appearance, backgrounds, styles, and motions, empowered by large-scale training data. Bey

safetyarxiv-cs-ai

Multimodal Image-based Robotic Assistance and Guidance Environment (MIRAGE): A Novel Unified Framework for Surgical Navigation and Visualization

arXiv:2610.12780v1 Announce Type: new Abstract: This paper presents the computational architecture and quantitative preclinical evaluation of MIRAGE, a multimodal image-guided robotic surgery framewor

researcharxiv-cs-ro

Retrieval-Augmented Multimodal Language Model with Heterogeneous Evidence Integration for Clinical Prognosis

arXiv:2610.13510v1 Announce Type: new Abstract: Clinical prognosis requires integrating structured measurements, physiological waveforms, longitudinal history, and population context. We introduce PRI

Autoregressive Retriever: Improving Query Understanding from Item Feedback for Universal Multimodal Retrieval

arXiv:2610.11666v1 Announce Type: cross Abstract: Universal multimodal retrieval typically encodes a query once and ranks independently indexed items by embedding similarity. This design supports effi

CoPoE: Multimodal Fusion via Decomposable Disease-Coordinate Product-of-Experts for Missing-Modality Alzheimer's Diagnosis

arXiv:2610.11394v1 Announce Type: cross Abstract: Multimodal Alzheimer's disease (AD) diagnosis benefits from integrating heterogeneous clinical, imaging, genomic, and biomarker evidence, but clinical

GeoReform: Reflective Formalization Evolution for Multimodal Geometry Problem Solving

arXiv:2610.12391v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) often struggle to identify and use geometric relations in diagrams. Recent methods address this challenge by co

safetyarxiv-cs-ai

MissMAC-Bench: Building Solid Benchmark for Missing Modality Issue in Robust Multimodal Affective Computing

arXiv:2602.00811v2 Announce Type: replace Abstract: Current Multimodal Affective Computing (MAC) systems heavily rely on the completeness of multiple modalities to accurately understand human's affect

When History Helps and Hurts: Selective History Use across Multimodal Turns

arXiv:2610.11948v1 Announce Type: new Abstract: Reliable multimodal interaction depends on selective use of conversational history: an earlier question may remain relevant while its previous answer is

MemoCare: An Interactive Multimodal Mobile System for Automated Cognitive Screening

arXiv:2610.10448v1 Announce Type: cross Abstract: MemoCare is an interactive mobile system for automated multimodal cognitive screening. A React Native application combines spoken responses, temporal

8 Oct 2026

Applications

MoR-MLLM: Mixture of Recursions for Efficient Multimodal Large Language Models