Search: “multimodal”

Human-Grounded Multimodal Benchmark with 900K-Scale Aggregated Student Response Distributions from Japan's National Assessment of Academic Ability

arXiv:2605.11663v1 Announce Type: new Abstract: Authentic school examinations provide a high-validity test bed for evaluating multimodal large language models (MLLMs), yet benchmarks grounded in Japan

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

OmniThoughtVis: A Scalable Distillation Pipeline for Deployable Multimodal Reasoning Models

arXiv:2605.11629v1 Announce Type: new Abstract: Recent multimodal large language models (MLLMs) have shown strong chain-of-thought (CoT) reasoning ability on vision-language tasks, but their direct de

applicationsarxiv-cs-cl

PresentAgent-2: Towards Generalist Multimodal Presentation Agents

arXiv:2605.11363v1 Announce Type: cross Abstract: Presentation generation is moving beyond static slide creation toward end-to-end presentation video generation with research grounding, multimodal med

STAGE: Tackling Semantic Drift in Multimodal Federated Graph Learning

arXiv:2605.11919v1 Announce Type: new Abstract: Federated graph learning (FGL) enables collaborative training on graph data across multiple clients. As graph data increasingly contain multimodal node

Very Efficient Listwise Multimodal Reranking for Long Documents

arXiv:2605.11864v1 Announce Type: cross Abstract: Listwise reranking is a key yet computationally expensive component in vision-centric retrieval and multimodal retrieval-augmented generation (M-RAG)

AgentRx: A Benchmark Study of LLM Agents for Multimodal Clinical Prediction Tasks

model-releasesarxiv-cs-ai

arXiv:2605.10286v1 Announce Type: new Abstract: Building effective clinical decision support systems requires the synthesis of complex heterogeneous multimodal data. Such modalities include temporal e

DeltaRubric: Generative Multimodal Reward Modeling via Joint Planning and Verification

arXiv:2605.09269v1 Announce Type: new Abstract: Aligning Multimodal Large Language Models (MLLMs) requires reliable reward models, yet existing single-step evaluators can suffer from lazy judging, exp

researcharxiv-cs-cl

FLAME: Adaptive Mixture-of-Experts for Continual Multimodal Multi-Task Learning

arXiv:2605.09355v1 Announce Type: new Abstract: Real-world model deployment across multiple domains requires multimodal models to operate under two complementary regimes: (1) multi-task pretraining, t

SciVQR: A Multidisciplinary Multimodal Benchmark for Advanced Scientific Reasoning Evaluation

arXiv:2605.10187v1 Announce Type: new Abstract: Scientific reasoning is a key aspect of human intelligence, requiring the integration of multimodal inputs, domain expertise, and multi-step inference a

TRACER: Verifiable Generative Provenance for Multimodal Tool-Using Agents

arXiv:2605.09934v1 Announce Type: new Abstract: Multimodal large language models increasingly solve vision-centric tasks by calling external tools for visual inspection, OCR, retrieval, calculation, a

STARFlow2: Bridging Language Models and Normalizing Flows for Unified Multimodal Generation

arXiv:2605.08029v1 Announce Type: new Abstract: Deep generative models have advanced rapidly across text and vision, motivating unified multimodal systems that can understand, reason over, and generat

11 May 2026

Training-Free Multimodal Large Language Model Orchestration

arXiv:2508.10016v3 Announce Type: replace Abstract: Building interactive omni-modal assistants often relies on end-to-end multimodal alignment to fuse heterogeneous modalities, which incurs substantia

11 May 2026

MULTIBENCH++: A Unified and Comprehensive Multimodal Fusion Benchmarking Across Specialized Domains

arXiv:2511.06452v3 Announce Type: replace Abstract: Although multimodal fusion has made significant progress, its advancement is severely hindered by the lack of adequate evaluation benchmarks. Curren

7 May 2026

OpenSearch-VL: An Open Recipe for Frontier Multimodal Search Agents

arXiv:2605.05185v1 Announce Type: new Abstract: Deep search has become a crucial capability for frontier multimodal agents, enabling models to solve complex questions through active search, evidence v

agentsarxiv-cs-cv

7 May 2026

Stable Multimodal Graph Unlearning via Feature-Dimension Aware Quantile Selection

arXiv:2605.03303v1 Announce Type: new Abstract: Graph unlearning remains a critical technique for supporting privacy-preserving and sustainable multimodal graph learning. However, we observe that exis

6 May 2026

EmoMM: Benchmarking and Steering MLLM for Multimodal Emotion Recognition under Conflict and Missingness

arXiv:2605.01024v1 Announce Type: new Abstract: Multimodal Emotion Recognition (MER) is critical for interpreting real-world interactions. While Multimodal Large Language Models (MLLM) have shown prom

5 May 2026

Quantifying Multimodal Capabilities: Formal Generalization Guarantees in Pairwise Metric Learning

arXiv:2605.01424v1 Announce Type: new Abstract: Multimodal learning leverages the integration of diverse data modalities to enhance performance in complex tasks. Yet, it frequently encounters incomple

applicationsarxiv-cs-lg

5 May 2026

TRIP-Evaluate: An Open Multimodal Benchmark for Evaluating Large Models in Transportation

arXiv:2605.00907v1 Announce Type: new Abstract: Large language models (LLMs) and multimodal large models (MLLMs) are increasingly used for transportation tasks such as regulation question answering, t

5 May 2026

SWAN: World-Aware Adaptive Multimodal Networks for Runtime Variations

arXiv:2604.26181v1 Announce Type: new Abstract: Multimodal deep neural networks deployed in realistic environments must contend with runtime variations: changes in modality quality, overall input comp

agentsarxiv-cs-lg

30 Apr 2026

MERIT: Modular Framework for Multimodal Misinformation Detection with Web-Grounded Reasoning

arXiv:2510.17590v2 Announce Type: replace Abstract: We present MERIT, an inference-time modular framework for multimodal misinformation detection that decomposes verification into four specialized mod

safetyarxiv-cs-ai

Modeling Induced Pleasure through Cognitive Appraisal Prediction via Multimodal Fusion

arXiv:2604.23753v1 Announce Type: new Abstract: Multimodal affective computing analyzes user-generated social media content to predict emotional states. However, a critical gap remains in understandin

researcharxiv-cs-ai

Multimodal Remote Inference

arXiv:2508.07555v3 Announce Type: replace Abstract: We consider a remote inference system with multiple modalities, where a multimodal machine learning (ML) model performs real-time inference using fe

safetyarxiv-cs-lg

PDF-WuKong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse Sampling

model-releasesarxiv-cs-ai

arXiv:2410.05970v3 Announce Type: replace-cross Abstract: Multimodal document understanding is a challenging task to process and comprehend large amounts of textual and visual information. Recent adva

Handling Missing Modalities in Multimodal Survival Prediction for Non-Small Cell Lung Cancer

arXiv:2601.10386v2 Announce Type: replace-cross Abstract: Accurate survival prediction in Non-Small Cell Lung Cancer (NSCLC) requires integrating clinical, radiological, and histopathological data. Mu

safetyarxiv-cs-ai

27 Apr 2026

AITP: Traffic Accident Responsibility Allocation via Multimodal Large Language Models

arXiv:2604.20878v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have achieved remarkable progress in Traffic Accident Detection (TAD) and Traffic Accident Understanding (TAU).

24 Apr 2026

MiMIC: Mitigating Visual Modality Collapse in Universal Multimodal Retrieval While Avoiding Semantic Misalignment

arXiv:2604.21326v1 Announce Type: cross Abstract: Universal Multimodal Retrieval (UMR) aims to map different modalities (e.g., visual and textual) into a shared embedding space for multi-modal retriev

researcharxiv-cs-ai

24 Apr 2026

Towards Multimodal Active Learning: Efficient Learning with Limited Paired Data

model-releasesarxiv-cs-ai

arXiv:2510.03247v2 Announce Type: replace-cross Abstract: Active learning (AL) is a principled strategy to reduce annotation cost in data-hungry deep learning. However, existing AL algorithms focus al

24 Apr 2026

From Raw Features to Effective Embeddings: A Three-Stage Approach for Multimodal Recipe Recommendation

arXiv:2511.19176v3 Announce Type: replace Abstract: Recipe recommendation has become an essential task in web-based food platforms. A central challenge is effectively leveraging rich multimodal featur

applicationsarxiv-cs-lg

23 Apr 2026

LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model

arXiv:2604.20796v1 Announce Type: new Abstract: We present LLaDA2.0-Uni, a unified discrete diffusion large language model (dLLM) that supports multimodal understanding and generation within a nativel

23 Apr 2026

SSL-R1: Self-Supervised Visual Reinforcement Post-Training for Multimodal Large Language Models

arXiv:2604.20705v1 Announce Type: new Abstract: Reinforcement learning (RL) with verifiable rewards (RLVR) has demonstrated the great potential of enhancing the reasoning abilities in multimodal large

23 Apr 2026

Multimodal Data Integration: Production Architectures for Healthcare AI

This Databricks resource discusses production-ready architectural approaches for integrating multimodal data (structured, unstructured, images, text, etc.) in healthcare AI systems. It likely covers b

applicationsdatabricks

PanDA: Unsupervised Domain Adaptation for Multimodal 3D Panoptic Segmentation in Autonomous Driving

arXiv:2604.19379v1 Announce Type: new Abstract: This paper presents the first study on Unsupervised Domain Adaptation (UDA) for multimodal 3D panoptic segmentation (mm-3DPS), aiming to improve general

agentsarxiv-cs-cv

ProjLens: Unveiling the Role of Projectors in Multimodal Model Safety

arXiv:2604.19083v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) have achieved remarkable success in cross-modal understanding and generation, yet their deployment is threate

safetyarxiv-cs-ai

VimRAG: Navigating Massive Visual Context in Retrieval-Augmented Generation via Multimodal Memory Graph

arXiv:2602.12735v2 Announce Type: replace-cross Abstract: Effectively retrieving, reasoning, and understanding multimodal information remains a critical challenge for agentic systems. Traditional Retr

Culture-Aware Humorous Captioning: Multimodal Humor Generation across Cultural Contexts

arXiv:2604.18091v1 Announce Type: new Abstract: Recent multimodal large language models have shown promising ability in generating humorous captions for images, yet they still lack stable control over

Evaluating Multimodal LLMs for Inpatient Diagnosis: Real-World Performance, Safety, and Cost Across Ten Frontier Models

arXiv:2604.16980v1 Announce Type: new Abstract: Background: Large language models (LLMs) are increasingly proposed for diagnostic support, but few evaluations use real-world multimodal inpatient data,

Instinct vs. Reflection: Unifying Token and Verbalized Confidence in Multimodal Large Models

arXiv:2604.17274v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have demonstrated exceptional capabilities in various perception and reasoning tasks. Despite this success, ens

safetyarxiv-cs-cv

mEOL: Training-Free Instruction-Guided Multimodal Embedder for Vector Graphics and Image Retrieval

arXiv:2604.17054v1 Announce Type: new Abstract: Scalable Vector Graphics (SVGs) function both as visual images and as structured code that encode rich geometric and layout information, yet most method

Multimodal Claim Extraction for Fact-Checking

arXiv:2604.16311v1 Announce Type: new Abstract: Automated Fact-Checking (AFC) relies on claim extraction as a first step, yet existing methods largely overlook the multimodal nature of today's misinfo

Reducing Peak Memory Usage for Modern Multimodal Large Language Model Pipelines

arXiv:2604.16734v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have recently demonstrated strong capabilities in understanding and generating responses from diverse visual in

Retrieval-Augmented Multimodal Model for Fake News Detection

arXiv:2604.18112v1 Announce Type: new Abstract: In recent years, multimodal multidomain fake news detection has garnered increasing attention. Nevertheless, this direction presents two significant cha

Scaling Beyond Context: A Survey of Multimodal Retrieval-Augmented Generation for Document Understanding

arXiv:2510.15253v3 Announce Type: replace Abstract: Document understanding is critical for applications from financial analysis to scientific discovery. Current approaches, whether OCR-based pipelines

agentsarxiv-cs-cl

M3R: Localized Rainfall Nowcasting with Meteorology-Informed MultiModal Attention

arXiv:2604.15377v1 Announce Type: cross Abstract: Accurate and timely rainfall nowcasting is crucial for disaster mitigation and water resource management. Despite recent advances in deep learning, pr

safetyarxiv-cs-cv

20 Apr 2026

PixDLM: A Dual-Path Multimodal Language Model for UAV Reasoning Segmentation

arXiv:2604.15670v1 Announce Type: new Abstract: Reasoning segmentation has recently expanded from ground-level scenes to remote-sensing imagery, yet UAV data poses distinct challenges, including obliq

20 Apr 2026

Cornfigurator: Automated Planning for Any-to-Any Multimodal Model Serving

arXiv:2512.14098v3 Announce Type: replace Abstract: Any-to-Any models are an emerging class of multimodal models that accept combinations of text and multimodal data as input and generate them as outp

researcharxiv-cs-lg

17 Apr 2026

RaTA-Tool: Retrieval-based Tool Selection with Multimodal Large Language Models

arXiv:2604.14951v1 Announce Type: cross Abstract: Tool learning with foundation models aims to endow AI systems with the ability to invoke external resources -- such as APIs, computational utilities,

17 Apr 2026

Local Ai

The Cost of Language: Centroid Erasure Exposes and Exploits Modal Competition in Multimodal Language Models

arXiv:2604.14363v1 Announce Type: new Abstract: Multimodal language models systematically underperform on visual perception tasks, yet the structure underlying this failure remains poorly understood.

local-aiarxiv-cs-cl

17 Apr 2026

ChartNet: A Million-Scale, High-Quality Multimodal Dataset for Robust Chart Understanding

arXiv:2603.27064v2 Announce Type: replace-cross Abstract: Understanding charts requires models to jointly reason over geometric visual patterns, structured numerical data, and natural language -- a ca