Search: “multimodal”

Uncovering Grounding IDs: How External Cues Shape Multi-Modal Binding

arXiv:2509.24072v5 Announce Type: replace-cross Abstract: Large vision-language models (LVLMs) perform well on multimodal tasks, but their ability to reason and precisely align visual and textual info

16 Oct 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

ActiveEvidence: Decision-Focused Evidence Graphs with Verifiable Acquisition Gaps

DGX agent

arXiv:2610.20532v1 Announce Type: cross Abstract: A multimodal agent must decide whether visual evidence is worth acquiring, which candidate or resolution to query, and when further interaction can no

safetyarxiv-cs-cv

15 Oct 2026

Beyond Static Cues: Unified Dynamic Detection of MLLM Backdoors via Dual-Flow Trajectory Analysis

arXiv:2610.20319v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) are increasingly deployed in safety-critical domains, yet their susceptibility to backdoor attacks remains a fo

CLIVO: Differentiable Cluster-Based Instruction Mixing with Learned Validation Objectives

arXiv:2610.16876v1 Announce Type: new Abstract: Target-aware multimodal instruction selection requires useful examples and an appropriate balance of supervision. Sample-level rankings can overrepresen

Designing Textual Interfaces To Enhance Llm Reasoning On Audio-Visual Question Answering

model-releasesarxiv-cs-cl

arXiv:2610.20085v1 Announce Type: cross Abstract: Automatic prompt optimization (APO) has shown strong effectiveness for text-based LLMs and LLM systems, but its application to audio-visual understand

Do you 'see' what I 'see'? A Multi-panel Visual Question Answer Dataset for Large Language Model Chart Analysis

arXiv:2610.14173v1 Announce Type: cross Abstract: Digital libraries increasingly host scientific publications whose figures encode primary research findings, yet making this visual content searchable,

Learning Perception to Action Rules through Reinforcement Learning for Theory-of-Mind Reasoning

arXiv:2610.19796v1 Announce Type: cross Abstract: In Theory-of-Mind (ToM) reasoning, large language models may correctly infer the agent's mental state but fail to use that inference when predicting o

safetyarxiv-cs-cl

LifeSearch: Benchmarking Deep Research Agents for Real-World Life and Productivity

arXiv:2610.18092v1 Announce Type: new Abstract: Deep research (DR) agents address open-ended information needs through multi-step reasoning, long-horizon web search, and evidence synthesis. However, e

Tutorials

ReferFlow: Beyond Final-Target Localization for Complex Referring Expressions

arXiv:2610.20352v1 Announce Type: new Abstract: Multimodal Large Language Models have made significant progress in referring expression comprehension (REC), yet most REC benchmarks still focus on fina

tutorialsarxiv-cs-cv

RouteWeaver: Weaving Mode Selection and Execution into Unified LLM Routing

arXiv:2610.19705v1 Announce Type: new Abstract: LLM routing dynamically selects and coordinates heterogeneous language models across diverse tasks. However, existing approaches are largely built aroun

safetyarxiv-cs-cl

The Gap Is in the Geometry: A Convergent Meta-Analysis of Multi-Facet Aerial and Remote Sensing Video Understanding

arXiv:2610.19102v1 Announce Type: new Abstract: Aerial and remote sensing video is increasingly evaluated like web video, by posing multiple-choice questions to multimodal large language models (MLLMs

VC-OPD: Visual Counterfactual On-Policy Distillation for Grounded Vision-Language Reasoning

arXiv:2610.14939v1 Announce Type: new Abstract: GRPO-style reinforcement learning has advanced vision-language reasoning, but its sequence-level rewards provide limited credit assignment for individua

Can Synthetic UAV Benchmarks Be Trusted? Real-Synthetic Validation for UAV Model Selection

arXiv:2610.14647v1 Announce Type: new Abstract: Synthetic UAV imagery can expand pre-deployment test evidence when task-specific Real data are scarce, but visual plausibility or semantic label alignme

DPOison-VL: Clean Preference Poisoning in Vision-Language Direct Preference Optimization

arXiv:2610.18609v1 Announce Type: cross Abstract: Direct Preference Optimization (DPO) has become a widely adopted approach for aligning vision-language models (VLMs), yet the security of multimodal p

EmoGenie: Benchmarking and Evaluating Expressed and Evoked Emotion in T2I Generation with MLLMs

arXiv:2610.18455v1 Announce Type: new Abstract: Rapid advances in artificial intelligence-generated content (AIGC) have significantly promoted using text-to-image (T2I) models to generate images with

FASHION-RQ: Mining Hierarchical Semantic Structure for Automated Evaluation of Fashion Retrieval

arXiv:2610.17841v1 Announce Type: cross Abstract: Evaluating fashion retrieval systems remains challenging due to the limited availability of benchmarks that capture the fine-grained, open-ended queri

PhySimCode: A Benchmark and Evaluation Method for Physics Video to Code Generation

arXiv:2610.15722v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) are good at video understanding and code generation, but it remains unclear whether they can recover the physic

Self-Verifier Capture in Unified Visual Generators: Diagnosing and Repairing Closed-Loop Self-Reward

arXiv:2610.16500v1 Announce Type: new Abstract: Image-space reward requires decoding and a separate judge; unified visual generators can instead reuse their understanding pathway for decode-free, self

Tutorials

Towards Modality-Agnostic Seizure Classification: A Unified Deep Learning Framework for Heterogeneous EEG and Intracranial EEG Signals

arXiv:2610.16596v1 Announce Type: new Abstract: Seizure prediction and detection, essential for clinical treatment of epilepsy, remain the crucial task of this neurological disease. EEG and iEEG are w

tutorialsarxiv-cs-lg

VL-DocIR: A Benchmark for Vision-Based Long Document Information Retrieval

arXiv:2610.17057v1 Announce Type: cross Abstract: Vision-based document retrieval has improved rapidly, but current evaluation settings still emphasize short documents and single relevant pages. This

XForecast: The KDD 2026 Finance Day Challenge on News-Grounded Financial Forecasting

model-releasesarxiv-cs-lg

arXiv:2610.16131v1 Announce Type: new Abstract: Financial forecasting has traditionally relied on numerical time-series (TS) signals, while textual information such as news remains largely underutiliz

AdaC-GRPO: Towards Mastering Long-Horizon Visual Sudoku Puzzles via Adaptive Curriculum Learning

arXiv:2610.13184v1 Announce Type: new Abstract: While reinforcement learning with verifiable reward (RLVR) enhances reasoning in large language models, its efficacy in long-horizon multimodal tasks re

12 Oct 2026

Applications

Cognition-Oriented Emotion Tracing from Causes to Consequences in Real-World Social Scenes

arXiv:2610.11410v1 Announce Type: new Abstract: Affective computing has progressed from categorical emotion recognition to open-ended affective analysis with large multimodal models. Yet affective sci

applicationsarxiv-cs-ai

Control-Ready Uncertainty for Trajectory Diffusion

arXiv:2610.12431v1 Announce Type: new Abstract: Diffusion models can represent complex, multimodal trajectory distributions, but extracting uncertainty from them typically requires costly Monte Carlo

safetyarxiv-cs-ro

Instruction-Conditioned Electromagnetic Spectrum Understanding via Budget-Adaptive Signal Tokenization

arXiv:2610.12142v1 Announce Type: new Abstract: Electromagnetic spectrum monitoring increasingly requires flexible analysis beyond task-specific recognition and detection. Multimodal large language mo

PXtal: Learning to Align Powder X-Ray Diffraction and Crystal Structures under Information Asymmetry across Modalities

arXiv:2610.10653v1 Announce Type: new Abstract: Scientific multimodal learning commonly assumes that paired views are comparably informative. Powder X-ray diffraction (PXRD) makes this mismatch explic

safetyarxiv-cs-lg

Revisiting Identity and Spectra Dispersion in Media-Bridged Time Series Forecasting: Linking Multivariate Signals and Narrative Flows

arXiv:2610.11924v1 Announce Type: new Abstract: Media-bridged time series forecasting is expanding to encompass traditional 'multivariate' and emerging 'multimodal' (e.g., through textual assistance).

Selective Listening: Mechanism-Guided Control of Audio Influence in Large Audio-Language Models

arXiv:2610.11196v1 Announce Type: cross Abstract: Large audio-language models (LALMs) exploit multimodal evidence, yet task-irrelevant audio can alter text-reasoning decisions when listening is unnece

researcharxiv-cs-cl

RoboQuest: Generalist Physical Agents that Search, Inspect and Test

arXiv:2610.10388v1 Announce Type: cross Abstract: Recent advances in multimodal foundation models have made them capable generalist physical agents for a range of manipulation tasks. However, successf

8 Oct 2026

Graph-Based Recognition of Simulated Train-Driver States From Facial and Upper-Body Keypoints

arXiv:2610.07083v1 Announce Type: cross Abstract: Driver fatigue poses a significant challenge to railway safety, with traditional systems like the dead-man switch offering limited and basic alertness

7 Oct 2026

Representation Bias, Correction Transfer, and Resolution Sensitivity in Three-Dimensional Mitochondrial Morphometry

arXiv:2610.07582v1 Announce Type: new Abstract: Quantitative imaging pipelines can produce precise but systematically different measurements of the same object. We present an empirical reliability ass

7 Oct 2026

Two Vectors Replace In-Context Demos: Structured Task Adaptation via Embeddings

arXiv:2610.07572v1 Announce Type: new Abstract: In-context learning (ICL) adapts frozen large multimodal models (LMMs) to new tasks from a few demonstrations (demos), but re-encodes them at every quer

researcharxiv-cs-cl

7 Oct 2026

AgroGround: Multi-Granularity Grounded Recognition in Agriculture

arXiv:2610.04425v1 Announce Type: new Abstract: Agricultural visual models are typically evaluated for either recognition or localization, but reliable diagnosis requires identifying what is present a

ASD-FEAT: A Multi-Modal Infant Video-Derived Dataset for Early ASD Risk Prediction

arXiv:2610.04051v1 Announce Type: new Abstract: Accurate early screening for Autism Spectrum Disorder (ASD) is a precursor to timely intervention, which is critical for improving cognitive and behavio

researcharxiv-cs-cv

FairRSFM: A Biome-Aware Benchmark and Debiasing Framework for Remote Sensing Foundation Models

arXiv:2610.05790v1 Announce Type: new Abstract: Remote sensing foundation models (RSFMs) are commonly evaluated using aggregate metrics, which can hide systematic performance disparities across ecolog

Hardware

FlashGaze: Training-Free Multi-Scale Patch Pruning For Efficient Video Understanding

arXiv:2610.04225v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have demonstrated strong performance in video understanding, yet efficiently processing long, high-resolution v

hardwarearxiv-cs-cv

Agents

VepAgent: Bridging Causal-Transition via Tool-Augmented Reinforcement Learning for Video Event Prediction

arXiv:2610.06293v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have demonstrated remarkable potential in video understanding, yet their reliance on retrospective summarizatio

agentsarxiv-cs-cv

AMBER: Multi-View Adaptive Budget Allocation for Listwise Vision-Language Reranking

arXiv:2610.02831v1 Announce Type: new Abstract: Vision-language models (VLMs) are powerful listwise rerankers for multimodal retrieval, but high inference costs restrict them to evaluating small local

5 Oct 2026

Local Ai

Beyond Entropy: Self-Diagnostic Multi-Role Token Optimization for Video Reasoning

arXiv:2610.03400v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards has substantially advanced multimodal reasoning, yet it remains fundamentally limited by ambiguous token-

local-aiarxiv-cs-cv

5 Oct 2026

Measure Less, Know More: Self-Supervised Test-Time Feature Acquisition

arXiv:2610.03454v1 Announce Type: cross Abstract: Recent progress in multimodal, high-dimensional learning has enabled foundation models to process heterogeneous, large-scale data. However, at test ti

5 Oct 2026

CompMat-Bench: Benchmarking AI Agents for Computational Materials Science

arXiv:2610.00636v1 Announce Type: new Abstract: Evaluating AI agents on scientific research tasks is constrained by the time and resources required for the underlying experiments or calculations. In c

Embedding Prediction Helps Image Generation

arXiv:2610.02203v1 Announce Type: new Abstract: In diffusion transformers, a class label or a text prompt is embedded once, and the same condition is reused at every denoising step. We ask whether pre

researcharxiv-cs-cv

Applications

Multi-Sensor Fusion for UAV Classification Based on Feature Maps of Image and Radar Data

arXiv:2410.16089v3 Announce Type: replace Abstract: The cost, flexibility, and efficiency of modern UAVs make them attractive across many applications, but their proliferation has driven a rising numb

applicationsarxiv-cs-ai

PhysVista: Benchmarking Physical Intelligence in VLMs via a Perception-Reasoning-Assessment Loop

arXiv:2610.00559v1 Announce Type: new Abstract: Vision-Language Models (VLMs) have shown strong multimodal reasoning capabilities, yet whether they truly capture the physical consistency underlying re

Context-Aware Classification and Grading of Sensitive Information in Online Conversational Health Data

arXiv:2601.09717v2 Announce Type: replace-cross Abstract: Online medical consultations contain sensitive health information whose privacy implications depend not only on the entities mentioned but als

ITO: Multi-View Alignment and Training-Time Fusion for Image-Text Pretraining

arXiv:2603.02767v4 Announce Type: replace-cross Abstract: Image--text contrastive pretraining has become a dominant paradigm for visual representation learning, yet existing methods often yield repres

Learning to Reason with Compressed Context: Ground-Truth-Free Adaptation of OmniLLMs via Self-Distillation

arXiv:2609.39953v1 Announce Type: new Abstract: Omni-modal large language models (OmniLLMs) enable unified audio-video understanding, but their long multimodal token sequences make deployment computat

LongEmo: Towards Emotion Understanding and Reasoning in Long Videos

arXiv:2609.40079v1 Announce Type: cross Abstract: While recent Multimodal Large Language Models (MLLMs) have shown promise in affective computing, their reasoning capabilities are largely confined to