Search: “multimodal”

PrismaCoder: Pushing the Boundaries of Open Multimodal Code Intelligence through Decomposed Rubric Synthesis

arXiv:2610.20538v1 Announce Type: new Abstract: Multimodal code intelligence connects the symbolic world of programs with the visual world their execution creates. Interest in this capability is burge

researcharxiv-cs-cl

15 Oct 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

Toward Fine-Grained Forgetting:Attribute Unlearning for Multimodal Large Language Models

DGX agent

arXiv:2608.01008v2 Announce Type: replace Abstract: Multimodal large language models (MLLMs) can memorize and disclose sensitive information, motivating machine unlearning to remove designated knowled

local-aiarxiv-cs-ai

15 Oct 2026

Towards a Data-Centric Understanding of Spatial Reasoning in Multimodal Large Language Models

model-releasesarxiv-cs-cl

arXiv:2610.19108v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) have been widely applied in embodied agents and robotics for vision tasks. However, MLLMs suffer from limitat

15 Oct 2026

Understanding Unified VLMs: From Attention Probing to Guidance Tuning for Multimodal Generation

arXiv:2610.15227v1 Announce Type: new Abstract: Unified vision-language models (VLMs) perform both text-to-image (T2I) and image-to-text (I2T) generation with one shared Transformer backbone, yet how

15 Oct 2026

Heading Hierarchy Reconstruction for Complex and Long Documents with Level-Wise Multimodal Memory

arXiv:2610.18238v1 Announce Type: new Abstract: Vision-language models (VLMs) have been widely adopted for document parsing and optical character recognition (OCR), as they can accurately extract page

14 Oct 2026

Tutorials

MDN-VJEPA: Multimodal Probabilistic Joint-Embedding World Models

arXiv:2610.13956v1 Announce Type: new Abstract: Joint-Embedding Predictive Architectures (JEPAs) learn world models by predicting future representations rather than reconstructing observations. Variat

tutorialsarxiv-cs-lg

14 Oct 2026

JoyInside-VLM-Agent: Product-Conditioned Multimodal Policy Learning for Embodied Agents

arXiv:2610.12957v1 Announce Type: cross Abstract: Embodied agents must translate multimodal observations and user requests into executable actions while adapting to product constraints, changing goals

safetyarxiv-cs-ai

12 Oct 2026

S-Space: Exploring Spatial Workspace in Multimodal Language Models

arXiv:2610.13527v1 Announce Type: cross Abstract: Multimodal language models (MLLMs) exhibit promising spatial reasoning capabilities, yet the internal mechanisms supporting them remain poorly underst

researcharxiv-cs-cl

12 Oct 2026

The Evidence Anchoring Boundary: Where Visual Interventions Matter and When They Help in Multimodal LLMs

arXiv:2610.12981v1 Announce Type: cross Abstract: Visual interventions provide a training-free way to reduce hallucinations in multimodal large language models. However, an intervention may have littl

12 Oct 2026

From Surface to Depth: Towards Cognitive Appraisal Reasoning in Multimodal Emotion Understanding

arXiv:2610.11918v1 Announce Type: cross Abstract: Recent multimodal large language models (MLLMs) increasingly incorporate explainable reasoning for emotion understanding. However, reasoning based mai

9 Oct 2026

HRIL: Learning Multimodal Synergy via Higher-Order Tensor Modeling

arXiv:2610.12393v1 Announce Type: new Abstract: Self-supervised multimodal representation learning has achieved remarkable success across diverse domains, yet capturing synergistic information remains

9 Oct 2026

Self-correction Optimization for Interleaved Multimodal Generation

arXiv:2610.10400v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have made significant progress in visual understanding and generation. However, generating interleaved image--t

8 Oct 2026

AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking

model-releasesarxiv-cs-cl

arXiv:2601.17645v2 Announce Type: replace-cross Abstract: Internet audio-visual clips convey meaning through time-varying sound and motion, which extend beyond what text alone can represent. To examin

Dual-Modality Multi-Stage Adversarial Safety Training: Robustifying Multimodal Web Agents Against Cross-Modal Attacks

arXiv:2603.04364v2 Announce Type: replace-cross Abstract: Multimodal web agents that process both screenshots and accessibility trees are increasingly deployed to interact with web interfaces, yet the

safetyarxiv-cs-ai

Hardware

Efficient Multimodal Inference through Adaptive Acquisition and Sequential Fusion

arXiv:2610.07466v1 Announce Type: new Abstract: Multimodal systems often encode every available input, even when a subset suffices for prediction. Adaptive acquisition can reduce this cost by using pr

hardwarearxiv-cs-lg

Quantum Entangled Multimodal Fusion Networks (QEMFN): Resource-Aware Hybrid Vision-Language Fusion via Trainable Entanglement

arXiv:2610.08216v1 Announce Type: new Abstract: Multimodal vision-language systems typically fuse image and text embeddings through classical operators such as concatenation, attention, bilinear pooli

Reading, Not Manipulating: Leveraging Router Logits for Multimodal Safety in MoE Vision-Language Models

model-releasesarxiv-cs-cl

arXiv:2610.07774v1 Announce Type: new Abstract: Vision-language models (VLMs) face compositional safety risks where harmful intent emerges from the interaction between visual and textual inputs. As mi

A Multimodal Sequence-to-Sequence Model for Cross-Subject Prediction of Brain Responses to Naturalistic Stimuli

arXiv:2507.18104v3 Announce Type: replace Abstract: Brain encoding models predict time-resolved neural activity from computational representations of ongoing experience, providing a principled framewo

6 Oct 2026

HyperBrowseComp: A Multilingual and Multimodal Stress Test for Web-Browsing Agents

arXiv:2610.03574v1 Announce Type: new Abstract: We introduce HyperBrowseComp, a multilingual and multimodal browsing benchmark comprising 423 manually authored and human-validated questions across 13

Kinematics-Induced Multimodal 3D Human Pose Estimation with Subject-Level Privacy

arXiv:2610.02943v1 Announce Type: new Abstract: Multimodal 3D Human Pose Estimation (3D HPE) combines complementary information from RGB, LiDAR, and mmWave radar, but models trained on correlated obse

Seeing, Saying, but Not Using: From Reportable Spatial Facts to Usable States in Multimodal Large Language Models

arXiv:2610.02876v1 Announce Type: new Abstract: A multimodal large language model that correctly reports a spatial fact does not necessarily use that fact in subsequent reasoning. To study this distin

The Percept-V Challenge: Can Multimodal LLMs Crack Simple Perception Problems?

arXiv:2508.21143v4 Announce Type: replace Abstract: Cognitive science research treats visual perception, the ability to understand and make sense of a visual input, as one of the early developmental s

researcharxiv-cs-cl

Applications

Faithful Chart Generation for Multimodal Deep Research: Frame-Evidence Co-Adaptation

arXiv:2610.00374v1 Announce Type: cross Abstract: Analytical charts in multimodal deep research encode quantitative claims, requiring every visualized value to be faithfully grounded in supporting evi

applicationsarxiv-cs-ai

2 Oct 2026

Tutorials

HAWK: Rethinking Multimodal Drafting for Speculative Decoding

arXiv:2610.00623v1 Announce Type: new Abstract: Speculative decoding has achieved substantial lossless speedups for LLMs, but remains less effective for large vision-language models (LVLMs), where lig

tutorialsarxiv-cs-cv

2 Oct 2026

PRISM: A Category-Theoretic Framework for Measuring and Refining Multimodal Analogies

arXiv:2610.01383v1 Announce Type: new Abstract: Analogical reasoning involves identifying and preserving relational structures across domains. However, existing approaches to AI-driven multimodal anal

2 Oct 2026

Can We Anticipate Violence? Multimodal Learning from Pre-Incident Behavioral Cues

arXiv:2609.40014v1 Announce Type: new Abstract: Detecting violence after it begins is important from recognizing behavioral cues that appear immediately beforehand. This work studies short-horizon pre

DecoMoE: Decoupling Visual Propagation and Expert Computation for Efficient Multimodal MoE Inference

arXiv:2609.38823v1 Announce Type: new Abstract: Multimodal mixture-of-experts (MoE) models combine sparse expert activation with visual-language capabilities, yet their inference remains costly becaus

Does Gradient Conflict Predict the Understanding--Generation Trade-off? A Controlled Audit of Conflict-Metric Validity in Unified Multimodal Models

arXiv:2609.38465v1 Announce Type: cross Abstract: Unified multimodal models (UMMs) are increasingly designed around gradient conflict between understanding and generation objectives. The premise that

From Compound Figures to Medical Multi-image Reasoning: Scaling Multimodal Large Language Models with Biomedical Literature

arXiv:2511.22232v2 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) are increasingly capable in medical imaging, yet most focus on single-image settings. Clinical interp

From Image Interpretation to Clinical Reasoning: Upstream Physician-Context-Aware Multimodal Learning with Causal Reinforcement Learning

arXiv:2609.38924v1 Announce Type: new Abstract: Major adverse cardiovascular events (MACE) remain the leading cause of mortality worldwide. Opportunistic screening using routinely acquired clinical da

Is Better Teacher Supervision Enough? Unlocking Student-side Learning in Multimodal On-Policy Distillation

arXiv:2609.39120v1 Announce Type: new Abstract: On-policy distillation (OPD) improves reasoning by providing token-level supervision from a teacher on a student's own trajectories. Existing methods pr

Mutual Equilibrium: Multimodal Representation Learning through Reciprocal Feedback

arXiv:2609.39456v1 Announce Type: cross Abstract: This work proposes a mutual feedback architecture, MEQ, that refines the two inputs, of possibly different modalities, into a pair of coupled embeddin

Reinforcing Multimodal Reasoning via Token-Level Perception-Grounded Advantage Estimation

arXiv:2609.39168v1 Announce Type: new Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has improved the reasoning capabilities of Multimodal Large Language Models (MLLMs), yet existing

MatToolBench: Benchmarking Multimodal Agents in Real-World Materials Science Workflows

arXiv:2609.37053v1 Announce Type: new Abstract: Multimodal GUI agents have achieved impressive results on general software benchmarks, yet their ability to operate professional scientific software rem

MoTIF-X: A Multimodal Tokenized Framework for Interpretable and Extensible Molecular Representation Learning

arXiv:2609.37384v1 Announce Type: new Abstract: Molecular representation learning is central to computer-aided drug discovery. Molecular graphs, SMILES strings, and 3D conformations provide complement

researcharxiv-cs-lg

Local Ai

Task-Oriented Visual Feature Compression via Residual Vector Quantization for Device-Edge Multimodal Inference

arXiv:2609.37090v1 Announce Type: new Abstract: Large multimodal models (LMMs) support diverse visual understanding and reasoning tasks but are often impractical to run entirely on resource-constraine

local-aiarxiv-cs-cv

VISTA: Internalizing Collective Visual Experience via On-Policy Distillation for Active Multimodal Agents

arXiv:2609.38086v1 Announce Type: new Abstract: Active multimodal agents use visual tools to acquire task-relevant evidence while reasoning. Although reinforcement learning samples multiple interactio

Agents

FlowAct-R2: Beyond Talking Avatar via Streaming Multimodal References and Proactive Agent Planning

arXiv:2609.35728v1 Announce Type: new Abstract: We present FlowAct-R2, a framework for interactive humanoid video generation that combines continuous multimodal control with proactive agent planning.

agentsarxiv-cs-cv

InfiMed2: A Generalist Medical Multimodal Foundation Model from Contextual Evidence and Stability-Aware Supervision

arXiv:2609.34798v1 Announce Type: cross Abstract: Recent medical multimodal models have benefited from larger corpora, broader modality coverage, and stronger reasoning-oriented training, yet effectiv

MAD-Guard: Controlled Study of Autoregressive Generation versus Direct Decision Interfaces for Closed Multimodal Forensic Tasks

arXiv:2609.33683v1 Announce Type: new Abstract: When should multimodal foundation models generate tokens, and when should they directly output a decision? We present MAD-Guard, a controlled study of o

Narrow Multimodal Fine-Tuning Can Induce Emergent Misalignment

arXiv:2609.35291v1 Announce Type: cross Abstract: Modern AI models are aligned through post-training to adapt them to downstream tasks. Recent work shows that fine-tuning language models on narrow tas

Applications

T-MoXAI: A Hierarchical Explainability Framework for Temporal Multimodal Data

arXiv:2609.33685v1 Announce Type: new Abstract: Artificial Intelligence (AI) models for temporal multimodal data have potential in healthcare and agriculture, but their opacity can limit trust and ado

applicationsarxiv-cs-lg

VaME: Exploring Variational Latent Reasoning for Multimodal Embeddings

arXiv:2609.33402v1 Announce Type: new Abstract: Universal multimodal retrieval requires compact embeddings that preserve task-relevant semantic information across diverse modalities. Prior works have

Hyperbolic Multimodal Continual Learning: A Closest-Admissible Solution

arXiv:2609.29329v1 Announce Type: cross Abstract: Existing continual-learning methods protect parameters, replayed examples, or Euclidean feature subspaces. When applied to hyperbolic multimodal model

25 Sept 2026

Long-Tail Adaptive Flow Matching with Explicit Conditional Consistency Guidance for Precise Multimodal Face Synthesis

arXiv:2609.29581v1 Announce Type: new Abstract: Although diffusion-based methods have substantially improved the controllability of multimodal face synthesis, their semantic alignment remains suboptim

25 Sept 2026

SemMSA: Latent Semantic-Aided Robust Multimodal Sentiment Analysis with Incomplete Data

arXiv:2609.30238v1 Announce Type: new Abstract: Recent research on Multimodal Sentiment Analysis (MSA) has focused on learning from language, visual, and acoustic modalities with incomplete data to in

safetyarxiv-cs-cl

25 Sept 2026

HINT-Blimp: Human INTent Inference from Multimodal Cues for Robotic Blimps

arXiv:2609.27154v1 Announce Type: new Abstract: In human-robot interaction, traditional interfaces such as joysticks and handheld tablets introduce latency into navigation tasks and require the operat

researcharxiv-cs-ro

24 Sept 2026

Local Ai

LAYERSCOPE: A Layerwise Characterization of Video and Multimodal Learned Representations