Search: “multimodal”

4D-RGPT: Toward Region-level 4D Understanding via Perceptual Distillation

arXiv:2512.17012v3 Announce Type: replace Abstract: Despite advances in Multimodal LLMs (MLLMs), their ability to reason over 3D structures and temporal dynamics remains limited, constrained by weak 4

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Agents

Fast-dVLM: Efficient Block-Diffusion VLM via Direct Conversion from Autoregressive VLM

DGX agent

arXiv:2604.06832v2 Announce Type: replace Abstract: Vision-language models (VLMs) predominantly rely on autoregressive decoding, which generates tokens one at a time and fundamentally limits inference

agentsarxiv-cs-cl

13 Apr 2026

How Should Video LLMs Output Time? An Analysis of Efficient Temporal Grounding Paradigms

arXiv:2604.08966v1 Announce Type: new Abstract: While Multimodal Large Language Models (MLLMs) have advanced Video Temporal Grounding (VTG), existing methods often couple output paradigms with differe

Local Ai

LADR: Locality-Aware Dynamic Rescue for Efficient Text-to-Image Generation with Diffusion Large Language Models

arXiv:2603.13450v2 Announce Type: replace-cross Abstract: Discrete Diffusion Language Models have emerged as a compelling paradigm for unified multimodal generation, yet their deployment is hindered b

local-aiarxiv-cs-cl

Agents

MAG-3D: Multi-Agent Grounded Reasoning for 3D Understanding

arXiv:2604.09167v1 Announce Type: new Abstract: Vision-language models (VLMs) have achieved strong performance in multimodal understanding and reasoning, yet grounded reasoning in 3D scenes remains un

agentsarxiv-cs-cv

VL-Calibration: Decoupled Confidence Calibration for Large Vision-Language Models Reasoning

arXiv:2604.09529v1 Announce Type: cross Abstract: Large Vision Language Models (LVLMs) achieve strong multimodal reasoning but frequently exhibit hallucinations and incorrect responses with high certa

AgriChain Visually Grounded Expert Verified Reasoning for Interpretable Agricultural Vision Language Models

arXiv:2604.07814v1 Announce Type: new Abstract: Accurate and interpretable plant disease diagnosis remains a major challenge for vision-language models (VLMs) in real-world agriculture. We introduce A

Do MLLMs Really Understand Space? A Mathematical Reasoning Evaluation

arXiv:2602.11635v2 Announce Type: replace Abstract: Multimodal large language models (MLLMs) have achieved strong performance on perception-oriented tasks, yet their ability to perform mathematical sp

EchoTorrent: Towards Swift, Sustained, and Streaming Multi-Modal Video Generation

arXiv:2602.13669v4 Announce Type: replace Abstract: Recent multi-modal video generation models have achieved high visual quality, but their prohibitive latency and limited temporal stability hinder re

Not All Tokens See Equally: Perception-Grounded Policy Optimization for Large Vision-Language Models

arXiv:2604.01840v2 Announce Type: replace Abstract: While Reinforcement Learning from Verifiable Rewards (RLVR) has advanced reasoning in Large Vision-Language Models (LVLMs), prevailing frameworks su

SpatialMosaic: A Multiview VLM Dataset for Partial Visibility

arXiv:2512.23365v3 Announce Type: replace Abstract: The rapid progress of Multimodal Large Language Models (MLLMs) has unlocked the potential for enhanced 3D scene understanding and spatial reasoning.

Stabilizing Unsupervised Self-Evolution of MLLMs via Continuous Softened Retracing reSampling

arXiv:2604.03647v2 Announce Type: replace-cross Abstract: In the unsupervised self-evolution of Multimodal Large Language Models, the quality of feedback signals during post-training is pivotal for st

What They Saw, Not Just Where They Looked: Semantic Scanpath Similarity via VLMs and NLP metric

arXiv:2604.08494v1 Announce Type: cross Abstract: Scanpath similarity metrics are central to eye-movement research, yet existing methods predominantly evaluate spatial and temporal alignment while neg

safetyarxiv-cs-cl

Introducing Gemma 4 31B from @GoogleDeepMind on Together AI. AI natives can now use Gemma 4 31B on Together and benefit from reliable infere…

model-releasestogether-ai--x

Introducing Gemma 4 31B from @GoogleDeepMind on Together AI. AI natives can now use Gemma 4 31B on Together and benefit from reliable inference for multimodal reasoning, tool use, and agentic workflow

9 Apr 2026

Agents

DocPilot: Interactive Agent Orchestration and Training for Long Visual Document Understanding

arXiv:2610.21327v1 Announce Type: new Abstract: Multimodal long-document question answering requires models to seek sparse evidence across pages and modalities, understand heterogeneous document conte

agentsarxiv-cs-ai

Tutorials

Full-Duplex Interaction with Speech, Expressions and Gestures

arXiv:2610.21452v1 Announce Type: cross Abstract: Human face-to-face conversation requires coordinating speech, gestures and expressions across both speaking and listening. We present ELLSA 2, an end-

tutorialsarxiv-cs-ai

Agents

FutureLift: Lifting Trajectory Proposals into Bidirectional Future Graphs for Motion Forecasting

arXiv:2610.22215v1 Announce Type: new Abstract: Accurate motion prediction is critical for safe autonomous driving, yet even strong forecasters leave residual errors in their multimodal proposals. Exi

agentsarxiv-cs-cv

TimeCap: A Scalable Open-Source Pipeline for Captioning Wearable Health Time-Series Data

model-releasesarxiv-cs-cl

arXiv:2610.21274v1 Announce Type: cross Abstract: Time-series data generated continuously across industrial, environmental, and especially health domains produce multimodal signals whose scale and het

Uncovering Grounding IDs: How External Cues Shape Multi-Modal Binding

arXiv:2509.24072v5 Announce Type: replace-cross Abstract: Large vision-language models (LVLMs) perform well on multimodal tasks, but their ability to reason and precisely align visual and textual info

safetyarxiv-cs-ai

ActiveEvidence: Decision-Focused Evidence Graphs with Verifiable Acquisition Gaps

arXiv:2610.20532v1 Announce Type: cross Abstract: A multimodal agent must decide whether visual evidence is worth acquiring, which candidate or resolution to query, and when further interaction can no

Beyond Static Cues: Unified Dynamic Detection of MLLM Backdoors via Dual-Flow Trajectory Analysis

arXiv:2610.20319v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) are increasingly deployed in safety-critical domains, yet their susceptibility to backdoor attacks remains a fo

CLIVO: Differentiable Cluster-Based Instruction Mixing with Learned Validation Objectives

arXiv:2610.16876v1 Announce Type: new Abstract: Target-aware multimodal instruction selection requires useful examples and an appropriate balance of supervision. Sample-level rankings can overrepresen

Designing Textual Interfaces To Enhance Llm Reasoning On Audio-Visual Question Answering

model-releasesarxiv-cs-cl

arXiv:2610.20085v1 Announce Type: cross Abstract: Automatic prompt optimization (APO) has shown strong effectiveness for text-based LLMs and LLM systems, but its application to audio-visual understand

Do you 'see' what I 'see'? A Multi-panel Visual Question Answer Dataset for Large Language Model Chart Analysis

arXiv:2610.14173v1 Announce Type: cross Abstract: Digital libraries increasingly host scientific publications whose figures encode primary research findings, yet making this visual content searchable,

Learning Perception to Action Rules through Reinforcement Learning for Theory-of-Mind Reasoning

arXiv:2610.19796v1 Announce Type: cross Abstract: In Theory-of-Mind (ToM) reasoning, large language models may correctly infer the agent's mental state but fail to use that inference when predicting o

safetyarxiv-cs-cl

LifeSearch: Benchmarking Deep Research Agents for Real-World Life and Productivity

arXiv:2610.18092v1 Announce Type: new Abstract: Deep research (DR) agents address open-ended information needs through multi-step reasoning, long-horizon web search, and evidence synthesis. However, e

MLCommons Selected as Benchmarking Team for U.S. National Science Foundation–Backed AI Efficiency Challenge to Build MLPerf Agents

A $3.5 million, two-year award will fund an industry-standard benchmark for the efficiency of complete agentic AI workflows The post MLCommons Selected as Benchmarking Team for U.S. National Science F

model-releasesmlcommons

Tutorials

ReferFlow: Beyond Final-Target Localization for Complex Referring Expressions

arXiv:2610.20352v1 Announce Type: new Abstract: Multimodal Large Language Models have made significant progress in referring expression comprehension (REC), yet most REC benchmarks still focus on fina

tutorialsarxiv-cs-cv

RouteWeaver: Weaving Mode Selection and Execution into Unified LLM Routing

arXiv:2610.19705v1 Announce Type: new Abstract: LLM routing dynamically selects and coordinates heterogeneous language models across diverse tasks. However, existing approaches are largely built aroun

safetyarxiv-cs-cl

The Gap Is in the Geometry: A Convergent Meta-Analysis of Multi-Facet Aerial and Remote Sensing Video Understanding

arXiv:2610.19102v1 Announce Type: new Abstract: Aerial and remote sensing video is increasingly evaluated like web video, by posing multiple-choice questions to multimodal large language models (MLLMs

VC-OPD: Visual Counterfactual On-Policy Distillation for Grounded Vision-Language Reasoning

arXiv:2610.14939v1 Announce Type: new Abstract: GRPO-style reinforcement learning has advanced vision-language reasoning, but its sequence-level rewards provide limited credit assignment for individua

safetyarxiv-cs-ai

Can Synthetic UAV Benchmarks Be Trusted? Real-Synthetic Validation for UAV Model Selection

arXiv:2610.14647v1 Announce Type: new Abstract: Synthetic UAV imagery can expand pre-deployment test evidence when task-specific Real data are scarce, but visual plausibility or semantic label alignme

DPOison-VL: Clean Preference Poisoning in Vision-Language Direct Preference Optimization

arXiv:2610.18609v1 Announce Type: cross Abstract: Direct Preference Optimization (DPO) has become a widely adopted approach for aligning vision-language models (VLMs), yet the security of multimodal p

EmoGenie: Benchmarking and Evaluating Expressed and Evoked Emotion in T2I Generation with MLLMs

arXiv:2610.18455v1 Announce Type: new Abstract: Rapid advances in artificial intelligence-generated content (AIGC) have significantly promoted using text-to-image (T2I) models to generate images with

FASHION-RQ: Mining Hierarchical Semantic Structure for Automated Evaluation of Fashion Retrieval

arXiv:2610.17841v1 Announce Type: cross Abstract: Evaluating fashion retrieval systems remains challenging due to the limited availability of benchmarks that capture the fine-grained, open-ended queri

PhySimCode: A Benchmark and Evaluation Method for Physics Video to Code Generation

arXiv:2610.15722v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) are good at video understanding and code generation, but it remains unclear whether they can recover the physic

Self-Verifier Capture in Unified Visual Generators: Diagnosing and Repairing Closed-Loop Self-Reward

arXiv:2610.16500v1 Announce Type: new Abstract: Image-space reward requires decoding and a separate judge; unified visual generators can instead reuse their understanding pathway for decode-free, self

Tutorials

Towards Modality-Agnostic Seizure Classification: A Unified Deep Learning Framework for Heterogeneous EEG and Intracranial EEG Signals

arXiv:2610.16596v1 Announce Type: new Abstract: Seizure prediction and detection, essential for clinical treatment of epilepsy, remain the crucial task of this neurological disease. EEG and iEEG are w

tutorialsarxiv-cs-lg

VL-DocIR: A Benchmark for Vision-Based Long Document Information Retrieval

arXiv:2610.17057v1 Announce Type: cross Abstract: Vision-based document retrieval has improved rapidly, but current evaluation settings still emphasize short documents and single relevant pages. This

XForecast: The KDD 2026 Finance Day Challenge on News-Grounded Financial Forecasting

model-releasesarxiv-cs-lg

arXiv:2610.16131v1 Announce Type: new Abstract: Financial forecasting has traditionally relied on numerical time-series (TS) signals, while textual information such as news remains largely underutiliz

AdaC-GRPO: Towards Mastering Long-Horizon Visual Sudoku Puzzles via Adaptive Curriculum Learning

arXiv:2610.13184v1 Announce Type: new Abstract: While reinforcement learning with verifiable reward (RLVR) enhances reasoning in large language models, its efficacy in long-horizon multimodal tasks re

12 Oct 2026

Applications

Cognition-Oriented Emotion Tracing from Causes to Consequences in Real-World Social Scenes

arXiv:2610.11410v1 Announce Type: new Abstract: Affective computing has progressed from categorical emotion recognition to open-ended affective analysis with large multimodal models. Yet affective sci

applicationsarxiv-cs-ai

Control-Ready Uncertainty for Trajectory Diffusion

arXiv:2610.12431v1 Announce Type: new Abstract: Diffusion models can represent complex, multimodal trajectory distributions, but extracting uncertainty from them typically requires costly Monte Carlo

safetyarxiv-cs-ro

Instruction-Conditioned Electromagnetic Spectrum Understanding via Budget-Adaptive Signal Tokenization

arXiv:2610.12142v1 Announce Type: new Abstract: Electromagnetic spectrum monitoring increasingly requires flexible analysis beyond task-specific recognition and detection. Multimodal large language mo

PXtal: Learning to Align Powder X-Ray Diffraction and Crystal Structures under Information Asymmetry across Modalities

arXiv:2610.10653v1 Announce Type: new Abstract: Scientific multimodal learning commonly assumes that paired views are comparably informative. Powder X-ray diffraction (PXRD) makes this mismatch explic

safetyarxiv-cs-lg

Revisiting Identity and Spectra Dispersion in Media-Bridged Time Series Forecasting: Linking Multivariate Signals and Narrative Flows

arXiv:2610.11924v1 Announce Type: new Abstract: Media-bridged time series forecasting is expanding to encompass traditional 'multivariate' and emerging 'multimodal' (e.g., through textual assistance).

Selective Listening: Mechanism-Guided Control of Audio Influence in Large Audio-Language Models

arXiv:2610.11196v1 Announce Type: cross Abstract: Large audio-language models (LALMs) exploit multimodal evidence, yet task-irrelevant audio can alter text-reasoning decisions when listening is unnece

researcharxiv-cs-cl

RoboQuest: Generalist Physical Agents that Search, Inspect and Test

arXiv:2610.10388v1 Announce Type: cross Abstract: Recent advances in multimodal foundation models have made them capable generalist physical agents for a range of manipulation tasks. However, successf