Search: “multimodal”

Mitigating Sample-Level Imbalance via Probabilistic Separation for Adaptive Multimodal Fusion

arXiv:2510.21797v4 Announce Type: replace-cross Abstract: Multimodal learning faces modality imbalance, where dominant modalities suppress weaker ones due to inconsistent convergence rates. Existing s

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Applications

Multimodal examination answer data with expert-designed Outcome-Based Education rubrics for criterion-level assessment

DGX agent

arXiv:2608.22346v1 Announce Type: cross Abstract: This data article describes a multimodal collection of scanned examination answers paired with expert-designed Outcome-Based Education (OBE) grading m

applicationsarxiv-cs-ai

25 Aug 2026

PUMA: A Polish Benchmark for Culturally Grounded Multimodal Understanding

model-releasesarxiv-cs-cl

arXiv:2608.21853v1 Announce Type: new Abstract: Large language models are increasingly moving beyond text processing, adding support for other modalities such as images and audio. While text understan

SlideGen: Collaborative Multimodal Agents for Scientific Slide Generation

arXiv:2512.04529v3 Announce Type: replace Abstract: Creating presentation slides from scientific papers is not simply a matter of summarizing paragraphs. A presenter is required to decide what story t

Text-Anchored Semantic Perturbations for Transferable Jailbreak Attacks on Multimodal Large Language Models

arXiv:2608.22312v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have achieved remarkable progress in vision-language interaction, yet their safety alignment remains vulnerable

safetyarxiv-cs-cl

VinciCoder: Unifying Multimodal Code Generation via Coarse-to-fine Visual Reinforcement Learning

arXiv:2511.00391v3 Announce Type: replace Abstract: While recent specialized multimodal code generation models excel in tasks like chart-to-code generation, their reliance on single-task training limi

safetyarxiv-cs-cv

EviRank: Structured Relevance Evidence for Multimodal Image Re-ranking

arXiv:2608.20886v1 Announce Type: new Abstract: Real-world image search queries are multimodal and compositional: ``find this shirt in pink'' specifies an entity to retain, an attribute to modify, and

applicationsarxiv-cs-cv

24 Aug 2026

Latent Ordinal Evidence, Misaligned Outputs: Inference-Time Ordinal Lens Alignment for Multimodal LLMs

arXiv:2608.20999v1 Announce Type: new Abstract: Multimodal LLMs apply the language model interface to visual inputs, where ordinal regression tasks such as age estimation, image quality assessment, an

safetyarxiv-cs-cv

24 Aug 2026

Multimodal Trajectory Planning for Surface Vehicles using Turning Circle-based Control Barrier Functions

arXiv:2608.19537v1 Announce Type: new Abstract: This paper presents a guide path-free multimodal trajectory planning framework for autonomous surface vehicles operating in dynamic environments. The pr

safetyarxiv-cs-ro

21 Aug 2026

Reproducible Multimodal Affordance Prediction

arXiv:2608.18317v1 Announce Type: new Abstract: Affordance prediction is the identification of potential actions an agent can perform on a target object from multimodal inputs. Affordance prediction m

safetyarxiv-cs-cv

20 Aug 2026

Mr.Dec: Daily-Scale Longitudinal Multimodal Modeling for 30-Day Readmission Prediction

arXiv:2608.16929v1 Announce Type: new Abstract: Predicting 30-day hospital readmission is essential for assessing patient stability and optimizing healthcare resources. As clinical risk evolves with t

applicationsarxiv-cs-lg

19 Aug 2026

MultiSigBERT: Beyond Survival Analysis through Multimodal and Sequential Modeling in Oncology

arXiv:2608.16972v1 Announce Type: new Abstract: Machine learning has become an essential component of modern healthcare, where the integration of heterogeneous data sources offers unprecedented opport

applicationsarxiv-cs-lg

19 Aug 2026

Uncertainty-Aware Decision Making in Multimodal Large Language Models

arXiv:2608.17084v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) increasingly answer questions whose correctness depends on visual, textual, temporal, acoustic, document, chart

safetyarxiv-cs-cl

19 Aug 2026

CLARA: Clip-Level Multimodal Alignment with VLM-Derived Rationales for Hateful Video Detection

arXiv:2608.15905v1 Announce Type: new Abstract: Hateful video detection has become increasingly important with the rapid growth of video-centric social media platforms, given the serious risks that ha

Local Ai

mR^2AG: Multimodal Retrieval-Reflection-Augmented Generation for Knowledge-Based VQA

arXiv:2411.15041v2 Announce Type: replace Abstract: Advanced Multimodal Large Language Models (MLLMs) struggle with recent Knowledge-based Visual Question Answering (VQA) tasks, such as INFOSEEK and E

local-aiarxiv-cs-ai

MUPA^{2}E: Multimodal Unified Perception with Asymmetric Attention for Emotion Assessment

arXiv:2608.15999v1 Announce Type: new Abstract: Automatic emotion assessment can benefit from combining neural and behavioral signals, but many multimodal approaches rely on separate, modality-specifi

researcharxiv-cs-ai

The Unwritten Benchmark: A New Challenge for Multimodal Machine Learning in Abstract Perceptual Reasoning

arXiv:2608.14558v1 Announce Type: new Abstract: Current multimodal models have demonstrated remarkable proficiency in recognizing static visual and auditory content. However, their capacity for abstra

Correcting What You Cannot See: Credit Assignment for Perception Distillation in Multimodal Reasoners

arXiv:2607.28336v3 Announce Type: replace Abstract: On-policy distillation provides dense supervision for multimodal reasoners, but its trajectory-level reward cannot determine whether a failed answer

17 Aug 2026

Generative Universal Multimodal Retrieval with Dual-role Identifiers

arXiv:2608.12987v1 Announce Type: cross Abstract: Generative information retrieval (GIR) has emerged as a compelling alternative to the conventional index-retrieve-then-rank retrieval pipeline by trai

14 Aug 2026

TennisVAR: A Stroke-Evidence-Grounded Multimodal Large Language Model for Tactical Reasoning in Tennis Videos

arXiv:2608.12920v1 Announce Type: new Abstract: Sports-video understanding is moving beyond event recognition toward explaining how actions collectively shape match progression, however, existing tenn

14 Aug 2026

BEST-KAG: Enhancing Question Answering of Building Engineering Standards with Multimodal Knowledge Graph Modeling and Large Language Model

arXiv:2608.11244v1 Announce Type: new Abstract: Construction standards are critical for building safety and sustainability. Existing standard application workflows rely on keyword-based document retri

13 Aug 2026

Local Ai

EGM-Det: Entropy-Guided Multimodal Adaptive Fusion for UAV RGB-IR Object Detection

arXiv:2608.11685v1 Announce Type: new Abstract: Joint use of RGB and infrared (IR) imagery can improve UAV-view object detection, but most existing methods fuse multimodal features with static or fixe

local-aiarxiv-cs-cv

13 Aug 2026

MBA: Multimodal Benchmark and Agents for Real-World Business Ideation

arXiv:2608.11616v1 Announce Type: new Abstract: Agentic systems powered by large language models (LLMs) have opened new opportunities for business ideation. Yet existing approaches remain confined to

13 Aug 2026

E^3mo-Bench: A Scalable Benchmark for Multimodal Evoked and Expressed Emotion Understanding via Bayesian Pairwise Alignment

arXiv:2608.10796v1 Announce Type: new Abstract: Understanding both expressed and evoked emotions is critical for multimodal large language models (MLLMs) to achieve comprehensive affect-aware interact

12 Aug 2026

HSSBench: Benchmarking Humanities and Social Sciences Ability for Multimodal Large Language Models

arXiv:2506.03922v4 Announce Type: replace-cross Abstract: Multimodal Large Language Models (MLLMs) have demonstrated significant potential to advance a broad range of domains. However, current benchma

12 Aug 2026

CONFER: Conflict-Aware Evidence Negotiation for Regime-Calibrated Weak Supervision in Multimodal Emotion Recognition

arXiv:2608.07867v1 Announce Type: new Abstract: Multimodal emotion recognition often treats self-reported labels as reliable supervision while overlooking self-report unreliability and cross-modal con

researcharxiv-cs-lg

Hardware

FlashRT: Agent Harness for Guiding Agents to Deploy Real-Time Multimodal Applications

arXiv:2607.18171v2 Announce Type: replace Abstract: Real-time multimodal applications, including voice agents and interactive video generation, compose heterogeneous models into pipelines whose effici

hardwarearxiv-cs-lg

Forged Peer Judgments Mislead Multimodal LLM Judge Panels: Source-Blind Anchoring and Panel-Consensus Verification

arXiv:2608.07920v1 Announce Type: new Abstract: Multimodal LLM judge panels can cross-reference peers, but a quoted peer judgment may itself be untrusted. We expose source-blind anchoring as a text-le

researcharxiv-cs-cv

Hyperbolic Multimodal Continual Learning

arXiv:2608.09572v1 Announce Type: new Abstract: Hyperbolic geometry has recently emerged as a powerful representation space for multimodal learning, as it naturally captures hierarchical semantic stru

researcharxiv-cs-lg

Local Ai

Integrated Multimodal AI System for Retrieval-Augmented Reasoning, Object Sensing, and Damage Analysis

arXiv:2608.08935v1 Announce Type: new Abstract: This work presents a unified multimodal AI system for damage assessment that integrates retrieval-augmented generation (RAG) models, thermal spectrum pe

local-aiarxiv-cs-ai

LIBAD: A Multimodal Anomaly Detection Benchmark for Li-Ion Battery Electrode Manufacturing

arXiv:2608.07958v1 Announce Type: new Abstract: Multimodal industrial anomaly detection has largely focused on discrete products using strongly correlated RGB and 3D observations, leaving continuous p

Unified Hallucination Fuzzing for Multimodal Large Language Models

arXiv:2608.07525v1 Announce Type: cross Abstract: Hallucination remains a persistent challenge for Multimodal Large Language Models (MLLMs), severely limiting their reliability in high-stakes applicat

GraphVerse: A Comprehensive Visual Graph Reasoning Benchmark for Multimodal Large Language Models

arXiv:2608.06769v1 Announce Type: new Abstract: Recent Multimodal Large Language Models (MLLMs) have achieved remarkable progress across diverse vision-language tasks, creating an urgent need for more

10 Aug 2026

Multimodal Drivers' Emotion Recognition and Safety-Oriented Intervention for Intelligent Transportation Systems

arXiv:2608.06378v1 Announce Type: cross Abstract: Driver emotions can affect risk perception, decision-making, and vehicle control under complex road conditions. Existing studies mainly focus on drive

10 Aug 2026

Panoramic Multimodal Semantic Occupancy Prediction for Quadruped Robots

arXiv:2603.13108v2 Announce Type: replace-cross Abstract: Panoramic imagery provides holistic 360{eg} visual coverage for environmental perception in quadruped robots. However, existing occupancy pred

10 Aug 2026

GAUGE: Granularity-Adaptive Counterfactual Gating of Evidence for Incomplete Multimodal Classification

arXiv:2608.05608v1 Announce Type: cross Abstract: Multimodal classification typically assumes all modalities are available, yet real-world inputs are often incomplete. Imputation and dynamic fusion ca

applicationsarxiv-cs-ai

7 Aug 2026

EvtGraph: Event-Adaptive Compression for Sparse Temporal Graph Learning in Multimodal Time Series

arXiv:2608.04368v1 Announce Type: new Abstract: Multimodal temporal data are inherently irregular and uneven in information density, yet most models rely on uniform discretization, leading to ineffici

researcharxiv-cs-lg

Tools

FLUX 3 is now live on Together AI. @bfl_ai’s new multimodal model generates video and synchronized audio together, with up to 20-second clip…

FLUX 3 is now live on Together AI. @bfl_ai’s new multimodal model generates video and synchronized audio together, with up to 20-second clips, multiple shots, and control from text, images, or keyfram

toolstogether-ai--x

Modality Agreement- and Conflict-Aware Prototype Hypergraph Learning for Multimodal Intent Understanding

arXiv:2608.04054v1 Announce Type: cross Abstract: Multimodal intent recognition requires understanding not only what textual, acoustic, and visual signals share, but also how they disagree. Such disag

SIGNPOST-Bench: Benchmarking Text-Vision Conflict Resolution in Multimodal Large Language Models

model-releasesarxiv-cs-cl

arXiv:2608.04244v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) make grounded predictions in real-world scenes by combining visual and textual cues, yet existing benchmarks

Compass: Degradation-Simulated Reciprocal Learning with Lightweight Needle RWKV for Multimodal Crack Segmentation under Missing Modalities

arXiv:2608.03559v1 Announce Type: new Abstract: In multimodal crack segmentation for industrial facilities, the key challenge is preventing missing modalities from degrading pixel-level performance wh

researcharxiv-cs-cv

Failure-Informed Image Self-Augmentation for Multimodal Large Language Model Self-Improvement

arXiv:2608.03733v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have achieved remarkable performance across vision-language tasks, but their progress depends heavily on large-

researcharxiv-cs-ai

KnowHal: A Knowledge-Driven Benchmark for Comprehensive Multimodal Hallucination Evaluation

arXiv:2608.03782v1 Announce Type: new Abstract: Hallucination remains a critical challenge for developing trustworthy Multimodal Large Language Models (MLLMs). While existing benchmarks mainly focus o

LDU-Bench: Multimodal LLM Evaluation for Lithography Defect Understanding under Layout-Varying Circuit Backgrounds

arXiv:2608.03078v1 Announce Type: new Abstract: Multimodal large language models have demonstrated strong defect recognition capability in industrial anomaly detection. However, in lithography review,

ParVL: Parallel Scaling and Expandable Compute Allocation for Multimodal LLMs

model-releasesarxiv-cs-cl

arXiv:2608.04010v1 Announce Type: cross Abstract: Existing scaling strategies for Multimodal Large Language Models (MLLMs) typically expand either model parameters or sequential inference computation,

Pattern over Pixels: Measuring Pattern Completion Bias in Multimodal Code Generation

arXiv:2608.03691v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) are increasingly used to translate webpage screenshots into front-end code, but repeated UI patterns may sway

IoU-PD: IoU-Aware Privileged Distillation for Visual Grounding with Multimodal Large Language Models

arXiv:2607.15732v2 Announce Type: replace Abstract: Visual grounding with multimodal large language models is commonly formulated as autoregressive coordinate generation, where a model outputs boundin

researcharxiv-cs-cv

4 Aug 2026

Agents

CodeShrink: Adaptive Visual Compression for Efficient Multimodal Code Understanding