Search: “multimodal”

Anchoring Bias: A Persistent Fairness Backdoor Attack against MLLMs under Continual Learning

arXiv:2608.21577v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) are increasingly deployed in high-stakes domains where fairness is a critical safety requirement. In practice

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

ATP-Bench: Towards Agentic Tool Planning for MLLM Interleaved Generation

DGX agent

arXiv:2603.29902v2 Announce Type: replace Abstract: Interleaved text-and-image generation represents a significant frontier for Multimodal Large Language Models (MLLMs), offering a more intuitive way

model-releasesarxiv-cs-ai

25 Aug 2026

Beyond Success and Failure: Length-Aware Contrastive Learning for GUI Agents

arXiv:2608.21830v1 Announce Type: new Abstract: Graphical User Interface (GUI) agents powered by Multimodal Large Language Models (MLLMs) have shown strong potential for automating tasks across divers

Context-Aware Cluster Decoding: Semantic Anchor-Driven Coherence in dMLLMs

arXiv:2608.22367v1 Announce Type: new Abstract: Diffusion multimodal large language models (dMLLMs) frequently produce long-form outputs marred by semantic drift and repetition, with quality generally

local-aiarxiv-cs-cl

Expert-level vision-language foundation model for real-world radiology and comprehensive evaluation

arXiv:2409.16183v2 Announce Type: replace Abstract: Radiology is a vital and complex component of modern clinical workflow and covers many tasks. Recently, vision-language (VL) foundation models in me

Grounding Free-Form Instructions for Fashion Complementary Image Generation

arXiv:2608.23302v1 Announce Type: new Abstract: Fashion complementary image generation (CIG) aims to create garments that stylistically match a seed item based on user intent, making it a natural mult

safetyarxiv-cs-cv

Agents

MetaCaster: Meta-Harness-Optimized Agent for End-to-End Few-Shot Learning of Lightweight Time Series Forecasters

arXiv:2608.23473v1 Announce Type: cross Abstract: Time series forecasting (TSF) is evolving toward multimodal and agentic settings, yet using foundation models remains uneconomical in resource-constra

agentsarxiv-cs-ai

Motion-Based Tokenization for Cross-Dataset Egocentric Gaze Modeling

arXiv:2608.22926v1 Announce Type: new Abstract: Gaze is increasingly used as an input signal for vision and multimodal models, yet no consensus exists on how to represent it across datasets. Raw trace

SA-RSQ: A Versatile Sparse Representation Framework for Multi-modal Recommender Systems

arXiv:2608.22979v1 Announce Type: new Abstract: Deploying high-dimensional multimodal features in industrial recommender systems incurs substantial storage and latency overhead. Hard quantization is c

researcharxiv-cs-ai

SAFE-G: Structure-aware Faithful Evidence-guided Generation for Knowledge-based Visual Question Answering

arXiv:2608.21796v1 Announce Type: cross Abstract: Knowledge-based Visual Question Answering (KB-VQA) aims to answer queries that necessitate reasoning over external knowledge sources beyond the visual

local-aiarxiv-cs-ai

Text-Guided Visual Dependency Graph Learning with Cross-Modal Attention Priors

arXiv:2608.21443v1 Announce Type: new Abstract: Estimating interpretable conditional-dependence structures from multimodal visual-linguistic features remains largely unexplored. We propose CM-GLasso (

Agents

Think with Structured Grounding: Perceptual Reinforcement Learning for Chart and Visual-Tabular Understanding

arXiv:2608.22429v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) capable of thinking with images often rely on external tools for fine-grained perception. However, this relianc

agentsarxiv-cs-ai

Is Visual Prompting All You Need? Studying VLM Spatial Reasoning under Progressive Visual Scaffolds

arXiv:2608.21170v1 Announce Type: cross Abstract: Vision-language models (VLMs) have advanced rapidly in multimodal reasoning, yet recent work shows that their failures often reflect an interaction be

24 Aug 2026

StateSight: Benchmarking Latent Spatial-State Reconstruction in Vision-Language Models

arXiv:2608.20414v1 Announce Type: new Abstract: Vision-language models are increasingly used for multimodal question answering, yet their ability to reconstruct latent spatial structure from a single

24 Aug 2026

CharTool: Tool-Integrated Visual Reasoning for Chart Understanding

arXiv:2604.02794v2 Announce Type: replace Abstract: Charts are ubiquitous in scientific and financial literature for presenting structured data. However, chart reasoning remains challenging for multim

local-aiarxiv-cs-ai

Does Listening Matter? Backchanneling and Nodding in AI Clone

arXiv:2608.19527v1 Announce Type: cross Abstract: AI clones that imitate a specific person typically reproduce what the person says and how they sound, but not how they listen. We investigate whether

researcharxiv-cs-cl

GRACE: Grounded Reasoning via Adapter Composition and Evidence-Aware Calibration for Educational Visual Question Answering

arXiv:2608.19355v1 Announce Type: cross Abstract: Educational visual question answering, or VQA, requires models to solve curriculum-oriented multiple-choice questions using both language and visual e

ROBOSHACKLES: A Safety Dataset for Human-Injury Prevention in Embodied Foundation Models

model-releasesarxiv-cs-ro

arXiv:2606.18632v2 Announce Type: replace Abstract: Embodied Foundation Models (EFMs) integrate multimodal understanding, future-state reasoning, and executable robot actions. Yet their safety alignme

Applications

Large Language Models in Mental Health: A Systematic Review of Applications, Innovations, and Ethical Challenges

arXiv:2608.18080v1 Announce Type: new Abstract: We present a review on the applications of large language models (LLMs) in health, e.g., social media analysis, clinical conversational agents, therapy

applicationsarxiv-cs-ai

20 Aug 2026

Tutorials

MARCUS: Missing-Aware Region Representation with Contextual Urban Signals for Rent Prediction

arXiv:2608.18546v1 Announce Type: new Abstract: Multimodal urban data has expanded the applications of urban region representation learning, such as functional zone identification and real estate appr

tutorialsarxiv-cs-lg

20 Aug 2026

MR-IQA-2: Faithful Image Quality Reflection via Fine-Grained Credit Assignment

arXiv:2608.18579v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) have shown strong potential for image quality assessment (IQA) by improving consistency between quality ratin

20 Aug 2026

Reinforcing Consistency in Video MLLMs with Structured Rewards

arXiv:2604.01460v2 Announce Type: replace Abstract: Multimodal large language models (MLLMs) have achieved remarkable progress in video understanding. However, seemingly plausible outputs often suffer

safetyarxiv-cs-cv

19 Aug 2026

Too Sure to Be Safe: Model Calibration for Reliable Log Anomaly Detection

arXiv:2608.17965v1 Announce Type: cross Abstract: Online log anomaly detection is critical for maintaining the reliability of large-scale computing systems. Although recent language model-based log an

19 Aug 2026

AnchorScore: A CLIP-Based Diagnostic of MLLM Annotation Difficulty

arXiv:2608.16690v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) are widely used for automated annotation, yet their per-class accuracy varies widely (e.g., 12%-98% across the

researcharxiv-cs-cv

Audio-Visual Segmentation via Depth-Guided Collaborative Modeling

arXiv:2608.16285v1 Announce Type: cross Abstract: Audio-Visual Segmentation (AVS) is a fundamental task in multimodal perception that performs pixel-level segmentation of sounding objects in videos by

ConceptFormer: Learning Adaptive Latent Concepts for Query-Document Alignment in Visual Document Retrieval

arXiv:2608.15698v1 Announce Type: new Abstract: Visual document retrieval is a critical component of multimodal retrieval-augmented generation, aiming to identify query-relevant pages from document co

local-aiarxiv-cs-cv

Deep Thought Alignment: Trajectory-Level Latent Distillation for Video Reasoning

arXiv:2608.16316v1 Announce Type: cross Abstract: Large Multimodal Models (LMMs) for video reasoning have long been hindered by the high computational cost of processing vast amounts of visual informa

ETHOS: Towards a Modular Ethics Framework for Clinical Multi-Agent Systems

arXiv:2608.15424v1 Announce Type: cross Abstract: The rapid adoption of large language models has enabled the development of clinical multi-agent systems (MAS) capable of integrating multimodal patien

FedADB: Class Anchor-Driven Dual-Branch Federated Learning for Mitigating Forgetting

arXiv:2608.15310v1 Announce Type: cross Abstract: Multimodal data collected by heterogeneous devices are used for collaborative training, where federated learning (FL) serves as a key paradigm for eff

safetyarxiv-cs-lg

Matched Outcomes, Divergent Gaze: How Foveated MLLMs Search Compared to Humans

arXiv:2608.16514v1 Announce Type: cross Abstract: Human visual search is serial: the fovea must land on a candidate to confirm it, and those landings form a scanpath. Whether multimodal large language

MEDR: Query-Independent Frame Selection via Multi-Signal Event Modeling and Dynamic Rescoring

arXiv:2608.15058v1 Announce Type: new Abstract: Frame selection is a fundamental component of multimodal large language models, enabling long videos to be processed under limited visual-token and comp

Modality-Invariant Coarse-to-Fine Retinal Image Registration

arXiv:2608.14829v1 Announce Type: cross Abstract: Retinal image registration is essential for ophthalmic diagnosis, longitudinal disease monitoring, and multimodal retinal image analysis. Existing ret

safetyarxiv-cs-cv

NumerosityVLM: A Cognitively Inspired Benchmark for Interpreting Numerosity Representations in Vision-Language Models

arXiv:2608.15425v1 Announce Type: cross Abstract: Vision-language models (VLMs) achieve strong performance on high-level multimodal tasks, yet numerosity perception, a cognitive ability that emerges i

Physiological World Models for Human State Transitions

arXiv:2608.15309v1 Announce Type: new Abstract: Continuous multimodal sensing now allows human physiology to be observed throughout daily life rather than only during occasional clinical visits. Howev

Planner-Conditioned Diffusion for Coordinated Multi-Agent Exploration

arXiv:2608.16229v1 Announce Type: new Abstract: Coordinated multi-agent exploration requires not only efficient individual coverage but also non-redundant coverage across agents over extended planning

safetyarxiv-cs-ro

SA-GEM: Scale-Adaptive and Geospatial Evidence-Modulated Token Pruning for Efficient Remote Sensing Large Vision-Language Models

arXiv:2608.15075v1 Announce Type: new Abstract: RS-LVLMs have advanced multimodal understanding of Earth observation imagery, yet their performance is fundamentally constrained by high-resolution proc

local-aiarxiv-cs-cv

TRACE-Bench: Decomposing and Diagnosing Multi-Reference Image Generation

arXiv:2608.16765v1 Announce Type: cross Abstract: Despite recent advances in unified multimodal models for multi-reference image generation, existing benchmarks remain organized around predefined task

local-aiarxiv-cs-ai

UniFed-VLM: Federated Instruction Tuning for Vision-Language Models with Multiple Heterogeneity

model-releasesarxiv-cs-lg

arXiv:2608.15516v1 Announce Type: new Abstract: Vision-Language Models (VLMs) have demonstrated strong performance in multimodal understanding and generation. However, fine-tuning of VLMs typically re

Act2Intention: A Benchmark For Developing Active Mobile Agents Through Inferring User Intention from GUI Actions

arXiv:2608.14132v1 Announce Type: cross Abstract: Mobile GUI Agents powered by multimodal large language models (MLLMs) show promise in human-computer intelligence. However, current research primarily

CRAFT: Constrained Reward via Attention Fine-Tuning for Subject Personalization without Composed Targets

arXiv:2608.14403v1 Announce Type: new Abstract: Subject-driven image personalization---generating new images that preserve the identity of one or several reference subjects in novel scenes---is a foun

researcharxiv-cs-cv

Data-driven techniques for translational neuroscience and personalized neuro-health

arXiv:2608.13749v1 Announce Type: cross Abstract: Neurodegenexrative diseases such as Alzheimer's disease and Parkinson's disease are diagnosed most reliably only after substantial, often irreversible

researcharxiv-cs-ai

EchoChange: A Diffusion Language Model with Dual Pass Remasking for Factual Remote Sensing Disaster Change Captioning

arXiv:2608.01856v2 Announce Type: replace Abstract: Bi-temporal remote-sensing disaster change captioning often needs to identify sparse and spatially localized changes across large pre- and post-even

SALSA-V: Shortcut-Augmented Long-form Synchronized Audio from Videos

arXiv:2510.02916v2 Announce Type: replace-cross Abstract: We propose SALSA-V, a multimodal video-to-audio generation model capable of synthesizing highly synchronized, high-fidelity long-form audio fr

safetyarxiv-cs-lg

CASA: Content-Acoustic Speaking Assessment with Speech Encoder and Large Language Model

arXiv:2608.13101v1 Announce Type: new Abstract: Research on automatic speaking assessment (ASA) has increasingly adopted multimodal speech large language models to assess learners' speaking performanc

researcharxiv-cs-cl

EgoMonth: A Month-Level Egocentric Video Benchmark for Long-Term Spatiotemporal Memory

arXiv:2608.13113v1 Announce Type: cross Abstract: Recent advances in Multimodal Large Language Models (MLLMs) have led to substantial progress in video understanding, accompanied by a growing number o

Exploring Instruction Data Quality for Explainable Image Quality Assessment

arXiv:2510.03880v2 Announce Type: replace Abstract: In recent years, with the rapid development of large multimodal models (LMMs), explainable image quality assessment (IQA) has attracted increasing a

researcharxiv-cs-cv

Reasoning for Social Audio-Visual Question Answering: Where Do We Stand?

arXiv:2608.13239v1 Announce Type: new Abstract: Training Multimodal Large Language Models for audio-visual social understanding is a crucial step toward embodied social intelligence. Chain-of-thought

Spatial Memory Agent: Experience-Grounded Procedure Memory for Spatial Intelligence

arXiv:2608.12743v1 Announce Type: new Abstract: Spatial intelligence is becoming a foundation for embodied agents, robotic planning, and multimodal assistants. To improve the spatial reasoning ability