Search: “multimodal”

HIVE: Understanding Post-Hallucination Reasoning in Vision Language Models

arXiv:2607.07507v1 Announce Type: cross Abstract: Hallucinations in vision language models (VLMs) are commonly treated as semantic errors, yet they often arise from partial or ambiguous visual evidenc

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

LEMUR 2: Unlocking Neural Network Diversity for AI

DGX agent

arXiv:2607.06839v1 Announce Type: cross Abstract: Existing NAS benchmarks (e.g., NAS-Bench, NATS-Bench) cover only narrow, task-specific regions of the architectural design space and lack cross-domain

researcharxiv-cs-cv

9 Jul 2026

MADB: A Large-Scale Music Aesthetics Dataset with Professional and Multi-Dimensional Annotations

arXiv:2607.06929v1 Announce Type: cross Abstract: Music aesthetic assessment is a challenging yet underexplored problem, requiring models to capture fine-grained, multi-dimensional human perceptual ju

MMAgent-R^2: Learning to Rerank and Reject for Agentic mRAG

arXiv:2607.07383v1 Announce Type: new Abstract: Knowledge-based Visual Question Answering (KB-VQA) requires models to retrieve visual entities matching the query image from large-scale encyclopedic kn

agentsarxiv-cs-cv

Tree-of-Thoughts Reasoning for Text-to-Image In-Context Learning

arXiv:2607.07117v1 Announce Type: cross Abstract: In text-to-image in-context learning (T2I-ICL), a model has to infer a latent compositional pattern from fewshot demonstrations for generating a query

UP: Unbounded Positive Asymmetric Optimization for Breaking the Exploration-Stability Dilemma

arXiv:2607.06987v1 Announce Type: new Abstract: Reinforcement learning (RL) has become the standard paradigm for enhancing the complex reasoning capabilities of large language models (LLMs). To achiev

safetyarxiv-cs-lg

Video2Reaction: Mapping Video to Audience Reaction Distribution in the Wild

arXiv:2607.06875v1 Announce Type: new Abstract: Understanding and forecasting audience reactions to video content are crucial for improving content creation, recommendation systems, and media analysis

WildCity: A Real-World City-Scale Testbed for Rendering, Simulation, and Spatial Intelligence

arXiv:2607.06838v1 Announce Type: new Abstract: Humans can navigate an unfamiliar city and gradually form a coherent spatial mental map spanning tens of square kilometers. Can AI build spatial represe

agentsarxiv-cs-cv

AgoraSim: A Hybrid Agent-Based Modeling Framework

arXiv:2607.05999v1 Announce Type: new Abstract: LLM-agent simulations make natural-language social scenarios easy to instantiate, but their outputs can be overread as predictions and are often difficu

Local Ai

Analysis-by-Proxy: Localization Signals in VLMs Operating as Condition Encoders

arXiv:2607.06445v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) are increasingly utilized as the conditioning backbone for diffusion-based image editing due to their remarkable multimo

local-aiarxiv-cs-ai

Benchmarking the Robustness of Autonomous Driving to Environmental Illusions: A Lane Perception Perspective

arXiv:2607.05783v1 Announce Type: new Abstract: Environmental illusions (eg., shadows, reflections, and tire marks) are naturally existing yet overlooked phenomena in real-world driving environments.

Ground3D-LMM: Fine-Grained 3D Point Grounding and Spatial Reasoning with LMM

arXiv:2607.05493v1 Announce Type: new Abstract: Natural-language queries about 3D environments become actionable when responses are verifiable and metric. Verifiability requires explicit grounding to

applicationsarxiv-cs-cv

Harrison.Rad 1.5 Technical Report: A radiology foundation model that can draft reports from images, priors and clinical context

arXiv:2607.05880v1 Announce Type: cross Abstract: Imaging demand is growing faster than the radiology workforce can expand, and reporting backlogs cannot be resolved through training and recruitment a

NAVER LABS System Re-implementation for the IWSLT 2026 Instruction-Following Task

model-releasesarxiv-cs-cl

arXiv:2607.05623v1 Announce Type: new Abstract: We re-implement the NAVER LABS IWSLT 2025 instruction-following pipeline for the IWSLT 2026 Shared Task (constrained condition, short audio track), adap

SparseCtrl-HOI: Sparse Temporal Control for Human-Object Interaction Video Generation

arXiv:2607.05994v1 Announce Type: new Abstract: Human-Object Interaction (HOI) video generation aims to synthesize realistic videos of humans manipulating diverse objects, serving as a promising avenu

researcharxiv-cs-cv

Uncovering Latent Depression Severity for Binary Depression Detection via Advantage-weighting Ranking

arXiv:2607.05901v1 Announce Type: new Abstract: Automatic depression detection using audio-visual data faces significant challenges, particularly in disentangling overlapping feature distributions and

UniLM-Nav: A Unified Framework for Zero-Shot Last-Mile Navigation

model-releasesarxiv-cs-ro

arXiv:2607.06537v1 Announce Type: new Abstract: Mobile manipulation requires a robot to navigate to a target object or receptacle and then perform intended manipulation. However, reaching the vicinity

Unsupervised Anomaly Detection of Information Operations Users via Behavioral and Language Patterns

arXiv:2607.05855v1 Announce Type: cross Abstract: Information Operations on social media networks have been identified as a significant threat to democracy and modern society, but they are challenging

applicationsarxiv-cs-ai

A Cost-Aware, Paired Protocol for Auditing Dynamic Tool Synthesis in Agentic Video Question Answering

arXiv:2607.01469v2 Announce Type: replace Abstract: Agentic Video Question Answering (VideoQA) systems invoke tools during inference, but their tool libraries are fixed, so recurring procedures are re

agentsarxiv-cs-cv

Tutorials

A harmonised dataset for Earth system foundation models

arXiv:2607.03298v1 Announce Type: cross Abstract: Foundation models for Earth systems have so far been trained primarily on physical climate and weather data, with limited representation of the human

tutorialsarxiv-cs-ai

Agentic and Generative AI for Open-Source Intelligence and Cyber Investigations: Taxonomy, Evaluation, Challenges, and Future Directions

arXiv:2607.03233v1 Announce Type: cross Abstract: The rapid growth of publicly available digital information has rendered manual open-source intelligence (OSINT) analysis insufficient for modern intel

Atlas is Your Perfect Context: One-Shot Customization for Generalizable Foundational Medical Image Segmentation

arXiv:2512.18176v2 Announce Type: replace Abstract: Accurate segmentation of anatomical structures in medical images is essential for diagnosis and treatment planning. While recent interactive segment

applicationsarxiv-cs-cv

Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment

arXiv:2607.04311v1 Announce Type: new Abstract: Subject-driven and multi-element video generation are central to controllable video synthesis, but existing methods still struggle to preserve identity

safetyarxiv-cs-cv

Autonomous Information Seeking: A Roadmap for Agentic Recommender Systems

arXiv:2607.04433v1 Announce Type: cross Abstract: The rapid integration of large language model-based agents into recommender systems has driven a shift from static, ranking-based pipelines toward aut

safetyarxiv-cs-cl

CAC-VLA: Context-Gated Action Conditioning for Vision-Language-Action Models

arXiv:2607.04816v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models have become a promising paradigm for generalist robot manipulation, where visual-language representations are used t

researcharxiv-cs-ro

CoFEND: A Cross-Modal Fusion End-to-End Network for Cold-Start Drug-Drug Interaction Prediction

arXiv:2607.02928v1 Announce Type: new Abstract: Cold-start drug-drug interaction (DDI) prediction for new drugs is critical for minimizing unexpected adverse drug reactions. The key challenge is to ca

researcharxiv-cs-lg

CRISP: A Spatiotemporal Camera-Radar Backbone for Driving via Forecasting-Based World-Model Pretraining

arXiv:2607.04541v1 Announce Type: cross Abstract: Camera-radar (CR) fusion is a practical sensing configuration for autonomous driving, but existing models are typically trained with task-specific sup

Criterion-Conditional In-Context Learning: Evaluating Criterion-Shift Adaptation in Vision-Language Models

arXiv:2607.02575v1 Announce Type: cross Abstract: Vision-language models can perform new tasks without parameter updates through in-context learning (ICL), whose core mechanism is utilizing the suppor

EM3M: An Electron Micrograph Dataset for Microstructural Segmentation and Generation

arXiv:2508.16239v2 Announce Type: replace Abstract: Quantitative microstructural characterization is fundamental to materials science, and electron micrographs (EMs) provide indispensable high-resolut

EmoteGPT: 3D Human Facial Expressions from Natural Language Descriptions

arXiv:2607.02674v1 Announce Type: new Abstract: Precise control of 3D facial expressions from text is crucial for virtual avatars, animation, and human-computer interaction, yet existing text-to-3D me

Explainable Novel Category Discovery in Semantic Concept Space

arXiv:2607.04548v1 Announce Type: cross Abstract: Novel category discovery aims to identify unseen classes from unlabeled data by transferring knowledge from labeled categories, but most existing meth

Framework and Multi-modal Dataset for Roadwork Zone Detection and Geo-localization

arXiv:2607.04330v1 Announce Type: new Abstract: Autonomous vehicles often rely on high-definition (HD) maps for navigation; however, these maps are not frequently updated and often lack semi-static in

HCSU: A Dataset and Benchmark for Fine-Grained Historical Calligraphy Style Understanding

arXiv:2607.04147v1 Announce Type: cross Abstract: Automated fine-grained perception of calligraphy styles--a task vital to cultural heritage preservation--remains a critical challenge for Large Vision

Humanoid Everyday: A Comprehensive Robotic Dataset for Open-World Humanoid Manipulation

arXiv:2510.08807v3 Announce Type: replace-cross Abstract: From loco-motion to dextrous manipulation, humanoid robots have made remarkable strides in demonstrating complex full-body capabilities. Howev

safetyarxiv-cs-lg

InternVLA-A1.5: Unifying Understanding, Latent Foresight, and Action for Compositional Generalization

arXiv:2607.04988v1 Announce Type: new Abstract: Unified models for robot manipulation aim to equip one policy with both the semantic priors of pretrained VLMs and the physical dynamics learned through

safetyarxiv-cs-ro

Interpretable machine learning predicts Parkinson's disease severity using motion-corrected QSM MRI and multiband multiecho fMRI features

arXiv:2607.02553v1 Announce Type: new Abstract: Introduction: Objective neuroimaging biomarkers may improve Parkinson's disease motor assessment by capturing brain variation not directly observable fr

researcharxiv-cs-cv

IRIS: An Intelligent Vision-Language System for Ocular Surface Diseases via Topic Tree and Scene-Driven VQA Generation

arXiv:2607.04344v1 Announce Type: cross Abstract: While Large Vision-Language Models (VLMs) demonstrate remarkable generic capabilities, their clinical reasoning in specialized domains like ocular sur

JADAI: Jointly Amortizing Adaptive Design and Bayesian Inference

arXiv:2512.22999v2 Announce Type: replace-cross Abstract: We consider problems of parameter estimation where design variables can be actively optimized to maximize information gain. To this end, we in

MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources

arXiv:2601.22054v2 Announce Type: replace-cross Abstract: Scaling has powered recent advances in vision foundation models, yet extending this paradigm to metric depth estimation remains challenging du

applicationsarxiv-cs-ai

MoP-JEPA: Hard-Assigned Predictor Mixtures for Stochastic JEPA World Models

arXiv:2607.05238v1 Announce Type: new Abstract: JEPA world models predict the next latent state with a single deterministic predictor trained by latent regression. We show that this fails structurally

RADIO1D: Elastic Representations for Condensed Vision Modeling

arXiv:2607.03624v1 Announce Type: cross Abstract: This paper challenges the assumption that vision-language models (VLMs) require fixed patch-based 2D vision features. Analyzing fine-tuned vision enco

safetyarxiv-cs-ai

Scalable Semantic Steering of Embedding Projections

arXiv:2607.03978v1 Announce Type: cross Abstract: Low-dimensional projections support interactive visual analysis of high-dimensional data embeddings, but their structure often does not align with ana

safetyarxiv-cs-ai

Search Beyond What Can Be Taught: Evolving the Knowledge Boundary in Agentic Visual Generation

arXiv:2607.05382v1 Announce Type: cross Abstract: Visual generators excel at rendering, but they confidently fabricate what they do not know. User requests are unbounded, evolving, and deeply long-tai

SIMPLER: Efficient Foundation Model Adaptation via Similarity-Guided Layer Pruning for Earth Observation

arXiv:2603.19873v2 Announce Type: replace Abstract: Fine-tuning foundation models for Earth Observation is computationally expensive, with high training time and memory demands for both training and d

Stable Global Weighting of Flow Mixtures using Simplex Exponential Moving Average

arXiv:2607.03809v1 Announce Type: new Abstract: Normalising flows provide a powerful variational family for approximate inference, yet individual architectures often fail to generalise across heteroge

researcharxiv-cs-lg

TacReasoner: A Dynamic Tactile-Language Framework for Interactive Reasoning in Real-World Scenarios

arXiv:2607.05131v1 Announce Type: new Abstract: Among the five primary human senses, tactile is arguably the most fundamental to survival, as it enables the perception of physical contact and interact

applicationsarxiv-cs-ai

The Good, the Bad, and the Brittle: Benchmarking Robustness and Generalisation of Histopathology Foundation Models

arXiv:2607.04401v1 Announce Type: new Abstract: How robust and generalisable are pathology foundation models and have their scaling limites been reached? We benchmarked twelve pathology foundation mod

Tutorials

Token Communications: A Large Model-Driven Framework for Cross-modal Context-aware Semantic Communications

arXiv:2502.12096v5 Announce Type: replace-cross Abstract: In this paper, we introduce token communications (TokCom), a large model-driven framework to leverage cross-modal context information in gener

tutorialsarxiv-cs-cv