Search: “multimodal”

VaaWIT: Visual-Aware Adaptation of Large Language Models for Multilingual Web Image Translation

model-releasesarxiv-cs-ai

arXiv:2605.24675v1 Announce Type: cross Abstract: Translating text embedded in Web images is crucial for improving content accessibility and cross-lingual information retrieval, particularly within so

26 May 2026

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Agents

Why We Need World Models for AGI: Where LLMs Fail and How World Models May Outperform

DGX agent

arXiv:2605.23972v1 Announce Type: new Abstract: Large language models achieve strong performance in language generation and knowledge-intensive tasks, yet remain limited in settings requiring causal r

agentsarxiv-cs-ai

26 May 2026

Autonomous Frontier-Based Exploration with VLM Guidance

arXiv:2605.23165v1 Announce Type: cross Abstract: Autonomous robotic exploration of unknown and hazardous environments, a long-standing challenge, can be significantly improved by leveraging the advan

agentsarxiv-cs-ai

Beyond VLM-Based Rewards: Diffusion-Native Latent Reward Modeling

arXiv:2602.11146v2 Announce Type: replace-cross Abstract: Preference optimization for diffusion and flow-matching models relies on reward functions that are both discriminatively robust and computatio

safetyarxiv-cs-ai

DDX-TRACE: A Benchmark for Medical Diagnostic Trajectories in VLMs

arXiv:2605.23629v1 Announce Type: new Abstract: Medical diagnosis is not a single prediction from a fully specified vignette. It is a sequential workup: clinicians decide what evidence to obtain, revi

Diffusion and Flow Matching Models for Tabular Data: A Survey

arXiv:2502.17119v2 Announce Type: replace-cross Abstract: Deep generative models have made rapid progress in image, text, audio, and video generation, and are increasingly being applied to structured

safetyarxiv-cs-ai

Diffusion-based Denoising Beats Vanilla Score Matching in Parameter Estimation: A Theoretical Explanation

model-releasesarxiv-cs-lg

arXiv:2605.22950v1 Announce Type: cross Abstract: Score matching is an alternative to maximum likelihood estimation when the normalizing constant is unknown or too costly to evaluate. However, vanilla

LangFlash: Feed-forward 3D Language Gaussian Splatting from Sparse Unposed Images

arXiv:2605.23287v1 Announce Type: new Abstract: We present LangFlash, a feed-forward framework for 3D Language Gaussian Splatting that reconstructs 3D scenes parameterized by Gaussian primitives enric

researcharxiv-cs-cv

MirrorCheck: Efficient Adversarial Defense for Vision-Language Models

arXiv:2406.09250v3 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) are increasingly susceptible to sophisticated adversarial attacks, including adaptive strategies specifically de

researcharxiv-cs-ai

Local Ai

PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQA

arXiv:2605.23559v1 Announce Type: cross Abstract: Whole-slide image visual question answering (WSI-VQA) frames pathology as an extreme-context search problem: to answer a free-form clinical query, a s

local-aiarxiv-cs-ai

Scaling-Aware Adapter for Structure-Grounded LLM Reasoning

arXiv:2602.02780v3 Announce Type: replace Abstract: Large language models (LLMs) are enabling reasoning over 2D and 3D structures, yet existing methods remain modality-specific and typically compress

researcharxiv-cs-ai

Using Ensemble Diffusion to Estimate Uncertainty for End-to-End Autonomous Driving

arXiv:2506.00560v2 Announce Type: replace-cross Abstract: End-to-end planning systems for autonomous driving are rapidly improving, especially in closed-loop simulation environments like CARLA. Many s

Measuring Cross-Modal Synergy: A Benchmark for VLM Explainability

model-releasesarxiv-cs-lg

arXiv:2605.22168v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) map complex visual inputs to semantic spaces, but interpreting the cross-modal reasoning of VLMs currently relies on pos

23 May 2026

On Robustness and Chain-of-Thought Consistency of RL-Finetuned VLMs

model-releasesarxiv-cs-lg

arXiv:2602.12506v3 Announce Type: replace Abstract: Reinforcement learning (RL) finetuning has become a key technique for enhancing large language models (LLMs) on reasoning-intensive tasks, motivatin

23 May 2026

Cambrian-P: Pose-Grounded Video Understanding

arXiv:2605.22819v1 Announce Type: new Abstract: Camera pose matters. The position and orientation of each viewpoint define a shared spatial coordinate frame that relates observations across video fram

researcharxiv-cs-cv

Circle-RoPE: Cone-like Decoupled Rotary Positional Embedding for Large Vision-Language Models

arXiv:2505.16416v3 Announce Type: replace Abstract: Rotary Position Embedding (RoPE) is widely adopted in large language models, but when applied to vision-language models (VLMs) it couples text and i

Cohere Command A+ is now available in Microsoft Foundry as a Managed Compute offer. Cohere’s latest open-source model is built for enterpris…

Cohere Command A+ is now available in Microsoft Foundry as a Managed Compute offer. Cohere’s latest open-source model is built for enterprise-grade agentic AI workloads, bringing together reasoning, m

agentscohere--x

FashionLens: Toward Versatile Fashion Image Retrieval via Task-Adaptive Learning

arXiv:2605.22552v1 Announce Type: new Abstract: Fashion image retrieval is a cornerstone of modern e-commerce systems. A unified framework that supports diverse query formats and search intentions is

From Recognition to Reasoning: Benchmarking and Enhancing MLLMs on Real-World Receipt Document Understanding

arXiv:2605.22413v1 Announce Type: new Abstract: Extracting structured information from visual documents (Visual Information Extraction, VIE) is a cornerstone of business automation. While recent Multi

GA-VLN: Geometry-Aware BEV Representation for Efficient Vision-Language Navigation

arXiv:2605.22036v1 Announce Type: new Abstract: Despite significant progress in Vision-Language Navigation (VLN), existing approaches still rely on dense RGB videos that produce excessive patch tokens

agentsarxiv-cs-cv

GLeVE: Graph-Guided Lesion Grounding with Proposal Verification in 3D CT

arXiv:2605.22619v1 Announce Type: new Abstract: Grounding radiology report descriptions to 3D CT volumes is essential for verifiable clinical interpretation, yet remains challenging due to the semanti

How can reasoning capability empower the AI copilot robot in endoscopic surgery

arXiv:2605.22322v1 Announce Type: new Abstract: Reasoning capability has significantly advanced complex logical inference and robotic decision-making in general domains. However, its potential in the

safetyarxiv-cs-ro

How Well Do Models Follow Visual Instructions? VIBE: A Systematic Benchmark for Visual Instruction-Driven Image Editing

arXiv:2602.01851v2 Announce Type: replace Abstract: Recent generative models have achieved remarkable progress in image editing. However, existing systems and benchmarks remain largely text-guided. In

MAP4TS: A Multi-Aspect Prompting Framework for Time-Series Forecasting with Large Language Models

model-releasesarxiv-cs-cl

arXiv:2510.23090v2 Announce Type: replace Abstract: Recent advances have investigated the use of pretrained large language models (LLMs) for time-series forecasting by aligning numerical inputs with L

Pre-VLA: Preemptive Runtime Verification for Reliable Vision-Language-Action and World-Model Rollouts

arXiv:2605.22446v1 Announce Type: new Abstract: While large vision-language-action (VLA) models and generative world models (WM) have advanced long-horizon embodied intelligence, their practical deplo

SURGE: An Event-Centric Social Media Sentiment Time Series Benchmark with Interaction Structure

model-releasesarxiv-cs-ai

arXiv:2605.21198v1 Announce Type: cross Abstract: Public events on social media generate large volumes of discussion whose collective dynamics carry direct value for opinion forecasting and crisis res

Tutorials

TextTeacher: What Can Language Teach About Images?

arXiv:2605.22098v1 Announce Type: new Abstract: The platonic representation hypothesis suggests that sufficiently large models converge to a shared representation geometry, even across modalities. Mot

tutorialsarxiv-cs-cv

ClaimDiff-RL: Fine-Grained Caption Reinforcement Learning through Visual Claim Comparison

arXiv:2605.20278v1 Announce Type: cross Abstract: Long-form image captioning exposes a reward granularity problem in RL: captions are judged as whole sequences, while the important errors occur at the

Applications

Findings of the Counter Turing Test: AI-Generated Image Detection

arXiv:2605.20787v1 Announce Type: new Abstract: The rapid advancements in generative AI technologies, such as Stable Diffusion, DALL-E, and Midjourney, have significantly transformed the creation of s

applicationsarxiv-cs-cv

Applications

FruitEnsemble: MLLM-Guided Arbitration for Heterogeneous ensemble in Fine-Grained Fruit Recognition

arXiv:2605.20892v1 Announce Type: new Abstract: Fine-grained fruit classification is a critical yet challenging task in agricultural computer vision, primarily hindered by a severe shortage of high-qu

applicationsarxiv-cs-cv

FullFlow: Upgrading Text-to-Image Flow Matching Models for Bidirectional Vision--Language Generation

arXiv:2605.20316v1 Announce Type: new Abstract: Modern text-to-image diffusion models encode rich visual priors, but expose them only through one-way text-conditioned generation. Existing unified visi

Leveraging Vision-Language Models to Detect Attention in Educational Videos

arXiv:2605.20211v1 Announce Type: new Abstract: Educational videos are a cornerstone of remote and blended learning. However, learners' fluctuating attention remains a significant barrier to effective

MASFactory: A Graph-centric Framework for Orchestrating LLM-Based Multi-Agent Systems with Vibe Graphing

arXiv:2603.06007v2 Announce Type: replace Abstract: Large language model-based (LLM-based) multi-agent systems (MAS) are increasingly used to extend agentic problem solving via role specialization and

agentsarxiv-cs-cl

MC-Risk: Multi-Component Risk Fields for Risk Identification and Motion Planning

arXiv:2605.21406v1 Announce Type: new Abstract: We present MC-Risk, a planner-aligned, multi-component risk field on a bird's-eye-view grid that yields early, calibrated, and class-aware risk localiza

agentsarxiv-cs-ro

Local Ai

OSGNet with MLLM Reranking @ Ego4D Episodic Memory Challenge 2026

arXiv:2605.20818v1 Announce Type: new Abstract: In this report, we present our champion solutions for the Natural Language Queries and GoalStep tracks of the Ego4D Episodic Memory Challenge at CVPR 20

local-aiarxiv-cs-cv

Pareto-Enhanced Portrait Generation: Vision-Aligned Text Supervision for Alignment, Realism, and Aesthetics

arXiv:2605.20640v1 Announce Type: new Abstract: Text-to-image diffusion models often face a severe trilemma in human portrait generation: text-image alignment, photorealism, and human-perceived aesthe

ShadeBench: A Benchmark Dataset for Building Shade Simulation in Sustainable Society

arXiv:2605.20510v1 Announce Type: new Abstract: Urban heat exposure is becoming an increasingly critical challenge due to the intensifying urban heat island effect. Fine-grained shade patterns, especi

STiTch: Semantic Transition and Transportation in Collaboration for Training-Free Zero-Shot Composed Image Retrieval

arXiv:2605.21261v1 Announce Type: new Abstract: Training-free zero-shot composed image retrieval models are recently gaining increasing research interest due to their generalizability and flexibility

The Visual Iconicity Challenge: Evaluating Vision-Language Models on Sign Language Form-Meaning Mapping

model-releasesarxiv-cs-cl

arXiv:2510.08482v3 Announce Type: replace-cross Abstract: Iconicity, the resemblance between linguistic form and meaning, is pervasive in signed languages, offering a natural testbed for visual ground

[AINews] Google I/O 2026: Gemini 3.5 Flash, Omni (NanoBanana for Video), Spark (background agents), and Antigravity 2.0

model-releaseslatent-space

Google I/O 2026 featured several new AI model releases including Gemini 3.5 Flash, an Omni model codenamed NanoBanana for video processing, Spark for background agent tasks, and Antigravity 2.0. These

Artifact-Bench: Evaluating MLLMs on Detecting and Assessing the Artifacts of AI-Generated Videos

arXiv:2605.18984v1 Announce Type: new Abstract: Recent video generative models have greatly improved the realism of AI-generated videos, yet their outputs still exhibit artifacts such as temporal inco

Beyond Waypoints: Dual-Heatmap Grounding for Cross-Embodiment Semantic Navigation

model-releasesarxiv-cs-ro

arXiv:2605.19420v1 Announce Type: new Abstract: Grounding open-ended semantic instructions into physically executable local goals is a fundamental challenge in human-robot interaction. While existing

Brain alignment of reasoning and action representations from vision-language and action models during naturalistic gameplay

arXiv:2605.19352v1 Announce Type: cross Abstract: Understanding how humans and artificial intelligence systems predict and plan by interacting with their environment is a fundamental challenge at the

safetyarxiv-cs-ai

CEPO: RLVR Self-Distillation using Contrastive Evidence Policy Optimization

arXiv:2605.19436v1 Announce Type: cross Abstract: When a model produces a correct solution under reinforcement learning with verifiable rewards (RLVR), every token receives the same reward signal rega

safetyarxiv-cs-cl

Tutorials

Character-Centered Dialogue Generation from Scene-Level Prompts

arXiv:2505.16819v4 Announce Type: replace Abstract: Recent advances in scene-based video generation enable coherent visual narratives from structured prompts, yet a key aspect of storytelling -- chara

tutorialsarxiv-cs-cv

CLIC: Contextual Language-Informed Cardiac Pathology Classification

arXiv:2605.19132v1 Announce Type: new Abstract: The electrocardiogram (ECG) is the gold standard for non-invasive diagnosis of cardiac pathologies and is a fundamental pillar of cardiovascular medicin

researcharxiv-cs-lg

Tutorials

Diffusion and Flow-based Copulas: Forgetting and Remembering Dependencies

arXiv:2509.19707v2 Announce Type: replace-cross Abstract: Copulas are a fundamental tool for modelling multivariate dependencies in data, forming the method of choice in diverse fields and application

tutorialsarxiv-cs-lg

Dynamic Model Merging Made Slim

model-releasesarxiv-cs-ai

arXiv:2605.18904v1 Announce Type: cross Abstract: Model merging enables the reuse of fine-tuned models without joint training or access to original data. Dynamic merging further improves flexibility b