Search: “multimodal”

SSL4RL: Revisiting Self-supervised Learning as Intrinsic Reward for Visual-Language Reasoning

arXiv:2510.16416v4 Announce Type: replace-cross Abstract: Vision-language models (VLMs) have shown remarkable abilities by integrating large language models with visual inputs. However, they often fai

safetyarxiv-cs-ai

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Statistical Unlearning of Distributions: A Hypothesis Testing Approach

DGX agent

arXiv:2605.16645v1 Announce Type: cross Abstract: Machine learning systems increasingly face requirements to forget not only individual data points, but entire domains of information, such as toxic la

researcharxiv-cs-lg

19 May 2026

T-STAR: A Context-Aware Transformer Framework for Short-Term Probabilistic Demand Forecasting in Dock-Based Shared Micro-Mobility

arXiv:2602.06866v2 Announce Type: replace Abstract: Reliable short-term demand forecasting is essential for managing shared micro-mobility services and ensuring responsive, user-centered operations. T

local-aiarxiv-cs-lg

Test-Time Hinting for Black-Box Vision-Language Models

arXiv:2605.16410v1 Announce Type: new Abstract: Test-time scaling (TTS) methods have proven highly effective for LLMs, yet their application to vision-language models (VLMs) remains relatively underex

researcharxiv-cs-cv

Hardware

TriAxialKV: Toward Extreme Low-Precision KV-Cache Quantization for Agentic Inference Tasks

arXiv:2605.17170v1 Announce Type: new Abstract: Agentic workloads have emerged as a major workload for LLM inference. They differ significantly from chat-only workloads, requiring long-context process

hardwarearxiv-cs-lg

VISTA-Bench: Do Vision-Language Models Really Understand Visualized Text as Well as Pure Text?

arXiv:2602.04802v2 Announce Type: replace Abstract: Vision-Language Models (VLMs) have achieved impressive performance in cross-modal understanding across textual and visual inputs, yet existing bench

VLM-AutoDrive: Post-Training Vision-Language Models for Safety-Critical Autonomous Driving Events

arXiv:2603.18178v2 Announce Type: replace-cross Abstract: The rapid growth of ego-centric dashcam footage presents a major challenge for detecting safety-critical events such as collisions and near-co

safetyarxiv-cs-ai

Watching, Reasoning, and Searching: A Video Deep Research Benchmark on Open Web for Agentic Video Reasoning

arXiv:2601.06943v2 Announce Type: replace-cross Abstract: In real-world video question answering scenarios, videos often provide only localized visual cues, while verifiable answers are distributed ac

WavFlow: Audio Generation in Waveform Space

arXiv:2605.18749v1 Announce Type: cross Abstract: Modern audio generation predominantly relies on latent-space compression, introducing additional complexity and potential information loss. In this wo

Why Modeling Human Haptic Material Perception with AI Is Difficult

arXiv:2605.16602v1 Announce Type: cross Abstract: Touch plays a central role in how humans perceive and recognize materials through physical contact. Despite decades of research, the mechanisms by whi

researcharxiv-cs-ai

World understanding: Gemini Omni is built on Gemini's vast knowledge of history, science, and culture, so it can produce videos that are gro…

model-releasesgoogle-ai--x

Gemini Omni is built on Gemini's extensive knowledge base of history, science, and culture, enabling it to generate videos with sophisticated contextual understanding. The capability leverages Google'

WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and Platform

arXiv:2605.17912v1 Announce Type: cross Abstract: World models have emerged as a central paradigm for embodied intelligence, enabling agents to predict action-conditioned future and reason about envir

AGC: Adaptive Geodesic Correction for Adversarial Robustness on Vision-Language Models

arXiv:2605.15584v1 Announce Type: new Abstract: Vision-language models like CLIP have demonstrated remarkable zero-shot transfer capabilities. However, their susceptibility to imperceptible adversaria

AirNav: A Large-Scale UAV Vision-and-Language Navigation Dataset with Natural and Diverse Instructions

model-releasesarxiv-cs-cl

arXiv:2601.03707v2 Announce Type: replace Abstract: Existing UAV vision-and-language navigation (VLN) benchmarks rarely provide realistic aerial scenes, natural process-level instructions, and suffici

Amortized Energy-Based Bayesian Inference

arXiv:2605.15407v1 Announce Type: cross Abstract: We consider amortized Bayesian inference for nonlinear inverse problems in settings where only samples from the joint distribution of parameters and o

researcharxiv-cs-ai

Cross-Modal Registration Between 3D and 2D Fingerprints via Pose-Aware Unwrapping and Point-Cloud Fusion

arXiv:2605.15796v1 Announce Type: new Abstract: Three-dimensional (3D) fingerprints preserve global finger geometry and local ridge structure while avoiding contact-induced deformation, but they remai

local-aiarxiv-cs-cv

Deep Pre-Alignment for VLMs

arXiv:2605.15300v1 Announce Type: new Abstract: Most Vision Language Models (VLMs) directly map outputs from ViT encoders to the LLM via a lightweight projector. While effective, recent analysis sugge

Driving Through the Network: Performance and Workload Under Latency and Video Impairment

arXiv:2605.15952v1 Announce Type: cross Abstract: Teleoperation promises to extend the operational envelope of automated vehicles, yet it critically depends on network latency and video quality. We re

safetyarxiv-cs-ro

ELDOR: A Dataset and Benchmark for Illegal Gold Mining in the Amazon Rainforest

arXiv:2605.15397v1 Announce Type: new Abstract: Illegal gold mining in the Amazon rainforest causes deforestation, water contamination, and long-term ecosystem disruption, yet remains difficult to mon

Entropic Auto-Encoding via Implicit Free-Energy Minimization

arXiv:2605.16164v1 Announce Type: new Abstract: Despite their ubiquity, variational autoencoders (VAEs) inherently suffer from posterior collapse, a failure mode in which latent variables are effectiv

researcharxiv-cs-lg

ForMaT: Dataset for Visually-Grounded Multilingual PDF Translation

model-releasesarxiv-cs-cl

arXiv:2605.15794v1 Announce Type: new Abstract: We present ForMaT (Format-Preserving Multilingual Translation), a parallel corpus of 3,956 PDFs across 15 language pairs that preserves original layout

GenAI-Driven Approach to RISC-V Supply Chain Exploration

arXiv:2605.15223v1 Announce Type: cross Abstract: This paper presents an LLM-empowered workflow for RISC-V supply chain analysis, integrating Vision-Language Models (VLMs) and Model-Driven Engineering

researcharxiv-cs-ai

Industry

Grok groks videos

Grok groks videos You can now upload entire videos to Grok and have it analyze, summarize, translate, explain scenes, or extract important context for you in real time Grok can understand full videos

industryelon-musk--x

Minerva-Ego: Spatiotemporal Hints for Egocentric Video Understanding

arXiv:2605.15342v1 Announce Type: new Abstract: Video reasoning models are a core component of egocentric and embodied agents. However, standard benchmarks for assessing models provide only evaluation

Industry

Moonlit stroll by Grok Imagine

'Moonlit Stroll by Grok Imagine' appears to be an AI-generated image created using xAI's Grok image generation model, shared via X (formerly Twitter). The post likely showcases Grok's capabilities in

industryelon-musk--x

PAGER: Bridging the Semantic-Execution Gap in Point-Precise Geometric GUI Control

arXiv:2605.15963v1 Announce Type: new Abstract: Large vision-language models have significantly advanced GUI agents, enabling executable interaction across web, mobile, and desktop interfaces. Yet the

PDRNN: Modular Data-driven Pedestrian Dead Reckoning on Loosely Coupled Radio- and Inertial-Signalstreams

arXiv:2605.15252v1 Announce Type: cross Abstract: Modern pedestrian dead reckoning (PDR) systems rely on fusing noisy and biased estimates of position, velocity, and calibrated orientation derived fro

PrismQuant: Rate-Distortion-Optimal Vector Quantization for Gaussian-Mixture Sources

arXiv:2605.15507v1 Announce Type: cross Abstract: For a Gaussian source under mean-squared error (MSE), classical transform coding is rate--distortion (RD) optimal: the Karhunen--Loeve transform (KLT)

local-aiarxiv-cs-ai

RAR: Retrieving And Ranking Augmented MLLMs for Visual Recognition

arXiv:2403.13805v2 Announce Type: replace-cross Abstract: CLIP (Contrastive Language-Image Pre-training) uses contrastive learning from noise image-text pairs to excel at recognizing a wide array of c

Res^2CLIP: Few-Shot Generalist Anomaly Detection with Residual-to-Residual Alignment

arXiv:2605.16171v1 Announce Type: new Abstract: Few-shot Generalist Anomaly Detection requires models to generalize to novel categories without retraining, posing significant challenges in real-world

safetyarxiv-cs-cv

SaaS-Bench: Can Computer-Use Agents Leverage Real-World SaaS to Solve Professional Workflows?

arXiv:2605.15777v1 Announce Type: new Abstract: Computer-Using Agents (CUAs) are rapidly extending large language models (LLMs) beyond text-based reasoning toward action execution in more complex envi

SARVLM: A Vision Language Foundation Model for Semantic Understanding in SAR Imagery

arXiv:2510.22665v3 Announce Type: replace-cross Abstract: Synthetic Aperture Radar (SAR) is a critical imaging modality due to its all-weather operational capability. Although recent advances in self-

SEED: Targeted Data Selection by Weighted Independent Set

arXiv:2605.15691v1 Announce Type: new Abstract: Data selection seeks to identify a compact yet informative subset from large-scale training corpora, balancing sample quality against collection diversi

local-aiarxiv-cs-lg

Segmentation, Detection and Explanation: A Unified Framework for CT Appearance Reasoning

arXiv:2605.15997v1 Announce Type: new Abstract: Recent progress in deep learning has significantly advanced CT image analysis, particularly for segmentation tasks. However, these advances are largely

local-aiarxiv-cs-cv

Skyra: AI-Generated Video Detection via Grounded Artifact Reasoning

arXiv:2512.15693v2 Announce Type: replace Abstract: The misuse of AI-driven video generation technologies has raised serious social concerns, highlighting the urgent need for reliable AI-generated vid

Unlocking Dense Metric Depth Estimation in VLMs

arXiv:2605.15876v1 Announce Type: new Abstract: Vision-Language Models (VLMs) excel at 2D tasks such as grounding and captioning, yet remain limited in 3D understanding. A key limitation is their text

Agents

WorldAct: Activating Monolithic 3D Worlds into Interactive-Ready Object-Centric Scenes

arXiv:2605.15843v1 Announce Type: new Abstract: Recent 3D world modeling systems based on generative scene synthesis, such as Marble, can create coherent and explorable 3D environments, yet their outp

agentsarxiv-cs-cv

A Tutorial on Cognitive Biases in Agentic AI-Driven 6G Autonomous Networks

arXiv:2510.19973v4 Announce Type: replace-cross Abstract: The path to higher network autonomy in 6G lies beyond the mere optimization of key performance indicators (KPIs), requiring systems that perce

Accelerated Sequential Flow Matching: A Bayesian Filtering Perspective

arXiv:2602.05319v3 Announce Type: replace Abstract: Sequential probabilistic inference from streaming observations requires modeling distributions over future trajectories as new observations arrive.

researcharxiv-cs-lg

Agents

Agentic AI Ecosystems in Higher Education: A Perspective on AI Agents to Emerging Inclusive, Agentic Multi-Agent AI Framework for Learning, Teaching and Institutional Intelligence

arXiv:2605.14266v1 Announce Type: new Abstract: Integration of artificial intelligent (AI) agents in higher education is transforming teaching, learning and administrative processes. Although existing

agentsarxiv-cs-ai

BCI-Based Assessment of Ocular Response Time Using Dynamic Time Warping Leveraging an RDWT-Driven Deep Neural Framework

arXiv:2605.14883v1 Announce Type: cross Abstract: Mild traumatic brain injury (mTBI) is a prevalent condition that remains difficult to diagnose in its early stages. Oculomotor dysfunction is a well-e

researcharxiv-cs-lg

Chain-of-Procedure: Hierarchical Visual-Language Reasoning for Procedural QA

model-releasesarxiv-cs-cl

arXiv:2605.14928v1 Announce Type: new Abstract: Recent advances in vision-language models (VLMs) have achieved impressive results on standard image-text tasks, yet their potential for visual procedure

Tutorials

Characterizing the visual representation of objects from the child's view

arXiv:2605.14990v1 Announce Type: new Abstract: Children acquire object category representations from their everyday experiences in the first few years of life. What do the inputs to this learning pro

tutorialsarxiv-cs-cv

Agents

Contestable Multi-Agent Debate with Arena-based Argumentative Computation for Multimedia Verification

arXiv:2605.14495v1 Announce Type: cross Abstract: Multimedia verification requires not only accurate conclusions but also transparent and contestable reasoning. We propose a contestable multi-agent fr

agentsarxiv-cs-ai

Do-Undo Bench: Reversibility for Action Understanding in Image Generation

arXiv:2512.13609v2 Announce Type: replace Abstract: We introduce the Do-Undo task and benchmark to address a critical gap in vision-language models: understanding and generating plausible scene transf

EARL: Towards a Unified Analysis-Guided Reinforcement Learning Framework for Egocentric Interaction Reasoning and Pixel Grounding

arXiv:2605.14742v1 Announce Type: new Abstract: Understanding human--environment interactions from egocentric vision is essential for assistive robotics and embodied intelligent agents, yet existing m

researcharxiv-cs-cv

Editor's Choice: Evaluating Abstract Intent in Image Editing through Atomic Entity Analysis

arXiv:2605.14842v1 Announce Type: new Abstract: Humans naturally communicate through abstract concepts like 'mood'. However, current image editing benchmarks focus primarily on explicit, literal comma

ICED: Concept-level Machine Unlearning via Interpretable Concept Decomposition

arXiv:2605.14309v1 Announce Type: cross Abstract: Machine unlearning in Vision-Language Models (VLMs) is typically performed at the image or instance level, making it difficult to precisely remove tar

safetyarxiv-cs-ai