Search: “multimodal”

Entropy Is Not Enough: Unlocking Effective Reinforcement Learning for Visual Reasoning via Vision-Anchored Token Selection

arXiv:2606.03937v1 Announce Type: new Abstract: While token-level entropy is commonly recognized as effective for credit assignment in text-only reinforcement learning with verifiable rewards (RLVR),

safetyarxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

extsc{CR-Seg}: Attention-Guided and CoT-Enhanced Coarse-to-Refined Reasoning Segmentation

DGX agent

arXiv:2606.03564v1 Announce Type: cross Abstract: Reasoning segmentation aims to segment target objects described by complex language through joint visual-textual reasoning. Existing methods typically

local-aiarxiv-cs-ai

3 Jun 2026

FinStressTS: A Parametric Synthetic Benchmark for Time-Series Forecasting in Finance

model-releasesarxiv-cs-lg

arXiv:2606.03184v1 Announce Type: cross Abstract: Financial forecasting is difficult due to low signal-to-noise ratios, latent factors, heavy tails, regime shifts, and jumps. Real-world benchmarks off

From Prompt to Service: An SLM-Based Agent Orchestration Gateway for AI-Driven Virtual Worlds

arXiv:2606.03557v1 Announce Type: new Abstract: As generative AI capabilities expand, AI-driven virtual worlds face a growing architectural challenge. Users interact through in-world interfaces in mul

Inference-Time Scaling for Joint Audio-Video Generation

arXiv:2606.03183v1 Announce Type: cross Abstract: Joint audio-video generation aims to synthesize realistic audio-video pairs that are both semantically aligned with text prompts and precisely synchro

Large AI Models in Dental Healthcare: From General-Purpose Systems to Domain-Specific Foundation Models

arXiv:2606.02914v1 Announce Type: new Abstract: Background: Oral diseases affect nearly 3.5 billion people worldwide, yet the comparative clinical potential of large-scale AI models in dentistry remai

MARIO: Motion-Augmented Real-Time Multi-Sensor Inertial Odometry

arXiv:2606.02996v1 Announce Type: cross Abstract: Inertial odometry (IO) using only Inertial Measurement Units (IMUs) provides a lightweight solution for human motion tracking in augmented reality (AR

Mixed-Modality Dual Face-Hair Retrieval

arXiv:2606.03470v1 Announce Type: new Abstract: We introduce Dual Face-Hair Retrieval (DFHR), a new mixed-modality dual-reference task in image retrieval where a query consists of a face image specify

OpenEAI-Platform: An Open-source Embodied Artificial Intelligence Hardware-Software Unified Platform

model-releasesarxiv-cs-ro

arXiv:2606.03392v1 Announce Type: new Abstract: Embodied AI in the real world requires both accurate hardware and robust vision-language-action (VLA) policies. We present OpenEAI-Platform, a fully ope

Pathway-Structured Privileged Distillation for Deployable Computational Pathology

arXiv:2606.02877v1 Announce Type: new Abstract: Integrating transcriptomics and histopathology can improve cancer risk modelling, yet practical use is constrained by the limited availability of RNA pr

PhotoCraft: Agentic Reasoning with Hierarchical Self-Evolving Memory for Deep Image Search

arXiv:2606.03099v1 Announce Type: cross Abstract: Deep Image Search requires multi-step reasoning over rich contextual cues, such as time, location, and event relations. However, most existing LLM-bas

Physical Plausibility Reasoning via HCM-GRPO: Empowering Compact Model for Superior Performance

arXiv:2511.10055v2 Announce Type: replace Abstract: The performance of image generation has been significantly improved in recent years. However, the study of image screening is rare, and its performa

SLU-2K: A Question-Based Benchmark for Semantic Evaluation of Sign Language Translation

arXiv:2606.03788v1 Announce Type: new Abstract: Sign Language Translation (SLT) is typically evaluated with surface-form metrics such as BLEU and ROUGE, which reward lexical overlap but do not directl

Thinking Past the Answer: Evaluating Harmful Overthinking in Large Reasoning Models

arXiv:2606.02835v1 Announce Type: new Abstract: Large Reasoning Models (LRMs) improve performance by generating explicit intermediate reasoning traces through increased test-time compute, yet the assu

Towards Characterizing Scientific Image Utility and Upgradability

arXiv:2606.03401v1 Announce Type: new Abstract: Scientific images function as critical evidence in research communication, yet their integrity faces unprecedented threats from AI-generated content tha

Trans GAN-WT: A Feature Extraction and Interactive Learning-Based Anomaly Detection Model for Wind Turbine Time Series Data

arXiv:2606.03112v1 Announce Type: cross Abstract: With the increasing scale and number of wind farms, wind turbines' daily operation and maintenance costs are increasing. To reduce operation and maint

researcharxiv-cs-lg

WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generation

arXiv:2503.07265v4 Announce Type: replace-cross Abstract: Text-to-Image (T2I) models are capable of generating high-quality artistic creations and visual content. However, existing research and evalua

3DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Code

arXiv:2606.01057v1 Announce Type: cross Abstract: Procedural 3D modeling through code is emerging as a versatile paradigm, offering deterministic, engine-ready, and precisely editable assets that neur

3rd Place at CVPR 2026 CASTLE Challenge: Agentic Multi-View Long-Context Video Understanding via Hierarchical Knowledge Graph Retrieval

arXiv:2606.01933v1 Announce Type: new Abstract: This paper presents our winning methodology for the CASTLE 2026 Challenge at the CVPR 2026 EgoVis Workshop, where our team secured third place globally.

A Survey of 3D Reconstruction with Event Cameras

arXiv:2505.08438v4 Announce Type: replace-cross Abstract: Event cameras are rapidly emerging as powerful vision sensors for 3D reconstruction, uniquely capable of asynchronously capturing per-pixel br

Hardware

APB-V: Accelerating Long-Video Understanding via Sequence-Parallelism-aware Approximate Attention

arXiv:2601.21444v2 Announce Type: replace-cross Abstract: The efficiency of long-video inference remains a critical bottleneck, mainly due to the dense computation in the prefill stage of Large Multim

hardwarearxiv-cs-ai

ATLAS: Agentic Test-time Learning-to-Allocate Scaling

model-releasesarxiv-cs-lg

arXiv:2606.01667v1 Announce Type: new Abstract: Test-time scaling has become a major way to improve large language model reasoning, but its orchestration has remained designer-engineered: a fixed samp

Applications

Auteur: Language-Driven Cinematographic Framing for Human-Centric Video Generation

arXiv:2606.01900v1 Announce Type: new Abstract: Generative video models have achieved remarkable visual fidelity and temporal coherence, yet intentional camera control remains elusive. Existing framew

applicationsarxiv-cs-cv

AutoMedBench: Towards Medical AutoResearch with Agentic AI Models

arXiv:2606.01961v1 Announce Type: new Abstract: Autonomous agents are increasingly expected to support end-to-end medical-AI research workflows, moving beyond isolated prediction tasks or short-form c

Avatar Forcing: Real-Time Interactive Head Avatar Generation for Natural Conversation

arXiv:2601.00664v2 Announce Type: replace-cross Abstract: Talking head generation creates lifelike avatars from static portraits for virtual communication and content creation. However, current models

Baton: Explicit Semantic Blueprints for Joint Video-Audio Generation

arXiv:2605.25195v2 Announce Type: replace Abstract: Current open-source diffusion models struggle to generate stable and synchronized audio-visual content, particularly in scenarios demanding complex

Better with Experience: Self-Evolving LLM Agents for Evidence-Grounded Health Community Notes

model-releasesarxiv-cs-cl

arXiv:2606.02215v1 Announce Type: new Abstract: Large Language Model (LLM)-augmented Community Notes offer a scalable path for timely, evidence-grounded correction of health misinformation on social p

Local Ai

Beyond Pure Sampling: Hybrid Optimization Mechanisms for Non-Convex Model Predictive Control

arXiv:2606.00737v1 Announce Type: new Abstract: This paper investigates the optimization mechanisms of non-convex Model Predictive Control (MPC) using the Maximum Entropy Differential Dynamic Programm

local-aiarxiv-cs-ro

Beyond Text and Tables: Vision-Language Model Integration in ComProScanner for Extracting Materials Data from Scientific Figures with High Accuracy

arXiv:2606.00065v1 Announce Type: cross Abstract: Automated extraction of materials composition-property data from scientific literature has advanced considerably with the development of large languag

CARES: Context-Aware Resolution Selector for VLMs

arXiv:2510.19496v3 Announce Type: replace-cross Abstract: Large vision-language models (VLMs) commonly process images at native or high resolution to remain effective across tasks. This inflates visua

CASTLE2026 Team WDL Technical Report

arXiv:2606.00712v1 Announce Type: new Abstract: The CASTLE Challenge @ EgoVis 2026 evaluates long-form egocentric video question answering over 600+ hours of multi-perspective recordings. Each four-ch

CoCoVideo: The High-Quality Commercial-Model-Based Contrastive Benchmark for AI-Generated Video Detection

arXiv:2606.00101v1 Announce Type: cross Abstract: With the rapid advancement of artificial intelligence generated content (AIGC) technologies, video forgery has become increasingly prevalent, posing n

Connecting the Dots: Benchmarking Reflective Memory in Long-Horizon Dialogue

arXiv:2606.01223v1 Announce Type: cross Abstract: Despite substantial progress in long-context modeling, existing benchmarks remain confined to factual memory for explicit recall, failing to measure t

Density-Aware Translation of Spurious Correlations in Zero-Shot VLMs

arXiv:2606.01710v1 Announce Type: new Abstract: Vision-Language models (VLMs), such as CLIP, achieve powerful zero-shot classification. However, their predictions remain sensitive to spurious correlat

Design-MLLM: A Reinforcement Alignment Framework for Verifiable and Aesthetic Interior Design

model-releasesarxiv-cs-lg

arXiv:2603.13312v2 Announce Type: replace-cross Abstract: Interior design is a requirements-to-visual-plan generation process that must simultaneously satisfy verifiable spatial feasibility and compar

Local Ai

Dynamic Resilient Spatio-Semantic Memory with Hybrid Localization for Mobile Manipulation

arXiv:2606.00576v1 Announce Type: new Abstract: Reliable mobile manipulation in dynamic indoor environments requires a scene representation that remains geometrically consistent, semantically queryabl

local-aiarxiv-cs-ro

EVA-Net: Subject-Independent EEG Motor Decoding with Video-Derived Motor Priors

arXiv:2606.01884v1 Announce Type: new Abstract: Practical non-invasive Brain-Computer Interface (BCI) systems require EEG decoders with strong cross-subject generalization and minimal calibration. How

FAIR^2 Drones: An AI-Ready Standard for Cross-Domain Wildlife Drone Datasets

arXiv:2606.00355v1 Announce Type: new Abstract: Animal ecology data collection using drones represents a substantial investment of time, expertise, and financial resources. Yet most existing datasets

researcharxiv-cs-ro

FigSIM: A Dataset for Fine-grained Suicide Severity and Figurative Language in Suicide Memes

model-releasesarxiv-cs-cl

arXiv:2606.02523v1 Announce Type: new Abstract: Suicide memes are memes used to express suicide-related thoughts or comment on suicide-related issues. Suicide memes are increasingly common on social m

Flexible Control of 3D CT Generation via Text and Semantically-Defined Segmentation Prompts

arXiv:2606.00967v1 Announce Type: new Abstract: Generative models for volumetric medical images have found many applications in medical imaging, ranging from data augmentation to serving as priors for

From Noise to Control: Parameterized Diffusion Policies

arXiv:2606.00336v1 Announce Type: new Abstract: We propose Parameterized Diffusion Policy (PDP), a framework for learning diffusion policies conditioned on low-dimensional, continuous parameters embed

safetyarxiv-cs-ai

Grounding or Guessing? Visual Signals for Detecting Hallucinations in Sign Language Translation

arXiv:2510.18439v3 Announce Type: replace Abstract: Hallucination, where models generate fluent text unsupported by visual evidence, remains a major flaw in vision-language models and is particularly

safetyarxiv-cs-cl

MindClaw: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention

arXiv:2606.01063v1 Announce Type: new Abstract: Theory of Mind (ToM) enables an agent to reason about another actor's beliefs, goals, and intentions, which is essential for human-centered embodied ass

Applications

MindZero: Learning Online Mental Reasoning With Zero Annotations

arXiv:2606.00240v1 Announce Type: new Abstract: Effective real-world assistance requires AI agents with robust Theory of Mind (ToM): inferring human mental states from their behavior. Despite recent a

applicationsarxiv-cs-ai

MMG2Skill: Can Agents Distill In-the-Wild Guides into Self-Evolving Skills?

arXiv:2606.01993v1 Announce Type: cross Abstract: Abundant procedural knowledge on the Web holds great potential for helping agents solve long-horizon tasks. However, such knowledge is often multimoda

OpenWebRL: Demystifying Online Multi-turn Reinforcement Learning for Visual Web Agents

arXiv:2606.02031v1 Announce Type: cross Abstract: Building capable visual web agents requires long-horizon reasoning, precise grounding, and robust interaction with dynamic real-world websites. Despit

PaSBench-Video: A Streaming Video Benchmark for Proactive Safety Warning

arXiv:2606.02443v1 Announce Type: cross Abstract: Between the first visible sign of danger and the moment an accident occurs, there is often a window where intervention remains possible. Video-capable

Pinterest Canvas: Large-Scale Image Generation at Pinterest

arXiv:2603.06453v2 Announce Type: replace Abstract: While recent image generation models demonstrate a remarkable ability to handle a wide variety of image generation tasks, this flexibility makes the

researcharxiv-cs-cv