Search: “multimodal”

From Retrieval to Recognition:How Vision--Language Models Become OCR Specialists

arXiv:2609.21543v1 Announce Type: new Abstract: Does a general vision--language model acquire specialized OCR ability by developing a new reading circuit or by reusing an existing mechanism? We addres

researcharxiv-cs-cv

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

KnowDemo: Knowledge-Guided Robot Demonstration Generation from Human Videos

DGX agent

arXiv:2609.21229v1 Announce Type: cross Abstract: Learning robot manipulation policies typically requires substantial demonstration data, which are costly to collect on real robots. Recent methods gen

safetyarxiv-cs-ai

21 Sept 2026

LLM-Generated Feature Pools for Time Series Anomaly Detection

arXiv:2609.21801v1 Announce Type: new Abstract: We study how far a simple statistical pipeline can go on univariate time series anomaly detection under a strict selection protocol. The method extracts

Tutorials

MemeTAG: Keyword-Driven Meme Classification through Tag Embedding Reconstruction

arXiv:2609.20962v1 Announce Type: new Abstract: The proliferation of harmful internet memes poses a significant societal threat, yet their automated classification remains a formidable algorithmic cha

tutorialsarxiv-cs-cv

MultiHU-TD: Multifeature Hyperspectral Unmixing Based on Tensor Decomposition

arXiv:2310.03860v1 Announce Type: cross Abstract: Hyperspectral unmixing allows representing mixed pixels as a set of pure materials weighted by their abundances. Spectral features alone are often ins

researcharxiv-cs-cv

OverThink: Slowdown Attacks on Reasoning LLMs

arXiv:2502.02542v5 Announce Type: replace Abstract: A reasoning language model (RLM) generates costly reasoning tokens, often hidden from the users, that help it excel at many tasks. Our Overthink att

safetyarxiv-cs-lg

ProTracer: Proprioception-Guided Failure Diagnosis in Robot Manipulation

arXiv:2609.21369v1 Announce Type: cross Abstract: This paper presents a comprehensive framework for robot manipulation failure analysis that includes binary failure detection, failure categorization,

SIRA: Reasoning-Aware Surgical Instrument Segmentation via Query-Anchored Alignment

arXiv:2609.21402v1 Announce Type: new Abstract: Surgical instrument segmentation (SIS) plays a critical role in robotic assistance and surgical workflow analysis. However, most existing SIS methods fo

Tutorials

When Should Robots Intervene? Balancing Engagement and Intrusiveness in Human-Robot Interaction

arXiv:2609.21734v1 Announce Type: new Abstract: Designing effective Human-Robot Interaction in task-oriented settings requires carefully balancing user engagement with socially acceptable levels of ro

tutorialsarxiv-cs-ro

4D Radar Perception Algorithms for Autonomous Driving: A Review

arXiv:2609.19216v1 Announce Type: cross Abstract: Research on 4D millimeter-wave radar perception algorithms has flourished in recent years, extending from signal processing and object detection to se

agentsarxiv-cs-cv

AI Smart Glasses for Wearable Intelligence: From Egocentric Sensing to Agentic Personalization

arXiv:2609.19793v1 Announce Type: new Abstract: Recent advances in artificial intelligence (AI) are reshaping smart glasses from egocentric capture and display devices into platforms for wearable inte

agentsarxiv-cs-cv

AntiGrounding: Executable Robot Trajectories as Visual Prompts for VLM-Guided Manipulation

arXiv:2506.12374v3 Announce Type: replace-cross Abstract: Natural-language manipulation instructions specify the task goal but leave the underlying robot trajectory unspecified. We present AntiGroundi

AURA: Adaptive Uncertainty-Routed Analysis for Email Threat Detection

arXiv:2609.19873v1 Announce Type: new Abstract: Email spam and phishing attacks remain a critical security threat. Adversaries increasingly exploit large language models to craft contextually convinci

applicationsarxiv-cs-lg

BinoGen: Scaling egocentric binocular data for embodied visual perception and learning

arXiv:2609.19881v1 Announce Type: new Abstract: Embodied visual perception relies on temporally coherent visual experience accumulated through continuous engagement with the environment. However, coll

applicationsarxiv-cs-cv

CitySTAR: Structured and Topology-Aware Reasoning for Open-Vocabulary Urban 3D Grounding

arXiv:2609.19911v1 Announce Type: new Abstract: 3D grounding aims to localize target entities in complex scenes from natural language and plays a fundamental role in embodied perception and spatial re

DeliveryGym: An RL Environment for Long-Horizon Embodied Agent Planning with Adaptive Curriculum

arXiv:2609.19801v1 Announce Type: new Abstract: Executable environments enable LLM agents to learn from the consequences of their actions. For embodied agents, those consequences extend beyond whether

safetyarxiv-cs-lg

Detecting Deceptive Recruitment: A Signal-theoretic Machine Learning Framework for Early Identification of Labour Exploitation

arXiv:2609.20336v1 Announce Type: cross Abstract: Deceptive online job advertisements have emerged as a primary pathway into forced labour, yet systematic detection methods remain underdeveloped due t

applicationsarxiv-cs-lg

DocAttriBench: Benchmarking Answer Grounding in Document Visual Question Answering

arXiv:2609.20574v1 Announce Type: new Abstract: Answer grounding in document visual question answering remains an open challenge: most benchmarks lack grounding annotations or provide limited-quality

FASA: Feedback-Aware Sampling Adaptation for Efficient Diffusion-Based VLA Models

arXiv:2609.19475v1 Announce Type: new Abstract: Diffusion-based Vision-Language-Action (VLA) models achieve strong performance in embodied tasks, but their iterative sampling imposes heavy computation

researcharxiv-cs-ro

FORGE: Forensic Reasoning with Grounded Evidence

arXiv:2503.15867v4 Announce Type: replace-cross Abstract: Forensic deepfake analysis demands more than binary classification: investigators need region-grounded natural language explanations they can

local-aiarxiv-cs-ai

Improving Generalization and Robustness in Offline Reinforcement Learning via Boundary-Aware Data Augmentation

arXiv:2609.20300v1 Announce Type: new Abstract: Current offline reinforcement learning (ORL) algorithms tend to overfit the training dataset and exhibit poor in-distribution generalization and robustn

safetyarxiv-cs-lg

Learn Before You Judge: Progressive Knowledge-to-Decision Alignment for Explainable Hateful Meme Detection

arXiv:2609.19778v1 Announce Type: new Abstract: Hateful memes spread abusive content through implicit interactions between images and text, posing serious threats to the safety of online communities.

safetyarxiv-cs-cl

PosteriorBench: From Point Estimates to Posterior Matching in Evaluating Generative Inverse Solvers

model-releasesarxiv-cs-lg

arXiv:2609.20794v1 Announce Type: new Abstract: Generative models are increasingly used to solve scientific inverse problems, but existing evaluations still focus primarily on whether a method can pro

Redemption Score: A Multi-Modal Evaluation Framework for Image Captioning via Distributional, Perceptual, and Linguistic Signal Triangulation

model-releasesarxiv-cs-cl

arXiv:2505.16180v3 Announce Type: replace-cross Abstract: Evaluating image captions requires cohesive assessment of both visual semantics and language pragmatics, which is often not entirely captured

Scientific Image Quality Assessment via Multi-modal Retrieval-Augmented Generation

arXiv:2609.19634v1 Announce Type: cross Abstract: This paper proposes a Retrieval-Augmented Generation (RAG) framework for scientific image quality assessment, designed to simultaneously address both

Stress Tests REVEAL Fragile Temporal and Visual Grounding in Video-Language Models

arXiv:2602.11244v2 Announce Type: replace Abstract: Video-Language Models (VidLMs) achieve strong benchmark scores, yet these scores often hide whether models use the video at all. We show that VidLM

WZPlanner: Safe End-to-End Path Planning for Autonomous Driving in Work Zones

arXiv:2609.19393v1 Announce Type: new Abstract: Work zones alter lane geometry through temporary traffic controls and closures that may be absent from on-board maps, challenging autonomous vehicle (AV

agentsarxiv-cs-cv

A Systematic Evaluation of the COTQ Provincial Land Cover Product: Structural Consistency, Spectral Separability, and Relative Positioning Against ESA, ESRI, and Google Products

arXiv:2609.17731v1 Announce Type: new Abstract: High-resolution land use and land cover (LULC) products derived from Sentinel-2 imagery are widely used for environmental monitoring and land management

Code Consistency Preference Optimization Verification for Language Model Alignment

model-releasesarxiv-cs-cl

arXiv:2609.19002v1 Announce Type: cross Abstract: Execution-based verification enhances large language models' mathematical reasoning through computational soundness and dependency-aware filtering. Ho

CompArt: Operationalizing Aesthetic Alignment in Text-to-Image Generation via Principles of Art

arXiv:2503.12018v2 Announce Type: replace-cross Abstract: Text-to-Image (T2I) diffusion models have made rapid progress on semantic alignment (generating what is described in the prompt), yet users st

Confidence Comes from Experience: Experiential Confidence Estimation from Reasoning to Agents

arXiv:2609.17708v1 Announce Type: cross Abstract: Reliable confidence estimation is increasingly central to the trustworthy deployment of language models: a calibrated estimate of the probability that

agentsarxiv-cs-ai

Entropy in Conversational AI: Structured Unpredictability as Inferrable Interiority

arXiv:2609.19044v1 Announce Type: new Abstract: Sampling can increase response diversity without producing history-dependent behavior. We formalize a different design target, structured unpredictabili

local-aiarxiv-cs-cl

EPOFusion: Exposure aware Progressive Optimization Method for Infrared and Visible Image Fusion

arXiv:2603.16130v5 Announce Type: replace Abstract: Overexposure caused by strong daylight and oncoming headlights frequently overwhelms visible sensors, resulting in critical information loss in visu

applicationsarxiv-cs-cv

EviGen: Predictive Evidence Scaffolding for Verifiable Clinical Rationale Generation

arXiv:2609.18852v1 Announce Type: new Abstract: Longitudinal electronic health records (EHRs) capture years of patient history across notes, codes, labs, and procedures, and contain evidence needed to

Gaze as Evidence for Common Grounding: A Cross-Corpus Analysis of MapTask and MUNDEX

arXiv:2609.18011v1 Announce Type: new Abstract: In collaborative tasks with asymmetric information, participants coordinate their understanding through interaction. We ask whether gaze provides eviden

Imitation Learning for Autonomous Driving in CARLA

model-releasesarxiv-cs-ai

arXiv:2609.17757v1 Announce Type: new Abstract: Behavioral cloning trains a policy offline on expert demonstrations, but deployment is closed loop: each action affects the observations the policy rece

Lexara-RF: Reference-Free Metrics for Evaluating Conversational Visual Analytics Agents

arXiv:2609.17842v1 Announce Type: cross Abstract: Conversational visual analytics (CVA) agents powered by large language models generate visualizations and natural-language explanations from open-ende

On-the-Fly Homographies Calibration for Multi-Camera Tracking

arXiv:2609.18582v1 Announce Type: cross Abstract: Precise multi-camera tracking traditionally relies on rigorous 3D site calibration, yet this requirement is often operationally impossible in large-sc

Relation Before Entity: Deferred Commitment in Language Model Factual Recall

arXiv:2609.17537v1 Announce Type: new Abstract: We ask whether relation-type information (e.g., capital-of) and entity-specific information (e.g., France to Paris) become causally active at the final-

Rethinking How We Evaluate Methodological Progress in Health AI

arXiv:2609.18134v1 Announce Type: cross Abstract: Methodological progress in artificial intelligence (AI) for electronic health records (EHRs) depends on our ability to determine which algorithms work

Scalable Music Cover Retrieval Using Lyrics-Aligned Audio Embeddings

arXiv:2601.11262v2 Announce Type: replace-cross Abstract: Music Cover Retrieval, also known as Version Identification, aims to recognize distinct renditions of the same underlying musical work, a task

researcharxiv-cs-lg

TabPFN-3.5: Technical Report

arXiv:2609.17895v1 Announce Type: new Abstract: We introduce TabPFN-3.5, our new flagship Tabular Foundation Model. It significantly outperforms its predecessor, TabPFN-3, and all existing baselines a

researcharxiv-cs-lg

Unleash LLMs Potential for Sequential Recommendation by Coordinating Dual Dynamic Index Mechanism

arXiv:2409.09253v2 Announce Type: replace-cross Abstract: Owing to the unprecedented capability in semantic understanding and logical reasoning, large language models (LLMs) have shown fantastic poten

WISE: A Lightweight, Weakly-Supervised Model for Onboard Fire Smoke Detection and Localization

arXiv:2609.18227v1 Announce Type: new Abstract: Wildfire smoke detection from satellite imagery is critical for early warning and rapid response. For onboard satellite deployment, detection systems mu

local-aiarxiv-cs-cv

A Framework for Generating Valid Context-Specific Benchmarks through Expert Guidance

model-releasesarxiv-cs-ai

arXiv:2609.16592v1 Announce Type: new Abstract: This paper presents an end-to-end approach for generating context-specific large language model (LLM) benchmark datasets by combining expert input with

Artificial Intelligence-Enabled Space Robot Operations: Technologies, Challenges and Prospects

arXiv:2609.16880v1 Announce Type: new Abstract: Space robots are increasingly expected to perform long-duration, contact-rich, and multi-stage operations with limited human intervention. Recent advanc

safetyarxiv-cs-ro

CLIP Embeddings for AI-Generated Image Detection: A Few-Shot Study with Lightweight Classifier

model-releasesarxiv-cs-ai

arXiv:2505.10664v2 Announce Type: replace-cross Abstract: Verifying the authenticity of AI-generated images presents a growing challenge on social media platforms these days. While vision-language mod

Det-LIME: Detector-Aware, Multi-Instance Local Interpretable Model-Agnostic Explanations for Automated Marine Mammal Detection

arXiv:2609.17479v1 Announce Type: cross Abstract: Despite the rapid uptake of black-box object detectors in marine mammal research and monitoring, explainability techniques are rarely integrated into

local-aiarxiv-cs-ai