Search: “multimodal”

Object Counting Across Modalities: Taxonomies, Benchmarks, Applications, and Open Challenges

arXiv:2608.23845v1 Announce Type: new Abstract: Object-counting methods have rapidly shifted from class-specific density regression to open-vocabulary, foundation-model-backed counters. These methods

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Applications

Real-World Knowledge-Guided Change Data Synthesis for Remote Sensing

DGX agent

arXiv:2608.24263v1 Announce Type: new Abstract: Change data synthesis provides a cost-effective solution for expanding training data and improving the performance of change detection models. However,

applicationsarxiv-cs-ai

26 Aug 2026

Local Ai

StrokeGuard: A Multi-Agent Guided System for Prehospital Stroke Assessment

arXiv:2608.24555v1 Announce Type: cross Abstract: Prehospital stroke assessment aims to accurately identify stroke symptoms and make rapid decisions through standardized procedures within an extremely

local-aiarxiv-cs-ai

ViSculpt: Visual-Centric Agentic Geometry Editing

arXiv:2608.24169v1 Announce Type: new Abstract: 3D geometry editing is a critical yet labor-intensive part of the graphics pipeline, requiring artists to translate creative intent into precise operati

Vision Language Model Fusion for Explainable Face Recognition

arXiv:2608.24430v1 Announce Type: new Abstract: Responsible deployment of face verification systems requires more than accurate decisions: systems should also provide interpretable and auditable evide

A Cross-Architecture Audit of Direction-Based Inference-Time Defences in Vision-Language Models

arXiv:2607.27910v2 Announce Type: replace Abstract: Inference time defences against vision language model jailbreaks often subtract a calibrated direction from the residual stream at a chosen decoder

A Latency-Aware Framework for Visuomotor Policy Learning on Industrial Robots

arXiv:2602.14255v2 Announce Type: replace Abstract: Industrial robots are increasingly deployed in construction and manufacturing tasks, where the deployment of end-to-end visuomotor policies is chall

safetyarxiv-cs-ro

Adapting Dense Vision-Language Relationships for Multi-label Classification with Partial Label

arXiv:2608.22313v1 Announce Type: new Abstract: Learning multi-label image classification with incomplete annotations is a challenging task that has been widely studied for its superior trade-off betw

Benchmarking and Boosting Multilingual Capabilities of LVLMs via OCR-Centric Reinforcement Learning

model-releasesarxiv-cs-cl

arXiv:2503.18484v3 Announce Type: replace-cross Abstract: Evaluating the multilingual capabilities of Large Vision-Language Models (LVLMs) remains challenging because most benchmarks rely on non-paral

BioMed-Agent-RL: A Meta Learning, All You Need for Biomedical Applications

arXiv:2608.21864v1 Announce Type: cross Abstract: The current progress of Clinical Vision Large Language Models (C-VLLMs) has substantially improved digital diagnostics, still these frameworks often e

Decoupled Physical Modeling and Execution for Physics Reasoning

arXiv:2608.22126v1 Announce Type: cross Abstract: Physics reasoning requires constructing a consistent model of the underlying physical system rather than relying solely on symbolic or formula-based m

researcharxiv-cs-cl

Local Ai

DRAgent: Discriminative Reasoning Agent for Referring Expression Segmentation

arXiv:2608.22885v1 Announce Type: new Abstract: Referring Expression Segmentation (RES) aims to generate a pixel-level mask for the object specified by a language expression. Recent methods based on m

local-aiarxiv-cs-cv

Tutorials

EMPIRE: Explicit Manipulation Planning as a Learnable Intermediate Representation for Egocentric Hand-Motion Forecasting

arXiv:2608.22449v1 Announce Type: cross Abstract: Forecasting dexterous hand motions from egocentric observations is fundamental to intelligent interactive systems. Existing VLM-based methods typicall

tutorialsarxiv-cs-ai

Evaluation of Small Vision-Language Models on Qualitative Mechanical Problems

arXiv:2608.22143v1 Announce Type: new Abstract: Qualitative mechanical problem-solving (QMPS) refers to solving qualitative problems from the mechanical domain. Qualitative problems can be solved with

Gauss--Hermite Quadrature for Gaussian-Mixture Entropy with an Action-Space Hermite Surrogate

model-releasesarxiv-cs-lg

arXiv:2608.21467v1 Announce Type: cross Abstract: Gaussian distributions are used to model uncertainty in signals and states, and Gaussian mixtures are often used when the underlying distribution is m

Hierarchical Exponential-Gaussian Mixtures for Watch-Time Distribution Prediction

model-releasesarxiv-cs-lg

arXiv:2608.23356v1 Announce Type: cross Abstract: Accurate watch-time (WT) prediction is an important requirement for short-video recommendations. Yet WT distributions are near-zero-inflated, long-tai

Learning Sample-wise Rank-aware Interpolation Weights for Composed Visual Data Retrieval

arXiv:2608.22500v1 Announce Type: new Abstract: At the heart of composed visual data retrieval is the fusion of a reference visual input and a textual modification into a single query. While current s

LiST: Local-Simplex Test-Time LoRA Fusion

arXiv:2608.22370v1 Announce Type: new Abstract: Task-specific LoRA adapters offer a modular way to specialize large language and vision-language models. However, existing adapter composition methods a

Mitigating Speaker Leakage in Cascaded Multi-talker ASR with Diarization-based Transcript Correction

arXiv:2608.22196v1 Announce Type: cross Abstract: While cascaded multi-talker ASR (MT-ASR) leverages state-of-the-art foundation models, its performance is often capped by speaker leakage during separ

safetyarxiv-cs-cl

Object-Uni: A Unified Model for Object-Centric Spatial Understanding and Controllable Generation

arXiv:2608.22757v1 Announce Type: cross Abstract: Unified models for visual understanding and generation have made rapid progress, yet they still lack the ability to understand and manipulate the spat

ODG-NoMaD: Overhead-Camera Direction-Guided NoMaD

arXiv:2608.21395v1 Announce Type: cross Abstract: NoMaD [31] is a learned vision-navigation policy that unifies goal-conditioned navigation and exploration in a single goal-masked diffusion policy. In

Optimize Surgical Triplet Recognition: A Knowledge-Driven Mixture-of-Experts Solution

arXiv:2608.22972v1 Announce Type: new Abstract: Surgical action triplet recognition constitutes a critical task in context-aware robot-assisted surgery, facilitating automatic surgical action percepti

Pointing-VLA: Typed Spatial Grounding Interfaces for Vision-Language-Action Manipulation

arXiv:2608.23138v1 Announce Type: cross Abstract: Vision-language-action (VLA) models often expose spatial grounding through autoregressive text coordinates or opaque action tokens, creating brittle i

presto: Efficient, Training-free, and Open-world Object Placement via Imaginary Search

arXiv:2608.21543v1 Announce Type: cross Abstract: Object placement is critical in image composition, requiring spatially and semantically coherent positioning of objects within diverse scenes. Existin

Rethinking Communication Metrics: How Should We Measure Meaning?

arXiv:2608.21626v1 Announce Type: new Abstract: Semantic communication shifts the objective of communication systems from accurate symbol reconstruction toward meaning preservation, task accomplishmen

researcharxiv-cs-lg

Thinking Beyond Videos: Unifying Video Reasoning and Deep Research for Open-World Video Agents

arXiv:2608.23329v1 Announce Type: cross Abstract: Open-world video understanding often requires a model to locate sparse visual evidence and acquire external knowledge that is absent from the video an

Towards Actionable Surgical Team Dynamics: from Teamwork to Counterfactual Annotations

arXiv:2608.23344v1 Announce Type: new Abstract: Modeling team interactions in high-stakes environments such as operating rooms is critical for understanding how coordination, communication, and indivi

safetyarxiv-cs-lg

Towards Comprehensive Basketball Understanding

arXiv:2608.23435v1 Announce Type: cross Abstract: Understanding a basketball game requires recognizing events, localizing actions, identifying players, and relating these to structured game knowledge.

Towards Safer Social Media Platforms: Scalable and Performant Few-Shot Harmful Content Moderation Using Large Language Models

arXiv:2501.13976v2 Announce Type: replace-cross Abstract: The prevalence of harmful content on social media platforms poses significant risks to users and society, necessitating more effective and sca

Training-Free VLM Personalization via Calibrated Residual Decoding

arXiv:2608.22263v1 Announce Type: cross Abstract: Vision-language models can be personalized in a training-free manner by directly providing user profiles, preferences, or visual references at inferen

VERDICT: Agreement Beats Pixel-Space Verification in Real-Document OCSR

arXiv:2608.22183v1 Announce Type: new Abstract: Optical Chemical Structure Recognition (OCSR) converts 2D molecular depictions in the published literature into SMILES, and is increasingly important fo

ViTexSZ: Heterogeneous Vision-Text Knowledge Distillation for EEG Seizure Detection

arXiv:2608.21445v1 Announce Type: new Abstract: Automated seizure detection from electroencephalography (EEG) is essential for continuous neurological monitoring, particularly for subclinical epilepti

A Collaborative Multi-Modality Interaction for VLA-based End-to-End Autonomous Driving

arXiv:2608.20890v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models have emerged as a powerful paradigm for end-to-end autonomous driving by jointly integrating perception, reasoning,

A VLM Answer Is Not an Anomaly Score: Rank Compression in Training-Free Video Anomaly Detection

arXiv:2608.21244v1 Announce Type: new Abstract: Vision-language models enable training-free video anomaly detection by answering questions about video segments. VAD benchmarks, however, require a scal

AEGIS: Preventing Cross-Domain Resource Abuse in MCP

arXiv:2608.20481v1 Announce Type: cross Abstract: The Model Context Protocol (MCP) is an open source JSON-RPC protocol that standardizes how large language models (LLMs) interact with external systems

AGIDefect-4K: A Richly Annotated Dataset for AI-Generated Image Defect Detection, Localization and Explanation

arXiv:2608.20713v1 Announce Type: new Abstract: Generative AI can now produce highly realistic images, yet current models still exhibit subtle but critical defects that undermine their reliability. Wh

Bankruptcy Prediction via Hybrid Resampling and Stacking Ensemble Techniques with Explainable Artificial Intelligence (XAI)-Driven Analysis

arXiv:2608.20343v1 Announce Type: new Abstract: This study develops and evaluates a bankruptcy prediction framework that integrates consensus-based feature selection, hybrid resampling, stacking ensem

researcharxiv-cs-lg

BC-Bench: Evaluating Agentic Engineering in a Domain-Specific Language for ERP

arXiv:2608.20851v1 Announce Type: cross Abstract: Agentic engineering systems have shown strong performance on general-purpose benchmarks, yet their effectiveness in enterprise resource planning (ERP)

Belief Without Behavior: Measuring the Translation of Theory of Mind into Coordinated Social Action in Vision-Language Models

arXiv:2608.20975v1 Announce Type: new Abstract: Effective social interaction requires agents to translate mental state inferences into coordinated behavioral signals across verbal and nonverbal channe

Breaking High Confidence: Practical Face Impersonation under High-Security Thresholds

arXiv:2608.20884v1 Announce Type: new Abstract: Face recognition systems (FRSs) are increasingly deployed in critical real-world services for authentication, such as banking applications and airport i

Bridging Language and Spherical Space: Object-Centric Control for Text-to-Panorama Generation

arXiv:2608.20691v1 Announce Type: new Abstract: Panoramic image generation is increasingly important for immersive applications such as virtual reality, augmented reality, and 3D content creation. Unl

CogCanvas: A Benchmark for Evaluating Multi-Subject Reference-Based Image Generation

arXiv:2606.15867v2 Announce Type: replace Abstract: Multi-subject reference-based image generation requires jointly preserving multiple human identities, binding per-person objects and fashion items,

CoST: Semantic-Aware Urban Understanding via Spatial-Temporal Alignment

arXiv:2608.21041v1 Announce Type: cross Abstract: Geospatial representation learning from satellite imagery is a fundamental problem for large-scale urban analysis and real-world applications. Despite

Dorsal Hand Images for Immersive (XR) and Privacy-preserving Age Assurance and Child Safety

arXiv:2608.21009v1 Announce Type: new Abstract: Ensuring that Extended Reality (XR) environments are age-appropriate is an important regulatory and safety challenge. However, current age assurance ope

Fine-tuning LLMs for Tourist Trajectory Prediction using Field Experiment Data

model-releasesarxiv-cs-lg

arXiv:2608.20830v1 Announce Type: cross Abstract: Evaluating mobility interventions at tourist destinations requires predicting visitor behavior under varying conditions. Traditional methods struggle

From Thermal Preference Prediction to Adaptive Thermal Intervention: A Reinforcement Learning Approach Using Physiological and Environmental Sensing

arXiv:2608.20423v1 Announce Type: cross Abstract: Personalised thermal comfort is essential for occupant wellbeing and for the development of more responsive building-control strategies, yet conventio

Applications

Humanoid Musical Robots as Experimental Interfaces for Music-Evoked Emotion

arXiv:2608.20433v1 Announce Type: new Abstract: Advances in technology have led to increasingly sophisticated musical humanoid robots. However, their use has largely been limited to performance and re

applicationsarxiv-cs-ro

Applications

Machine Learning and ARIMA Model Averaging for Adaptive Public Health Forecasting: Comparative Evaluation and an Ontario COVID-19 Case Study

arXiv:2608.20406v1 Announce Type: new Abstract: Public health forecasts must respond to abrupt changes in surveillance data without over-extrapolating noise, reporting artifacts, or temporary trends.

applicationsarxiv-cs-lg