Search: “multimodal”

UGD: An Unsupervised Geometric Distance for Evaluating Real-world Noisy Point Cloud Denoising

arXiv:2604.16976v1 Announce Type: new Abstract: Point cloud denoising is a fundamental and crucial challenge in real-world point cloud applications. Existing quantitative evaluation metrics for point

tutorialsarxiv-cs-cv

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Agents

Unified Ultrasound Intelligence Toward an End-to-End Agentic System

DGX agent

arXiv:2604.16914v1 Announce Type: new Abstract: Clinical ultrasound analysis demands models that generalize across heterogeneous organs, views, and devices, while supporting interpretable workflow-lev

agentsarxiv-cs-cv

21 Apr 2026

When Background Matters: Breaking Medical Vision Language Models by Transferable Attack

arXiv:2604.17318v1 Announce Type: new Abstract: Vision-Language Models (VLMs) are increasingly used in clinical diagnostics, yet their robustness to adversarial attacks remains largely unexplored, pos

When More Words Say Less: Decoupling Length and Specificity in Image Description Evaluation

arXiv:2601.04609v2 Announce Type: replace Abstract: Vision-language models (VLMs) are increasingly used to make visual content accessible via text-based descriptions. In current systems, however, desc

researcharxiv-cs-cl

When Seeing Overrides Knowing: Disentangling Knowledge Conflicts in Vision-Language Models

arXiv:2507.13868v2 Announce Type: replace Abstract: Vision-language models (VLMs) increasingly combine visual and textual information to perform complex tasks. However, conflicts between their interna

Applications

A Q-learning-based QoS-aware multipath routing protocol in IoMT-based wireless body area network

arXiv:2604.15489v1 Announce Type: cross Abstract: The Internet of Medical Things (IoMT) enables intelligent healthcare services but faces challenges such as dynamic topology, energy constraints, and d

applicationsarxiv-cs-ai

Acoustic and Facial Markers of Perceived Conversational Success in Spontaneous Speech

arXiv:2604.15322v1 Announce Type: cross Abstract: Individuals often align their speaking patterns with their interlocutors, a phenomenon linked to engagement and rapport. While well documented in task

researcharxiv-cs-cl

Adaptive Spatio-temporal Estimation on the Graph Edges via Line Graph Transformation

arXiv:2311.00656v4 Announce Type: replace-cross Abstract: Spatial-temporal estimation of signals on graph edges is challenging because most conventional Graph Signal Processing techniques are defined

researcharxiv-cs-lg

Analyzing Chain of Thought (CoT) Approaches in Control Flow Code Deobfuscation Tasks

arXiv:2604.15390v1 Announce Type: cross Abstract: Code deobfuscation is the task of recovering a readable version of a program while preserving its original behavior. In practice, this often requires

tutorialsarxiv-cs-ai

AutoDrive-R^2: Incentivizing Reasoning and Self-Reflection Capacity for VLA Model in Autonomous Driving

arXiv:2509.01944v3 Announce Type: replace-cross Abstract: Vision-Language-Action (VLA) models in autonomous driving systems have recently demonstrated transformative potential by integrating multimoda

safetyarxiv-cs-cv

Cognitive Agency Surrender: Defending Epistemic Sovereignty via Scaffolded AI Friction

arXiv:2603.21735v2 Announce Type: replace-cross Abstract: The proliferation of Generative Artificial Intelligence has transformed benign cognitive offloading into a systemic risk of cognitive agency s

safetyarxiv-cs-ai

DASB -- Discrete Audio and Speech Benchmark

arXiv:2406.14294v3 Announce Type: replace-cross Abstract: Discrete audio tokens have recently gained considerable attention for their potential to bridge audio and language processing, enabling multim

Dispatch-Aware Ragged Attention for Pruned Vision Transformers

arXiv:2604.15408v1 Announce Type: cross Abstract: Token pruning methods for Vision Transformers (ViTs) promise quadratic reductions in attention FLOPs by dropping uninformative patches. Yet when prune

researcharxiv-cs-ai

Do Vision-Language Models Truly Perform Vision Reasoning? A Rigorous Study of the Modality Gap

model-releasesarxiv-cs-cl

arXiv:2604.16256v1 Announce Type: cross Abstract: Reasoning in vision-language models (VLMs) has recently attracted significant attention due to its broad applicability across diverse downstream tasks

Local Ai

Dual-Modal Lung Cancer AI: Interpretable Radiology and Microscopy with Clinical Risk Integration

arXiv:2604.16104v1 Announce Type: cross Abstract: Lung cancer remains one of the leading causes of cancer-related mortality worldwide. Conventional computed tomography (CT) imaging, while essential fo

local-aiarxiv-cs-ai

Facial-Expression-Aware Prompting for Empathetic LLM Tutoring

arXiv:2604.15336v1 Announce Type: cross Abstract: Large language models (LLMs) enable increasingly capable tutoring-style conversational agents, yet effective tutoring requires sensitivity to learners

FETAL-GAUGE: A Benchmark for Assessing Vision-Language Models in Fetal Ultrasound

arXiv:2512.22278v2 Announce Type: replace Abstract: The growing demand for prenatal ultrasound imaging has intensified a global shortage of trained sonographers, creating barriers to essential fetal h

GaussianFlow SLAM: Monocular Gaussian Splatting SLAM Guided by GaussianFlow

arXiv:2604.15612v1 Announce Type: cross Abstract: Gaussian splatting has recently gained traction as a compelling map representation for SLAM systems, enabling dense and photo-realistic scene modeling

tutorialsarxiv-cs-cv

GTA-2: Benchmarking General Tool Agents from Atomic Tool-Use to Open-Ended Workflows

arXiv:2604.15715v1 Announce Type: cross Abstract: The development of general-purpose agents requires a shift from executing simple instructions to completing complex, real-world productivity workflows

Intelligent Healthcare Imaging Platform: A VLM-Based Framework for Automated Medical Image Analysis and Clinical Report Generation

arXiv:2509.13590v3 Announce Type: replace-cross Abstract: The rapid advancement of artificial intelligence (AI) in healthcare imaging has revolutionized diagnostic medicine and clinical decision-makin

Is this chart lying to me? Automating the detection of misleading visualizations

model-releasesarxiv-cs-cl

arXiv:2508.21675v3 Announce Type: replace Abstract: Misleading visualizations are a potent driver of misinformation on social media and the web. By violating chart design principles, they distort data

Machine learning approaches to uncover the neural mechanisms of motivated behaviour: from ADHD to individual differences in effort and reward sensitivity

arXiv:2604.15363v1 Announce Type: cross Abstract: Motivated behaviour relies on the brain's capacity to evaluate effort and reward. Dysregulation within these processes contributes to a spectrum of co

researcharxiv-cs-lg

MMAudioSep: Taming Video-to-Audio Generative Model Towards Video/Text-Queried Sound Separation

arXiv:2510.09065v2 Announce Type: replace-cross Abstract: We introduce MMAudioSep, a generative model for video/text-queried sound separation that is founded on a pretrained video-to-audio model. By l

One-Shot Cross-Geometry Skill Transfer through Part Decomposition

arXiv:2604.15455v1 Announce Type: new Abstract: Given a demonstration, a robot should be able to generalize a skill to any object it encounters-but existing approaches to skill transfer often fail to

safetyarxiv-cs-ro

OSCBench: Benchmarking Object State Change in Text-to-Video Generation

arXiv:2603.11698v2 Announce Type: replace-cross Abstract: Text-to-video (T2V) generation models have made rapid progress in producing visually high-quality and temporally coherent videos. However, exi

Agents

{pi}_{0.7}: a Steerable Generalist Robotic Foundation Model with Emergent Capabilities

arXiv:2604.15483v1 Announce Type: new Abstract: We present a new robotic foundation model, called {pi}_{0.7}, that can enable strong out-of-the-box performance in a wide range of scenarios. {pi}_{0.7}

agentsarxiv-cs-lg

PILOT: A Promptable Interleaved Layout-aware OCR Transformer

arXiv:2504.03621v2 Announce Type: replace Abstract: Classical OCR pipelines decompose document reading into detection, segmentation, and recognition stages, which makes them sensitive to localization

Reasoning over Video: Evaluating How MLLMs Extract, Integrate, and Reconstruct Spatiotemporal Evidence

arXiv:2603.13091v2 Announce Type: replace Abstract: The growing interest in embodied agents increases the demand for spatiotemporal video understanding, yet existing benchmarks largely emphasize extra

Seed1.8 Model Card: Towards Generalized Real-World Agency

arXiv:2603.20633v3 Announce Type: replace Abstract: We present Seed1.8, a foundation model aimed at generalized real-world agency: going beyond single-turn prediction to multi-turn interaction, tool u

Agents

SENSE: Stereo OpEN Vocabulary SEmantic Segmentation

arXiv:2604.15946v1 Announce Type: new Abstract: Open-vocabulary semantic segmentation enables models to segment objects or image regions beyond fixed class sets, offering flexibility in dynamic enviro

agentsarxiv-cs-cv

Stein Variational Black-Box Combinatorial Optimization

arXiv:2604.15837v1 Announce Type: new Abstract: Combinatorial black-box optimization in high-dimensional settings demands a careful trade-off between exploiting promising regions of the search space a

UA-Net: Uncertainty-Aware Network for TRISO Image Semantic Segmentation

arXiv:2604.15542v1 Announce Type: new Abstract: Tristructural isotropic (TRISO)-coated particle fuels undergo dimensional changes and chemical reactions during high-temperature neutron irradiation. Po

UniEditBench: A Unified and Cost-Effective Benchmark for Image and Video Editing via Distilled MLLMs

arXiv:2604.15871v1 Announce Type: cross Abstract: The evaluation of visual editing models remains fragmented across methods and modalities. Existing benchmarks are often tailored to specific paradigms

Zero-Shot Scalable Resilience in UAV Swarms: A Decentralized Imitation Learning Framework with Physics-Informed Graph Interactions

arXiv:2604.15762v1 Announce Type: new Abstract: Large-scale Unmanned Aerial Vehicle (UAV) failures can split an unmanned aerial vehicle swarm network into disconnected sub-networks, making decentraliz

safetyarxiv-cs-lg

Local Ai

AIPC: Agent-Based Automation for AI Model Deployment with Qualcomm AI Runtime

arXiv:2604.14661v1 Announce Type: cross Abstract: Edge AI model deployment is a multi-stage engineering process involving model conversion, operator compatibility handling, quantization calibration, r

local-aiarxiv-cs-lg

All Changes May Have Invariant Principles: Improving Ever-Shifting Harmful Meme Detection via Design Concept Reproduction

arXiv:2601.04567v2 Announce Type: replace Abstract: Harmful memes are ever-shifting in the Internet communities, which are difficult to analyze due to their type-shifting and temporal-evolving nature.

tutorialsarxiv-cs-cv

Building Trust in the Skies: A Knowledge-Grounded LLM-based Framework for Aviation Safety

arXiv:2604.13101v1 Announce Type: cross Abstract: The integration of Large Language Models (LLMs) into aviation safety decision-making represents a significant technological advancement, yet their sta

safetyarxiv-cs-ai

Constrained Decoding for Safe Robot Navigation Foundation Models

model-releasesarxiv-cs-lg

arXiv:2509.01728v4 Announce Type: replace-cross Abstract: Recent advances in the development of robotic foundation models have led to promising end-to-end and general-purpose capabilities in robotic s

Counting Without Numbers and Finding Without Words

arXiv:2603.24470v2 Announce Type: replace-cross Abstract: Every year, 10 million pets enter shelters, separated from their families. Despite desperate searches by both guardians and lost animals, 70%

researcharxiv-cs-cl

DockAnywhere: Data-Efficient Visuomotor Policy Learning for Mobile Manipulation via Novel Demonstration Generation

arXiv:2604.15023v1 Announce Type: new Abstract: Mobile manipulation is a fundamental capability that enables robots to interact in expansive environments such as homes and factories. Most existing app

safetyarxiv-cs-ro

EviSearch: A Human in the Loop System for Extracting and Auditing Clinical Evidence for Systematic Reviews

model-releasesarxiv-cs-cl

arXiv:2604.14165v1 Announce Type: new Abstract: We present EviSearch, a multi-agent extraction system that automates the creation of ontology-aligned clinical evidence tables directly from native tria

Federated Breast Cancer Detection Enhanced by Synthetic Ultrasound Image Augmentation

arXiv:2506.23334v3 Announce Type: replace-cross Abstract: Federated learning enables collaborative training of deep learning models across institutions without sharing sensitive patient data. However,

FoodSense: A Multisensory Food Dataset and Benchmark for Predicting Taste, Smell, Texture, and Sound from Images

arXiv:2604.14388v1 Announce Type: new Abstract: Humans routinely infer taste, smell, texture, and even sound from food images a phenomenon well studied in cognitive science. However, prior vision lang

G-MIXER: Geodesic Mixup-based Implicit Semantic Expansion and Explicit Semantic Re-ranking for Zero-Shot Composed Image Retrieval

arXiv:2604.14710v1 Announce Type: new Abstract: Composed Image Retrieval (CIR) aims to retrieve target images by integrating a reference image with a corresponding modification text. CIR requires join

GeoAgentBench: A Dynamic Execution Benchmark for Tool-Augmented Agents in Spatial Analysis

arXiv:2604.13888v1 Announce Type: new Abstract: The integration of Large Language Models (LLMs) into Geographic Information Systems (GIS) marks a paradigm shift toward autonomous spatial analysis. How

Local Ai

Large Vision Model-Guided Masked Low-Rank Approximation for Ground-Roll Attenuation

arXiv:2604.00998v2 Announce Type: replace Abstract: Ground roll is a common type of coherent noise in seismic records, and its attenuation remains challenging due to its substantial overlap with usefu

local-aiarxiv-cs-cv

PolyBench: Benchmarking LLM Forecasting and Trading Capabilities on Live Prediction Market Data

model-releasesarxiv-cs-lg

arXiv:2604.14199v1 Announce Type: cross Abstract: Predicting real-world events from live market signals demands systems that fuse qualitative news with quantitative order-book dynamics under strict te

PortraitCraft: A Benchmark for Portrait Composition Understanding and Generation

arXiv:2604.03611v2 Announce Type: replace Abstract: Portrait composition plays a central role in portrait aesthetics and visual communication, yet existing datasets and benchmarks mainly focus on coar