Search: “multimodal”

Measuring Social Bias in Vision-Language Models with Face-Only Counterfactuals from Real Photos

arXiv:2601.06931v2 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) are increasingly deployed in socially consequential settings, raising concerns about social bias driven by demog

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Medical thinking with multiple images

DGX agent

arXiv:2604.16506v1 Announce Type: cross Abstract: Large language models perform well on many medical QA benchmarks, but real clinical reasoning often requires integrating evidence across multiple imag

model-releasesarxiv-cs-cl

21 Apr 2026

Missing Pattern Tree based Decision Grouping and Ensemble for Enhancing Pair Utilization in Deep Incomplete Multi-View Clustering

model-releasesarxiv-cs-cv

arXiv:2512.21510v2 Announce Type: replace-cross Abstract: Real-world multi-view data often exhibit highly inconsistent missing patterns, posing significant challenges for incomplete multi-view cluster

mlr3torch: A Deep Learning Framework in R based on mlr3 and torch

arXiv:2604.18152v1 Announce Type: cross Abstract: Deep learning (DL) has become a cornerstone of modern machine learning (ML) praxis. We introduce the R package mlr3torch, which is an extensible DL fr

tutorialsarxiv-cs-lg

Agents

MODEST: Multi-Optics Depth-of-Field Stereo Dataset

arXiv:2511.20853v3 Announce Type: replace Abstract: Reliable depth estimation under real optical conditions remains a core challenge for camera vision in systems such as autonomous robotics and augmen

agentsarxiv-cs-cv

Noise Injection: Improving Out-of-Distribution Generalization for Limited Size Datasets

arXiv:2511.03855v2 Announce Type: replace Abstract: Deep learned (DL) models for image recognition have been shown to fail to generalize to data from different devices, populations, etc. COVID-19 dete

OC-Distill: Ontology-aware Contrastive Learning with Cross-Modal Distillation for ICU Risk Prediction

arXiv:2604.16878v1 Announce Type: new Abstract: Early prediction of severe clinical deterioration and remaining length of stay can enable timely intervention and better resource allocation in high-acu

tutorialsarxiv-cs-lg

OmniVLA-RL: A Vision-Language-Action Model with Spatial Understanding and Online RL

arXiv:2604.17706v1 Announce Type: new Abstract: Visual-Language-Action (VLA) models represent a paradigm shift in embodied AI, yet existing frameworks often struggle with imprecise spatial perception,

safetyarxiv-cs-ro

On the Importance of Tactile Sensing for Imitation Learning: A Case Study on Robotic Match Lighting

arXiv:2504.13618v4 Announce Type: replace Abstract: The field of robotic manipulation has advanced significantly in recent years. At the sensing level, several novel tactile sensors have been develope

safetyarxiv-cs-ro

Optimally Bridging Semantics and Data: Generative Semantic Communication via Schrodinger Bridge

arXiv:2604.17802v1 Announce Type: cross Abstract: Generative Semantic Communication (GSC) is a promising solution for image transmission over narrow-band and high-noise channels. However, existing GSC

OVOD-Agent: A Markov-Bandit Framework for Proactive Visual Reasoning and Self-Evolving Detection

arXiv:2511.21064v2 Announce Type: replace-cross Abstract: Open-Vocabulary Object Detection (OVOD) aims to enable detectors to generalize across categories by leveraging semantic information. Although

Parkinson's Disease Detection via Self-Supervised Dual-Channel Cross-Attention on Bilateral Wrist-Worn IMU Signals

arXiv:2604.18372v1 Announce Type: new Abstract: Parkinson's disease (PD) is a chronic neurodegenerative disease. It shows multiple motor symptoms such as tremor, bradykinesia, postural instability, fr

researcharxiv-cs-lg

PersonalHomeBench: Evaluating Agents in Personalized Smart Homes

arXiv:2604.16813v1 Announce Type: cross Abstract: Agentic AI systems are rapidly advancing toward real-world applications, yet their readiness in complex and personalized environments remains insuffic

PowerCLIP: Powerset Alignment for Contrastive Pre-Training

arXiv:2511.23170v5 Announce Type: replace Abstract: Contrastive vision-language pre-training frameworks such as CLIP have demonstrated impressive zero-shot performance across a range of vision-languag

Predictive Modeling of Natural Medicinal Compounds for Alzheimer Disease Using Cheminformatics

arXiv:2604.18316v1 Announce Type: cross Abstract: The most common cause of dementia is Alzheimer disease, a progressive neurodegenerative disorder affecting older adults that gradually impairs memory,

researcharxiv-cs-lg

Local Ai

Q-DeepSight: Incentivizing Thinking with Images for Image Quality Assessment and Refinement

arXiv:2604.16858v1 Announce Type: new Abstract: Image Quality Assessment (IQA) models are increasingly deployed as perceptual critics to guide generative models and image restoration. This role demand

local-aiarxiv-cs-cv

Rethinking Cross-Modal Fine-Tuning: Optimizing the Interaction Between Feature Alignment and Target Fitting

model-releasesarxiv-cs-lg

arXiv:2601.18231v4 Announce Type: replace Abstract: Adapting pre-trained models to unseen feature modalities has become increasingly important due to the growing need for cross-disciplinary knowledge

S-GRPO: Unified Post-Training for Large Vision-Language Models

arXiv:2604.16557v1 Announce Type: cross Abstract: Current post-training methodologies for adapting Large Vision-Language Models (LVLMs) generally fall into two paradigms: Supervised Fine-Tuning (SFT)

safetyarxiv-cs-cl

Scalable Neighborhood-Based Multi-Agent Actor-Critic

arXiv:2604.18190v1 Announce Type: new Abstract: We propose MADDPG-K, a scalable extension to Multi-Agent Deep Deterministic Policy Gradient (MADDPG) that addresses the computational limitations of cen

safetyarxiv-cs-lg

ScenarioControl: Vision-Language Controllable Vectorized Latent Scenario Generation

arXiv:2604.17147v1 Announce Type: new Abstract: We introduce ScenarioControl, the first vision-language control mechanism for learned driving scenario generation. Given a text prompt or an input image

Sculpting the Vector Space: Towards Efficient Multi-Vector Visual Document Retrieval via Prune-then-Merge Framework

arXiv:2602.19549v2 Announce Type: replace Abstract: Visual Document Retrieval (VDR), which aims to retrieve relevant pages within vast corpora of visually-rich documents, is of significance in current

researcharxiv-cs-cl

Agents

Self-Reasoning Agentic Framework for Narrative Product Grid-Collage Generation

arXiv:2604.16958v1 Announce Type: new Abstract: Narrative-driven product photography has become a prevalent paradigm in modern marketing, as coherent visual storytelling helps convey product value and

agentsarxiv-cs-cv

SentiAvatar: Towards Expressive and Interactive Digital Humans

arXiv:2604.02908v2 Announce Type: replace Abstract: We present SentiAvatar, a framework for building expressive interactive 3D digital humans, and use it to create SuSu, a virtual character that speak

Source-Free Domain Adaptation with Vision-Language Prior

arXiv:2604.17748v1 Announce Type: new Abstract: Source-Free Domain Adaptation (SFDA) seeks to adapt a source model, which is pre-trained on a supervised source domain, for a target domain, with only a

Local Ai

SpatialStack: Layered Geometry-Language Fusion for 3D VLM Spatial Reasoning

arXiv:2603.27437v2 Announce Type: replace Abstract: Large vision-language models (VLMs) still struggle with reliable 3D spatial reasoning, a core capability for embodied and physical AI systems. This

local-aiarxiv-cs-cv

Spec-o3: A Tool-Augmented Vision-Language Agent for Rare Celestial Object Candidate Vetting via Automated Spectral Inspection

arXiv:2601.06498v2 Announce Type: replace Abstract: Due to the limited generalization and interpretability of deep learning classifiers, The final vetting of rare celestial object candidates still rel

SpeechMedAssist: Efficiently and Effectively Adapting Speech Language Models for Medical Consultation

arXiv:2601.04638v2 Announce Type: replace Abstract: Medical consultations are intrinsically speech-centric. However, most prior works focus on long-text-based interactions, which are cumbersome and pa

Test-Time Perturbation Learning with Delayed Feedback for Vision-Language-Action Models

arXiv:2604.18107v1 Announce Type: new Abstract: Vision-Language-Action models (VLAs) achieve remarkable performance in sequential decision-making but remain fragile to subtle environmental shifts, suc

Towards Trustworthy Depression Estimation via Disentangled Evidential Learning

arXiv:2604.16579v1 Announce Type: new Abstract: Automated depression estimation is highly vulnerable to signal corruption and ambient noise in real-world deployment. Prevailing deterministic methods p

safetyarxiv-cs-lg

UGD: An Unsupervised Geometric Distance for Evaluating Real-world Noisy Point Cloud Denoising

arXiv:2604.16976v1 Announce Type: new Abstract: Point cloud denoising is a fundamental and crucial challenge in real-world point cloud applications. Existing quantitative evaluation metrics for point

Agents

Unified Ultrasound Intelligence Toward an End-to-End Agentic System

arXiv:2604.16914v1 Announce Type: new Abstract: Clinical ultrasound analysis demands models that generalize across heterogeneous organs, views, and devices, while supporting interpretable workflow-lev

agentsarxiv-cs-cv

When Background Matters: Breaking Medical Vision Language Models by Transferable Attack

arXiv:2604.17318v1 Announce Type: new Abstract: Vision-Language Models (VLMs) are increasingly used in clinical diagnostics, yet their robustness to adversarial attacks remains largely unexplored, pos

When More Words Say Less: Decoupling Length and Specificity in Image Description Evaluation

arXiv:2601.04609v2 Announce Type: replace Abstract: Vision-language models (VLMs) are increasingly used to make visual content accessible via text-based descriptions. In current systems, however, desc

researcharxiv-cs-cl

When Seeing Overrides Knowing: Disentangling Knowledge Conflicts in Vision-Language Models

arXiv:2507.13868v2 Announce Type: replace Abstract: Vision-language models (VLMs) increasingly combine visual and textual information to perform complex tasks. However, conflicts between their interna

Applications

A Q-learning-based QoS-aware multipath routing protocol in IoMT-based wireless body area network

arXiv:2604.15489v1 Announce Type: cross Abstract: The Internet of Medical Things (IoMT) enables intelligent healthcare services but faces challenges such as dynamic topology, energy constraints, and d

applicationsarxiv-cs-ai

Acoustic and Facial Markers of Perceived Conversational Success in Spontaneous Speech

arXiv:2604.15322v1 Announce Type: cross Abstract: Individuals often align their speaking patterns with their interlocutors, a phenomenon linked to engagement and rapport. While well documented in task

researcharxiv-cs-cl

Adaptive Spatio-temporal Estimation on the Graph Edges via Line Graph Transformation

arXiv:2311.00656v4 Announce Type: replace-cross Abstract: Spatial-temporal estimation of signals on graph edges is challenging because most conventional Graph Signal Processing techniques are defined

researcharxiv-cs-lg

Analyzing Chain of Thought (CoT) Approaches in Control Flow Code Deobfuscation Tasks

arXiv:2604.15390v1 Announce Type: cross Abstract: Code deobfuscation is the task of recovering a readable version of a program while preserving its original behavior. In practice, this often requires

tutorialsarxiv-cs-ai

AutoDrive-R^2: Incentivizing Reasoning and Self-Reflection Capacity for VLA Model in Autonomous Driving

arXiv:2509.01944v3 Announce Type: replace-cross Abstract: Vision-Language-Action (VLA) models in autonomous driving systems have recently demonstrated transformative potential by integrating multimoda

Cognitive Agency Surrender: Defending Epistemic Sovereignty via Scaffolded AI Friction

arXiv:2603.21735v2 Announce Type: replace-cross Abstract: The proliferation of Generative Artificial Intelligence has transformed benign cognitive offloading into a systemic risk of cognitive agency s

safetyarxiv-cs-ai

DASB -- Discrete Audio and Speech Benchmark

model-releasesarxiv-cs-ai

arXiv:2406.14294v3 Announce Type: replace-cross Abstract: Discrete audio tokens have recently gained considerable attention for their potential to bridge audio and language processing, enabling multim

Dispatch-Aware Ragged Attention for Pruned Vision Transformers

arXiv:2604.15408v1 Announce Type: cross Abstract: Token pruning methods for Vision Transformers (ViTs) promise quadratic reductions in attention FLOPs by dropping uninformative patches. Yet when prune

researcharxiv-cs-ai

Do Vision-Language Models Truly Perform Vision Reasoning? A Rigorous Study of the Modality Gap

arXiv:2604.16256v1 Announce Type: cross Abstract: Reasoning in vision-language models (VLMs) has recently attracted significant attention due to its broad applicability across diverse downstream tasks

Local Ai

Dual-Modal Lung Cancer AI: Interpretable Radiology and Microscopy with Clinical Risk Integration

arXiv:2604.16104v1 Announce Type: cross Abstract: Lung cancer remains one of the leading causes of cancer-related mortality worldwide. Conventional computed tomography (CT) imaging, while essential fo

local-aiarxiv-cs-ai

Facial-Expression-Aware Prompting for Empathetic LLM Tutoring

model-releasesarxiv-cs-ai

arXiv:2604.15336v1 Announce Type: cross Abstract: Large language models (LLMs) enable increasingly capable tutoring-style conversational agents, yet effective tutoring requires sensitivity to learners

FETAL-GAUGE: A Benchmark for Assessing Vision-Language Models in Fetal Ultrasound

model-releasesarxiv-cs-cv

arXiv:2512.22278v2 Announce Type: replace Abstract: The growing demand for prenatal ultrasound imaging has intensified a global shortage of trained sonographers, creating barriers to essential fetal h

GaussianFlow SLAM: Monocular Gaussian Splatting SLAM Guided by GaussianFlow

arXiv:2604.15612v1 Announce Type: cross Abstract: Gaussian splatting has recently gained traction as a compelling map representation for SLAM systems, enabling dense and photo-realistic scene modeling

GTA-2: Benchmarking General Tool Agents from Atomic Tool-Use to Open-Ended Workflows

model-releasesarxiv-cs-ai

arXiv:2604.15715v1 Announce Type: cross Abstract: The development of general-purpose agents requires a shift from executing simple instructions to completing complex, real-world productivity workflows