Search: “multimodal”

STOCKTAKE: Measuring the Gap Between Perception and Action in LLM Agents with a Fair Oracle

model-releasesarxiv-cs-ai

arXiv:2607.13618v1 Announce Type: new Abstract: LLM agents are increasingly evaluated on multi-week decision tasks in which the state that drives cost is never directly observed. On such tasks the fin

16 Jul 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Tutorials

The Hyperspherical Geometry of CLIP Latent Space: A Semantic Mixture Model

DGX agent

arXiv:2607.13660v1 Announce Type: new Abstract: Contrastive Language-Image Pretraining (CLIP) representations form a semantic embedding space governed by cosine similarity, reflecting an intrinsic hyp

tutorialsarxiv-cs-lg

16 Jul 2026

TRACE-PCa: Predicting Prostate Cancer Progression from Longitudinal MRI During Active Surveillance

arXiv:2607.13506v1 Announce Type: new Abstract: Active surveillance (AS) is the preferred strategy for favorable-risk prostate cancer, yet current protocols rely on scheduled repeat biopsies, most of

16 Jul 2026

A Biomimetic Myoelectric Tentacle Prosthesis with Sensorless Object Detection and Vibrotactile Feedback

arXiv:2607.09807v2 Announce Type: replace Abstract: This paper presents the design and evaluation of a myoelectric tentacle-shaped prosthesis integrating electromyographic (EMG) control, sensorless ob

researcharxiv-cs-ro

ACID: Adaptive Caching for vIDeo generation

arXiv:2607.12358v1 Announce Type: new Abstract: Video diffusion models produce high-quality generations but remain slow at inference due to their sequential denoising procedure. Caching-based accelera

Adaptive Cross-Modal Fusion with Sparse Attention for Pedestrian Crossing Intention Prediction

arXiv:2607.12293v1 Announce Type: new Abstract: Predicting pedestrian crossing intention is a safety-critical task for autonomous driving, yet existing approaches often rely on single-modal inputs or

Agentic systems for breast cancer treatment recommendations

model-releasesarxiv-cs-cl

arXiv:2607.12051v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly being explored for clinical decision support, but their reliability in complex oncology treatment planning

An Empirical Analysis of Continual Learning for Heterogeneous Medical Visual Question Answering

arXiv:2607.12048v1 Announce Type: cross Abstract: Deploying medical visual question answering (MedVQA) systems in real-world clinical settings requires models that adapt to new clinical tasks without

applicationsarxiv-cs-ai

Analysis of Mutual and Referential Human and Robot Gazes in a Collaborative Word Association Game

arXiv:2607.12181v1 Announce Type: new Abstract: Robot gaze is a major component of human-robot dialogue coordination. Most studies of gaze in human-robot dialogue focus on face-to-face social conversa

researcharxiv-cs-ro

CRC-HGD: A Histopathological Image Dataset for Grading Colorectal Cancer

arXiv:2607.12750v1 Announce Type: new Abstract: Colorectal cancer (CRC) is the third most common cancer worldwide and the second leading cause of cancer-related deaths globally, with approximately 1,9

DA-Nav: Direction-Aware City-Scale Vision-Language Navigation

arXiv:2607.11638v2 Announce Type: replace Abstract: City-scale outdoor navigation is currently hindered by the heavy reliance on dense maps or costly navigation supervision. In this work, we introduce

applicationsarxiv-cs-ro

Efficient Conformal Prediction for Regression Models under Label Noise

arXiv:2509.15120v2 Announce Type: replace Abstract: In high-stakes scenarios, such as medical imaging applications, it is critical to equip the predictions of a regression model with reliable confiden

researcharxiv-cs-lg

Exploring Zero-Shot Foundation Models for Multivariate Time Series Anomaly Detection

arXiv:2607.12454v1 Announce Type: new Abstract: Multivariate Time Series Anomaly Detection (MTSAD) is essential for reliability and safety in domains such as industrial process monitoring and financia

ExtraGS: Enhancing Endoscopic View Extrapolation via Diffusion-Guided 3D Gaussian Splatting

arXiv:2607.12785v1 Announce Type: new Abstract: Robot-assisted minimally invasive surgery (MIS) critically depends on reliable endoscopic perception for navigation and safety. However, conventional en

safetyarxiv-cs-cv

FAIR GraphRAG: A Retrieval-Augmented Generation Approach for Semantic Data Analysis

arXiv:2607.11464v1 Announce Type: cross Abstract: Retrieval-Augmented Generation (RAG) addresses the limitations of Large Language Models (LLMs) when providing responses to domain-specific questions.

applicationsarxiv-cs-ai

From Many to Meaningful: Feature-Guided Zero-Shot Chronic Kidney Disease Screening Using Large Language Models

arXiv:2607.12260v1 Announce Type: new Abstract: Early screening of chronic kidney disease (CKD) is essential for preventing irreversible progression; however, many machine learning (ML)-based screenin

Imputation-free transformer learning enables robust Alzheimer's disease prediction and calibrated uncertainty quantification across heterogeneous clinical cohorts

arXiv:2607.11656v2 Announce Type: replace-cross Abstract: Accurate diagnostic classification and disease-severity prediction for Alzheimer's disease are hampered by the incompleteness and heterogeneit

safetyarxiv-cs-lg

Inclusive Federated Learning Through Compliance-Weighted Noise Allocation in Healthcare AI

arXiv:2505.22108v4 Announce Type: replace-cross Abstract: Background: Federated learning (FL) enables collaborative training of clinical AI models without centralizing patient data, but adoption is li

applicationsarxiv-cs-ai

Tutorials

Invariant Learning Dynamics of Transformers in Inductive Reasoning Tasks

arXiv:2607.11875v2 Announce Type: replace-cross Abstract: We present a theoretical framework to explain the emergence of inductive reasoning abilities in Transformer language models. While previous wo

tutorialsarxiv-cs-ai

Kernel PCA for Out-of-Distribution Detection: Non-Linear Kernel Selection and Approximation

arXiv:2505.15284v2 Announce Type: replace-cross Abstract: Out-of-Distribution (OoD) detection is vital for the reliability of deep neural networks, the key of which lies in effectively characterizing

applicationsarxiv-cs-cv

Tutorials

Learning to Discretize: Diffusion-Based Adaptive Mesh with Spectral Guidance

arXiv:2607.11974v1 Announce Type: cross Abstract: Most neural partial differential equation (PDE) surrogates learn how fields evolve after a grid has already been chosen. However, before any operator

tutorialsarxiv-cs-ai

MambaPSA: A Mamba-based Replacement for C2PSA in YOLO26

arXiv:2607.12681v1 Announce Type: new Abstract: State space models (SSMs), notably Mamba, have recently emerged as efficient alternatives to self-attention with linear computational complexity. We inv

Local Ai

On-Device Deep Research at 4B: Exposure Bounds Faithfulness, Retrieval Bounds Coverage

arXiv:2607.12257v1 Announce Type: new Abstract: On-device research agents search a corpus, read sources, and write a cited brief on a personal laptop. Whether their citations are faithful, and at what

local-aiarxiv-cs-ai

PFAdapter: Hierarchical LoRA Decomposition for Personalized Federated MLLMs

model-releasesarxiv-cs-ai

arXiv:2607.12111v1 Announce Type: cross Abstract: Agentic AI systems are reshaping communications and networking by deploying autonomous intelligent agents capable of collaborative learning while main

Physically Aware Radiomics Without Interpolation: Disentangling Voxel Geometry and Signal Modification in CT and MRI

arXiv:2607.12399v1 Announce Type: new Abstract: Objective: Radiomic texture features are usually computed in voxel-index neighborhoods, implicitly assuming isotropic spatial relationships. In anisotro

Semantic-Edge Response Decoding of SAM3 for Zero-Shot Crack Segmentation

arXiv:2607.12292v1 Announce Type: new Abstract: Crack segmentation is essential for infrastructure inspection and structural health assessment, but existing high-performance methods typically require

TerraLogic: A Benchmark for Hierarchical Geospatial Reasoning in Earth Observation

arXiv:2607.12497v1 Announce Type: new Abstract: Beyond perception, reasoning is essential in remote sensing for advanced interpretation, inference, and decision-making. Recent advances in large langua

The Computational Basis of Confidence in Large Language Models

arXiv:2607.12447v1 Announce Type: cross Abstract: Reliable confidence -- the probability that a model's own answer is correct -- is essential for the trustworthy deployment of language models. Existin

researcharxiv-cs-ai

The Sound of Absence: Audio-Language Embedding Models Struggle with Negation

arXiv:2607.12290v1 Announce Type: cross Abstract: Audio-language embedding models such as CLAP are widely evaluated on matching present sound events, but rarely on negation. We show this affirmation-o

safetyarxiv-cs-ai

Understanding Sources of Demographic Predictability in Brain MRI via Disentangling Anatomy and Contrast

arXiv:2603.04113v2 Announce Type: replace-cross Abstract: Demographic attributes can be predicted from medical images, raising concerns about bias in clinical AI systems. In X-ray imaging, acquisition

safetyarxiv-cs-ai

Dual-Correlation Hypergraph Network for Unaligned RGBT Video Object Detection and A Large-scale Benchmark

arXiv:2607.08191v1 Announce Type: new Abstract: RGB-Thermal (RGBT) Video Object Detection (VOD) has gained significant traction due to its ability to overcome the limitations of conventional RGB-based

10 Jul 2026

Agents

CoMind: Understanding Collaborative Human Activity from Multiple Minds and Views

arXiv:2607.06691v1 Announce Type: new Abstract: Human-human collaboration is a fundamental aspect of everyday life, essential to success in a wide range of goal-directed activities from household task

agentsarxiv-cs-cv

9 Jul 2026

Dual Latent Memory in Vision-Language-Action Models for Robotic Manipulation

arXiv:2607.07608v1 Announce Type: cross Abstract: Mainstream Vision-Language-Action (VLA) models predict actions primarily from the current observation under a Markovian assumption, thus struggling wi

safetyarxiv-cs-cv

9 Jul 2026

Immersive Social Interaction with VR and LLM-Assisted Humanoids

arXiv:2607.07430v1 Announce Type: new Abstract: Humanoid robots can extend human presence to remote, constrained, or hazardous environments, but existing teleoperation interfaces often require physica

researcharxiv-cs-ro

9 Jul 2026

Platonic Representations for Poverty Mapping: Unified Vision-Language Codes or Agent-Induced Novelty?

arXiv:2508.01109v3 Announce Type: replace Abstract: We investigate whether socioeconomic indicators, like household wealth, leave recoverable informational imprints in both satellite imagery (capturin

safetyarxiv-cs-ai

Training-Free Acceleration for Vision-Language-Action Models with Action Caching and Refinement

arXiv:2607.06370v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models have emerged as a promising approach for generalizable robotic manipulations. In particular, flow matching-based V

applicationsarxiv-cs-cv

Agents

VaseMuseum: Digital Intelligent Museum for Ancient Greek Pottery

arXiv:2607.06374v1 Announce Type: new Abstract: Vision-language models (VLMs) have made interactive digital museums increasingly feasible by connecting 3D digitization with natural-language artifact e

agentsarxiv-cs-cv

What Images Cannot Say: Language-Guided Olfactory Representation Learning

arXiv:2607.06402v1 Announce Type: cross Abstract: Images tell us what a scene looks like, but rarely what it would feel like to be there. While recent datasets pair visual scenes with electronic-nose

researcharxiv-cs-ai

FUSE: FK-Steered Multi-Modal Flow Matching for Efficient Simulation-Based Posterior Estimation

arXiv:2607.05252v1 Announce Type: new Abstract: Simulation-Based Inference (SBI) is critical for scientific discovery, with generative models offering a promising path toward efficient inference. Howe

QSVideo: Query-Conditioned Semantic Temporal Retrieval for Video Understanding

arXiv:2607.04559v1 Announce Type: new Abstract: The performance of vision-language models (VLMs) in video understanding declines with increasing video duration, as video moments unrelated to the query

safetyarxiv-cs-cv

RL Forgets! Towards Continual Policy Optimization

arXiv:2607.04364v1 Announce Type: new Abstract: Continual post-training is becoming a central paradigm for adapting vision-language models to evolving tasks. Recent work has increasingly favored reinf

SpectralGCD: Spectral Concept Selection and Cross-modal Representation Learning for Generalized Category Discovery

arXiv:2602.17395v2 Announce Type: replace-cross Abstract: Generalized Category Discovery (GCD) aims to identify novel categories in unlabeled data while leveraging a small labeled subset of known clas

researcharxiv-cs-ai

Local Ai

UniSkip-Mamba: A Frequency-Aware State Space Model for Audio-Visual Temporal Forgery Localization

arXiv:2607.04498v1 Announce Type: new Abstract: With the proliferation of AI-generated content, sophisticated multimedia manipulation has raised critical concerns about malicious applications such as

local-aiarxiv-cs-cv

EduArt: An educational-level benchmark for evaluating art history knowledge in large language models

model-releasesarxiv-cs-cl

arXiv:2607.02007v1 Announce Type: new Abstract: Large language models now score near ceiling on general benchmarks, but these aggregate measures reveal little about how models behave within single dis

3 Jul 2026

Local Ai

SEPS: Semantic-enhanced Patch Slimming Framework for fine-grained cross-modal alignment

arXiv:2511.01390v2 Announce Type: replace-cross Abstract: Fine-grained cross-modal alignment aims to establish precise local correspondences between vision and language, forming a cornerstone for visu

local-aiarxiv-cs-ai

3 Jul 2026

Autonomous Scientific Discovery via Iterative Meta-Reflection

model-releasesarxiv-cs-ai

arXiv:2607.01131v1 Announce Type: cross Abstract: Autonomous scientific discovery systems offer the potential to accelerate research by automating the process of hypothesis generation and validation.

2 Jul 2026

Agents

BaRA: BFS-and-Reflection Web Data Collection Agent

arXiv:2607.00007v1 Announce Type: cross Abstract: Large language model (LLM)-based web agents reduce manual scripting for web data collection, yet on live websites, they often miss relevant pages, ret

agentsarxiv-cs-ai

2 Jul 2026

VisReason: A Large-Scale Dataset for Visual Chain-of-Thought Reasoning

arXiv:2511.17731v2 Announce Type: replace Abstract: Chain-of-Thought (CoT) prompting has proven remarkably effective for eliciting complex reasoning in large language models (LLMs). Yet, its potential