Search: “multimodal”

Listening Between the Lines: Joint Learning of ASR Embeddings and LLM-Augmented Linguistics for Dementia Detection

arXiv:2606.30675v1 Announce Type: cross Abstract: Early detection of dementia through speech analysis offers a non-invasive screening alternative, but capturing both acoustic and linguistic biomarkers

researcharxiv-cs-ai

1 Jul 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

RESOLVE: A Multi-Resolution and Multi-Modal Dataset for Roadside Cooperative Perception

DGX agent

arXiv:2606.31895v1 Announce Type: new Abstract: LiDAR has increasingly been integrated into traffic cameras to expand coverage and mitigate occlusion in roadside cooperative perception. However, how u

model-releasesarxiv-cs-cv

1 Jul 2026

T-QPM: Enabling Temporal Out-Of-Distribution Detection and Domain Generalization for Vision-Language Models in Open-World

arXiv:2603.18481v2 Announce Type: replace Abstract: Out-of-distribution (OOD) detection remains a critical challenge in open-world learning, where models must adapt to evolving data distributions. Whi

1 Jul 2026

Local Ai

CCRC: A Change-Aware Captioning and Reasoning Chain for Image Change Captioning and Segmentation

arXiv:2606.28724v1 Announce Type: cross Abstract: Understanding and localizing subtle changes between paired images is critical for tasks such as surveillance and image editing. However, traditional I

local-aiarxiv-cs-ai

Cross-Modal Iteration Distillation for Robust IHD Screening: The IDNet Framework and A New Benchmark

arXiv:2606.30027v1 Announce Type: new Abstract: Color Fundus Photography (CFP) offers a low-cost and non-invasive route for ischemic heart disease (IHD) screening, but current studies are limited by s

DataComp-VLM: Improved Open Datasets for Vision-Language Models

arXiv:2606.28551v1 Announce Type: cross Abstract: Building performant Vision-Language Models (VLMs) requires carefully curating large-scale training datasets, yet the community lacks systematic benchm

Tutorials

Mural: Transferring LLM knowledge to image generation via Mixture-of-Transformers

arXiv:2606.29013v1 Announce Type: new Abstract: Leveraging capabilities of large language models (LLMs) in text-to-image (T2I) synthesis is an important research direction. In this work we investigate

tutorialsarxiv-cs-cv

Obliviate: Erasing Concepts from Autoregressive Image Generation Models

arXiv:2606.28643v1 Announce Type: new Abstract: The widespread adoption of generative AI models has intensified concerns about misuse, including the creation of unsafe or disturbing imagery. To mitiga

Agents

SICAGE: Speaker-Independent Culture-Aware Gesture Generation using TED4C-L Dataset

arXiv:2606.30001v1 Announce Type: new Abstract: Recent co-speech gesture generation methods often overlook cultural differences, limiting their effectiveness in human-agent interaction. Moreover, cult

agentsarxiv-cs-cv

Aloe-Vision: Robust Vision-Language Models for Healthcare

arXiv:2606.27500v1 Announce Type: cross Abstract: Large Vision-Language Models (LVLMs) specialized in healthcare are emerging as a promising research direction due to their potential impact in clinica

29 Jun 2026

Local Ai

Verifiable Geometry Problem Solving: Solver-Driven Autoformalization and Theorem Proposing

arXiv:2606.27926v1 Announce Type: new Abstract: Geometry Problem Solving have increasingly adopt the neuro-symbolic paradigm, combining neural intuition with symbolic rigor. However, current framework

local-aiarxiv-cs-ai

29 Jun 2026

A Systematic Survey of Semantic Role Labeling in the Era of Pretrained Language Models

arXiv:2502.08660v4 Announce Type: replace Abstract: Semantic role labeling (SRL) is a central natural language processing task for understanding predicate-argument structures within texts and enabling

researcharxiv-cs-cl

Tutorials

DynFS-MoE: Dynamic Functional-Structural Mixture-of-Experts for Post-Traumatic Epilepsy Diagnosis

arXiv:2606.16203v3 Announce Type: replace Abstract: Post-traumatic epilepsy (PTE) is a severe complication of traumatic brain injury (TBI). Yet, early identification remains challenging due to the com

tutorialsarxiv-cs-cv

Geometry-Aware Superpixel Graph Transformer with Metadata for Skin Lesion Classification

arXiv:2606.20390v2 Announce Type: replace Abstract: Automated skin cancer classification from dermoscopic images remains challenging due to heterogeneous lesion structure, strong intra-class variabili

LAMP: Lane-Aligned Motion Primitives for Feasible Trajectory Prediction

arXiv:2606.26661v1 Announce Type: cross Abstract: Motion forecasting is essential for autonomous driving systems to enable safe decision-making and planning in complex driving scenarios. While existin

safetyarxiv-cs-ai

PhysEditWorld: A Large-Scale Dataset Toward Physics-Editable World Models

arXiv:2606.26694v1 Announce Type: new Abstract: Recent game world models can synthesize visually plausible, action-conditioned rollouts. However, their interaction behaviors often remain limited to ex

safetyarxiv-cs-cv

MedLayBench-V: A Large-Scale Benchmark for Expert-Lay Semantic Alignment in Medical Vision Language Models

arXiv:2604.05738v2 Announce Type: replace Abstract: Medical Vision-Language Models (Med-VLMs) have achieved expert-level proficiency in interpreting diagnostic imaging. However, current models are pre

25 Jun 2026

Wan-Streamer v0.1: End-to-end Real-time Interactive Foundation Models

arXiv:2606.25041v1 Announce Type: new Abstract: We present Wan-Streamer, a native-streaming, end-to-end interactive foundation model designed from the ground up for real-time, low-latency, full-duplex

25 Jun 2026

EvidenceLens: A Claim-Evidence Matrix for Auditing Financial Question Answering

arXiv:2606.23724v1 Announce Type: cross Abstract: Large language models are increasingly used to answer questions over annual reports, earnings decks, and analyst notes, yet their outputs remain diffi

safetyarxiv-cs-cl

24 Jun 2026

Applications

Legible and Intuitive Multi-modal Robot State and Intent Communication Validated in Online and Real-world Studies

arXiv:2606.24445v1 Announce Type: new Abstract: Effective robot-to-human communication can increase transparency and trust, reduce uncertainty, and contribute to safer collaboration in shared workspac

applicationsarxiv-cs-ro

24 Jun 2026

Agents

NavWM: A Unified Navigation World Model for Foresight-Driven Planning

arXiv:2606.24101v1 Announce Type: cross Abstract: Conventional visual navigation policies often struggle with myopic decision-making and mode collapse in complex environments. While world models offer

agentsarxiv-cs-cv

24 Jun 2026

Cohort-Anchored Foundation Models for Electronic Health Records: From Risk Scores to Auditable Peer Cohorts

arXiv:2606.21885v1 Announce Type: new Abstract: Foundation models have achieved remarkable performance across medical question answering, imaging, and electronic health record (EHR) tasks, yet reliabl

safetyarxiv-cs-lg

Fursee: Hybrid YOLO-DINOv3 Framework for Fursuit Identity Retrieval and Clustering

arXiv:2606.22872v1 Announce Type: new Abstract: Global furry conventions produce massive fursuit photographs, while manual sorting brings heavy labor costs and calls for automatic identity retrieval a

OGD4All: A Framework for Accessible Interaction with Geospatial Open Government Data Based on Large Language Models

model-releasesarxiv-cs-lg

arXiv:2602.00012v3 Announce Type: replace Abstract: We present OGD4All, a transparent, auditable, and reproducible framework based on Large Language Models (LLMs) to enhance citizens' interaction with

Unlocking In-Context Learning in Audio-Language Models from Decentralized Medical Audio

arXiv:2606.23243v1 Announce Type: new Abstract: Clinical audio diagnosis in low-resource settings requires models that identify conditions from minimal examples without large annotated corpora. We pro

researcharxiv-cs-lg

Vision-language models for chest radiography do not always need the image

arXiv:2606.17710v2 Announce Type: replace Abstract: Medical vision-language models report strong chest radiograph accuracy, and this is increasingly read as evidence that they use the image. That infe

Benchmarking Large Language Models for Safety Data Extraction

arXiv:2606.11204v1 Announce Type: new Abstract: Accurate extraction of structured information from Safety Data Sheets (SDS) remains challenging in industrial safety due to heterogeneous document forma

CoVR-R:Reason-Aware Composed Video Retrieval

arXiv:2603.20190v2 Announce Type: replace Abstract: Composed Video Retrieval (CoVR) aims to find a target video given a reference video and a textual modification. Prior work assumes the modification

Does the Question Really Matter? Training-Free Data Selection for Vision-Language SFT

arXiv:2603.09715v2 Announce Type: replace Abstract: Visual instruction tuning is crucial for improving vision-language large models (VLLMs). However, many samples can be solved via linguistic patterns

researcharxiv-cs-ai

MedCTA: A Benchmark for Clinical Tool Agents

arXiv:2606.11702v1 Announce Type: cross Abstract: To make clinically grounded decisions, medical AI agents are expected to go beyond simple recognition and be capable of tool retrieval, evidence acqui

The Unreasonable Effectiveness of Discrete-Time Gaussian Process Mixtures for Robot Policy Learning

arXiv:2505.03296v2 Announce Type: replace-cross Abstract: We present Mixture of Discrete-time Gaussian Processes (MiDiGap), a novel approach for flexible policy representation and imitation learning i

safetyarxiv-cs-ai

Baichuan-M4: A Clinical-Grade Medical Agent System for Continuous Care

arXiv:2606.08982v1 Announce Type: new Abstract: Baichuan-M4 is Baichuan Intelligence's clinical-grade medical large model, designed for continuous care rather than single-turn medical question answeri

safetyarxiv-cs-ai

Crayotter: Traceable Multi-Agent Workflows for Long-Form Video Editing

arXiv:2606.07636v1 Announce Type: new Abstract: Editing a long-form video from heterogeneous footage requires more than selecting clips: an agent must preserve narrative intent across material prepara

safetyarxiv-cs-cv

How Well Do Latent World Models Understand Partially Observable Safety Constraints?

arXiv:2510.06492v2 Announce Type: replace Abstract: Latent world models are a promising approach for learning state representations and dynamics directly from high-dimensional observations, enabling r

safetyarxiv-cs-ro

Language as a Sensor: Calibrated Spatial Belief Estimation in 3D Scenes from Natural Language

model-releasesarxiv-cs-ro

arXiv:2606.08666v1 Announce Type: new Abstract: Robots deployed in human-centric environments routinely receive natural-language descriptions of spatial information ('I left my backpack on the table')

LUNA-AD: Lightweight Uncertainty-Aware Language Model with Lifelong Learning for Autonomous Driving

arXiv:2606.08470v1 Announce Type: new Abstract: While large language models (LLMs) offer promising reasoning capabilities, their integration into safety-critical driving systems is hindered by limited

safetyarxiv-cs-ro

MatSciBench: Benchmarking the Reasoning Ability of Large Language Models in Materials Science

arXiv:2510.12171v2 Announce Type: replace Abstract: Large Language Models have shown strong scientific reasoning ability, but their performance on materials science problems remains less studied. To f

MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understanding

arXiv:2410.21747v2 Announce Type: replace Abstract: Generating lifelike human motions from descriptive texts has experienced remarkable research focus in the recent years, propelled by the emerging re

Local Ai

PhysAgent: Automating Physics-Based 4D Synthesis via Trajectory-Grounded Multi-Agent Feedback

arXiv:2606.08688v1 Announce Type: cross Abstract: Achieving fully automated, physically plausible 3D motion synthesis is a core objective in graphics and generative AI. However, configuring complex en

local-aiarxiv-cs-cv

Towards Mitigating Hallucinations in Large Vision-Language Models by Refining Textual Embeddings

arXiv:2511.05017v2 Announce Type: replace Abstract: Hallucinations in Large Vision-Language Models (LVLMs) remain a persistent challenge, often stemming from inadequate integration of visual informati

safetyarxiv-cs-cv

Transition-Based Digital Twin Modelling for Alzheimer's Disease under Sparse Longitudinal Data

arXiv:2606.09671v1 Announce Type: cross Abstract: Alzheimer's disease (AD) progression is highly heterogeneous and is typically observed through sparse and irregular longitudinal data, posing challeng

researcharxiv-cs-ai

Agents

AutoTool: Dynamic Tool Selection and Integration for Agentic Reasoning

arXiv:2512.13278v2 Announce Type: replace Abstract: Agentic reinforcement learning has advanced large language models (LLMs) to reason through long chain-of-thought trajectories while interleaving ext

agentsarxiv-cs-cl

8 Jun 2026

Textual Supervision Enhances Geospatial Representations in Vision-Language Models

arXiv:2606.07172v1 Announce Type: cross Abstract: Geospatial understanding is a critical yet underexplored dimension in the development of machine learning systems for tasks such as image geolocation

8 Jun 2026

Applications

Learning Predictive Visuomotor Coordination

arXiv:2503.23300v2 Announce Type: replace Abstract: Understanding and predicting human visuomotor coordination is crucial for applications in robotics, human-computer interaction, and assistive techno

applicationsarxiv-cs-cv

PlanBench-V: A Spatial Planning Map Benchmark for Vision-Language Models

arXiv:2606.05744v1 Announce Type: new Abstract: Spatial planning maps are central to territorial governance, translating planning objectives, regulations, and spatial strategies into visual forms for

Revising Context, Shifting Simulated Stance: Auditing LLM-Based Stance Simulation in Online Discussions

arXiv:2606.06443v1 Announce Type: new Abstract: Large language models are increasingly used to simulate social media users and infer how individuals may respond to online discussions. However, it rema

researcharxiv-cs-cl

Seeing Time: Benchmarking Chronological Reasoning and Shortcut Biases in Vision-Language Models

arXiv:2606.05702v1 Announce Type: cross Abstract: Recent advancements in Vision-Language Models (VLMs) have significantly enhanced their ability to interpret complex visual semantics, yet their capaci

Continual Visual and Verbal Learning Through a Child's Egocentric Input

arXiv:2606.05115v1 Announce Type: cross Abstract: Children learn the meanings of words from a continuous, temporally structured stream of egocentric experience. Recent work shows that neural networks