Search: “multimodal”

MeddeX: A Retrieval-Augmented LLaMA-3 System with Gemini Vision for Evidence-Backed Medical Report Analysis

arXiv:2610.20632v1 Announce Type: new Abstract: Modern healthcare generates increasingly complex medical reports that challenge clinical professionals in terms of time and interpretive burden. Manual

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

MedPAO-VL: Interpretable and Protocol-Compliant Agent for Structured Radiology Report Generation

DGX agent

arXiv:2610.21794v1 Announce Type: new Abstract: Despite the remarkable generalization capabilities of Large Language Models, generating clinically accurate and structured radiology reports from medica

safetyarxiv-cs-cv

16 Oct 2026

Mind the Tail: Data Selection Through Sparse Concepts

arXiv:2610.21007v1 Announce Type: new Abstract: Data selection reallocates training support across visual concepts, including objects, attributes, color, texture, and backgrounds. Different allocation

Hardware

MJev-Spatial: System One Spatial Intelligence via Native Attention Matching

arXiv:2610.22276v1 Announce Type: new Abstract: Spatial intelligence lets an agent perceive and act in the physical world, and many of its judgments must be made at interaction rates: which spatial re

hardwarearxiv-cs-cv

OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using Agents

arXiv:2610.22234v1 Announce Type: cross Abstract: Real desktop automation is neither purely visual nor purely programmatic. Agents must understand user-facing interfaces while efficiently manipulating

safetyarxiv-cs-ai

Perception or Reasoning? Diagnosing and Tackling Reinforcement Learning Bottlenecks in VLMs

arXiv:2610.21380v1 Announce Type: new Abstract: Reinforcement learning has brought strong gains to language model reasoning, but its improvements on visual tasks remain less consistent. One difficulty

Realtime-Bench: Can Frontier Models Solve Real-time Interactive Problems?

arXiv:2610.22155v1 Announce Type: new Abstract: Real-time interaction requires agents to perceive evolving environments and act under temporal constraints, yet existing evaluations of real-time stream

Reinforcement Learning-driven Diffusion Models: Language, Vision, and Beyond

arXiv:2610.21539v1 Announce Type: new Abstract: Diffusion models (DMs) have steadily demonstrated outstanding performance in high-fidelity, controllable generation across diverse scenarios, following

agentsarxiv-cs-ai

Semantic Alignment of EEG and Text: A Contrastive Learning Framework for Decoding Imagined Speech

arXiv:2610.20766v1 Announce Type: new Abstract: Imagined speech decoding from EEG offers a promising route toward naturalistic brain-computer interfaces. Traditional closed-set classifiers treat seman

safetyarxiv-cs-lg

Sub-Millisecond Reflexes for Continuous Physical Human-Robot Interaction

arXiv:2610.21913v1 Announce Type: new Abstract: Continuous physical human-robot interaction requires robots to rapidly adapt their control behaviour without interrupting task execution. However, exist

safetyarxiv-cs-ro

Text-to-Image Synthesis: A Decade Survey

arXiv:2411.16164v2 Announce Type: replace Abstract: Text-to-image synthesis (T2I) focuses on generating high-quality images from textual descriptions In this survey, we review 490 papers on T2I spanni

safetyarxiv-cs-cv

Tool-Augmented Large Language Models for Reliable Medical Calculation from Patient Notes

arXiv:2610.21477v1 Announce Type: new Abstract: Medical calculators translate raw patient observations into clinically actionable values and scores. However, applying these calculators directly to fre

VELD-QA: A Large-Scale Dataset for Visual Evidence Grounding and Question Answering in Long Documents

arXiv:2610.20964v1 Announce Type: cross Abstract: Existing long-document QA benchmarks rarely combine large-scale human-authored questions with detailed visual evidence annotations, limiting diagnosis

Visual Sanad: Auditing Vision-Language Models for False Acceptance of Qur'anic Citations

arXiv:2610.22009v1 Announce Type: new Abstract: Vision-language models (VLMs) are increasingly used to interpret religious, educational, and culturally sensitive visual content, yet their reliability

VisualTrust: Video Reasoning under On-Screen Claim Framing

arXiv:2610.21159v1 Announce Type: new Abstract: On-screen text can describe what a video shows, or it can frame what the video is supposed to mean. Current benchmarks treat both alike, testing whether

What Should Robot Policies Learn to Predict? Rethinking Supervision Targets in Vision-Language-Action Learning

arXiv:2610.21915v1 Announce Type: new Abstract: Vision-language-action (VLA) policies are typically trained with action prediction as the primary supervision signal, since robots ultimately execute ac

safetyarxiv-cs-ro

ADAPT: Audio-Depth Action Planning with Transition-Aware Rewards for Lights-Out Industrial Navigation

arXiv:2610.15956v1 Announce Type: new Abstract: Vision-language-action models for embodied navigation typically rely on RGB observations, limiting their applicability in lights-out industrial environm

AlignPoison: Conditional Targeted Poisoning of Generative Recommenders via Decoding-Aligned Prefixes

arXiv:2610.14487v1 Announce Type: new Abstract: Generative recommendation models based on autoregressive decoding have been adopted as alternatives to classical ranking-based systems. While their mode

safetyarxiv-cs-ai

BFHD: Bidirectional Feature Harmonization Decomposition for Heterogeneous Clinical Assessments

arXiv:2610.19352v1 Announce Type: new Abstract: Clinical assessments are often collected using heterogeneous assessment systems across centers and time, leading to records that mix different but relat

researcharxiv-cs-lg

Can Learning to Answer Spatial Questions Improve Novel-View Generation?

arXiv:2610.20610v1 Announce Type: new Abstract: Generating novel views from limited observations requires preserving both the appearance and spatial structure of a scene. Although recent approaches ex

Cortex: Consolidating Context into Parametric Memory

arXiv:2610.20399v1 Announce Type: new Abstract: Context can improve large language model performance, but these gains may be lost after context removal. Inspired by biological systems consolidation, w

researcharxiv-cs-cl

DecisionRobust: Benchmarking Robustness for JEV Style Decision Models Across Text and Vision

arXiv:2610.19118v1 Announce Type: new Abstract: Emerging decision models such as JEV provide typed interfaces that map task instructions and observations directly to choices, judgments, and scores. As

Eigen-Agent: Adaptive Multi-Agent Scientific Reasoning with Monitor-Based RAG

arXiv:2509.21193v2 Announce Type: replace Abstract: Large language models (LLMs) have recently shown strong progress on scientific reasoning, yet two major bottlenecks remain. First, explicit retrieva

agentsarxiv-cs-cl

Empowering Edge Agents: A Systematic Analysis of Edge-Cloud Collaboration in LLM Agent Execution

arXiv:2610.17816v1 Announce Type: new Abstract: Edge-cloud collaboration combines the lower inference overhead and greater data locality of edge-side execution with the stronger capabilities of cloud-

EvoWeb: A Benchmark for Coding Agents on Evolving Web Applications

arXiv:2610.16402v1 Announce Type: new Abstract: Web application development often proceeds through successive requests that extend an existing implementation. Yet web-generation benchmarks primarily e

From Triage to Impact: A Multi-Hop Reasoning Benchmark for Explainable Persian Hate Speech

arXiv:2610.20370v1 Announce Type: new Abstract: Hate speech has become increasingly prevalent on social media, raising concerns about its detection, interpretation, and moderation. Persian, a relative

Geometric Alignment without Functional Equivalence: A Layer-wise Analysis of the Speech-Text Modality Gap

arXiv:2603.01502v2 Announce Type: replace Abstract: End-to-end speech large language models (LLMs) often answer the same question less accurately from speech than from text, even when the spoken conte

safetyarxiv-cs-cl

Applications

Geospatial Vector Geometry as a Native Spatial Modality for Vision-Language Models

arXiv:2610.16769v1 Announce Type: new Abstract: Geospatial reasoning links VLMs to real-world action and decision making. Reliable reasoning requires accurate spatial information and effective spatial

applicationsarxiv-cs-ai

Joint Discrete and SE(3) Diffusion for Protein Interface Design

arXiv:2610.14699v1 Announce Type: new Abstract: The design of high-affinity, target-specific protein binders is central to the development of modern therapeutics. However, existing protein-generation

Learning Adaptive Deliberation Control for Reliable Recognition with Multi-Agent Language Models

arXiv:2610.17840v1 Announce Type: new Abstract: Multi-agent deliberation can improve recognition by criticizing and revising candidate answers, but fixed controls cannot respond to changes in disagree

safetyarxiv-cs-ai

Tutorials

Learning How to Remember: Memory Modality Selection for GUI Agents

arXiv:2610.17928v1 Announce Type: new Abstract: Recent advances in vision-language models (VLMs) have substantially improved the capabilities of GUI agents, while memory augmentation has emerged as a

tutorialsarxiv-cs-ai

Long-Horizon-Terminal-Bench: Testing the Limits of Agents on Long-Horizon Terminal Tasks with Dense Reward-Based Grading

arXiv:2607.08964v3 Announce Type: replace Abstract: AI agents have become capable of autonomously completing short, well-specified tasks. However, existing terminal benchmarks largely focus on simple

LURE: a Phase-Labelled Synthetic Corpus of Online-Grooming Exchanges

arXiv:2610.15908v1 Announce Type: new Abstract: Phase-annotated conversational data is essential for studying the progression of online grooming of minors and for developing early warning tools. Howev

MADDIE: Multi-Agent Drug Discovery Engine

arXiv:2610.16975v1 Announce Type: new Abstract: Drug discovery remains a resource-intensive and time-consuming process, involving billions of dollars and a decade of development to advance a drug to m

agentsarxiv-cs-ai

MagicGarment: Benchmarking Single-Image Standalone 3D Garment Reconstruction

arXiv:2610.19623v1 Announce Type: new Abstract: Single-image 3D reconstruction has advanced rapidly, yet standalone garments remain challenging due to thin-shell geometry, open boundaries, and layered

Tutorials

MemeLogos: Knowledge-Driven Retrieval-Augmented Reasoning for Harmful Meme Detection

arXiv:2610.15463v1 Announce Type: new Abstract: With the rapid proliferation of social media, harmful memes have become a growing threat to online ecosystems. Their harmfulness is often implicitly con

tutorialsarxiv-cs-ai

MIRAGE: Metric Inference and Reliability-Aware Gaussian Estimation from Feed-Forward Vision

arXiv:2610.12568v2 Announce Type: replace Abstract: Feed-forward 3D priors enable high-quality reconstruction from image streams but often lack reliable metric scale and suffer from long-term trajecto

Multi-Horizon Explainable Queue Forecasting and Resource-Aware Decision Support for Intelligent Border Control Using LightGBM

arXiv:2610.15930v1 Announce Type: new Abstract: Border crossing points are stochastic service systems in which traffic demand, traveler categories, registration status, inspection requirements, staffi

Player-1: Learning to Play from Synthetic Experience

arXiv:2610.20584v1 Announce Type: new Abstract: Computer-use agents have demonstrated strong capabilities in interpreting screens and executing keyboard and mouse actions. However, games, with their v

agentsarxiv-cs-cv

Read, Parse, Describe: Unified Document Parsing with Visual Element Description Generation

arXiv:2610.20335v1 Announce Type: new Abstract: Document understanding systems are typically evaluated as separate components via layout analysis, optical text recognition, reading-order prediction, a

Recall What Is Missing: Composing Evidence from Long-Term Agent Memory

arXiv:2610.15642v1 Announce Type: new Abstract: Under a limited context budget, a long-term agent must recall not merely memories that are individually relevant, but evidence that is collectively suff

agentsarxiv-cs-ai

Reels-RSI: Program-Level Self-Improvement for Code-Rendered Explainer Videos

arXiv:2610.14495v1 Announce Type: new Abstract: Explainer videos -- a worked geometry problem, why the sky is blue, how a dynasty fell -- are usually one more target for pixel video generation. We arg

Robust Real-Time Monocular Human Pose Estimation with Insole-Based Sensor Fusion

arXiv:2610.19494v1 Announce Type: new Abstract: Real-time monocular human pose estimation is an important sensing component for human-centered intelligent systems. While recent camera-based methods ha

SAM3RL: Memory Control via Reinforcement Learning for Visual Object Tracking

arXiv:2610.19931v1 Announce Type: new Abstract: Segment Anything Model 3 (SAM 3) is a foundation model for image and video segmentation that sets the state of the art in visual object tracking. Its tr

Self-Representation Alignment in Diffusion Models for Video Background Music Generation

arXiv:2610.15575v1 Announce Type: new Abstract: Diffusion models have been widely used for various generative tasks. However, recent studies have demonstrated that the internal representations learned

SMI: Ontology-Grounded Semantic IDs for Hierarchy-Aware Medical Concept Representation

arXiv:2610.18672v1 Announce Type: cross Abstract: Biomedical language models (LMs) provide strong representations for clinical tasks, but they often fail to capture the hierarchical structure among me

State Representation Shapes Long-Horizon Agent Learning and Transfer: An Empirical Study

arXiv:2610.15407v1 Announce Type: new Abstract: An end-to-end success rate alone cannot distinguish failure to learn an action from failure to apply it as task state changes. We study this distinction

Local Ai

STP-GUI: Spatially-Aware Token Pruning for Efficient Web-GUI Agents

arXiv:2610.20390v1 Announce Type: new Abstract: With the rapid development of vision-language models (VLMs), Web-GUI agents have achieved promising performance in interacting with real-world interface

local-aiarxiv-cs-cv