Search: “multimodal”

Agentic Explainable Artificial Intelligence (Agentic XAI) Approach To Explore Better Explanation: A Case Study in Decision Support for Rice Cultivation in Japan

arXiv:2512.21066v4 Announce Type: replace Abstract: Explainable artificial intelligence (XAI) reveals how explanatory variables relate to a response variable, yet communicating XAI outputs to layperso

safetyarxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

BananaVLM: A Domain-Adapted Vision Language Model for Banana Crop Disease Diagnosis

DGX agent

arXiv:2609.25040v1 Announce Type: cross Abstract: Banana crop diseases threaten food security across the world, yet field diagnosis remains difficult because of limited expert access and visual simila

model-releasesarxiv-cs-cv

23 Sept 2026

Calibrated Confidence Expression for Radiology Report Generation

arXiv:2603.29492v2 Announce Type: replace Abstract: Safe deployment of Large Vision-Language Models (LVLMs) in radiology report generation requires not only accurate predictions but also clinically in

researcharxiv-cs-cl

Entropy Can Flow, or It Can Guide. Be Entropy. LEDFlow: Introducing Entropy-guided Generation Order into Uniform Discrete Flow

arXiv:2609.25131v1 Announce Type: new Abstract: Uniform discrete flow permits repeated updates at every generation position. While continued revision supports correction of wrong tokens, it also expos

local-aiarxiv-cs-lg

From Inference Engine to Inference Control Plane: Connecting vLLM, llm-d, and the Evolution of Efficient Distributed LLM Serving

model-releasesarxiv-cs-ai

arXiv:2609.23130v1 Announce Type: new Abstract: Large language model (LLM) inference is evolving from an engine-local optimization problem into a distributed control problem involving reusable state,

JAMB: Joint Action-Motion Diffusion for Bimanual Manipulation

arXiv:2609.25322v1 Announce Type: new Abstract: Coordinated bimanual manipulation is challenging because the motion of either arm can alter the shared 3D scene and thereby affect the other arm. Yet mo

KwaiMind Technical Report

arXiv:2609.26375v1 Announce Type: new Abstract: Commercial image editing requires product identity preservation, accurate text rendering, and user appeal alongside general editing quality. We present

Tutorials

Less Is More in the Long Tail: Stage-Adaptive Sample Selection for Annotation-Efficient Dense Prediction

arXiv:2609.25850v1 Announce Type: new Abstract: Deep learning performance generally improves with increasing training data, yet this scaling is fundamentally constrained by annotation cost in large-sc

tutorialsarxiv-cs-cv

Listen Then Reason: Perception-Grounded Test-Time Reinforcement Learning for Large Audio-Language Models

arXiv:2609.23589v1 Announce Type: cross Abstract: Large audio-language models (LALMs) are increasingly used for a broader range of audio reasoning tasks. These models typically incorporate audio repre

researcharxiv-cs-ai

Mammo-LIFE: Longitudinal Mammographic Imaging and Clinical Feature Enrichment for Post-Radiotherapy Outcome Prediction

arXiv:2609.26443v1 Announce Type: new Abstract: Recent advances in Artificial Intelligence (AI)-powered Computer-Aided Diagnosis (CAD) systems have substantially improved breast cancer screening, diag

MedRSI: Recursive Self-Improvement for Medical Agents via Clinically Aligned Self-Evolution

arXiv:2609.24838v1 Announce Type: new Abstract: Medical agents increasingly combine general reasoning models with specialized clinical tools, yet their capabilities remain largely fixed by what clinic

safetyarxiv-cs-ai

Metric-Bench: Exploring In-context Spatial Metric Reasoning in VLMs for Indoor Scenes

arXiv:2609.25841v1 Announce Type: new Abstract: Metric reasoning is a critical and challenging task for Vision Language Models (VLMs), playing a pivotal role in embodied AI tasks such as robotic manip

Neoadjuvant chemotherapy response prediction using pretreatment diffusion and contrast-enhanced magnetic resonance imaging with clinical variables

arXiv:2609.26105v1 Announce Type: cross Abstract: Prediction of pathological complete response before neoadjuvant chemotherapy may facilitate more tailored therapeutic planning for breast cancer patie

Applications

Predicting Postprandial Glycemic Response from Meal Images, Clinical Variables, and Gut Microbiome Information

arXiv:2609.24453v1 Announce Type: new Abstract: Predicting postprandial glycemic response (PPGR) is fundamental to personalized nutrition and type 2 diabetes management, yet existing approaches typica

applicationsarxiv-cs-ai

Qwen-Audio-3.1-Realtime: Towards Reliable Agentic Voice Interaction

model-releasesarxiv-cs-cl

arXiv:2609.25176v1 Announce Type: cross Abstract: Real-time voice assistants must reason over evolving requests, execute actions, and follow conversational rules. Qwen-Audio-3.1-Realtime brings these

RGSQ: Riemannian Geometry-Sensitive Quantization for Large Vision-Language Models

arXiv:2609.25492v1 Announce Type: new Abstract: Large vision-language models (VLMs) can be efficiently deployed under stringent memory and latency constraints through post training quantization (PTQ).

StepTrigger: Contact-State-Triggered Backdoor Attacks on VLM-Powered Legged Robots

arXiv:2609.26131v1 Announce Type: new Abstract: Large language models and vision-language models are increasingly used as high-level planners in robotic systems, using task goals and sensor summaries

Taming CoT Obfuscation in VLMs: From Mechanistic Evidence to Activation Enforcement

arXiv:2609.24243v1 Announce Type: new Abstract: Reinforcement learning (RL) improves reasoning in vision-language models (VLMs) but can induce chain-of-thought (CoT) obfuscation: an operational, non-i

local-aiarxiv-cs-ai

TV-AudioRemover: Joint Text-Visual Guided Sound Removal with Multi-Task Hard-Mixture Curriculum

arXiv:2609.25864v1 Announce Type: cross Abstract: Visual object removal can eliminate a target from video frames, yet its acoustic trace persists in the soundtrack, causing obvious audio-visual incons

World In Your Hands: A Large-Scale and Open-Source Ecosystem for Learning Human-Centric Manipulation in the Wild

arXiv:2512.24310v4 Announce Type: replace Abstract: We introduce World In Your Hands (WIYH), a large-scale open-source ecosystem comprising over 1,000 hours of human manipulation data collected in-the

You Only Need 2/3 of the Chosen Experts: An Empirical Study of Dynamic Expert Pruning in Fine-Grained MoE LLMs

arXiv:2609.25809v1 Announce Type: new Abstract: Fine-grained mixture-of-experts (MoE) architectures have become a mainstream design for open-weight LLMs, with hundreds of experts and increasingly many

researcharxiv-cs-lg

AniPrO: Interpretable Anime Image Provenance Detection via Multi-Dimensional Semantic Reasoning

arXiv:2609.23345v1 Announce Type: new Abstract: As generative AI becomes increasingly used in anime-style image creation, distinguishing human-drawn, AI-inpainted, and text-to-image images is importan

Bimanual 3D Hand Motion and Articulation Forecasting in Everyday Images

arXiv:2510.06145v2 Announce Type: replace Abstract: We tackle the problem of forecasting bimanual 3D hand motion and articulation from a single image in everyday settings. To address the lack of 3D ha

ChartJudgeBench: Evaluating LMM Judges for Chart-to-Code Generation

arXiv:2609.24210v1 Announce Type: new Abstract: Building strong chart-to-code systems increasingly relies on reinforcement learning, whose effectiveness depends critically on the quality of the reward

CLIP-Powered Domain Generalization and Domain Adaptation: A Comprehensive Survey

arXiv:2504.14280v2 Announce Type: replace Abstract: As machine learning evolves, domain generalization (DG) and domain adaptation (DA) have become crucial for improving model robustness across diverse

Dissecting Agentic Forensics: The Role of Triage, Prompting, and Evidence Arbitration in Open-World Fake Image Detection

arXiv:2609.24359v1 Announce Type: new Abstract: Image forensics is increasingly an open-world problem: manipulations range from fully synthetic images to localized edits, splicing and swapping, while

local-aiarxiv-cs-cv

FeasibleFlow: One-Step Joint Transport of Configuration Feasibility and Trajectories for End-to-End Driving

model-releasesarxiv-cs-ro

arXiv:2609.23488v1 Announce Type: new Abstract: End-to-end autonomous driving maps current observations directly to future trajectories, yet those trajectories must remain valid as the scene evolves.

Financial Language Models as Applied Artificial Intelligence Systems for News-Based Trading under Market Frictions

arXiv:2609.23703v1 Announce Type: new Abstract: Financial language models can transform unstructured firm-specific news into structured decision signals, but financial AI research lacks an integrated

researcharxiv-cs-cl

Tutorials

From Content Generation to Learning Support: Pedagogy-Guided Generative Video Tutors for STEM Learning

arXiv:2609.24083v1 Announce Type: new Abstract: Generative AI enables scalable production of educational videos, but current systems largely focus on producing visually coherent content rather than su

tutorialsarxiv-cs-cl

ME-Brain-1.0: Memory, Cognition and Action for Evolving Embodied Intelligence

arXiv:2609.24271v1 Announce Type: new Abstract: Current embodied systems largely rely on pretrained capabilities that remain fixed after deployment, limiting their ability to learn from physical inter

local-aiarxiv-cs-ro

Mira-Scene: Pixel-Aligned Layouts for Generative 3D Scene

arXiv:2609.23796v1 Announce Type: new Abstract: Single-image 3D object generation can now produce high-fidelity assets, yet accurately placing them into a coherent scene layout remains an open challen

NAVIR: Neuromorphic Audio-Visual Speech Recognition for Robust Human-Robot Interaction on Edge Hardware

model-releasesarxiv-cs-lg

arXiv:2609.24391v1 Announce Type: new Abstract: Voice-controlled interaction in industrial settings is hampered by acoustic noise, which severely degrades audio-only speech recognition. Audio-visual s

Omni2Web: Benchmarking Audiovisual Website Development

arXiv:2609.23417v1 Announce Type: cross Abstract: Screen-recorded web editing requests contain weak deictic expressions such as ``this'' and ``there,'' whose referents depend on speech, cursor traject

PackLab: A Comprehensive Framework for Developing, Training, and Evaluating MLLMs in Robotic Bin Packing

model-releasesarxiv-cs-ro

arXiv:2609.23784v1 Announce Type: new Abstract: Robotic bin packing requires long-horizon sequential decision-making, as each object placement affects the available space for subsequent packing. Exist

QwenVLConnector: A Fast, Unified Medical VLM Chatbot for Fine-Grained Clinical Perception and Text Generation

arXiv:2609.23139v1 Announce Type: new Abstract: Most medical vision-language models (VLMs) excel at open-ended report generation and VQA but provide limited support for structured, fine-grained clinic

Safe Learning for Contact-Rich Robot Tasks: A Survey from Classical Learning-Based Methods to Safe Foundation Models

arXiv:2512.11908v3 Announce Type: replace Abstract: Contact-rich tasks pose significant challenges for robotic systems due to inherent uncertainty, complex dynamics, and the high risk of damage during

SalQ-VLM: Fine-Grained Saliency-Guided Quantization for Vision-Language Models

model-releasesarxiv-cs-cl

arXiv:2508.03351v3 Announce Type: replace-cross Abstract: Large language models (LLMs) have demonstrated remarkable capabilities across diverse language tasks, motivating their extension to vision-lan

Agents

SALSA: Semi-Autonomous Literature Summarization Assistant

arXiv:2609.22210v1 Announce Type: new Abstract: SALSA (Semi-Autonomous Literature Summarization Assistant) is an open- source, human-in-the-loop platform for extracting structured scientific datasets

agentsarxiv-cs-cl

Agents

Structured World-State Reasoning for Agentic Robotic Search

arXiv:2609.23841v1 Announce Type: new Abstract: Long-horizon robotic search must resolve natural language against heterogeneous, incomplete, and often ambiguous evidence: textual information, prior ma

agentsarxiv-cs-ro

Task aware Dynamic Movement Primitives for failure detection and recovery in contact rich manipulation

arXiv:2609.23151v1 Announce Type: cross Abstract: Assembly remains a challenging robotic manipulation task in presence of tight tolerances and complex contact interactions. While Learning from Demonst

VideoGen-Agent: Reinforcing Video Generation Agents

arXiv:2609.24997v1 Announce Type: new Abstract: Recent advances in video generative models have enabled high-fidelity, temporally coherent video generation. However, these models often struggle to sat

What do VLM-Based Vision-Language Navigation Models Rely on: Interpreting and Steering Policy Behavior

arXiv:2609.24576v1 Announce Type: cross Abstract: Modern Vision-Language Navigation (VLN) models rely mostly on pre-trained large Vision-Language Models (VLMs) to predict navigation actions. While thi

WorldScape Policy 2.0: Empowering Steerable World Action Modeling with Reasoning-Augmented Memory and In-Context Learning

arXiv:2607.18840v2 Announce Type: replace Abstract: World Action Models (WAMs) offer a promising paradigm for robotic manipulation by jointly modeling visual state transitions and robot actions. Howev

A Generative Grammar Underlying the Voynich Manuscript, the Pastiche Hypothesis: Evidence from Large Language Models

arXiv:2609.20835v1 Announce Type: new Abstract: Background: The Voynich Manuscript is a fifteenth-century codex written in an unknown script whose content remains undeciphered. Previous studies sugges

safetyarxiv-cs-cl

AVT-Fabric: Active Visuo-Tactile Perception via Adaptive Evidence Selection for Efficient Robotic Fabric Comparison

arXiv:2609.21377v1 Announce Type: new Abstract: Robotic fabric comparison needs to actively combine visual appearance and tactile cues. Here, we present AVT-Fabric, an RGB-first framework that allocat

researcharxiv-cs-ro

Beyond Exact Match: Task-Aware GRPO for Cross-Domain PCBA Visual Question Answering

arXiv:2609.21276v1 Announce Type: cross Abstract: In automated Printed Circuit Board Assembly (PCBA) inspection, standards-guided decisions require systems to jointly reason over fine-grained visual c

safetyarxiv-cs-ai

DEXTERA: From a Single Image to Deployable Dexterous Manipulation via Real-to-Sim-to-Real

arXiv:2609.21045v1 Announce Type: new Abstract: Collecting real-world robot data for dexterous manipulation is costly and time-consuming. While high-fidelity physics simulators enable scalable data sy

Tutorials

ForeTac-VLA: A Forecasting-Based Tactile-Vision-Language-Action Model for Contact-Rich Robotic Manipulation

arXiv:2609.20980v1 Announce Type: new Abstract: Vision-language-action (VLA) models have demonstrated strong capabilities in robotic manipulation, yet their reliance on visual perception limits robust

tutorialsarxiv-cs-ro