Search: “multimodal”

arXiv:2609.37918v1 Announce Type: new Abstract: Reasoning across videos requires aligning events, matching identities, comparing motion, and integrating partial observations. Evaluating these capabili

tutorialsarxiv-cs-cv

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Text2Sim: Agentic Physics-Based Simulation Generation with Distilled Expertise

DGX agent

arXiv:2609.36593v1 Announce Type: cross Abstract: Creating diverse physical simulations remains labor-intensive because assets, layout, physical parameters, motion, control, and rendering must be desi

agentsarxiv-cs-ai

30 Sept 2026

The Vote Hides the Failure: Aggregation Choice and Noise Robustness in Heart Murmur Detection

arXiv:2609.37161v1 Announce Type: new Abstract: Noise robustness in automated phonocardiogram (PCG) murmur detection, and how it is measured, remains underexamined despite growing interest in low-reso

Local Ai

UniAfford: Token-Routed Multitask Learning for Generalizable 2D-3D Affordance Perception

arXiv:2609.37264v1 Announce Type: cross Abstract: Affordance perception aims to localize actionable regions supporting embodied interaction, yet 2D and 3D affordance grounding have evolved as separate

local-aiarxiv-cs-ai

V2X-WAM: A Cooperative World Action Model for End-to-End Autonomous Driving

arXiv:2609.37098v1 Announce Type: cross Abstract: Vehicle-infrastructure cooperation can complement onboard sensing with broader and more informative observations of the traffic environment, providing

safetyarxiv-cs-cv

WayFinder: Hierarchical Visual-Language-Action for Zero-Shot Waypoint Generation and Low-Level Kinematic Control

arXiv:2609.37922v1 Announce Type: new Abstract: Visual Language Action (VLA) models offer unprecedented generalization for autonomous robots; however, their real-world deployment is frequently bottlen

safetyarxiv-cs-ro

When Semantics Matter: Reliability-Aware Semantic-Rhythm Control for Co-Speech Gesture Generation

arXiv:2609.36685v1 Announce Type: new Abstract: Co-speech gesture generation aims to synthesize natural gestures that are both temporally synchronized with speech and semantically consistent with the

Advancing Video-Text Pretraining with Multi-View Captions

arXiv:2609.35090v1 Announce Type: new Abstract: Video-text pretraining has achieved remarkable progress through the scaling of models and datasets, yet the quality of language supervision remains unde

Agentic Video Understanding: A Survey

arXiv:2609.31713v1 Announce Type: new Abstract: As large language models (LLMs) become capable of processing increasingly diverse modalities and longer temporal contexts, an emerging line of work is m

agentsarxiv-cs-cv

AI-driven ionic liquid discovery with unified chemical intelligence

arXiv:2511.11257v2 Announce Type: replace-cross Abstract: The rational discovery of functional solvents remains challenging because macroscopic solvent behaviors emerge from complex many-body interact

agentsarxiv-cs-lg

Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligence

arXiv:2609.32041v1 Announce Type: new Abstract: Modern Document AI reads contracts, extracts fields, reasons over tables, and grounds answers to page regions, then forgets everything. Processing an am

Attribution Gaps in Zero-Training LLM+OVOD Pipelines: A Fine-Grained Analysis of the CAAP--SNAP Discrepancy

arXiv:2609.32567v1 Announce Type: new Abstract: LAOD and similar zero-training LLM+open-vocabulary-detector (OVOD) pipelines score two things separately: class-agnostic localization accuracy (CAAP) an

Tutorials

Augmenting Visual Anomaly Detection with Automated Interpretability

arXiv:2609.33818v1 Announce Type: new Abstract: Visual anomaly detectors identify deviations from known-normal data, but their anomaly signals may mix evidence of actual anomalies with benign visual v

tutorialsarxiv-cs-cv

Automated Lesion Segmentation of Stroke MRI Using nnU-Net: A Comprehensive External Validation Across Acute and Chronic Lesions

arXiv:2601.08701v2 Announce Type: replace-cross Abstract: Accurate and generalisable segmentation of stroke lesions from magnetic resonance imaging (MRI) is essential for advancing clinical research,

Automated Species Identification in Camera Trap Images for Wildlife Conservation

arXiv:2609.35420v1 Announce Type: new Abstract: Wildlife conservation involves protecting, preserving, and managing wildlife species and their habitats. With today's rapid pace of human development, c

Beyond Gaussian Assumptions: Distribution-Aware Channel Capacity for Effective Connectivity

arXiv:2609.32774v1 Announce Type: new Abstract: Effective-connectivity estimation from brain signals often relies on Gaussian residual modeling, which enables tractable estimation but can discard info

CAPEX: Efficiently Distilling Foundation Model Behavior into Deployable Robot Policies through Experience-Adaptive Reasoning

arXiv:2609.33007v1 Announce Type: cross Abstract: Robot learning has largely relied on human-teleoperated demonstrations to acquire effective learnable behaviors. However, human-operated data collecti

safetyarxiv-cs-lg

CoCurve: Cross-Module Co-Pruning Curvature for Structured LLM Pruning

arXiv:2607.17568v2 Announce Type: replace Abstract: Resource-constrained deployment requires sustaining large language model (LLM) capabilities as models scale under fixed memory and computation budge

Conformal Prediction and Conditional Coverage for Tabular Foundation Models

arXiv:2609.34887v1 Announce Type: cross Abstract: Tabular foundation models (TFMs) provide predictive distributions for regression, but their prediction regions can exhibit undercoverage or overcovera

CT-OPD: Counterfactual Trace On-Policy Distillation for Diffusion Vision-Language Models

arXiv:2609.32781v1 Announce Type: new Abstract: Diffusion vision-language models generate answers by gradually resolving masked tokens, making accurate conditional prediction in partially resolved sta

CyberWorld: World Models for Sample-Efficient Autonomous Cyber Defense

arXiv:2609.31893v1 Announce Type: new Abstract: Deep reinforcement learning has become a prominent approach to autonomous cyber defense. Existing methods are predominantly model-free and consequently

agentsarxiv-cs-lg

Denoising Multi-Robot Trajectories

arXiv:2609.35651v1 Announce Type: new Abstract: Multi-robot trajectory planning is a fundamental problem in multi-robot coordination but remains computationally challenging due to its nonconvex, multi

researcharxiv-cs-ro

DS-VLA: A Dendritic-inspired Vision-Language-Action Model for Robust Action Control

arXiv:2609.32253v1 Announce Type: new Abstract: Vision-language-action (VLA) models have achieved strong performance in language-conditioned manipulation, yet success under nominal evaluation does not

researcharxiv-cs-ro

Dynamic Image Prompt Adapter for Scalable Zero-shot Personalized Text-to-Image Generation

arXiv:2512.09814v2 Announce Type: replace Abstract: Personalized Text-to-Image (PT2I) generation aims to produce customized images based on reference images. A prominent interest pertains to the integ

Evidence Before Accuracy: A MRI-PET Fusion Network for Alzheimer Disease Classification with Causal Regional Validation

arXiv:2609.34520v1 Announce Type: new Abstract: Deep learning models for Alzheimer disease (AD) classification routinely report near-perfect discrimination, yet few are shown to rest on AD-relevant ne

EyeVQA: Benchmarking Ophthalmic Vision-Language Models from Recognition to Spatial Grounding

arXiv:2609.32352v1 Announce Type: new Abstract: Vision-language models (VLMs) have shown increasing potential for medical image understanding, yet their capabilities in ophthalmic imaging remain insuf

Federated Subspace Guided Vision-Language-Action Policy Distillation for Non-IID Multi-Robot Manipulation

arXiv:2609.32239v1 Announce Type: cross Abstract: Federated learning offers a natural way for multiple robots to jointly improve manipulation policies without requiring centralized access to training

FocusDrive: Reasoning with Visual Focus for Autonomous Driving

arXiv:2609.33190v1 Announce Type: new Abstract: Driving decisions depend on both where to focus and how to act on what is seen. Effective driving reasoning must establish which objects matter, where t

agentsarxiv-cs-cv

G^3-LoRA: Organizing Reward-Weighted Video Data with Gradient-Guided Grouped LoRA

arXiv:2609.35189v1 Announce Type: new Abstract: Post-training foundation video models on heterogeneous reward-weighted data usually assume that all data categories induce compatible updates. This assu

safetyarxiv-cs-cv

Guava: Distilling Frontier VLM Agents into a Compact Model with a Manipulation Harness

arXiv:2606.18363v2 Announce Type: replace Abstract: Language models trained on large-scale vision-language data have demonstrated strong potential for embodied agents. Harnessing models through embodi

agentsarxiv-cs-ro

HeroFrame-Bench: Reference-Anchored Evaluation via Rubric--Ranking Co-Evolution for Movie Hero Frame Selection

arXiv:2609.32280v1 Announce Type: new Abstract: Hero frames are in-film stills used as source imagery for theatrical posters, streaming cover art, film database listings, and other promotional placeme

safetyarxiv-cs-cv

InterTab: Interleaved Visual-Structure Alignment for Multi-Modal Table Reasoning

arXiv:2609.32660v1 Announce Type: new Abstract: Table images preserve structural information that are often lost in text serialization, and reasoning over them requires locating relevant rows, columns

Local Ai

LEGAU: Learning Semantic Gaussian Priors for Scalable Category-level Pose Estimation

arXiv:2609.35046v1 Announce Type: new Abstract: Category-level 6D pose estimation from a single RGB-D observation is inherently under-constrained, since partial visible geometry must be interpreted to

local-aiarxiv-cs-cv

Look Before You Select: Rethinking Vocabulary Sparsification in On-Policy Distillation

model-releasesarxiv-cs-lg

arXiv:2609.34386v1 Announce Type: cross Abstract: On-policy distillation (OPD) uses teacher correction on student-generated responses. Full-vocabulary correction can provide important corrections even

Modernising the Compressed-Domain Video Captioner: A Controlled Study of SigLIP2 and GPT-2 Substitutions

arXiv:2609.31700v1 Announce Type: new Abstract: Compressed-domain video captioning avoids full video decoding by operating directly on I-frames, motion vectors and residuals, trading a small amount of

MoGround: Measuring and Mitigating Modality Distraction in Vision-Language Models

arXiv:2609.33431v1 Announce Type: new Abstract: We release MoGround, a vision-language dataset spanning four visual domains in which the answer to every question is guaranteed to be available from exa

MotionSpaceFlow: Representation-Aware Flow Matching in Direct Motion Space

arXiv:2609.34190v1 Announce Type: new Abstract: Recent advances in diffusion and flow models have substantially improved text-driven human motion generation. Yet most methods generate in low-dimension

NutriVision: Ingredient-Conditioned Fusion and Prediction for Single-Image Food Nutrition Estimation

arXiv:2609.33076v1 Announce Type: new Abstract: Nutrition estimation is a fundamental task in consumer diet tracking, clinical dietetics, chronic disease management, sports and hospital nutrition, and

OmniWeaving: Towards Unified Video Generation with Free-form Composition and Reasoning

arXiv:2603.24458v3 Announce Type: replace Abstract: While proprietary systems such as Seedance-2.0 have achieved remarkable success in omni-capable video generation, the academic research community la

One Sensor, Whole Body - 3D Body Pose from a Single Consumer Earbud IMU

arXiv:2609.34978v1 Announce Type: new Abstract: Consumer earbuds already stream inertial motion data from the head, one of the most widely worn sensor locations on the body. We ask how much of the 3D

Tutorials

Optimal Transport Dropout for Structured Predictive Uncertainty

arXiv:2609.33377v1 Announce Type: new Abstract: Deterministic neural networks and neural operators provide point predictions with no intrinsic measure of reliability. Yet, predictive uncertainty may s

tutorialsarxiv-cs-lg

Optimal transport meets speech: a tutorial review

arXiv:2609.31787v1 Announce Type: cross Abstract: Optimal Transport (OT) provides a principled framework for comparing and transforming probability distributions while preserving geometric structure.

safetyarxiv-cs-lg

PlaylistEval: Can Video-Language Judges Be Trusted at Day Scale and Beyond?

arXiv:2609.34314v1 Announce Type: new Abstract: Video-language models are increasingly used as judges of video understanding, both for evaluating model outputs and for training reward models. Whether

Applications

Rethinking Causal Action Tokenization with Conditional Annealing in Flow Matching

arXiv:2609.35469v1 Announce Type: cross Abstract: Autoregressive Vision-Language-Action (VLA) models offer a scalable path to robot learning, yet existing action tokenizers treat tokenization as a com

applicationsarxiv-cs-lg

ReVision3D: Attribution-Guided Recursive Self-Improvement for 3D Medical Perception

arXiv:2609.32984v1 Announce Type: new Abstract: Recursive self-improvement (RSI) offers a promising path for overcoming the limited visual capability of current medical imaging agents. Yet applying RS

RLE-Bench: A Qualifying Exam for Coding Agents as Robot Learning Engineers

model-releasesarxiv-cs-ro

arXiv:2609.34210v1 Announce Type: new Abstract: Coding agents are beginning to move beyond purely digital tasks to tackle physical-world challenges, particularly in robotics. Existing robotics benchma

Safe Score Matching: Diffusion Policies with Hamilton-Jacobi Reachability for Online Safe Reinforcement Learning

arXiv:2609.33337v1 Announce Type: new Abstract: Online safe reinforcement learning (RL) seeks policies that maximize reward while satisfying safety constraints. A popular line of research in safe RL r

safetyarxiv-cs-lg

T-SNN: Temporal Simplicial Neural Network for EEG Decoding

arXiv:2609.34002v1 Announce Type: new Abstract: Decoding brain states requires models that capture both the evolution of neural activity and interactions among groups of brain regions. Existing EEG me