Search: “multimodal”

Conformal Prediction and Conditional Coverage for Tabular Foundation Models

arXiv:2609.34887v1 Announce Type: cross Abstract: Tabular foundation models (TFMs) provide predictive distributions for regression, but their prediction regions can exhibit undercoverage or overcovera

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

CT-OPD: Counterfactual Trace On-Policy Distillation for Diffusion Vision-Language Models

DGX agent

arXiv:2609.32781v1 Announce Type: new Abstract: Diffusion vision-language models generate answers by gradually resolving masked tokens, making accurate conditional prediction in partially resolved sta

model-releasesarxiv-cs-cv

29 Sept 2026

CyberWorld: World Models for Sample-Efficient Autonomous Cyber Defense

arXiv:2609.31893v1 Announce Type: new Abstract: Deep reinforcement learning has become a prominent approach to autonomous cyber defense. Existing methods are predominantly model-free and consequently

agentsarxiv-cs-lg

Denoising Multi-Robot Trajectories

arXiv:2609.35651v1 Announce Type: new Abstract: Multi-robot trajectory planning is a fundamental problem in multi-robot coordination but remains computationally challenging due to its nonconvex, multi

researcharxiv-cs-ro

DS-VLA: A Dendritic-inspired Vision-Language-Action Model for Robust Action Control

arXiv:2609.32253v1 Announce Type: new Abstract: Vision-language-action (VLA) models have achieved strong performance in language-conditioned manipulation, yet success under nominal evaluation does not

researcharxiv-cs-ro

Dynamic Image Prompt Adapter for Scalable Zero-shot Personalized Text-to-Image Generation

arXiv:2512.09814v2 Announce Type: replace Abstract: Personalized Text-to-Image (PT2I) generation aims to produce customized images based on reference images. A prominent interest pertains to the integ

Evidence Before Accuracy: A MRI-PET Fusion Network for Alzheimer Disease Classification with Causal Regional Validation

arXiv:2609.34520v1 Announce Type: new Abstract: Deep learning models for Alzheimer disease (AD) classification routinely report near-perfect discrimination, yet few are shown to rest on AD-relevant ne

EyeVQA: Benchmarking Ophthalmic Vision-Language Models from Recognition to Spatial Grounding

arXiv:2609.32352v1 Announce Type: new Abstract: Vision-language models (VLMs) have shown increasing potential for medical image understanding, yet their capabilities in ophthalmic imaging remain insuf

Federated Subspace Guided Vision-Language-Action Policy Distillation for Non-IID Multi-Robot Manipulation

arXiv:2609.32239v1 Announce Type: cross Abstract: Federated learning offers a natural way for multiple robots to jointly improve manipulation policies without requiring centralized access to training

FocusDrive: Reasoning with Visual Focus for Autonomous Driving

arXiv:2609.33190v1 Announce Type: new Abstract: Driving decisions depend on both where to focus and how to act on what is seen. Effective driving reasoning must establish which objects matter, where t

agentsarxiv-cs-cv

G^3-LoRA: Organizing Reward-Weighted Video Data with Gradient-Guided Grouped LoRA

arXiv:2609.35189v1 Announce Type: new Abstract: Post-training foundation video models on heterogeneous reward-weighted data usually assume that all data categories induce compatible updates. This assu

Guava: Distilling Frontier VLM Agents into a Compact Model with a Manipulation Harness

arXiv:2606.18363v2 Announce Type: replace Abstract: Language models trained on large-scale vision-language data have demonstrated strong potential for embodied agents. Harnessing models through embodi

agentsarxiv-cs-ro

HeroFrame-Bench: Reference-Anchored Evaluation via Rubric--Ranking Co-Evolution for Movie Hero Frame Selection

arXiv:2609.32280v1 Announce Type: new Abstract: Hero frames are in-film stills used as source imagery for theatrical posters, streaming cover art, film database listings, and other promotional placeme

InterTab: Interleaved Visual-Structure Alignment for Multi-Modal Table Reasoning

arXiv:2609.32660v1 Announce Type: new Abstract: Table images preserve structural information that are often lost in text serialization, and reasoning over them requires locating relevant rows, columns

Local Ai

LEGAU: Learning Semantic Gaussian Priors for Scalable Category-level Pose Estimation

arXiv:2609.35046v1 Announce Type: new Abstract: Category-level 6D pose estimation from a single RGB-D observation is inherently under-constrained, since partial visible geometry must be interpreted to

local-aiarxiv-cs-cv

Look Before You Select: Rethinking Vocabulary Sparsification in On-Policy Distillation

model-releasesarxiv-cs-lg

arXiv:2609.34386v1 Announce Type: cross Abstract: On-policy distillation (OPD) uses teacher correction on student-generated responses. Full-vocabulary correction can provide important corrections even

Modernising the Compressed-Domain Video Captioner: A Controlled Study of SigLIP2 and GPT-2 Substitutions

arXiv:2609.31700v1 Announce Type: new Abstract: Compressed-domain video captioning avoids full video decoding by operating directly on I-frames, motion vectors and residuals, trading a small amount of

MoGround: Measuring and Mitigating Modality Distraction in Vision-Language Models

arXiv:2609.33431v1 Announce Type: new Abstract: We release MoGround, a vision-language dataset spanning four visual domains in which the answer to every question is guaranteed to be available from exa

MotionSpaceFlow: Representation-Aware Flow Matching in Direct Motion Space

arXiv:2609.34190v1 Announce Type: new Abstract: Recent advances in diffusion and flow models have substantially improved text-driven human motion generation. Yet most methods generate in low-dimension

NutriVision: Ingredient-Conditioned Fusion and Prediction for Single-Image Food Nutrition Estimation

arXiv:2609.33076v1 Announce Type: new Abstract: Nutrition estimation is a fundamental task in consumer diet tracking, clinical dietetics, chronic disease management, sports and hospital nutrition, and

OmniWeaving: Towards Unified Video Generation with Free-form Composition and Reasoning

arXiv:2603.24458v3 Announce Type: replace Abstract: While proprietary systems such as Seedance-2.0 have achieved remarkable success in omni-capable video generation, the academic research community la

One Sensor, Whole Body - 3D Body Pose from a Single Consumer Earbud IMU

arXiv:2609.34978v1 Announce Type: new Abstract: Consumer earbuds already stream inertial motion data from the head, one of the most widely worn sensor locations on the body. We ask how much of the 3D

Tutorials

Optimal Transport Dropout for Structured Predictive Uncertainty

arXiv:2609.33377v1 Announce Type: new Abstract: Deterministic neural networks and neural operators provide point predictions with no intrinsic measure of reliability. Yet, predictive uncertainty may s

tutorialsarxiv-cs-lg

Optimal transport meets speech: a tutorial review

arXiv:2609.31787v1 Announce Type: cross Abstract: Optimal Transport (OT) provides a principled framework for comparing and transforming probability distributions while preserving geometric structure.

safetyarxiv-cs-lg

PlaylistEval: Can Video-Language Judges Be Trusted at Day Scale and Beyond?

arXiv:2609.34314v1 Announce Type: new Abstract: Video-language models are increasingly used as judges of video understanding, both for evaluating model outputs and for training reward models. Whether

Applications

Rethinking Causal Action Tokenization with Conditional Annealing in Flow Matching

arXiv:2609.35469v1 Announce Type: cross Abstract: Autoregressive Vision-Language-Action (VLA) models offer a scalable path to robot learning, yet existing action tokenizers treat tokenization as a com

applicationsarxiv-cs-lg

ReVision3D: Attribution-Guided Recursive Self-Improvement for 3D Medical Perception

arXiv:2609.32984v1 Announce Type: new Abstract: Recursive self-improvement (RSI) offers a promising path for overcoming the limited visual capability of current medical imaging agents. Yet applying RS

RLE-Bench: A Qualifying Exam for Coding Agents as Robot Learning Engineers

model-releasesarxiv-cs-ro

arXiv:2609.34210v1 Announce Type: new Abstract: Coding agents are beginning to move beyond purely digital tasks to tackle physical-world challenges, particularly in robotics. Existing robotics benchma

Safe Score Matching: Diffusion Policies with Hamilton-Jacobi Reachability for Online Safe Reinforcement Learning

arXiv:2609.33337v1 Announce Type: new Abstract: Online safe reinforcement learning (RL) seeks policies that maximize reward while satisfying safety constraints. A popular line of research in safe RL r

safetyarxiv-cs-lg

T-SNN: Temporal Simplicial Neural Network for EEG Decoding

arXiv:2609.34002v1 Announce Type: new Abstract: Decoding brain states requires models that capture both the evolution of neural activity and interactions among groups of brain regions. Existing EEG me

Token-Disentangled Latent Test-Time Scaling for Vision-Language Reasoning

arXiv:2609.35228v1 Announce Type: new Abstract: Latent test-time scaling improves reasoning by refining hidden states during inference, but existing methods typically apply a single scalar reward to a

TTRSD: Test-Time Reinforcement Learning with Self-Distillation for Vision-Language Models

arXiv:2609.33414v1 Announce Type: new Abstract: Test-time reinforcement learning enables vision-language models (VLMs) to adapt using unlabeled inputs. However, repeated sampling under fixed visual co

Tutorials

Uni-VLaT: Whole-Body Tactile Adaptation of VLA Policies for Humanoid Loco-Manipulation

arXiv:2609.35450v1 Announce Type: new Abstract: Physical contact often determines how a humanoid should respond during loco-manipulation, yet vision and proprioception alone are often insufficient to

tutorialsarxiv-cs-ro

Vision-Language Agents for Active Perception in Optics Laboratories

arXiv:2609.32918v1 Announce Type: cross Abstract: Vision-language models (VLMs) are increasingly being used in scientific workflows, but their ability as agents to directly control laboratory experime

agentsarxiv-cs-cv

VL-AcneSeg: A Vision-Language Framework for Region-Aware Acne Lesion Segmentation

arXiv:2609.34472v1 Announce Type: new Abstract: Acne assessment is crucial for clinical decision-making, yet traditional grading and counting are subjective and fail to account for lesion size. While

WSM-Aware HRI: An IoT-Enhanced Framework for Early Detection and Norm-Guided Repair of Failures with LLM Guidance

arXiv:2609.32336v1 Announce Type: new Abstract: Human-robot interaction (HRI) failures remain a major barrier to deploying robots in real-world environments. Prior work often treats failures as isolat

safetyarxiv-cs-ro

Amplify What You Gaze At: Target Saliency Boosting in Text-to-Image Generation

arXiv:2609.30733v1 Announce Type: new Abstract: Text-to-image generation has advanced in controlling what, where, and how objects appear, yet how visual attention is distributed among objects remains

BAT-CLIP: Trimodal Alignment of Brain, Audio and Text

model-releasesarxiv-cs-ai

arXiv:2609.31180v1 Announce Type: cross Abstract: Decoding and interpreting naturalistic speech from the brain increasingly relies on alignment to pretrained speech and language representation spaces.

Block Sparse Attention with Log-Linear Complexity

arXiv:2609.31093v1 Announce Type: new Abstract: Scaling language models to long contexts is limited by the quadratic cost of self-attention. Block sparse attention offers an efficient alternative, but

CCRV-Bench: Constraint-Based Evaluation of Causal Reasoning in Vision-Language Models

arXiv:2609.30979v1 Announce Type: new Abstract: Vision-language models (VLMs) have demonstrated excellent performance in visual tasks, but their visual causal reasoning capabilities still lack reliabl

CG-Probes: Recovering Guardrail Directions from Patient Query Embeddings

arXiv:2609.31062v1 Announce Type: new Abstract: Patient-facing AI assistants promise valuable support to patients, but incoming queries can pose medical risks. To create guardrails, we work with oncol

safetyarxiv-cs-cl

EmoZone-Talker: Regional Semantic Control of Audio-Driven 3DGS Talking Heads via Facial Action Units

arXiv:2606.15848v2 Announce Type: replace Abstract: 3D Gaussian Splatting (3DGS) has shown strong potential for high-fidelity talking head synthesis. However, enabling fine-grained, interpretable, and

From Reward Signal to Visual Utility: A Controlled Audit of Medical VLM Post-Training

model-releasesarxiv-cs-ai

arXiv:2609.31450v1 Announce Type: cross Abstract: Medical vision-language model (VLM) post-training is commonly evaluated through answer accuracy. We examine how changes in accuracy and training objec

HybridInfer: Thermal-Aware Reinforcement-Learning Tier Routing for On-Device, Edge, and Cloud LLM Inference

model-releasesarxiv-cs-lg

arXiv:2609.30270v1 Announce Type: new Abstract: On-device inference with small language models keeps user data local, works offline, and incurs no per-query cost, so the on-device tier is preferred wh

MDSkin-Net: Multi-Task Skin Lesion Analysis Driven by Pattern Analysis Priors and Spatial Alignment Regularization

arXiv:2609.30855v1 Announce Type: new Abstract: Reliable skin lesion segmentation and classification are central to dermoscopic computer-aided diagnosis. Existing multi-task frameworks couple the two

MexHat: A Dataset for Hate Speech Detection in Mexican Spanish Videos

arXiv:2609.31553v1 Announce Type: new Abstract: Ensuring online safety through content monitoring had raised Hate Speech Detection as a crucial task to be addressed. By essence the task demands the ca

safetyarxiv-cs-cl

Peer Review as Structured Commentary: Immutable Identity, Public Dialogue, and Reproducible Scholarship

arXiv:2506.22497v2 Announce Type: replace-cross Abstract: This paper reconceptualises peer review as structured public commentary. Traditional academic validation is hindered by anonymity, latency, an

researcharxiv-cs-ai

PHASE: Compliance-Enabled Tactile Phase Retrieval for Few-Shot Insertion Learning

arXiv:2609.30889v1 Announce Type: new Abstract: Contact-rich assembly tasks such as peg-in-hole insertion remain difficult to learn from limited demonstrations. While retrieval-augmented imitation lea

safetyarxiv-cs-ro