Search: “multimodal”

A robust single-sensing-element tactile sensor for concurrent pressure and tackiness detection with real-time signal decoupling capability

arXiv:2609.36558v1 Announce Type: new Abstract: Integrating tackiness sensation into the artificial skin of humanoid robots significantly enhances their cognitive and operational capabilities. However

researcharxiv-cs-ro

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

AerialDojo-200K: A Large-Scale Benchmark Suite for Open-World Aerial Object-Goal Search

DGX agent

arXiv:2609.36066v1 Announce Type: cross Abstract: Open-world aerial object-goal search is a foundational yet challenging task, requiring aerial agents to autonomously explore large-scale, unstructured

model-releasesarxiv-cs-ai

30 Sept 2026

All Roads Lead to Rome: Flow-driven Multi-Anchor Exploration for Open-Environment Active 3D Mapping

arXiv:2609.36889v1 Announce Type: new Abstract: To advance the development of embodied intelligence, Open-Environment Active 3D Mapping has attracted increasing attention, aiming to perform a long-hor

researcharxiv-cs-ro

Behavioral Capacity Certificates for Quantized Language Models

arXiv:2609.37887v1 Announce Type: new Abstract: Activation and key-value cache precision change what a quantized language model computes without altering its stored weights. Direct weight-code bounds,

Beyond Binary Preferences: Graded Preference Optimization for Limb-Motion Captioning

arXiv:2609.36628v1 Announce Type: new Abstract: Vision-Language Models (VLMs) can generate rich video captions, yet often misidentify which person performs an action or which limb is involved, particu

Bootstrapping Audiovisual Speech Recognition in Zero-AV-Resource Scenarios

model-releasesarxiv-cs-cl

arXiv:2603.08249v2 Announce Type: replace-cross Abstract: Audiovisual speech recognition (AVSR) combines acoustic and visual cues to improve transcription robustness under challenging conditions but r

Can We Still Trust Disaster Social Sensing? Empirical Evidence on Detecting AI-Generated Social Media Posts

arXiv:2609.35821v1 Announce Type: new Abstract: Disaster social sensing converts public social-media posts into evidence for situational awareness and humanitarian needs, but generative artificial int

researcharxiv-cs-cl

Causal-EVC: Breaking Emotional Spurious Causality via Spatiotemporal Grounding and Counterfactual Intervention

arXiv:2609.36776v1 Announce Type: new Abstract: Emotional Video Captioning aims to generate factually accurate and emotionally empathetic descriptions. While recent methods have recognized the importa

Embodied Semantic Communication for Collective Autonomous Agents: A Tutorial on Representation, Wireless Delivery, and Closed-Loop Coordination

arXiv:2609.35936v1 Announce Type: cross Abstract: As autonomous systems and embodied intelligence enter the dynamic physical world, multi-agent collaboration calls for a paradigm shift in communicatio

agentsarxiv-cs-ai

EnergyEminence: Source-Aware Environmental Calibration and Evaluation in a Physics-Grounded Grid Digital Twin

arXiv:2609.36215v1 Announce Type: new Abstract: Power-grid digital twins must combine data-driven prediction with physically meaningful state evolution while preserving the provenance of environmental

Tutorials

EnJoi: Ensemble Joint Score Filter for Generative Data Assimilation

arXiv:2609.35944v1 Announce Type: new Abstract: Data Assimilation (DA) aims to recover the full state of a dynamical system that is only partially observed. A solution is to use Score-based models to

tutorialsarxiv-cs-lg

Explore, Execute, Evolve: A Skill Acquisition and Reuse Loop for Embodied Agents

arXiv:2609.37810v1 Announce Type: cross Abstract: Vision-language-action and world-action models have demonstrated impressive capabilities in robotics, yet generalization to unseen tasks remains chall

agentsarxiv-cs-ai

From Sharp Eyes to Expert Mind: Internalizing Expert Knowledge in MLLMs for Tampered Text Detection

arXiv:2609.36145v1 Announce Type: new Abstract: Tampered Text Detection (TTD) is essential for safeguarding document authenticity in security-critical workflows. Existing expert models are effective a

safetyarxiv-cs-cv

Local Ai

From Surfaces to Volumes: Registered Geometry for Protein Representation Learning

arXiv:2609.36277v1 Announce Type: new Abstract: Existing protein geometry models typically represent molecular surfaces using local geometric features such as sampled points, normals, and curvature. W

local-aiarxiv-cs-ai

GlassFormer: Learning Real-time Glass Segmentation using Radar-Depth Fusion

arXiv:2609.36844v1 Announce Type: new Abstract: Transparent surfaces are ubiquitous in built environments, yet they remain a persistent failure case for robotic perception. RGB cameras perceive the ba

GraphVQ: Structure-Aware Autoregressive Decoding over Context-Quantized Graph Tokens

arXiv:2609.37604v1 Announce Type: new Abstract: Graph foundation models need a discrete token representation, but casting a graph as a generatable token sequence faces a structural obstacle: edges spa

High-Dimensional Partial Least Squares: Spectral Analysis and Fundamental Limitations

arXiv:2512.15684v2 Announce Type: replace-cross Abstract: Partial Least Squares (PLS) is a widely used method for data integration, designed to extract latent components shared across paired high-dime

safetyarxiv-cs-lg

How Language Models Differ in Redistributing Attention-Head Activity Under Serial Demand

model-releasesarxiv-cs-lg

arXiv:2609.36221v1 Announce Type: new Abstract: The way a model distributes activity over each layer's attention heads offers a coarse view of how it routes information through depth; how this changes

How Medical VLMs Underutilize Their Vision Encoders: A Dermatology Perspective

arXiv:2609.36557v1 Announce Type: cross Abstract: Medical Vision-Language Models (VLMs) show significant promise for clinical image understanding, offering accurate diagnosis with interpretable reason

researcharxiv-cs-ai

Interpolated Policy Distillation: A Controllable Continuum Between Off-Policy and On-Policy Distillation

arXiv:2609.37170v1 Announce Type: cross Abstract: Off-policy and on-policy distillation have traditionally been formulated as separate paradigms, each favoring a different property of distillation tra

safetyarxiv-cs-ai

Koa-action: Fast and Consistent Structured Decision Making with Generative LLMs

model-releasesarxiv-cs-lg

arXiv:2609.36115v1 Announce Type: new Abstract: Industry applications often demand low-latency classification, yet current large language model (LLM) approaches remain poorly suited for latency-critic

LazySloth: Bounded LLM-based Lazy Tree Search for Fast Long Video Comprehension

model-releasesarxiv-cs-ai

arXiv:2609.37426v1 Announce Type: cross Abstract: Modern vision-language models (VLMs) have shown promising results in long-video understanding due to the rich semantic information they can capture. H

LongLive-Plug: Once-for-All Distillation for Video Generation

arXiv:2609.38154v1 Announce Type: new Abstract: Video diffusion models are increasingly developed into specialized models for diverse downstream tasks, and this development often includes a distillati

Local Ai

On-Policy Visual Evidence Distillation

arXiv:2609.36838v1 Announce Type: cross Abstract: Visual agents solve problems by interleaving reasoning with image operations, and on-policy distillation (OPD) provides guidance from a strong teacher

local-aiarxiv-cs-ai

PDE-OBS: Controlled Evaluation Across Observation Patterns

model-releasesarxiv-cs-lg

arXiv:2609.36521v2 Announce Type: new Abstract: Physical-field reconstruction and forecasting depend on both measurement density and spatial layout, yet evaluation under a single observation pattern d

Physical Cross-Modal Masked Autoencoding for Seismic-to-Well Representation Learning

arXiv:2609.36193v1 Announce Type: new Abstract: Learning from scientific measurements often requires aligning modalities with different spatial support and resolution. Subsurface characterization is a

POET: Preference Optimization for Enhanced Text-to-Image Generation

arXiv:2510.12041v3 Announce Type: replace Abstract: Recent advances in text-to-image (T2I) generation have achieved impressive results, yet existing models often struggle with simple or underspecified

safetyarxiv-cs-cl

Render Before Reading: Visual Rendering as a Prompt Injection Defense

arXiv:2609.36121v1 Announce Type: cross Abstract: Large language models are vulnerable to prompt injection attacks, where third-party adversarial content can hijack the model's behavior. In this paper

researcharxiv-cs-ai

S^3: Spectral Null-Space Swap Makes Reasoning Models Efficient

arXiv:2609.37976v1 Announce Type: cross Abstract: LLMs trained with Chain-of-thought excel in reasoning capability, but often come with excessive token cost. We find that the core of reasoning capacit

researcharxiv-cs-ai

Seeing What Should Be Heard: Diagnosing and Repairing Cross-Modal Shortcuts in Omni-Modal LLMs

model-releasesarxiv-cs-cl

arXiv:2609.36798v1 Announce Type: cross Abstract: Omni-modal large language models (LLMs) are expected to answer a question using the modality it explicitly refers to. However, existing training parad

Tutorials

SYNCR: Diagnosing and Learning Cross-Video Reasoning from Simulation

arXiv:2609.37918v1 Announce Type: new Abstract: Reasoning across videos requires aligning events, matching identities, comparing motion, and integrating partial observations. Evaluating these capabili

tutorialsarxiv-cs-cv

Text2Sim: Agentic Physics-Based Simulation Generation with Distilled Expertise

arXiv:2609.36593v1 Announce Type: cross Abstract: Creating diverse physical simulations remains labor-intensive because assets, layout, physical parameters, motion, control, and rendering must be desi

agentsarxiv-cs-ai

The Vote Hides the Failure: Aggregation Choice and Noise Robustness in Heart Murmur Detection

arXiv:2609.37161v1 Announce Type: new Abstract: Noise robustness in automated phonocardiogram (PCG) murmur detection, and how it is measured, remains underexamined despite growing interest in low-reso

Local Ai

UniAfford: Token-Routed Multitask Learning for Generalizable 2D-3D Affordance Perception

arXiv:2609.37264v1 Announce Type: cross Abstract: Affordance perception aims to localize actionable regions supporting embodied interaction, yet 2D and 3D affordance grounding have evolved as separate

local-aiarxiv-cs-ai

V2X-WAM: A Cooperative World Action Model for End-to-End Autonomous Driving

arXiv:2609.37098v1 Announce Type: cross Abstract: Vehicle-infrastructure cooperation can complement onboard sensing with broader and more informative observations of the traffic environment, providing

safetyarxiv-cs-cv

WayFinder: Hierarchical Visual-Language-Action for Zero-Shot Waypoint Generation and Low-Level Kinematic Control

arXiv:2609.37922v1 Announce Type: new Abstract: Visual Language Action (VLA) models offer unprecedented generalization for autonomous robots; however, their real-world deployment is frequently bottlen

safetyarxiv-cs-ro

When Semantics Matter: Reliability-Aware Semantic-Rhythm Control for Co-Speech Gesture Generation

arXiv:2609.36685v1 Announce Type: new Abstract: Co-speech gesture generation aims to synthesize natural gestures that are both temporally synchronized with speech and semantically consistent with the

Advancing Video-Text Pretraining with Multi-View Captions

arXiv:2609.35090v1 Announce Type: new Abstract: Video-text pretraining has achieved remarkable progress through the scaling of models and datasets, yet the quality of language supervision remains unde

Agentic Video Understanding: A Survey

arXiv:2609.31713v1 Announce Type: new Abstract: As large language models (LLMs) become capable of processing increasingly diverse modalities and longer temporal contexts, an emerging line of work is m

agentsarxiv-cs-cv

AI-driven ionic liquid discovery with unified chemical intelligence

arXiv:2511.11257v2 Announce Type: replace-cross Abstract: The rational discovery of functional solvents remains challenging because macroscopic solvent behaviors emerge from complex many-body interact

agentsarxiv-cs-lg

Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligence

arXiv:2609.32041v1 Announce Type: new Abstract: Modern Document AI reads contracts, extracts fields, reasons over tables, and grounds answers to page regions, then forgets everything. Processing an am

Attribution Gaps in Zero-Training LLM+OVOD Pipelines: A Fine-Grained Analysis of the CAAP--SNAP Discrepancy

arXiv:2609.32567v1 Announce Type: new Abstract: LAOD and similar zero-training LLM+open-vocabulary-detector (OVOD) pipelines score two things separately: class-agnostic localization accuracy (CAAP) an

Tutorials

Augmenting Visual Anomaly Detection with Automated Interpretability

arXiv:2609.33818v1 Announce Type: new Abstract: Visual anomaly detectors identify deviations from known-normal data, but their anomaly signals may mix evidence of actual anomalies with benign visual v

tutorialsarxiv-cs-cv

Automated Lesion Segmentation of Stroke MRI Using nnU-Net: A Comprehensive External Validation Across Acute and Chronic Lesions

arXiv:2601.08701v2 Announce Type: replace-cross Abstract: Accurate and generalisable segmentation of stroke lesions from magnetic resonance imaging (MRI) is essential for advancing clinical research,

Automated Species Identification in Camera Trap Images for Wildlife Conservation

arXiv:2609.35420v1 Announce Type: new Abstract: Wildlife conservation involves protecting, preserving, and managing wildlife species and their habitats. With today's rapid pace of human development, c

Beyond Gaussian Assumptions: Distribution-Aware Channel Capacity for Effective Connectivity

arXiv:2609.32774v1 Announce Type: new Abstract: Effective-connectivity estimation from brain signals often relies on Gaussian residual modeling, which enables tractable estimation but can discard info

CAPEX: Efficiently Distilling Foundation Model Behavior into Deployable Robot Policies through Experience-Adaptive Reasoning

arXiv:2609.33007v1 Announce Type: cross Abstract: Robot learning has largely relied on human-teleoperated demonstrations to acquire effective learnable behaviors. However, human-operated data collecti

safetyarxiv-cs-lg

CoCurve: Cross-Module Co-Pruning Curvature for Structured LLM Pruning

arXiv:2607.17568v2 Announce Type: replace Abstract: Resource-constrained deployment requires sustaining large language model (LLM) capabilities as models scale under fixed memory and computation budge