Search: “multimodal”

Integrated Sensing and Communications for Real-time Avatar Control in XR over 5G

arXiv:2606.23771v1 Announce Type: cross Abstract: Extended Reality (XR) presents a challenging use case for 5G and 6G networks, requiring high data-rates and lowlatency communication to deliver a trul

researcharxiv-cs-ai

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

LecturaAgents: A Multi-Agent Framework for Adaptive Personalized AI-Assisted Learning and Embodied Teaching

DGX agent

arXiv:2606.16428v2 Announce Type: replace-cross Abstract: Effective personalized AI-assisted learning demands systems that can not only generate accurate learner-specific educational materials, but al

safetyarxiv-cs-ai

24 Jun 2026

Agents

MM-TRELLIS: Point-Cloud Guided Multi-Modal 3D Vehicle Generation in Autonomous Driving

arXiv:2606.24301v1 Announce Type: new Abstract: Recovering realistic 3D vehicle models from autonomous driving scenes is crucial for synthesizing training data and building simulation environment. How

agentsarxiv-cs-cv

Local Ai

MOCHA: Multi-modal Objects-aware Cross-arcHitecture Alignment

arXiv:2509.14001v5 Announce Type: replace-cross Abstract: Personalized object detection aims to adapt a general-purpose detector to recognize user-specific instances from only a few examples. Lightwei

local-aiarxiv-cs-ai

Tutorials

NoContactNoWorries: Estimating Contact through Vision and Proprioception for In-Hand Dexterous Manipulation

arXiv:2606.24450v1 Announce Type: cross Abstract: Perceiving physical contact is fundamental to dexterous manipulation. While robots often rely on dedicated hardware tactile sensors, humans exhibit a

tutorialsarxiv-cs-ai

PixJail: Self-Evolving Paper-to-Pipeline Reproduction for Text-to-Image Jailbreak Evaluation

arXiv:2606.24081v1 Announce Type: cross Abstract: As Text-to-Image (T2I) jailbreak techniques evolve rapidly, existing benchmarks and reproduction workflows often struggle to keep pace. More important

safetyarxiv-cs-ai

REALM: A Unified Red-Teaming Benchmark for Physical-World VLMs

arXiv:2606.23892v1 Announce Type: new Abstract: Vision-language models (VLMs) are increasingly used as perception-reasoning backbones for embodied intelligence in safety-critical physical systems, whe

RetiSEM: Generalising Causal Models for Fragmented Biomedical Data

model-releasesarxiv-cs-ai

arXiv:2606.24488v1 Announce Type: cross Abstract: Learning causal models from fragmented biomedical data is challenging because clinical, molecular, and imaging variables are often incomplete or not j

Tri-Efficient Transfer Learning for Point Cloud Videos

arXiv:2606.24175v1 Announce Type: new Abstract: While point cloud foundation models have significantly advanced point cloud video understanding, existing parameter-efficient fine-tuning (PEFT) methods

UniRED: Unified RGB-D Video Frame Interpolation with Event Guidance

arXiv:2606.24282v1 Announce Type: new Abstract: High frame-rate RGB-D videos are crucial for a variety of downstream tasks, including motion analysis, dynamic scene understanding, and 3D reconstructio

4DVLT: Dynamic Scene Understanding with Worldline-Centered Vision-Language Tracking

arXiv:2606.22631v1 Announce Type: new Abstract: 4D dynamic scene understanding requires grounding language to a persistent worldline that binds identity, metric 3D motion, and synchronized multi-view

A UAV-Mounted Sensor Network for Close-Range Inspection of Wind Turbine Rotor Blades

arXiv:2606.21220v1 Announce Type: new Abstract: Inspection of offshore wind turbine rotor blades is critical for predictive maintenance to maximise efficiency and extend operational lifetime. However,

researcharxiv-cs-ro

Atomistic Language Models Understand and Generate Materials

model-releasesarxiv-cs-lg

arXiv:2606.21395v1 Announce Type: new Abstract: Atomistic structure and natural language have long been modeled separately, with language models either calling atomistic models as tools or being fine-

Automated sign detection across the Electronic Babylonian Library: A large-scale dataset and end-to-end cuneiform OCR pipeline

arXiv:2606.22608v1 Announce Type: new Abstract: Learning to read cuneiform tablets is an extremely demanding task; consequently, of the roughly half million excavated tablets, only a small fraction ha

Beyond 'One Language, One Script': Quantifying Orthographic Bias in Multilingual VLMs with PuMVR

model-releasesarxiv-cs-lg

arXiv:2606.20770v1 Announce Type: cross Abstract: Current Vision-Language Models (VLMs) are celebrated for their multilingual capabilities, yet they operate under a flawed assumption: that one languag

CDER-SME: A Cross-Device Event-RGB Micro-Expression Dataset under Multi-Level Stress Induction

arXiv:2606.20715v1 Announce Type: new Abstract: Micro-expression recognition (MER) in realistic scenarios demands high temporal sensitivity and ecological validity, yet existing benchmarks are largely

Applications

Changing Modalities: Adapting Remote Sensing Models to New Satellites and Sensors

arXiv:2606.23356v1 Announce Type: new Abstract: Machine learning models for remote sensing are trained and deployed on a static set of modalities. However, as we equip newer satellites with novel sens

applicationsarxiv-cs-cv

Cross-Modal Corroboration for Annotation-Free Wildlife Monitoring

arXiv:2606.21613v1 Announce Type: new Abstract: Scaling wildlife monitoring for real-world conservation deployments requires automated analysis of smart sensors that operate under severe annotation sc

Data-Driven Image Registration and Deformation Modeling for Image-Guided Neurosurgery: A Systematic Review

arXiv:2602.10155v2 Announce Type: replace-cross Abstract: Accurate compensation of brain deformation is critical for reliable image-guided neurosurgery. Surgical manipulation and tumor resection induc

Decoupling the Declarative from the Procedural in Vision-Language-Action Models

arXiv:2606.21496v1 Announce Type: cross Abstract: Deploying generalist robotic agents in the real world requires transferable skills. Specifically, a policy trained to clone a behavior from object-spe

Deep learning-based detection of cessation of breathing in pre-term infants

arXiv:2606.23213v1 Announce Type: new Abstract: Apnoea of prematurity is characterised by recurrent episodes of cessation of breathing and remains difficult to detect reliably using routinely monitore

Dense Reward for Multi-View 3D Reasoning with Global Maps and Local Views

arXiv:2606.23557v1 Announce Type: new Abstract: Multi-view 3D Visual Question Answering (MV3D-VQA) requires integrating partial observations into a coherent 3D scene representation and selecting infor

Tutorials

Diffusion-Driven State Space Models

arXiv:2606.21036v1 Announce Type: cross Abstract: In many domains, practitioners seek models that produce accurate forecasts while faithfully capturing latent system dynamics. Existing approaches typi

tutorialsarxiv-cs-lg

Distribution-Aware Diffusion-LLM for Robust Ultra-Long-Term Time Series Forecasting

arXiv:2606.23391v1 Announce Type: new Abstract: Time series forecasting is a fundamental machine learning task. Recent work has explored Large Language Models (LLMs) for this purpose due to their stro

safetyarxiv-cs-lg

EasyUUV: An LLM-Enhanced Universal and Lightweight Sim-to-Real Reinforcement Learning Framework for UUV Attitude Control

arXiv:2510.22126v3 Announce Type: replace Abstract: Despite recent advances in Unmanned Underwater Vehicle (UUV) attitude control, existing methods still struggle with generalizability, robustness to

safetyarxiv-cs-ro

EmbodiedUS-FS: Fast Slow Intelligence for Ultrasound Robotics

arXiv:2606.22319v1 Announce Type: cross Abstract: Robotic ultrasound scanning in real clinical environments requires both high-level clinical workflow reasoning and low-level closed-loop execution. Ph

Agents

Empowering Embodied AI in 6G Networks: Architecture, Enablers, and Open Challenges

arXiv:2606.20592v1 Announce Type: cross Abstract: Embodied artificial intelligence (AI) is emerging as a key driver of the sixth-generation (6G) wireless networks by enabling agents that continuously

agentsarxiv-cs-lg

Hardware

FleetAgent: Teleoperation Assistant for Autonomous Fleets via Vectorized V2N Messages

arXiv:2606.21222v1 Announce Type: new Abstract: Large-scale autonomous fleets rely on teleoperation to resolve rare failures, yet streaming raw sensor data from many vehicles is costly, and remote ope

hardwarearxiv-cs-ro

Foundation Models for Epileptogenic Zone Identification in Drug-Resistant Epilepsy

arXiv:2606.22657v1 Announce Type: new Abstract: Accurate identification of the epileptogenic zone (EZ) is essential for seizure freedom after resective surgery in drug-resistant epilepsy, yet seizure

Applications

Generative Robust Optimisation

arXiv:2606.22536v1 Announce Type: new Abstract: Classical uncertainty sets for robust optimisation impose fixed geometric shapes that cannot represent the complex dependencies present in real-world da

applicationsarxiv-cs-lg

GEOPHYS: The Geometry of Physical Plausibility

arXiv:2606.20707v1 Announce Type: new Abstract: While humans can identify physically implausible events within milliseconds, machine learning approaches addressing the same problem are extremely slow

Gold Points Sniper: Self-guided Visual Reasoning in VLM for Fine-grained Action Understanding

arXiv:2606.22409v1 Announce Type: new Abstract: Robots operating in everyday environments must understand fine-grained human actions, intentions, and contextual cues from broad views where people occu

Local Ai

GreenRFM: Learning a resource-efficient radiology vision-language foundation model via supervision-centric pre-training

arXiv:2603.06467v2 Announce Type: replace Abstract: Radiology foundation models (RFMs) have largely inherited the scale-first recipe of natural-image vision--language pre-training. This recipe is diff

local-aiarxiv-cs-cv

HERO: Hypothesis-Driven Evidence Retrieval from Omics for Multi-Task Breast Cancer Analysis

arXiv:2606.21174v1 Announce Type: new Abstract: Matched multi-omics can improve WSI-based biomarker and prognosis prediction, but most existing pipelines use omics as a paral lel feature stream or tex

Intrinsic Flow Matching on Quantum Pure-State Manifolds with Phase-Aligned Transport

arXiv:2606.21256v1 Announce Type: new Abstract: Quantum pure-state ensembles live on complex projective space, making flat Euclidean generative modeling geometrically mismatched. We introduce Intrinsi

Local Ai

Johnson-Lindenstrauss Lemma Guided Network for Efficient 3D Medical Segmentation

arXiv:2509.22307v2 Announce Type: replace Abstract: Lightweight 3D medical image segmentation remains constrained by a fundamental extit{``efficiency / robustness conflict''}, particularly when proces

local-aiarxiv-cs-cv

JPPD: Joint Prediction_Planning Diffusion with Differentiable Safety Guidance for Dynamic Obstacle Avoidance in Intelligent Transportation Systems

arXiv:2606.20686v1 Announce Type: new Abstract: Shared-space transportation operation requires low-speed autonomous platforms to navigate safely and efficiently among pedestrians, service robots, micr

safetyarxiv-cs-ro

Jury Duty: Calibration and Orientation Failures in MLLM-as-a-Judge Under Cultural Ambiguity

arXiv:2606.20676v1 Announce Type: new Abstract: MLLM-as-a-Judge is conventionally validated by agreement with human annotations, but this metric is undefined when the human pool is culturally heteroge

MEDLAYXPLAIN: Benchmarking the Expert-Lay Gap in Medical Vision-Language Models

arXiv:2606.21194v1 Announce Type: new Abstract: Medical Vision-Language Models (Med-VLMs) achieve strong expert-level performance, yet their ability to generate patient-accessible descriptions remains

MILE: A Mechanically Isomorphic Exoskeleton Data Collection System with Fingertip Visuotactile Sensing for Dexterous Manipulation

arXiv:2512.00324v3 Announce Type: replace-cross Abstract: Imitation learning provides a promising approach to dexterous hand manipulation, but its effectiveness is limited by the lack of large-scale,

Tutorials

MIRCaps: A Large-Scale Mixed-Domain Dataset with Image-Level and Region-Level Captions for Fine-Grained Vision-Language Learning

arXiv:2606.21419v1 Announce Type: new Abstract: Despite recent progress in Vision-Language Models (VLMs), mixed-domain image-caption datasets for both general-purpose and CCTV-based video surveillance

tutorialsarxiv-cs-cv

MotionHalluc: Diagnosing Kinematic Hallucinations in Fine-Grained Motion Reasoning

arXiv:2606.23061v1 Announce Type: new Abstract: Motion instruction generation in cross-video comparison aims to produce corrective feedback that describes the differences between a query and a referen

NeoJaundice-AI: Smartphone-Based Neonatal Jaundice Detection Using Dual-Input Deep Learning and Synthetic Augmentation

arXiv:2606.20689v1 Announce Type: new Abstract: Neonatal jaundice (hyperbilirubinemia) is one of the most common conditions affecting newborns worldwide, with India alone recording roughly 15 million

Next-Gen CAPTCHAs: Leveraging the Cognitive Gap for Scalable and Diverse GUI-Agent Defense

model-releasesarxiv-cs-lg

arXiv:2602.09012v2 Announce Type: replace Abstract: The rapid evolution of GUI-enabled agents has rendered traditional CAPTCHAs obsolete. While previous benchmarks like OpenCaptchaWorld established a

Null-Calibrated Conformal Selection via Target-Membership Scores

arXiv:2606.22336v1 Announce Type: cross Abstract: Conformal selection aims to identify test candidates whose unknown responses fall in a target region while controlling the false discovery rate. Exist

Omega: Operator-based Mixture Ensemble for Generative Assimilation

arXiv:2606.20920v1 Announce Type: new Abstract: Characterizing non-Gaussian posterior distributions in partially observed high-dimensional nonlinear systems remains a fundamental challenge in data ass

On the Limits of Prompt-Conditioned Language Models as General-Purpose Learners

arXiv:2606.23668v1 Announce Type: new Abstract: Large Language Models (LLMs) are frequently portrayed as general-purpose solvers capable of solving arbitrary tasks. We argue that this view overlooks a

safetyarxiv-cs-lg

Applications

Physics-Informed Modeling for Wood Thermal Analysis and Prediction

arXiv:2606.23402v1 Announce Type: new Abstract: Wood materials exhibit complex, spatially varying thermal properties that challenge traditional architectural assumptions of material homogeneity. Altho

applicationsarxiv-cs-lg