Search: “multimodal”

PixSim: a calibrated open-source simulator of instant-payment fraud, recovery and interdiction under analyst capacity constraints

arXiv:2609.30684v1 Announce Type: new Abstract: Brazil's Pix settles about 5.9 billion instant, irreversible transfers a month. A fraudulent transfer can be recovered only while the funds remain in a

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Policy-Calibrated DAgger: Offline Calibrated Noise Injection for Imitation Learning

DGX agent

arXiv:2609.30462v1 Announce Type: new Abstract: Policies trained with imitation learning can accumulate errors over time, causing the robot to drift outside the training distribution. Existing methods

safetyarxiv-cs-ro

28 Sept 2026

Preserve-and-Compose Training for Composed Image Retrieval

arXiv:2609.31202v1 Announce Type: new Abstract: Composed image retrieval (CIR) aims to retrieve images that satisfy a user-specified modification while preserving relevant visual content from a refere

ProCAP: Probabilistic Cross-Attentive Prompt Learning for Vision-Language Models

arXiv:2609.30434v1 Announce Type: new Abstract: Pre-trained vision-language models such as CLIP can recognize new categories via prompting, but they often struggle when labeled data are scarce or the

Prompt-Based Continual Compositional Zero-Shot Learning

arXiv:2512.09172v3 Announce Type: replace-cross Abstract: We tackle continual adaptation of vision-language models to new attributes, objects, and their compositions in Compositional Zero-Shot Learnin

SciHorizon-eLab: An Agentic Protocol-to-Task Compiler for Scalable Benchmarking of Scientific Embodied Agents

arXiv:2609.30971v1 Announce Type: new Abstract: Embodied agents offer a promising route to automating scientific experimentation, yet their progress is constrained by the lack of reliable and systemat

Stepwise Intrinsic Rewards for Reasoning in Large Language Models

arXiv:2602.01034v2 Announce Type: replace Abstract: Reinforcement learning (RL) has become a widely used paradigm for improving the reasoning abilities of large language models (LLMs) and Vision-langu

The Linear Representation Hypothesis for Vision-Language-Action Models

arXiv:2609.30996v1 Announce Type: cross Abstract: The linear representation hypothesis (LRH) has become a standard lens for measuring and intervening on semantic information through the internal repre

UniAR: A Unified Framework for Autism Recognition Enhanced by Multi-View Prompt Learning

arXiv:2609.31298v1 Announce Type: cross Abstract: Autism Spectrum Disorder (ASD) is a complex neurodevelopmental disorder for which early and accurate diagnosis is critical to improving long-term deve

Local Ai

A Rapid Pipeline for Training and Deploying ML Models on WeBe Band

arXiv:2609.29084v1 Announce Type: new Abstract: Developing optimized machine-learning algorithms for edge devices with limited computational and memory resources is challenging, time-consuming, and hi

local-aiarxiv-cs-ai

Benchmarking and Domain Adaptation of Automatic Speech Recognition (ASR) for Adolescent Health Communication in Ghanaian Languages

arXiv:2609.29798v1 Announce Type: cross Abstract: This paper presents an end-to-end study of automatic speech recognition (ASR) for adolescent health communication in three Ghanaian languages (Twi, Da

Deep learning of longitudinal visual fields predicts glaucoma progression rate and identifies fast progressors

arXiv:2609.29256v1 Announce Type: cross Abstract: Glaucoma is the leading cause of irreversible blindness, and timely identification of fast progressors is essential to prevent disability. Current pra

Local Ai

Edge AI on Constrained Devices for Binary Sleep-Wake Classification in Dynamic Environments

arXiv:2609.29163v1 Announce Type: new Abstract: This paper presents an Edge AI-based system for detecting sleep and wake states in non-stationary mobile environments using resource-constrained embedde

local-aiarxiv-cs-lg

Faster Visuomotor Policy Learning on Action Manifolds via Riemannian MeanFlow

arXiv:2609.30127v1 Announce Type: new Abstract: Visuomotor policies learn a direct map from raw sensory observations to robot action sequences. Policies based on Diffusion and Flow Matching capture th

safetyarxiv-cs-ro

From Target Selection to Digging: A Learning-Based Framework for Continuous Autonomous Excavation

arXiv:2609.29750v1 Announce Type: new Abstract: Repeated excavation continuously reshapes pile geometry, requiring an autonomous excavator to adapt its digging targets and coordinate motion across suc

safetyarxiv-cs-ro

From Text Decisions to Pixels: An Study of Jev-Style Visual Choice Model

arXiv:2609.29283v1 Announce Type: new Abstract: Visual software often needs a decision over supplied alternatives rather than a generated explanation. We present PixelJev, a native-image decision inte

GeoNLI - A Natural Language Interpreter for Satellite Imagery

arXiv:2609.28741v1 Announce Type: new Abstract: Multi-modal multitasking models have shown strong performance on remote sensing datasets. However, because these models are trained on heterogeneous dat

Applications

M3GD: Multi-Modal Multi-View Geometric Diffusion for Camera--LiDAR Novel View Synthesis

arXiv:2609.30056v1 Announce Type: cross Abstract: Robotic novel view synthesis (NVS) must recover both visual appearance and metric 3D structure, yet most generative NVS methods rely only on images, o

applicationsarxiv-cs-cv

Markerless Multi-Modal Autonomous Robotic Inspection of Large Space Structures

arXiv:2609.29644v1 Announce Type: new Abstract: Future orbital infrastructures, such as deployable antennas, solar farms, and large orbital platforms will require autonomous inspection systems able to

agentsarxiv-cs-ro

RGBD20K: A Large-Scale Benchmark for RGB-D Semantic Segmentation

arXiv:2609.29028v1 Announce Type: new Abstract: In this paper, we propose RGBD20K, a novel dataset for facilitating the development of more robust and general RGB-D semantic segmentation by encompassi

SEE Challenge 2026: Event-Guided Brightness Adjustment Across a Broad Illumination Range

arXiv:2609.29347v1 Announce Type: new Abstract: Event cameras provide a high dynamic range and preserve brightness-change cues in lighting conditions where conventional RGB frames may be noisy or satu

SMILESGNN: Interpretable Clinical Toxicity Prediction via SMILES-Graph Cross-Attention Fusion

arXiv:2609.28553v1 Announce Type: cross Abstract: Drug toxicity prediction is critical for reducing late-stage attrition in drug discovery, yet remains challenging due to severe class imbalance, scaff

World Action Agent: Harnessing VLMs for Robot Manipulation via World Action Rehearsal

arXiv:2609.29964v1 Announce Type: cross Abstract: General-purpose vision-language models (VLMs) bring broad knowledge and spatial reasoning to robot manipulation, yet existing systems either use them

A hierarchy of faithfulness criteria for knowledge base completion

arXiv:2609.27863v1 Announce Type: new Abstract: Knowledge graph completion is evaluated by ranking observed triples above randomly corrupted ones, which treats every unobserved fact as false. When the

Tutorials

Active Learning for Biodiversity Monitoring: From Label Efficiency to Reliable Ecological Inference

arXiv:2609.27409v1 Announce Type: new Abstract: Limited expert annotation capacity is a pervasive constraint in biodiversity monitoring. Passive acoustic recorders and camera traps generate data faste

tutorialsarxiv-cs-lg

Alignment of LRMs via Counter-Aligned Few-Shot Conversation Exposure

arXiv:2609.27763v1 Announce Type: new Abstract: Large Reasoning Models (LRMs) rely on explicit chain-of-thought (CoT) reasoning and large context windows to achieve strong performance on complex tasks

All modalities are equal, but video is more equal: Closing the Cross-Attention Gap in Joint Video Generation

arXiv:2609.27901v1 Announce Type: new Abstract: Video is a rich representation of a physical event, capturing appearance, geometry, motion, and temporal evolution. Other modalities, such as 3D body mo

ASCIIBench: Evaluating Language-Model-Based Understanding of Visually-Oriented Text

arXiv:2512.04125v2 Announce Type: replace Abstract: Large language models (LLMs) have demonstrated several emergent behaviors with scale, including reasoning and fluency in long-form text generation.

BranchDrive: A Branch-Structured Dataset for Action-Conditioned Driving Prediction

model-releasesarxiv-cs-ro

arXiv:2609.27275v1 Announce Type: new Abstract: Most autonomous-driving datasets record only the action executed by a behavior policy and the single future that followed, providing limited supervision

Copy-Move Forgery Detection and Question Answering for Remote Sensing Image

arXiv:2412.02575v3 Announce Type: replace Abstract: Driven by practical demands in land resource monitoring and national defense security, this paper introduces the Remote Sensing Copy-Move Question A

EmbodiedMemory-Bench: Benchmarking Embodied Memory for Long-Horizon Embodied Tasks

arXiv:2609.28236v1 Announce Type: new Abstract: Long-horizon embodied interaction requires agents to retain and continually update information about the environment as they observe, act, and encounter

safetyarxiv-cs-cv

Evaluation of pre-trained models for pedagogical assessment of novel AI-assisted educational questions

arXiv:2609.27749v1 Announce Type: new Abstract: The surge in AI-assisted generation of educational materials has outpaced our capacity to validate their pedagogical quality. Automated evaluation using

Invisible in Space, Visible in Time: Motion Vision CAPTCHA against GUI Agents

arXiv:2609.27461v1 Announce Type: new Abstract: Most existing visual CAPTCHAs remain spatially solvable: the required information is exposed by static appearance, local structure, and interface state.

Learn How to Act from Your Own Interactions: On-Policy Self-Distillation for GUI Agents

arXiv:2609.27307v1 Announce Type: new Abstract: Graphical User Interface (GUI) agents enable the fulfillment of complex user instructions through multi-turn interactions with software environments, re

Learning the Cost of Reliable Inference

arXiv:2609.28322v1 Announce Type: new Abstract: Benchmarking and routing platforms increasingly act as intermediaries connecting large language model providers with end-users. However, providers on th

Applications

Lend me an Ear: Speech Enhancement Using a Robotic Arm with a Microphone Array

arXiv:2602.17818v2 Announce Type: replace Abstract: Speech enhancement performance degrades significantly in noisy environments, limiting the deployment of speech-controlled technologies in industrial

applicationsarxiv-cs-ro

Listening and Mirroring: The Effects of Verbal Attunement and Behavioral Mimicry on Social and Empathic Perceptions of Embodied AI Agents in VR

arXiv:2609.27246v1 Announce Type: cross Abstract: As embodied agents take on increasingly social and relational roles in VR, visual realism and embodiment alone may be insufficient; users must also pe

agentsarxiv-cs-ai

Live Assistant: Learning Whether, When, and Whom to Assist in Real-World Live Social Streams

arXiv:2609.27303v1 Announce Type: new Abstract: Livestreams are long-lasting interactive environments where audiovisual content, viewer activity, host behavior, and platform signals evolve together, c

Lost in Speech: Trilingual Spoken Hallucination Detection Across Audio and Transcripts

model-releasesarxiv-cs-cl

arXiv:2608.24707v2 Announce Type: replace Abstract: While text-based hallucination detection is well studied, reference-free detection of factual alterations in speech remains underexplored, especiall

MultiVENT-Raw: A Benchmark for Retrieval and Reasoning over Raw Videos

arXiv:2609.28437v1 Announce Type: new Abstract: Online information is increasingly consumed in video format. Much of this comes in the form of *raw video*: continuous footage taken on a cell phone, wi

NADI 2026: The Second Multidialectal Arabic Speech Processing Shared Task

model-releasesarxiv-cs-cl

arXiv:2609.27086v1 Announce Type: new Abstract: NADI 2026 is the seventh edition of the Nuanced Arabic Dialect Identification (NADI) shared task series and the second dedicated to multidialectal Arabi

NV-Reason-CT: 3D Visual Language Model for CT Analysis

arXiv:2609.27511v1 Announce Type: cross Abstract: We present NV-Reason-CT, a generative vision--language model for chest and abdominal CT combining native 3D visual encoding with radiologist-guided re

PBLH Estimation from Satellite Radiances via a Dual-Encoder Transformer

arXiv:2609.28286v1 Announce Type: new Abstract: Estimating the Planetary Boundary Layer Height (PBLH) from satellite observations is a challenging regression problem due to the indirect relationship b

Physiologically Informed Digital Auscultation for Pneumonia Detection in Long-term Care Residents

arXiv:2609.27222v1 Announce Type: cross Abstract: Pneumonia is difficult to diagnose in older long-term care residents; multimorbidity and atypical presentations obscure signs, motivating operationall

PR-Smoother: Simulator-Preserving Non-Gaussian Smoothing for Data Assimilation

arXiv:2609.26890v1 Announce Type: new Abstract: Many physical data assimilation (DA) workflows require smoothing methods that represent non-Gaussian posteriors over physical state variables, scale to

RoboCafe in the Open: Interaction Continuity in Long-Term Public Human-Robot Interaction

arXiv:2609.27475v1 Announce Type: new Abstract: As robots remain in public spaces over extended periods, they must maintain interaction continuity by preserving and correctly applying context as peopl

agentsarxiv-cs-ro

Where Should I Join? Robot Group Joining via Language-Guided Goal Prediction

arXiv:2609.28467v1 Announce Type: cross Abstract: Social navigation typically assumes a specified goal and focuses on reaching it while respecting social conventions, whereas robot group joining requi

agentsarxiv-cs-ai

A Reconfigurable Bidirectional Cable-Driven Hip Exoskeleton with Swappable Bench/Backpack Dual-configuration Actuation