Search: “multimodal”

TTRSD: Test-Time Reinforcement Learning with Self-Distillation for Vision-Language Models

arXiv:2609.33414v1 Announce Type: new Abstract: Test-time reinforcement learning enables vision-language models (VLMs) to adapt using unlabeled inputs. However, repeated sampling under fixed visual co

safetyarxiv-cs-cv

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Tutorials

Uni-VLaT: Whole-Body Tactile Adaptation of VLA Policies for Humanoid Loco-Manipulation

DGX agent

arXiv:2609.35450v1 Announce Type: new Abstract: Physical contact often determines how a humanoid should respond during loco-manipulation, yet vision and proprioception alone are often insufficient to

tutorialsarxiv-cs-ro

29 Sept 2026

Agents

Vision-Language Agents for Active Perception in Optics Laboratories

arXiv:2609.32918v1 Announce Type: cross Abstract: Vision-language models (VLMs) are increasingly being used in scientific workflows, but their ability as agents to directly control laboratory experime

agentsarxiv-cs-cv

VL-AcneSeg: A Vision-Language Framework for Region-Aware Acne Lesion Segmentation

arXiv:2609.34472v1 Announce Type: new Abstract: Acne assessment is crucial for clinical decision-making, yet traditional grading and counting are subjective and fail to account for lesion size. While

WSM-Aware HRI: An IoT-Enhanced Framework for Early Detection and Norm-Guided Repair of Failures with LLM Guidance

arXiv:2609.32336v1 Announce Type: new Abstract: Human-robot interaction (HRI) failures remain a major barrier to deploying robots in real-world environments. Prior work often treats failures as isolat

Amplify What You Gaze At: Target Saliency Boosting in Text-to-Image Generation

arXiv:2609.30733v1 Announce Type: new Abstract: Text-to-image generation has advanced in controlling what, where, and how objects appear, yet how visual attention is distributed among objects remains

safetyarxiv-cs-cv

BAT-CLIP: Trimodal Alignment of Brain, Audio and Text

arXiv:2609.31180v1 Announce Type: cross Abstract: Decoding and interpreting naturalistic speech from the brain increasingly relies on alignment to pretrained speech and language representation spaces.

Block Sparse Attention with Log-Linear Complexity

arXiv:2609.31093v1 Announce Type: new Abstract: Scaling language models to long contexts is limited by the quadratic cost of self-attention. Block sparse attention offers an efficient alternative, but

researcharxiv-cs-lg

CCRV-Bench: Constraint-Based Evaluation of Causal Reasoning in Vision-Language Models

arXiv:2609.30979v1 Announce Type: new Abstract: Vision-language models (VLMs) have demonstrated excellent performance in visual tasks, but their visual causal reasoning capabilities still lack reliabl

CG-Probes: Recovering Guardrail Directions from Patient Query Embeddings

arXiv:2609.31062v1 Announce Type: new Abstract: Patient-facing AI assistants promise valuable support to patients, but incoming queries can pose medical risks. To create guardrails, we work with oncol

safetyarxiv-cs-cl

EmoZone-Talker: Regional Semantic Control of Audio-Driven 3DGS Talking Heads via Facial Action Units

arXiv:2606.15848v2 Announce Type: replace Abstract: 3D Gaussian Splatting (3DGS) has shown strong potential for high-fidelity talking head synthesis. However, enabling fine-grained, interpretable, and

From Reward Signal to Visual Utility: A Controlled Audit of Medical VLM Post-Training

arXiv:2609.31450v1 Announce Type: cross Abstract: Medical vision-language model (VLM) post-training is commonly evaluated through answer accuracy. We examine how changes in accuracy and training objec

HybridInfer: Thermal-Aware Reinforcement-Learning Tier Routing for On-Device, Edge, and Cloud LLM Inference

model-releasesarxiv-cs-lg

arXiv:2609.30270v1 Announce Type: new Abstract: On-device inference with small language models keeps user data local, works offline, and incurs no per-query cost, so the on-device tier is preferred wh

Introducing FireRouter with Opus. Our first router model. Routine tasks go to top open models, Claude Opus handles the rest. Cache and task-…

model-releasesfireworks-ai--x

Introducing FireRouter with Opus. Our first router model. Routine tasks go to top open models, Claude Opus handles the rest. Cache and task-aware routing. Proven 98.1% of Opus accuracy with 57% lower

MDSkin-Net: Multi-Task Skin Lesion Analysis Driven by Pattern Analysis Priors and Spatial Alignment Regularization

arXiv:2609.30855v1 Announce Type: new Abstract: Reliable skin lesion segmentation and classification are central to dermoscopic computer-aided diagnosis. Existing multi-task frameworks couple the two

MexHat: A Dataset for Hate Speech Detection in Mexican Spanish Videos

arXiv:2609.31553v1 Announce Type: new Abstract: Ensuring online safety through content monitoring had raised Hate Speech Detection as a crucial task to be addressed. By essence the task demands the ca

safetyarxiv-cs-cl

Peer Review as Structured Commentary: Immutable Identity, Public Dialogue, and Reproducible Scholarship

arXiv:2506.22497v2 Announce Type: replace-cross Abstract: This paper reconceptualises peer review as structured public commentary. Traditional academic validation is hindered by anonymity, latency, an

PHASE: Compliance-Enabled Tactile Phase Retrieval for Few-Shot Insertion Learning

arXiv:2609.30889v1 Announce Type: new Abstract: Contact-rich assembly tasks such as peg-in-hole insertion remain difficult to learn from limited demonstrations. While retrieval-augmented imitation lea

PixSim: a calibrated open-source simulator of instant-payment fraud, recovery and interdiction under analyst capacity constraints

model-releasesarxiv-cs-lg

arXiv:2609.30684v1 Announce Type: new Abstract: Brazil's Pix settles about 5.9 billion instant, irreversible transfers a month. A fraudulent transfer can be recovered only while the funds remain in a

Policy-Calibrated DAgger: Offline Calibrated Noise Injection for Imitation Learning

arXiv:2609.30462v1 Announce Type: new Abstract: Policies trained with imitation learning can accumulate errors over time, causing the robot to drift outside the training distribution. Existing methods

Preserve-and-Compose Training for Composed Image Retrieval

arXiv:2609.31202v1 Announce Type: new Abstract: Composed image retrieval (CIR) aims to retrieve images that satisfy a user-specified modification while preserving relevant visual content from a refere

ProCAP: Probabilistic Cross-Attentive Prompt Learning for Vision-Language Models

arXiv:2609.30434v1 Announce Type: new Abstract: Pre-trained vision-language models such as CLIP can recognize new categories via prompting, but they often struggle when labeled data are scarce or the

Prompt-Based Continual Compositional Zero-Shot Learning

arXiv:2512.09172v3 Announce Type: replace-cross Abstract: We tackle continual adaptation of vision-language models to new attributes, objects, and their compositions in Compositional Zero-Shot Learnin

SciHorizon-eLab: An Agentic Protocol-to-Task Compiler for Scalable Benchmarking of Scientific Embodied Agents

arXiv:2609.30971v1 Announce Type: new Abstract: Embodied agents offer a promising route to automating scientific experimentation, yet their progress is constrained by the lack of reliable and systemat

Stepwise Intrinsic Rewards for Reasoning in Large Language Models

arXiv:2602.01034v2 Announce Type: replace Abstract: Reinforcement learning (RL) has become a widely used paradigm for improving the reasoning abilities of large language models (LLMs) and Vision-langu

The Linear Representation Hypothesis for Vision-Language-Action Models

arXiv:2609.30996v1 Announce Type: cross Abstract: The linear representation hypothesis (LRH) has become a standard lens for measuring and intervening on semantic information through the internal repre

UniAR: A Unified Framework for Autism Recognition Enhanced by Multi-View Prompt Learning

arXiv:2609.31298v1 Announce Type: cross Abstract: Autism Spectrum Disorder (ASD) is a complex neurodevelopmental disorder for which early and accurate diagnosis is critical to improving long-term deve

b11223

model-releasesllama-cpp-releases

server : allow RANK pooling batch splitting for causal LLM rerankers (ie. Qwen3 and Qwen3-VL) (#28876) server : allow splitting RANK pooling for causal LLM rerankers Rerank models fall into two catego

27 Sept 2026

Local Ai

A Rapid Pipeline for Training and Deploying ML Models on WeBe Band

arXiv:2609.29084v1 Announce Type: new Abstract: Developing optimized machine-learning algorithms for edge devices with limited computational and memory resources is challenging, time-consuming, and hi

local-aiarxiv-cs-ai

Benchmarking and Domain Adaptation of Automatic Speech Recognition (ASR) for Adolescent Health Communication in Ghanaian Languages

arXiv:2609.29798v1 Announce Type: cross Abstract: This paper presents an end-to-end study of automatic speech recognition (ASR) for adolescent health communication in three Ghanaian languages (Twi, Da

Deep learning of longitudinal visual fields predicts glaucoma progression rate and identifies fast progressors

arXiv:2609.29256v1 Announce Type: cross Abstract: Glaucoma is the leading cause of irreversible blindness, and timely identification of fast progressors is essential to prevent disability. Current pra

Local Ai

Edge AI on Constrained Devices for Binary Sleep-Wake Classification in Dynamic Environments

arXiv:2609.29163v1 Announce Type: new Abstract: This paper presents an Edge AI-based system for detecting sleep and wake states in non-stationary mobile environments using resource-constrained embedde

local-aiarxiv-cs-lg

Faster Visuomotor Policy Learning on Action Manifolds via Riemannian MeanFlow

arXiv:2609.30127v1 Announce Type: new Abstract: Visuomotor policies learn a direct map from raw sensory observations to robot action sequences. Policies based on Diffusion and Flow Matching capture th

From Target Selection to Digging: A Learning-Based Framework for Continuous Autonomous Excavation

arXiv:2609.29750v1 Announce Type: new Abstract: Repeated excavation continuously reshapes pile geometry, requiring an autonomous excavator to adapt its digging targets and coordinate motion across suc

From Text Decisions to Pixels: An Study of Jev-Style Visual Choice Model

arXiv:2609.29283v1 Announce Type: new Abstract: Visual software often needs a decision over supplied alternatives rather than a generated explanation. We present PixelJev, a native-image decision inte

GeoNLI - A Natural Language Interpreter for Satellite Imagery

arXiv:2609.28741v1 Announce Type: new Abstract: Multi-modal multitasking models have shown strong performance on remote sensing datasets. However, because these models are trained on heterogeneous dat

Applications

M3GD: Multi-Modal Multi-View Geometric Diffusion for Camera--LiDAR Novel View Synthesis

arXiv:2609.30056v1 Announce Type: cross Abstract: Robotic novel view synthesis (NVS) must recover both visual appearance and metric 3D structure, yet most generative NVS methods rely only on images, o

applicationsarxiv-cs-cv

Agents

Markerless Multi-Modal Autonomous Robotic Inspection of Large Space Structures

arXiv:2609.29644v1 Announce Type: new Abstract: Future orbital infrastructures, such as deployable antennas, solar farms, and large orbital platforms will require autonomous inspection systems able to

agentsarxiv-cs-ro

RGBD20K: A Large-Scale Benchmark for RGB-D Semantic Segmentation

arXiv:2609.29028v1 Announce Type: new Abstract: In this paper, we propose RGBD20K, a novel dataset for facilitating the development of more robust and general RGB-D semantic segmentation by encompassi

SEE Challenge 2026: Event-Guided Brightness Adjustment Across a Broad Illumination Range

arXiv:2609.29347v1 Announce Type: new Abstract: Event cameras provide a high dynamic range and preserve brightness-change cues in lighting conditions where conventional RGB frames may be noisy or satu

SMILESGNN: Interpretable Clinical Toxicity Prediction via SMILES-Graph Cross-Attention Fusion

arXiv:2609.28553v1 Announce Type: cross Abstract: Drug toxicity prediction is critical for reducing late-stage attrition in drug discovery, yet remains challenging due to severe class imbalance, scaff

World Action Agent: Harnessing VLMs for Robot Manipulation via World Action Rehearsal

arXiv:2609.29964v1 Announce Type: cross Abstract: General-purpose vision-language models (VLMs) bring broad knowledge and spatial reasoning to robot manipulation, yet existing systems either use them

A hierarchy of faithfulness criteria for knowledge base completion

arXiv:2609.27863v1 Announce Type: new Abstract: Knowledge graph completion is evaluated by ranking observed triples above randomly corrupted ones, which treats every unobserved fact as false. When the

Tutorials

Active Learning for Biodiversity Monitoring: From Label Efficiency to Reliable Ecological Inference

arXiv:2609.27409v1 Announce Type: new Abstract: Limited expert annotation capacity is a pervasive constraint in biodiversity monitoring. Passive acoustic recorders and camera traps generate data faste

tutorialsarxiv-cs-lg

Alignment of LRMs via Counter-Aligned Few-Shot Conversation Exposure

arXiv:2609.27763v1 Announce Type: new Abstract: Large Reasoning Models (LRMs) rely on explicit chain-of-thought (CoT) reasoning and large context windows to achieve strong performance on complex tasks

All modalities are equal, but video is more equal: Closing the Cross-Attention Gap in Joint Video Generation

arXiv:2609.27901v1 Announce Type: new Abstract: Video is a rich representation of a physical event, capturing appearance, geometry, motion, and temporal evolution. Other modalities, such as 3D body mo

ASCIIBench: Evaluating Language-Model-Based Understanding of Visually-Oriented Text

model-releasesarxiv-cs-lg

arXiv:2512.04125v2 Announce Type: replace Abstract: Large language models (LLMs) have demonstrated several emergent behaviors with scale, including reasoning and fluency in long-form text generation.

BranchDrive: A Branch-Structured Dataset for Action-Conditioned Driving Prediction

model-releasesarxiv-cs-ro

arXiv:2609.27275v1 Announce Type: new Abstract: Most autonomous-driving datasets record only the action executed by a behavior policy and the single future that followed, providing limited supervision