Search: “multimodal”

SpikeMoE: Brain-Inspired Competitive Routing for Flexible Spiking Mixture-of-Experts

arXiv:2610.01418v1 Announce Type: new Abstract: Spiking Neural Networks (SNNs) enable event-driven computation through biologically inspired dynamics at the neuronal scale, while Mixture-of-Experts (M

researcharxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

TOAST: Stochastic Robot Action Tokenization for Autoregressive Vision-Language-Action Models

DGX agent

arXiv:2610.00899v1 Announce Type: cross Abstract: Autoregressive Vision-Language-Action models often represent continuous robot actions as discrete token sequences, enabling action prediction with sta

safetyarxiv-cs-ai

2 Oct 2026

vFedProtoQNAS: Prototype-Guided Personalized Quantum Neural Architecture Search for Virtual Federated Learning

arXiv:2610.01718v1 Announce Type: new Abstract: Quantum federated learning (QFL) has emerged as a promising approach for collaboratively training compact quantum neural networks (QNNs) over distribute

safetyarxiv-cs-ai

Local Ai

Video Evidence Indexing: Learning Where to Look from Video Previews for Token-Budgeted Long-Video Question Answering

arXiv:2610.00757v1 Announce Type: new Abstract: Long-video question answering is limited by the high cost of visual tokens and by the fixed context width of current VLMs. A long-video question may req

local-aiarxiv-cs-cv

WIPSNet: Deep Learning for Paediatric Wheeze Detection from Overnight Impedance Pneumography

arXiv:2610.00398v1 Announce Type: new Abstract: Overnight impedance pneumography (IP) is used to monitor paediatric respiratory health. Its current clinical readout, the Expiratory Variability Index (

researcharxiv-cs-lg

Active Learning with Imperfect Labels: Optimal Labeler Assignment and Sample Selection

arXiv:2512.12870v2 Announce Type: replace-cross Abstract: Active Learning (AL) is commonly used in applications where labeling data is expensive or time-consuming. In practice, however, labels are oft

BadAction: Backdoor Attacks on Interactive Video Generation via Action-Guided Triggers

arXiv:2609.39047v1 Announce Type: new Abstract: Interactive video generation (IVG) models have achieved remarkable progress in producing controllable visual content guided by user-defined actions, yet

Beyond Spatial-Domain Supervision: A Relation Constrained Space for Multi-Modal Image Fusion

arXiv:2609.38968v1 Announce Type: new Abstract: Multi-modal image fusion (MMIF) aims to form a single image by integrating shared information, preserving complementary cues, and coordinating cross-mod

Local Ai

BTC3D: Blended Tile Conditioning for Detail-Enhancing Image-to-3D Generation

arXiv:2609.39709v1 Announce Type: new Abstract: Recent diffusion-based pipelines have achieved promising progress in image-to-3D synthesis. However, generating high-fidelity details remains challengin

local-aiarxiv-cs-cv

EngramBench: A Capability-Grounded Benchmark for Skill-Evolution Harnesses

arXiv:2609.39284v1 Announce Type: cross Abstract: While large language models have achieved remarkable success in isolated code generation, authentic software engineering requires sustained reasoning,

Evaluating Whether LLMs Can Reliably Connect the DOTs?

model-releasesarxiv-cs-cl

arXiv:2609.38406v1 Announce Type: new Abstract: Access to real-world information is often noisy and fragmented. Constructing a coherent narrative from such fragments requires models to reconstruct mis

Explore-on-Graph: Hybrid Embedding-LLM Reasoning for Knowledge Graph Question Answering under Incompleteness

model-releasesarxiv-cs-cl

arXiv:2609.39786v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly combined with knowledge graphs (KGs) to ground reasoning in structured evidence. However, most LLM-based K

ExploreNet: Learning Where to Explore in Diffusion GRPO

arXiv:2609.38329v1 Announce Type: new Abstract: Group-relative RL methods such as Flow-GRPO post-train image generators by exploring with isotropic Gaussian noise added at every denoising step. This n

Fairness Theatre: Evaluating Post-Hoc Fairness Interventions in Vendor-Controlled Early Warning Systems

arXiv:2609.38552v1 Announce Type: cross Abstract: Public institutions increasingly procure AI systems whose design they cannot inspect or change. In higher education, proprietary Early Warning Systems

safetyarxiv-cs-lg

GLARE: Generating Listening Heads with Appropriate Reactions

arXiv:2609.40317v1 Announce Type: new Abstract: While talking head generation has advanced rapidly, generating natural listener behavior in dyadic conversations, which know when to react, how to react

GraphForge: Training Working Agents with Graph-Anchored Workspace Synthesis

model-releasesarxiv-cs-cl

arXiv:2609.38923v1 Announce Type: new Abstract: Working agents need to read diverse files, coordinate tools, and produce deliverables. Training such agents requires tasks built on many real files with

Grounding Time-Series Foundation Models in Digital Twin Topology for Predictive Maintenance

arXiv:2609.40071v1 Announce Type: cross Abstract: Digital twins increasingly support downstream analytical tasks that depend on time-series data, motivating interest in time-series foundation models (

GroundingPI: A Grounding Foundation Model towards Physical Intelligence with Visual Primitives

arXiv:2609.39601v1 Announce Type: cross Abstract: Precise grounding matters. It specifies which object is the target and where that object is, even in clutter and for tiny objects, and it has to be fa

agentsarxiv-cs-ai

Hard-Region Supervision: #1 on the Waymo Open Dataset 2D Video Panoptic Segmentation Leaderboard

arXiv:2609.38714v1 Announce Type: new Abstract: We describe our winning entry to the Waymo Open Dataset 2D Video Panoptic Segmentation Challenge. The task asks for a semantic class at every pixel of e

Interactor: Agentic RL oriented Iterative Creation for Ad Description Generation in Sponsored Search

arXiv:2606.15911v2 Announce Type: replace Abstract: This paper focuses on automatically generating informative ad descriptions in sponsored search. Unlike ad titles which are usually optimized to attr

safetyarxiv-cs-cl

Learning to Route in Visual Space via Multi-Step Embedding Retrieval

arXiv:2609.38743v1 Announce Type: new Abstract: LLM agents rely on retrieval tools to access external knowledge, yet visual agentic search remains severely bottlenecked by standard single-step retriev

Less Data, Better Timing: Student-Curriculum Coupling for VLM On-Policy Distillation in Temporal Video Grounding

arXiv:2609.40055v1 Announce Type: cross Abstract: On-policy distillation (OPD) provides dense supervision directly on student-generated trajectories, making it an effective post-training strategy for

safetyarxiv-cs-ai

Make Code as Policy Great Again: Frontier Agents Write, Call, and Evolve Robot Tools

arXiv:2609.39018v1 Announce Type: cross Abstract: Frontier models can control robots, but reasoning through every reach, grasp, and retreat makes manipulation slow and token-intensive. We revisit code

MemCodex: Self-Programming Hierarchical Memory for Language Agents

arXiv:2609.39765v1 Announce Type: new Abstract: Agent memory faces heterogeneous access needs: a single-hop question may require one piece of evidence, whereas a multi-hop question must combine eviden

agentsarxiv-cs-cl

ModalFidelity: Routing Modalities for Deepfake Detection on a Budget

arXiv:2609.38246v1 Announce Type: cross Abstract: Deepfakes no longer need to fake a whole video. Generators that read the transcript now alter only the few seconds in which a video's meaning turns, s

researcharxiv-cs-ai

OP-CAD: On-Policy Clean-Audio Distillation for Robust Audio-Visual Reasoning

arXiv:2609.39150v1 Announce Type: new Abstract: Omni-modal large language models deployed in real-world environments encounter external noise that can interfere with their perception and understanding

Re-ranking and Late Interaction Drive Retrieval Quality: A Controlled Comparison of RAG Strategies for Scientific Question Answering

arXiv:2609.38473v1 Announce Type: cross Abstract: Retrieval-Augmented Generation (RAG) is now the standard way to ground Large Language Models (LLMs) in external knowledge, yet the design space of ret

Recognition of Urbanized Areas in UAV-Derived Very-High-Resolution Visible-Light Imagery

arXiv:2609.40212v1 Announce Type: new Abstract: This study compared classifiers that differentiate between urbanized and non-urbanized areas based on unmanned aerial vehicle (UAV)-acquired RGB imagery

Role-guided Speaker Deletion Verification in Clinical Psychiatry Speech Recordings with Audio Language Models

arXiv:2609.38491v1 Announce Type: new Abstract: Clinical research in psychiatry increasingly relies on large scale collection of spoken language data to identify acoustic and linguistic biomarkers. Ye

Semantic Misalignment in Vision-Language Models under Perceptual Degradation

arXiv:2601.08355v3 Announce Type: replace Abstract: Vision-Language Models (VLMs) are increasingly deployed in autonomous driving and embodied AI systems, where reliable perception is critical for saf

Signal-Routed Temperature Scaling: Low-Capacity Risk-Conditioned Calibration for Small Validation Budgets

arXiv:2609.38936v1 Announce Type: cross Abstract: When a classifier is recalibrated from only a few thousand held-out examples, the capacity of the calibration map becomes a statistical design choice

Structural Limits of the Information-Theoretic Uncertainty Decomposition

arXiv:2609.39591v1 Announce Type: new Abstract: Uncertainty estimation in machine learning typically decomposes uncertainty into aleatoric uncertainty (AU) and epistemic uncertainty (EU) using the sta

TutlAit v1: a crowdsourced Moroccan Tamazight speech dataset with Arabic transcriptions and regional accent labels

arXiv:2609.38219v1 Announce Type: new Abstract: Tamazight (Amazigh) is, together with Arabic, one of the two official languages of Morocco, yet it remains severely under-resourced for speech technolog

researcharxiv-cs-cl

What to Attend, What to Keep: Skill-Conditioned Visuotactile Representation with Progress-Guided Event Memory

arXiv:2609.38494v1 Announce Type: cross Abstract: Robotic manipulation integrates vision, touch, and language, whose importance shifts across stages: vision guides reaching, while touch, through its e

When a Kindergartener Solves Calculus: Measuring Capability Leakage in Role-Prompted Reasoning Models

arXiv:2609.39846v1 Announce Type: cross Abstract: We investigate the problem of role-capability leakage (RCL), in which a role-prompted reasoning model generates convincing in-role text while continui

Who Owns That? Evaluating Ownership Intuitions in Large Language Models

arXiv:2609.39483v1 Announce Type: new Abstract: Ownership establishes rights over the use, control, and transfer of objects. Understanding these relations is essential for AI systems to interact appro

researcharxiv-cs-ai

Early Learning Shapes Later Directions Of Representation Change In Continual Learning

arXiv:2609.36081v1 Announce Type: new Abstract: Representations continually change as a network learns new tasks. We ask whether early representational changes naturally form a geometric structure tha

researcharxiv-cs-lg

Local Ai

FocusVTC: Efficient and High-Performance Visual Text Compression with Adaptive Resolution

arXiv:2609.36651v1 Announce Type: cross Abstract: Long-context reasoning in large language models incurs substantial computation and memory costs. Visual text compression (VTC) reduces input length by

local-aiarxiv-cs-ai

Hierarchical Compression of Vision-Language Model Benchmarks

arXiv:2609.37515v1 Announce Type: cross Abstract: Thorough evaluation of vision-language models (VLMs) has become prohibitively expensive, as benchmarks span an ever-broader spectrum of capabilities a

Reliability Testing of Medical Model Performance under Distributed Deployment

arXiv:2609.36525v1 Announce Type: cross Abstract: Distributed inference has become an indispensable part of deploying medical models under practical latency, memory, and throughput constraints. Althou

ReMem: Rethinking Perception and Memory in Long-Context Recommendation Agents

arXiv:2609.37311v1 Announce Type: new Abstract: Recent Recommendation Agents (RecAgents) offer a promising alternative by shifting recommendation to an active, user-side paradigm, where generative age

agentsarxiv-cs-ai

The Universal Classifier for Graph Learning

arXiv:2609.36302v1 Announce Type: new Abstract: While foundation models have revolutionized natural language processing and computer vision by leveraging universal vocabularies, Graph Machine Learning

researcharxiv-cs-lg

Toward a Culturally Adapted Chinese Language Agent: A Wizard-of-Oz Study of Nonverbal Behavior in Chinese-German Intercultural Interaction

arXiv:2609.35150v1 Announce Type: cross Abstract: Successful intercultural communication requires more than grammatical competence. It demands sensitivity to culturally embedded social norms whose vio

agentsarxiv-cs-cl

Tracing the Evidence: Faithful Token Attribution Through Vision-Language Reasoning

arXiv:2609.37656v1 Announce Type: new Abstract: Large vision-language models (LVLMs) exhibit strong reasoning capabilities, yet the visual and textual evidence supporting the generated responses remai

UnlearningSoup: Is Repeated Tuning Necessary for Large Language Model Unlearning?

arXiv:2609.37076v1 Announce Type: new Abstract: Large language models trained on vast corpora inherently risk memorizing harmful content that may later re-emerge in their outputs. To mitigate this iss

Wasserstein Causal Forests for Distribution-Valued Outcomes

arXiv:2609.35898v1 Announce Type: cross Abstract: This paper proposes Wasserstein Causal Forests (WCF) for settings in which each unit's outcome is itself a probability distribution. This study also d

Where Root Cause Analysis Fails: A Retrieval-Reranking Decomposition

arXiv:2609.36686v1 Announce Type: new Abstract: Identifying the root cause of an anomaly among hundreds of sensors is critical for preventing safety incidents and costly downtime in complex monitored

Evaluating Single and Multi-Omics Based Explainable Artificial Intelligence (MOXAI) for Molecular Subclass Classification of Adult-Type Diffuse Gliomas

arXiv:2609.32190v1 Announce Type: new Abstract: DNA methylation (DNAM) profiling has emerged as a powerful diagnostic tool for classifying brain and solid tumors. However, existing computational model