Search: “multimodal”

More with Less: a Large Scale Remote Sensing VLM with a Simple Recipe

arXiv:2607.15942v2 Announce Type: replace Abstract: Remote sensing vision-language models are increasingly expected to support open-ended reasoning over Earth Observation data and a variety of tasks.

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

OmniSeek: Native Tool Integration for Multi-turn Audio-Visual Reasoning

DGX agent

arXiv:2610.02181v1 Announce Type: new Abstract: We present OmniSeek, an agentic framework that transforms an Omni Large Language Model (Omni-LLM) into an active, multi-turn reasoning agent with native

safetyarxiv-cs-cv

2 Oct 2026

Prompt caching benchmark: high cache reuse doesn’t always mean lower cost

We benchmarked prompt caching across DeepSeek, GLM, GPT, and Claude using Harbor evals and Phoenix traces, so we could compare cache reuse, estimated cost, and latency on the same multi-turn shopping

model-releasesarize-ai

Tutorials

Questionnaire-Guided Disaggregation of Energy Appliance Use for Domestic Smart Meter Data

arXiv:2610.01297v1 Announce Type: new Abstract: Ireland's smart metering programme records electricity use at 30-minute resolution, with smart meters installed in over 80% of households as of late 202

tutorialsarxiv-cs-ai

Agents

ReLiveGym: Evaluating Long-Lived Agents over Weeks of Replayed Reality

arXiv:2610.00710v1 Announce Type: new Abstract: As large language model (LLM) agents become widely adopted, they are increasingly deployed for tasks that require persistent monitoring or recurring act

agentsarxiv-cs-ai

REVEAL: Robust Evolution of Vision-Language Models for Explainable AI-Video Detection

model-releasesarxiv-cs-cv

arXiv:2502.14994v2 Announce Type: replace Abstract: The rapid advancement of AI-generated video poses challenges to digital authenticity and security. Current detection methods, often trained on speci

Signal-Noise Factorization Isolates Nuisance Variation into Removable Subspaces

arXiv:2610.00751v1 Announce Type: cross Abstract: Recent theoretical work identified fundamental properties of representation geometry that shape inference ability of deep neural networks. These inclu

Signed Lexical Confidence for Risk-Calibrated Intent Routing

arXiv:2610.00262v1 Announce Type: cross Abstract: Selective intent routing allows an assistant to act on reliable predictions while deferring uncertain requests. Standard confidence scores primarily r

SpikeMoE: Brain-Inspired Competitive Routing for Flexible Spiking Mixture-of-Experts

arXiv:2610.01418v1 Announce Type: new Abstract: Spiking Neural Networks (SNNs) enable event-driven computation through biologically inspired dynamics at the neuronal scale, while Mixture-of-Experts (M

researcharxiv-cs-ai

TOAST: Stochastic Robot Action Tokenization for Autoregressive Vision-Language-Action Models

arXiv:2610.00899v1 Announce Type: cross Abstract: Autoregressive Vision-Language-Action models often represent continuous robot actions as discrete token sequences, enabling action prediction with sta

vFedProtoQNAS: Prototype-Guided Personalized Quantum Neural Architecture Search for Virtual Federated Learning

arXiv:2610.01718v1 Announce Type: new Abstract: Quantum federated learning (QFL) has emerged as a promising approach for collaboratively training compact quantum neural networks (QNNs) over distribute

Local Ai

Video Evidence Indexing: Learning Where to Look from Video Previews for Token-Budgeted Long-Video Question Answering

arXiv:2610.00757v1 Announce Type: new Abstract: Long-video question answering is limited by the high cost of visual tokens and by the fixed context width of current VLMs. A long-video question may req

local-aiarxiv-cs-cv

WIPSNet: Deep Learning for Paediatric Wheeze Detection from Overnight Impedance Pneumography

arXiv:2610.00398v1 Announce Type: new Abstract: Overnight impedance pneumography (IP) is used to monitor paediatric respiratory health. Its current clinical readout, the Expiratory Variability Index (

researcharxiv-cs-lg

Active Learning with Imperfect Labels: Optimal Labeler Assignment and Sample Selection

arXiv:2512.12870v2 Announce Type: replace-cross Abstract: Active Learning (AL) is commonly used in applications where labeling data is expensive or time-consuming. In practice, however, labels are oft

BadAction: Backdoor Attacks on Interactive Video Generation via Action-Guided Triggers

arXiv:2609.39047v1 Announce Type: new Abstract: Interactive video generation (IVG) models have achieved remarkable progress in producing controllable visual content guided by user-defined actions, yet

Beyond Spatial-Domain Supervision: A Relation Constrained Space for Multi-Modal Image Fusion

arXiv:2609.38968v1 Announce Type: new Abstract: Multi-modal image fusion (MMIF) aims to form a single image by integrating shared information, preserving complementary cues, and coordinating cross-mod

Local Ai

BTC3D: Blended Tile Conditioning for Detail-Enhancing Image-to-3D Generation

arXiv:2609.39709v1 Announce Type: new Abstract: Recent diffusion-based pipelines have achieved promising progress in image-to-3D synthesis. However, generating high-fidelity details remains challengin

local-aiarxiv-cs-cv

EngramBench: A Capability-Grounded Benchmark for Skill-Evolution Harnesses

arXiv:2609.39284v1 Announce Type: cross Abstract: While large language models have achieved remarkable success in isolated code generation, authentic software engineering requires sustained reasoning,

Evaluating Whether LLMs Can Reliably Connect the DOTs?

model-releasesarxiv-cs-cl

arXiv:2609.38406v1 Announce Type: new Abstract: Access to real-world information is often noisy and fragmented. Constructing a coherent narrative from such fragments requires models to reconstruct mis

Explore-on-Graph: Hybrid Embedding-LLM Reasoning for Knowledge Graph Question Answering under Incompleteness

model-releasesarxiv-cs-cl

arXiv:2609.39786v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly combined with knowledge graphs (KGs) to ground reasoning in structured evidence. However, most LLM-based K

ExploreNet: Learning Where to Explore in Diffusion GRPO

arXiv:2609.38329v1 Announce Type: new Abstract: Group-relative RL methods such as Flow-GRPO post-train image generators by exploring with isotropic Gaussian noise added at every denoising step. This n

Fairness Theatre: Evaluating Post-Hoc Fairness Interventions in Vendor-Controlled Early Warning Systems

arXiv:2609.38552v1 Announce Type: cross Abstract: Public institutions increasingly procure AI systems whose design they cannot inspect or change. In higher education, proprietary Early Warning Systems

safetyarxiv-cs-lg

GLARE: Generating Listening Heads with Appropriate Reactions

arXiv:2609.40317v1 Announce Type: new Abstract: While talking head generation has advanced rapidly, generating natural listener behavior in dyadic conversations, which know when to react, how to react

GraphForge: Training Working Agents with Graph-Anchored Workspace Synthesis

model-releasesarxiv-cs-cl

arXiv:2609.38923v1 Announce Type: new Abstract: Working agents need to read diverse files, coordinate tools, and produce deliverables. Training such agents requires tasks built on many real files with

Grounding Time-Series Foundation Models in Digital Twin Topology for Predictive Maintenance

arXiv:2609.40071v1 Announce Type: cross Abstract: Digital twins increasingly support downstream analytical tasks that depend on time-series data, motivating interest in time-series foundation models (

Agents

GroundingPI: A Grounding Foundation Model towards Physical Intelligence with Visual Primitives

arXiv:2609.39601v1 Announce Type: cross Abstract: Precise grounding matters. It specifies which object is the target and where that object is, even in clutter and for tiny objects, and it has to be fa

agentsarxiv-cs-ai

Hard-Region Supervision: #1 on the Waymo Open Dataset 2D Video Panoptic Segmentation Leaderboard

arXiv:2609.38714v1 Announce Type: new Abstract: We describe our winning entry to the Waymo Open Dataset 2D Video Panoptic Segmentation Challenge. The task asks for a semantic class at every pixel of e

Interactor: Agentic RL oriented Iterative Creation for Ad Description Generation in Sponsored Search

arXiv:2606.15911v2 Announce Type: replace Abstract: This paper focuses on automatically generating informative ad descriptions in sponsored search. Unlike ad titles which are usually optimized to attr

safetyarxiv-cs-cl

Learning to Route in Visual Space via Multi-Step Embedding Retrieval

arXiv:2609.38743v1 Announce Type: new Abstract: LLM agents rely on retrieval tools to access external knowledge, yet visual agentic search remains severely bottlenecked by standard single-step retriev

Less Data, Better Timing: Student-Curriculum Coupling for VLM On-Policy Distillation in Temporal Video Grounding

arXiv:2609.40055v1 Announce Type: cross Abstract: On-policy distillation (OPD) provides dense supervision directly on student-generated trajectories, making it an effective post-training strategy for

Make Code as Policy Great Again: Frontier Agents Write, Call, and Evolve Robot Tools

arXiv:2609.39018v1 Announce Type: cross Abstract: Frontier models can control robots, but reasoning through every reach, grasp, and retreat makes manipulation slow and token-intensive. We revisit code

Agents

MemCodex: Self-Programming Hierarchical Memory for Language Agents

arXiv:2609.39765v1 Announce Type: new Abstract: Agent memory faces heterogeneous access needs: a single-hop question may require one piece of evidence, whereas a multi-hop question must combine eviden

agentsarxiv-cs-cl

ModalFidelity: Routing Modalities for Deepfake Detection on a Budget

arXiv:2609.38246v1 Announce Type: cross Abstract: Deepfakes no longer need to fake a whole video. Generators that read the transcript now alter only the few seconds in which a video's meaning turns, s

researcharxiv-cs-ai

OP-CAD: On-Policy Clean-Audio Distillation for Robust Audio-Visual Reasoning

arXiv:2609.39150v1 Announce Type: new Abstract: Omni-modal large language models deployed in real-world environments encounter external noise that can interfere with their perception and understanding

Re-ranking and Late Interaction Drive Retrieval Quality: A Controlled Comparison of RAG Strategies for Scientific Question Answering

arXiv:2609.38473v1 Announce Type: cross Abstract: Retrieval-Augmented Generation (RAG) is now the standard way to ground Large Language Models (LLMs) in external knowledge, yet the design space of ret

Recognition of Urbanized Areas in UAV-Derived Very-High-Resolution Visible-Light Imagery

arXiv:2609.40212v1 Announce Type: new Abstract: This study compared classifiers that differentiate between urbanized and non-urbanized areas based on unmanned aerial vehicle (UAV)-acquired RGB imagery

Role-guided Speaker Deletion Verification in Clinical Psychiatry Speech Recordings with Audio Language Models

model-releasesarxiv-cs-lg

arXiv:2609.38491v1 Announce Type: new Abstract: Clinical research in psychiatry increasingly relies on large scale collection of spoken language data to identify acoustic and linguistic biomarkers. Ye

Semantic Misalignment in Vision-Language Models under Perceptual Degradation

arXiv:2601.08355v3 Announce Type: replace Abstract: Vision-Language Models (VLMs) are increasingly deployed in autonomous driving and embodied AI systems, where reliable perception is critical for saf

Signal-Routed Temperature Scaling: Low-Capacity Risk-Conditioned Calibration for Small Validation Budgets

arXiv:2609.38936v1 Announce Type: cross Abstract: When a classifier is recalibrated from only a few thousand held-out examples, the capacity of the calibration map becomes a statistical design choice

Structural Limits of the Information-Theoretic Uncertainty Decomposition

arXiv:2609.39591v1 Announce Type: new Abstract: Uncertainty estimation in machine learning typically decomposes uncertainty into aleatoric uncertainty (AU) and epistemic uncertainty (EU) using the sta

TutlAit v1: a crowdsourced Moroccan Tamazight speech dataset with Arabic transcriptions and regional accent labels

arXiv:2609.38219v1 Announce Type: new Abstract: Tamazight (Amazigh) is, together with Arabic, one of the two official languages of Morocco, yet it remains severely under-resourced for speech technolog

researcharxiv-cs-cl

What to Attend, What to Keep: Skill-Conditioned Visuotactile Representation with Progress-Guided Event Memory

arXiv:2609.38494v1 Announce Type: cross Abstract: Robotic manipulation integrates vision, touch, and language, whose importance shifts across stages: vision guides reaching, while touch, through its e

When a Kindergartener Solves Calculus: Measuring Capability Leakage in Role-Prompted Reasoning Models

arXiv:2609.39846v1 Announce Type: cross Abstract: We investigate the problem of role-capability leakage (RCL), in which a role-prompted reasoning model generates convincing in-role text while continui

Who Owns That? Evaluating Ownership Intuitions in Large Language Models

arXiv:2609.39483v1 Announce Type: new Abstract: Ownership establishes rights over the use, control, and transfer of objects. Understanding these relations is essential for AI systems to interact appro

researcharxiv-cs-ai

Early Learning Shapes Later Directions Of Representation Change In Continual Learning

arXiv:2609.36081v1 Announce Type: new Abstract: Representations continually change as a network learns new tasks. We ask whether early representational changes naturally form a geometric structure tha

researcharxiv-cs-lg

Local Ai

FocusVTC: Efficient and High-Performance Visual Text Compression with Adaptive Resolution

arXiv:2609.36651v1 Announce Type: cross Abstract: Long-context reasoning in large language models incurs substantial computation and memory costs. Visual text compression (VTC) reduces input length by

local-aiarxiv-cs-ai

Follow-up: my native Rust + Vulkan Transformer training backend — 14 days later, now 14 parity-verified architectures and full PEFT

model-releasesr-localllama

Follow-up to my post from about two weeks ago. A lot has changed since then, so I wanted to post an update on where the backend is now. Where the green architectures stand When I posted last time, 7 a

Hierarchical Compression of Vision-Language Model Benchmarks

arXiv:2609.37515v1 Announce Type: cross Abstract: Thorough evaluation of vision-language models (VLMs) has become prohibitively expensive, as benchmarks span an ever-broader spectrum of capabilities a