Search: “multimodal”

The Robot Data Factory

model-releasesarxiv-cs-ro

arXiv:2609.16705v1 Announce Type: new Abstract: Physical AI requires more than increasingly large robot datasets: intelligent robots acquire knowledge through continuous interaction with the physical

16 Sept 2026

Toward Governance-Aware Autonomous GIS: A Narrative Review of Ethical and Privacy Risks in LLM-Enabled GeoAI

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2609.16232v1 Announce Type: new Abstract: Geospatial artificial intelligence (GeoAI) powered by large language models (LLMs) is expanding the capacity to query, generate, and interpret spatial i

safetyarxiv-cs-ai

16 Sept 2026

Towards Illusions Awareness in Cyber-Physical System's Design

arXiv:2609.17260v1 Announce Type: new Abstract: Cyber-Physical Systems (CPS) operate through a continuous sense-compute-act loop within an open context environment, making it impossible to anticipate

researcharxiv-cs-cl

16 Sept 2026

Applications

A Conservative OCR-Enabled Workflow for R214 Sodium Screening of South African Packaged Foods

arXiv:2609.15427v1 Announce Type: cross Abstract: Using food package images to monitor sodium and salt content against South Africa's R214 sodium limits is challenging when screening decisions require

applicationsarxiv-cs-ai

Adapting Open-Weight MLLMs to Generate Point Prompts for Electron Microscopy Segmentation

arXiv:2609.14080v1 Announce Type: new Abstract: Promptable models such as microSAM segment electron microscopy (EM) images from point prompts, but automation requires generating prompts without user i

researcharxiv-cs-cv

AnchorGUI: Asymmetric Memory for Dual-Scale Learning in GUI Navigation

arXiv:2609.15457v1 Announce Type: new Abstract: Vision-Language Models (VLMs) enable autonomous GUI navigation, but agents still struggle to process and learn from dense, continuous visual histories.

agentsarxiv-cs-cv

Beyond Dead Reckoning: A Point of View on Camera--DAS--GNSS Continuity in Road Tunnels

arXiv:2609.14748v1 Announce Type: new Abstract: Road tunnels remove satellite visibility where connected and automated vehicles still require continuous, attributable, and integrity-bounded positionin

researcharxiv-cs-ro

Beyond Safe Answers: Segment-Aware Listwise Alignment for Reasoning Safety in Large Reasoning Models

arXiv:2609.15517v1 Announce Type: new Abstract: Large Reasoning Models (LRMs) pose a dual-surface safety challenge: both intermediate reasoning traces and final answers can contain harmful content. Ex

Bridging Thought and Action: Taming Long-Horizon Instability in Open-Source LLM Agents with a MetaTool-Enhanced ROS Framework

arXiv:2609.13335v1 Announce Type: cross Abstract: Large Language Models (LLMs) have enabled more natural human-robot interaction, but open-source models often exhibit unstable long-horizon reasoning a

agentsarxiv-cs-ai

CCMAN: Cognitive Instability-Aware Cross-Modal Attention Network for Interpretable Temporal Biomarkers of Verbal Fluency Speech

model-releasesarxiv-cs-lg

arXiv:2609.14764v1 Announce Type: cross Abstract: Early detection of cognitive decline from speech offers a scalable and non-invasive alternative to conventional clinical assessment. Verbal fluency ta

DiVA: Enabling Interactive Digital Life Simulation via Video Models

arXiv:2609.13830v1 Announce Type: new Abstract: We present DiVA, a deeply interactive digital life simulator pioneering a new paradigm for long-term, open-ended interactive experiences within digital

researcharxiv-cs-cv

Enhancing Large Language Model-Based Systems for End-to-End Circuit Analysis Problem Solving

arXiv:2512.10159v3 Announce Type: replace-cross Abstract: LLMs have shown strong performance in data-rich domains such as programming, but their reliability in engineering tasks remains limited. Circu

Four Ledgers, Not One Score: Responsible Communication of LLM-Judge Calibration in Biomedical ML

arXiv:2609.15015v1 Announce Type: new Abstract: Synthetic perturbations appear to offer inexpensive calibration data for LLM evaluators in biomedical ML, where expert review is scarce. Yet a planted m

From matrix inversion to constraints: provably tighter confidence regions for importance weights in label shift

arXiv:2609.14802v1 Announce Type: cross Abstract: Importance weights are essential in domain adaptation under label shift, yet their utility is often undermined by the finite sample uncertainty associ

agentsarxiv-cs-lg

Local Ai

From Visual Attribution to Clinical Reasoning: Explainable Parkinson's Disease Screening from Hand-Drawn Patterns

arXiv:2609.14441v1 Announce Type: cross Abstract: Parkinson's disease (PD) manifests early neuromotor impairments that become observable in controlled hand-drawn patterns such as spirals and meanders,

local-aiarxiv-cs-ai

Grounded Adjudication of Variations across Extracted TimeLines (GAVEL): Comparing Clinical Timelines Against Their Case Reports

arXiv:2609.13475v1 Announce Type: new Abstract: Existing pipelines for clinical timeline extraction from case reports are evaluated using an expert reference and are limited by imperfect reference ann

Harnessing human expertise for high-precision robotic assembly in industrialized construction: A sample-efficient installer-in-the-loop interactive reinforcement learning framework

arXiv:2609.13234v1 Announce Type: new Abstract: Industrialized construction imposes stringent precision requirements on robotic assembly of modular components such as prefabricated window units. In to

safetyarxiv-cs-ro

HarnessVLN: Unifying Training-Free Embodied Navigation through an Agent Harness

arXiv:2609.15195v1 Announce Type: new Abstract: Embodied navigation requires agents to interpret visual observations, accumulate spatial knowledge, and execute actions to follow instructions or locate

agentsarxiv-cs-ro

(How) Do MLLMs Report Bistable Images Like Humans?

arXiv:2609.13254v1 Announce Type: cross Abstract: Bistable images such as the duck-rabbit are classic stimuli in which one image supports multiple mutually incompatible interpretations, typically repo

Human-Grounded Calibration for Long-Text Image-Text Congruence in Vision-Language Models

arXiv:2609.15640v1 Announce Type: cross Abstract: Long-text image--text congruence scoring is increasingly important for vision-language systems that must evaluate whether detailed textual description

researcharxiv-cs-cl

LayerRoute: Adaptive Layer-Skipping with LoRA-Preserved Quality for Efficient LLM Inference

arXiv:2609.13682v1 Announce Type: cross Abstract: We introduce LayerRoute, a parameter-efficient method for adaptive transformer layer-skipping that combines per-layer hard-gated routing (trained via

Learning Human-Like Badminton Skills for Humanoid Robots

arXiv:2602.08370v2 Announce Type: replace-cross Abstract: Realizing versatile and human-like performance in high-demand sports like badminton remains a formidable challenge for humanoid robotics. Unli

Learning Manipulation-Sufficient Representations via Outcome Bottlenecks

arXiv:2609.13235v1 Announce Type: cross Abstract: Networked manipulation endpoints couple perception to actuation across compute- and bandwidth-limited links, yet commonly exchange dense geometric sta

safetyarxiv-cs-cv

LePlanner: An Iterative Amortized Controller For World Models

arXiv:2609.13845v1 Announce Type: cross Abstract: World models trained with joint-embedding predictive architectures learn compact, structured latent representations from physical interaction, yet pla

MedSAM3: Delving into Segment Anything with Medical Concepts

arXiv:2511.19046v2 Announce Type: replace-cross Abstract: Medical image segmentation is fundamental for biomedical discovery. Existing methods lack generalizability and demand extensive, time-consumin

agentsarxiv-cs-ai

Perceptual Reality Transformer: What Must an Illustration Preserve?

arXiv:2508.09852v2 Announce Type: replace-cross Abstract: How can models help people communicate unusual perceptual experiences without changing what they mean? A recognizable image is only part of th

PhysBrain 1.5: From Vision-Language Models to Physical Foundation Models

arXiv:2609.14973v1 Announce Type: new Abstract: We present PhysBrain 1.5, a unified model for understanding physical environments, generating actions, and predicting future states. Motivated by the ph

PuzzleMate: Benchmarking MLLMs for Egocentric Puzzle Assistance

arXiv:2609.14473v1 Announce Type: new Abstract: Personal AI assistants hold the potential to evolve from digital interfaces into embodied companions capable of guiding users through complex physical a

Refinement-based Flow Policy Optimization

arXiv:2609.15123v1 Announce Type: cross Abstract: Flow-based policies offer an expressive representation for online reinforcement learning, but conventional flow matching requires samples drawn from t

Rethinking Camouflage Image Generation towards a Training-Free Paradigm

arXiv:2609.14377v1 Announce Type: new Abstract: Camouflage image generation (CIG) aims to synthesize realistic camouflaged images by blending foreground objects into concealment-compatible background

SomBench: Benchmark Dataset for Advancing Machine Learning in Lunar Science

arXiv:2609.13277v1 Announce Type: new Abstract: Lunar orbital missions, such as Lunar Reconnaissance Orbiter, Kaguya/SELENE, Gravity Recovery and Interior Laboratory, and Lunar Prospector, among other

Talking to Me or Someone Else? Rethinking Talk-to-Me Detection in Egocentric Videos

arXiv:2609.14118v1 Announce Type: cross Abstract: Online understanding of who is talking to the camera wearer is a key capability for egocentric social interaction. However, existing talk-to-me (TTM)

The Router Within: Eliciting Native Skill Routing from a Frozen LLM

arXiv:2609.15982v1 Announce Type: cross Abstract: Skills extend an LLM agent beyond its parametric knowledge, and the gain they promise rests on picking the right one. Deployed harnesses route by prel

Thinking beyond the anthropomorphic paradigm benefits LLM research

arXiv:2502.09192v3 Announce Type: replace Abstract: Anthropomorphism, or the attribution of human traits to technology, is an automatic and unconscious response that occurs even in those with advanced

researcharxiv-cs-cl

Transfer Learning for Socioeconomic Estimation in Forced-Displacement Settings

arXiv:2609.15773v1 Announce Type: cross Abstract: Progress in inclusive household surveys has strengthened socioeconomic evidence for forcibly displaced populations, providing indispensable benchmarks

Trustworthy Agentic AI: A Comprehensive Cybersecurity and Systems Survey on Threat Landscapes, Defense Architectures, and Open Challenges

arXiv:2609.13731v1 Announce Type: new Abstract: The transition from passive foundation models to autonomous, goal-directed agentic AI systems has introduced unprecedented capabilities by coupling recu

VGFM: Expressive Robot Policies via Dense Value Guidance in Flow Matching

arXiv:2609.14261v1 Announce Type: cross Abstract: Recent robot learning paradigms increasingly rely on large offline datasets of robotic interactions to train control policies. Expressive generative m

safetyarxiv-cs-lg

Local Ai

WLA^3: World Latent Action Modeling for Semantics, Dynamics, and Kinematics

arXiv:2609.15870v1 Announce Type: new Abstract: Scaling generalist policy models with heterogeneous data is limited by the lack of unified, low-noise action supervision. Human egocentric videos are ab

local-aiarxiv-cs-ro

AnchorVLN: Geometry-Anchored Vision-Language Grounding Reasoning for Open-Vocabulary Navigation

arXiv:2609.12285v1 Announce Type: cross Abstract: Vision-Language Navigation (VLN) in unseen indoor environments is useful in real-world robotics, where an agent must follow natural-language instructi

Behavior Quotient Learning for Low-Rank Adaptation of LLM Agents

model-releasesarxiv-cs-lg

arXiv:2609.12896v1 Announce Type: new Abstract: LLM-based agents rely on heterogeneous interaction capabilities to accomplish complex tasks. Existing approaches often distribute these capabilities acr

DWMP: Leveraging Dual World Models for Humanoid Obstacle Traversal

arXiv:2609.12347v1 Announce Type: new Abstract: Humanoid robots must traverse cluttered obstacle fields using onboard proprioceptive and visual observations, yet existing methods usually process multi

safetyarxiv-cs-ro

Hardware

Dynamic Expert Quantization for Scalable Mixture-of-Experts Inference

arXiv:2511.15015v4 Announce Type: replace-cross Abstract: Mixture-of-Experts (MoE) has become a practical architecture for scaling LLM capacity while keeping per-token compute modest, but deploying Mo

hardwarearxiv-cs-lg

EventMemAgent: Hierarchical Event-Centric Memory for Online Video Understanding with Adaptive Tool Use

arXiv:2602.15329v2 Announce Type: replace Abstract: Online video understanding requires models to perform continuous perception and long-range reasoning within potentially infinite visual streams. Its

Tutorials

FRIST: FMRI Representation Informed Shared-space Training Improves EEG-only Individual-Finger BCI Decoding

arXiv:2609.12298v1 Announce Type: new Abstract: Finger-level motor decoding is important for naturalistic brain-computer interface (BCI) control, yet individual-finger decoding from scalp electroencep

tutorialsarxiv-cs-lg

Hardware

HoliBench: A Cross-Platform Benchmarking and Deployment Toolkit for Foundation Models in CPS-IoT Applications

arXiv:2609.12412v1 Announce Type: cross Abstract: Foundation models, including large language models, vision-language models, and time-series foundation models, are increasingly deployed on embedded a

hardwarearxiv-cs-lg

Not All Speech Is Intent: Adaptive Self-Correcting Inference Layer for Post-ASR False Wake-Up

model-releasesarxiv-cs-cl

arXiv:2609.12469v1 Announce Type: new Abstract: False wake-up activations remain a persistent challenge in conversational AI. Speech phonetically similar to a device's wake word can produce a syntacti

Online Video Agent Harness for Long Video Understanding

arXiv:2609.12818v1 Announce Type: new Abstract: Long video understanding often behaves like a visual needle-in-a-haystack problem: query-relevant evidence is sparsely distributed across long temporal

agentsarxiv-cs-cv

PA-CDM: Position-Aware Character Detection Matching for Evaluating Handwritten Mathematical Expression Recognition

model-releasesarxiv-cs-cl

arXiv:2609.12917v1 Announce Type: cross Abstract: Handwritten mathematical expression recognition (HMER) is conventionally scored by exact-match rates and string-similarity metrics that are blind to w