Trust Before Autonomy: Rethinking Agentic Remote Sensing for Crisis Response

arXiv:2610.18789v1 Announce Type: new Abstract: Agentic remote sensing is evaluated on how many questions it can answer, whereas crisis response depends on whether its answers can be relied on and how much of the decision can safely be handed to the agent. This paper argues that autonomy should be earned, not assumed: An Earth-Observation (EO) agent should be granted autonomy in proportion to demonstrated reliability, epistemic honesty and verifiability. The position is supported by an evidential meta-analysis of twelve agentic RS/EO/GIS benchmark studies from peer-reviewed venues. Only one repeats runs, three contain unanswerable tasks and none measures calibration. Their own tables show that completed workflows are often not correct (task success exceeds tool-call correctness by up to 54pp on identical queries), that the gap to an expert trajectory widens overall with trajectory length (from 7 to 56pp), and that capability does not predict abstention (Spearman r from -0.25 to 0.50, all n.s.). The paper then contributes three EO-specific trust properties, an autonomy ladder for crisis EO tasks, and a readiness protocol that replays archived emergency activations before any live use. In this context, current evidence justifies assistive roles only.

Related

• BEFORE THE FLIP: Measuring Hidden Score Shifts In Quantized Vision Language Models Before The Answer Changes for Visual Question Answering
• Benchmark Designers Should 'Train on the Test Set' to Expose Exploitable Non-Visual Shortcuts
• FairRSFM: A Biome-Aware Benchmark and Debiasing Framework for Remote Sensing Foundation Models
• DisasterInsight: A Multimodal Benchmark for Function-Aware and Grounded Disaster Assessment

Source: arXiv cs.CV | 2026-10-14