EvoSpatial: Experience-Driven Skill and Tool Evolution for Spatial Reasoning Agents

arXiv:2610.16679v1 Announce Type: new Abstract: Tool-augmented vision-language agents compose perception and measurement to reason about spatial relationships, but effective execution also requires tracking geometric assumptions and checking intermediate evidence. Preserving this experience across tasks requires retaining procedural knowledge together with the computations it governs. We introduce EvoSpatial, an experience-driven framework that evolves a library of linked skills and tools. Our key insight is that successful and failed spatial trajectories reveal both how to compute and when to trust the result. EvoSpatial retrieves skills, reuses tools, and synthesizes reusable computational functions (generated helpers) during reasoning. After answer submission, supervised outcome feedback guides skill refinement and tool consolidation for subsequent tasks. Across 20 benchmarks, EvoSpatial attains the highest average score among the compared spatial agents, exceeding SpatialClaw by 4.0 percentage points. Further experiments show cross-benchmark transfer and improved reasoning through skill-guided distillation without external skills at evaluation. These results support accumulating spatial experience for both inference-time reuse and trajectory-based training.

Related

• S-Agent: Spatial Tool-Use Elicits Reasoning for Spatial Intelligence
• Dynamo: Dynamic Skill-Tool Evolution for Vision-Language Agents
• Skill-3D: Evolving Scene-Aware Skills for Agentic 3D Spatial Reasoning
• Don't Show Pixels, Show Cues: Unlocking Visual Tool Reasoning in Language Models via Perception Programs

Source: arXiv cs.CV | 2026-10-14