ReCoQA: A Benchmark for Tool-Augmented and Multi-Step Reasoning in Real Estate Question and Answering

arXiv:2604.17944v1 Announce Type: new Abstract: Developing agents capable of navigating fragmented, multi-source information remains challenging, primarily due to the scarcity of benchmarks reflecting hybrid workflows combining database querying with external APIs. To bridge this gap, we introduce ReCoQA, a large-scale benchmark of 29,270 real-estate instances featuring machine-verifiable supervision for intermediate steps, including structured intent labels, SQL queries, and API calls. Complementarily, we propose HIRE-Agent, a hierarchical framework instantiating an understand-plan-execute architecture as a strong baseline. By orchestrating a Front-end parser, a planning Supervisor, and execution Specialists, HIRE-Agent effectively integrates heterogeneous evidence. Extensive experiments demonstrate that HIRE-Agent constitutes a strong baseline and substantiates the necessity of hierarchical collaboration for complex, real-world reasoning tasks.

Related

• Benchmarking Real-Time Question Answering via Executable Code Workflows
• From Proof to Program: Characterizing Tool-Induced Reasoning Hallucinations in Large Language Models
• MERRIN: A Benchmark for Multimodal Evidence Retrieval and Reasoning in Noisy Web Environments
• Scaling External Knowledge Input Beyond Context Windows of LLMs via Multi-Agent Collaboration

Source: arXiv cs.CL | 2026-04-21