AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysis

arXiv:2608.17834v1 Announce Type: cross Abstract: Large language models are pushing data science toward increasingly autonomous and agentic workflows, with recent systems already supporting multi-step and long-running analyses. As these workflows become more autonomous, conventional interfaces no longer provide adequate support for two critical requirements: observability for understanding an agent's evolving reasoning and evidence, and steerability for redirecting low-value directions or deepening promising ones during execution. Existing interactive approaches improve process visibility and open intervention points, but they remain largely designed for discrete, turn-by-turn exchanges rather than the parallel branches and evolving decision structures of long-running agentic analysis. We study this need as interactive oversight in long-running agentic data analysis and present AdaLens, an interactive system for monitoring and steering ongoing runs. AdaLens combines a storyline-based representation that unifies analytical plans, execution progress, intermediate findings, and data-column involvement with steering interactions grounded in these analytical elements for directional guidance and execution control. We evaluate AdaLens through two case studies and a user study, examining how it supports analysts in monitoring and steering long-running agentic data analysis.

Related

• MUSE: An Interactive Meta-Agent for Understanding and Steering LLM-powered Data Science Systems
• How Consistent Are LLM Agents? Measuring Behavioral Reproducibility in Multi-Step Tool-Calling Pipelines
• Willful Disobedience: Automatically Detecting Failures in Agentic Traces
• Formal Verification of Agentic Systems over Operational Data

Source: arXiv cs.AI | 2026-08-19