Agents
Inside VAKRA: Reasoning, Tool Use, and Failure Modes of Agents
VAKRA (Versatile Agent and Knowledge Reasoning Assessment) is a benchmark developed by IBM Research to evaluate AI agents on complex reasoning, tool use, and multi-step task execution across diverse d
VAKRA (Versatile Agent and Knowledge Reasoning Assessment) is a benchmark developed by IBM Research to evaluate AI agents on complex reasoning, tool use, and multi-step task execution across diverse domains. The benchmark assesses failure modes in agentic systems, examining where and why agents break down when handling tasks that require planning, external tool integration, and dynamic decision-making. The analysis provides insights into agent performance gaps, helping researchers understand limitations in current AI agent architectures to guide future improvements.
Related
- OctoTools: An Agentic Framework with Extensible Tools for Complex Reasoning
- RAGEN-2: Reasoning Collapse in Agentic RL
- Structure-Grounded Knowledge Retrieval via Code Dependencies for Multi-Step Data Reasoning
- SkVM: Revisiting Language VM for Skills across Heterogenous LLMs and Harnesses
- Reasoning Provenance for Autonomous AI Agents: Structured Behavioral Analytics Beyond State Checkpoints and Execution Traces
- CodeTracer: Towards Traceable Agent States
Source: Hugging Face | 2026-04-15