Agents
Creative Generation via Multi-Agent Debate: Does Debate Suppress Diversity?
arXiv:2609.00683v1 Announce Type: new Abstract: Creative generation tasks, such as narrative writing and scientific ideation, demand both high-quality outputs and distinct responses across independent
arXiv:2609.00683v1 Announce Type: new Abstract: Creative generation tasks, such as narrative writing and scientific ideation, demand both high-quality outputs and distinct responses across independent runs to maximize exploration. Multi-Agent Debate (MAD) has shown strong quality gains on factual and reasoning tasks, making it a natural candidate for creative generation. However, we find its convergence-driven design actively suppresses output diversity across independent runs, creating an inherent trade-off with creative tasks. We theoretically show that preserving diversity among agents within each debate session is a necessary condition for achieving diverse outputs across independent runs. Building on this finding, we propose Creative-MAD, which introduces two synergistic interventions to sustain agent divergence. Specifically, Cognitive Lens Assignment counters identity drift by anchoring each agent to a distinct and persistent cognitive mode, while Embedding-based Peer Selection counters majority pull by limiting each agent's context to its most semantically distant peers. Experiments across four creative benchmarks demonstrate that Creative-MAD significantly enhances both lexical and semantic diversity while maintaining MAD's output quality.
Related
- Hear Both Sides: Efficient Multi-Agent Debate via Diversity-Aware Message Retention
- Diversity Collapse in Multi-Agent LLM Systems: Structural Coupling and Collective Failure in Open-Ended Idea Generation
- Multi-Persona Debate System for Automated Scientific Hypothesis Generation
Source: arXiv cs.CL | 2026-09-02