SEPAL: Separated Expert Pairs with Answer-Level Fusion for Reliable LLM Collaboration

arXiv:2609.39645v1 Announce Type: cross Abstract: Multi-agent collaboration lets large language models (LLMs) improve question answering through deliberation and feedback. Yet shared discussion couples correction with exposure to the same mistakes, which can erode the diversity needed for voting. Self-consistency offers sampling diversity without feedback, while single-pair Actor-Critic collaboration refines only one candidate. We introduce SEPAL, which assigns three private Actor-Critic teams to direct reasoning, evidence grounding, and verification. Role-specific training gives the teams different reasoning objectives beyond sampling variation. Each Critic guides revisions within its own team, preventing feedback from carrying errors across candidates. Once revision ends, majority voting combines only the final answers, keeping the reasoning histories separate until the decision. Across five open-weight backbones and five question-answering benchmarks, SEPAL improves mean accuracy by 1.81 percentage points over a matched single Actor-Critic pair, with improvements across all five backbones. Code is available at https://github.com/zhansan114514/SEPAL.

Related

• MATA: Multi-Agent Framework for Reliable and Flexible Table Question Answering
• OMAC: A Holistic Optimization Framework for LLM-Based Multi-Agent Collaboration
• From Voting to Agent Collaboration: Answer-Type-Aware LLM Pipelines for BioASQ 14b
• Dynamic Trust-Aware Sparse Communication Topology for LLM-Based Multi-Agent Consensus

Source: arXiv cs.AI | 2026-10-01