What Makes a Social Agent's Interactions Effective? Learning from Verifiable Outcomes in Paired Worlds

arXiv:2610.20195v1 Announce Type: new Abstract: Effective social interaction requires more than fluent responses: agents must reach plans that fit the participants' needs and circumstances. Existing evaluations of social agents mainly rely on LLM judges that rate the conversation, without checking the resulting plan. We introduce HICO-Bench, a benchmark of 180 everyday coordination scenarios, such as resource allocation, scheduling, and authorization, in which two agents with private information converse and then independently record the plan they agreed on. A program checks Feasibility (the two records match and satisfy both participants' private conditions), and an LLM judge checks Integrity (the conversation supports the recorded plan); passing both is a Verified Success. Each scenario has two versions that share the same public context but differ in one private condition, so the correct plan differs between them. Across thirteen LLMs, 36% of conversations rated highly for goal completion fail Verified Success. To learn from outcomes that arrive only at the end of a conversation, we propose Paired-Credit Policy Optimization (PaCPO). After each turn, PaCPO asks the agent for a tentative plan, checks it in both versions of the scenario, and rewards the turns after which the tentative plans fit their respective versions. PaCPO raises Qwen3-8B's Verified Success from 20.4% to 28.3%.

Related

• What Do AI Agents Talk About? Discourse and Architectural Constraints in the First AI-Only Social Network
• When to Communicate: Belief Distributions and KL Divergence for Principled Gating in Multi-Agent RL
• RealClawBench: Live OpenClaw Benchmarks from Real Developer-Agent Sessions
• Do LLMs Trust the Accuser or the Accusation? Measuring Belief Shifts in Werewolf
• MMDS-Bench: Benchmarking Multimodal Large Language Models on Dynamic Stance in Social Media Interactions

Source: arXiv cs.CL | 2026-10-15