CALL FOR PAPERS
WMAC 2027: Third Workshop on Multi-Agent Collaboration
Measuring Collective Intelligence in Agentic Systems
AAAI-27 | Montréal, Canada | February 22–23, 2027

Website: https://multiagents.org/2027/
Submit on OpenReview: https://openreview.net/group?id=AAAI.org/2027/Workshop/WMAC
Submission deadline: November 20, 2026 (AoE)

OVERVIEW

Modern agent deployments rarely consist of a single model. Coding assistants delegate to sub-agents for retrieval, editing, and verification; research prototypes organize dozens of agents into societies that negotiate and trade; and most real systems keep humans in the loop. How well these pieces work together decides how well the system works.

Our evaluation tools have not kept up. Standard benchmarks score one model on one task and say little about coordination overhead, specialization, communication efficiency, or whether adding another agent helps at all. The first two WMAC editions asked how to make LLM-based agents collaborate. One question kept coming back and stayed open: how do we know a group of agents is actually working well together? This edition takes that question as its topic.

We want to make progress on three questions:
1. What is worth measuring in a multi-agent or sub-agent system, beyond end-task success?
2. How can it be measured reproducibly and comparably across systems?
3. When do collectives outperform individuals, and when do they merely add cost?

We welcome contributions from machine learning, multi-agent systems, reinforcement learning, economics, and cognitive science.

TOPICS OF INTEREST

Submissions on the following topics are welcome, but not limited to them:

- Metrics and evaluation methodologies. New metrics for coordination quality, communication efficiency, specialization, and robustness in agent teams; extending single-agent frameworks (e.g., AgentBoard) and multi-agent arenas (e.g., LLMArena) to measure collective behavior.
- Benchmarks, environments, and simulations. Controlled environments where collective behavior can be studied reproducibly, including negotiation and social settings; benchmarks that score collaboration and competition directly.
- Foundations and theories. Formal definitions and scaling laws for collective intelligence, with connections to biological and economic systems.
- Hierarchical and sub-agent architectures. Measurement questions specific to planner–executor and manager–worker structures, where performance is attributable to no single component.
- Human–agent collectives. Evaluation of mixed human–AI teams and collective decision making.
- Applications. Case studies from software engineering, scientific discovery, robotics, healthcare, and economics where collective performance was measured, successfully or not.

SUBMISSION GUIDELINES

Full papers: up to 8 pages. Original research on measuring collective intelligence in agentic systems.
Short, demo & position papers: up to 4 pages. Early results, system demos, case studies, and position statements.

- Non-archival. Presenting at WMAC does not prevent publication elsewhere; work under review or recently published at other venues is welcome.
- Double-blind review on OpenReview, with three reviews per paper. Please anonymize your submission.
- Format. Page limits exclude references and appendices. Please use the AAAI-27 author kit.
- Presentation. Accepted papers are presented as oral talks or posters. Every poster gets a short lightning pitch.
- Best Student Paper Award for work led by a master's or PhD student.
- Industry demos of deployed multi-agent systems are welcome. Presenters should prepare a recorded fallback.

Submit at: https://openreview.net/group?id=AAAI.org/2027/Workshop/WMAC

IMPORTANT DATES

Paper submission deadline: November 20, 2026 (AoE)
Notification of acceptance: December 2, 2026
Workshop: February 22–23, 2027, Montréal (AAAI-27)

Dates follow the schedule set by the AAAI-27 workshop chairs and may change. Check the website for updates.

PROGRAM

A full day built for interaction: four invited talks, contributed oral and lightning talks, a poster session, breakout discussions in small groups, live industry demos, and a closing panel.

Invited participants (tentative, pending confirmation):
- Michael Wooldridge, University of Oxford
- Samy Bengio, Apple / EPFL
- Mikaela Grace, Anthropic
- Bo An, Nanyang Technological University
- Noah Goodman, Stanford University

ORGANIZERS

- Raphael Shu, OpenAgents (workshop chair)
- Alborz Geramifard, LinkedIn
- Alex Marin, Thomson Reuters Labs
- Yusen Zhang, Columbia University
- Asli Celikyilmaz, Microsoft / University of Washington

ABOUT THE SERIES

WMAC is the Workshop on Multi-Agent Collaboration at AAAI. WMAC 2025 (Philadelphia) received 33 submissions with 178 registered attendees. WMAC 2026 (Singapore, AAAI-26 Bridge Program) received 42 submissions with over 600 registrations. Past editions: https://multiagents.org/

CONTACT

Contact the workshop chair Raphael Shu (raphael@uaca.com).

We look forward to your submissions and to seeing you in Montréal!