Multi-Agent Debate & LLM Reasoning Glossary
Plain-English definitions for the terms used across Multi Agent Debates research — from M-MAD and CoT-SC to Degeneration of Thought and calibration.
Multi-Agent Debate (MAD)
Also known as: MAD, LLM debate, multi-agent AI debate
- Multi-Agent Debate is an LLM reasoning technique in which two or more language model instances argue across structured rounds, critiquing each other's claims before a verdict. Research reports improvements on some factuality, calibration, and adversarial robustness benchmarks, with outcomes varying by model and task.
Self-Consistency (CoT-SC)
Also known as: CoT-SC, chain-of-thought self-consistency, majority voting LLM
- Self-Consistency is a reasoning strategy that samples multiple chain-of-thought paths from one model at non-zero temperature, then majority-votes the final answer. Introduced by Wang et al. (ICLR 2023), it is fast, embarrassingly parallel, and the strong default for math and multiple-choice tasks with a single correct label.
M-MAD
- M-MAD (Multidimensional Multi-Agent Debate) is a verdict-scoring protocol from Feng et al. (ACL 2025) that runs independent arbiter passes on separate dimensions — correctness, evidence use, responsiveness, calibration, and citation quality — instead of one holistic 'who won' judgment. Multi Agent Debates uses M-MAD in its Truth-Seeking Debate workflow.
Degeneration of Thought (DoT)
Also known as: DoT
- Degeneration of Thought is a failure mode formalized by Liang et al. (EMNLP 2024) where an LLM, once committed to an answer, fails to produce genuinely novel reasoning during self-reflection — even when the initial answer is wrong. Separating critic and advocate roles may help, but does not eliminate the risk.
Truth-Seeking Debate
- Truth-Seeking Debate is a 10-phase protocol combining structured rebuttals, claim extraction, and an independent M-MAD arbiter sweep. It is designed for cases where an auditable per-dimension scorecard is more useful than a single confidence number.
Open Discussion
- Open Discussion is the platform's brainstorming protocol. Agents take turns surfacing objections, evidence, and angles without a fixed verdict pipeline. It can be used for exploratory pre-mortems, early-stage idea expansion, and collecting objections before a more structured debate.
Team Discussion
- Team Discussion is the platform's two-team protocol. Battle mode places an advocate team against an adversary team across bounded rounds; collaboration mode lets the teams synthesize. It can be used for message testing, product positioning, and other settings that benefit from a staged opposing case.
Dimension-Sweep Arbiter
- A Dimension-Sweep Arbiter scores a debate across independent passes — typically correctness, evidence use, responsiveness, calibration, and citation quality — rather than producing a single holistic judgment. Introduced by Feng et al. (ACL 2025) as M-MAD, it prevents an arbiter from retroactively rewriting its own verdict.
Mixture-of-Agents (MoA)
Also known as: MoA
- Mixture-of-Agents is a layered multi-LLM architecture from Wang et al. (ICLR 2025) where each layer's agents refine the previous layer's outputs. Open-source MoA reached 65.1% on AlpacaEval 2.0, beating GPT-4 Omni — strong evidence that orchestrated ensembles can outperform any single frontier model.
Chain-of-Thought (CoT)
Also known as: CoT
- Chain-of-Thought prompting (Wei et al., 2022) is the technique of asking an LLM to 'think step by step' before giving an answer. It unlocks reasoning that greedy single-shot decoding misses and is the foundation that Self-Consistency and Multi-Agent Debate both build on.
Reflexion
- Reflexion (Shinn et al., NeurIPS 2023) is a verbal self-critique loop where an agent reflects on prior attempts, generates a critique, and retries. The method uses linguistic feedback rather than updating model weights during the task.
Self-Refine
- Self-Refine (Madaan et al., NeurIPS 2023) is single-model iterative refinement using self-generated feedback. It is the minimal version of what multi-agent debate scales up across roles — the same critique-and-revise loop, but performed by separate agents with distinct context to avoid Degeneration of Thought.
ChatEval
- ChatEval (Chan et al., ICLR 2024) demonstrated that multi-agent debate panels evaluate generated text more reliably than single-judge baselines. It is one of the foundational results behind using LLM-as-judge debates for tasks like response quality scoring and open-ended evaluation.
AutoGen
- AutoGen (Microsoft, COLM 2024) is a multi-agent conversation framework that orchestrates role-specialized agents through structured dialogues. It covers general multi-agent tasks, while Multi Agent Debates focuses on configured debate protocols and an M-MAD-inspired arbiter pipeline.
CrewAI
- CrewAI is an open-source framework for role-based multi-agent orchestration with sequential or hierarchical task execution. It is a general-purpose orchestration framework, while Multi Agent Debates focuses on purpose-built discussion formats, durable monitoring, and format-specific reports.
LangGraph
- LangGraph is LangChain's graph-based agent orchestration library, modeling multi-agent flows as stateful directed graphs. Multi Agent Debates uses configured debate protocols rather than user-authored graphs, with M-MAD-inspired scoring.
Model Context Protocol (MCP)
Also known as: MCP
- The Model Context Protocol is an open standard for connecting AI applications to external tools, data sources, and reusable prompts through a common client-server interface. It reduces the need to build a separate proprietary connector for every compatible host and service.
Sycophancy
- Sycophancy is the tendency of LLMs to agree with users or peers even when the correct answer disagrees. In multi-agent debate, Wynn et al. (2025) showed agents can shift from correct to incorrect answers to match peers — making adversary calibration and adaptive stopping essential.
Adaptive Stability Detection
- Adaptive Stability Detection (Hu et al., NeurIPS 2025) is a stopping rule for multi-agent debates: stop the moment the arbiter verdict stabilizes across consecutive rounds, rather than running fixed-length debates. Improves accuracy over majority vote while cutting token cost by 30–60% in reported benchmarks.
GroupDebate
- GroupDebate (Liu et al., AAMAS 2026) introduces group-based discussion to scale multi-agent debate efficiency. By partitioning agents into discussion groups before plenary synthesis, it cuts token cost relative to all-pairs debate while preserving accuracy on hard reasoning tasks.
Sparse Communication Topology
- Sparse Communication Topology (Li et al., EMNLP 2024 Findings) shows that fully-connected agent communication is wasteful — selecting a sparse subset of inter-agent edges preserves multi-agent debate accuracy while dramatically reducing context length and cost.
Calibration
- In LLM evaluation, calibration measures whether a model's stated confidence matches its actual accuracy. Well-calibrated agents say 'I'm uncertain' on questions they get wrong. Multi-agent debate generally improves calibration; the M-MAD arbiter scores it as a separate dimension.
Steelman
- Steelmanning is the rhetorical practice of constructing the strongest possible version of an opposing argument before rebutting it. In multi-agent debate, asking agents to steelman can expose whether a disagreement survives a fair representation of both sides rather than a convenient strawman.
Position Drift
- Position Drift is the failure mode where an agent silently abandons or contradicts an earlier claim without acknowledgment. Reviewing drift across turns helps identify when an agent endorses one position and later contradicts it without an explicit reversal.
Hallucination
- An LLM hallucination is a confidently stated claim that is fabricated, contradicted by sources, or unsupported by the available evidence. Adversarial cross-examination may surface some unsupported claims, but results still require human review and source checking.
LLM-as-Judge
- LLM-as-Judge is the practice of using a language model to score, rank, or arbitrate the outputs of other models. ChatEval and M-MAD both work in this paradigm. Risks include positional bias, length bias, and self-preference — mitigated by debate among judges and dimension-sweep scoring.
Red-Teaming
- In AI strategy, red-teaming means stress-testing an idea, claim, or decision against hostile scrutiny before commitment. Multi-agent debate operationalizes this by staging structured adversary teams with specific personas, then capturing the surviving claims and unresolved objections as deliverables.
Best-of-N
- Best-of-N sampling runs an LLM N times and selects the highest-scoring output by a reward model or rubric. It is conceptually close to Self-Consistency but selects rather than votes. The platform's Lab Experiments similarly score parameter-sweep runs against a validation prompt and expected outcome.
Related: self consistency, m mad, degeneration of thought
Related: multi agent debate, chain of thought
Related: multi agent debate, arbiter, dimension sweep
Related: multi agent debate, self refine
Related: m mad, arbiter, multi agent debate
Related: truth seeking debate, team discussion
Related: open discussion, truth seeking debate
Related: multi agent debate
Related: self consistency
Related: self refine
Related: reflexion, degeneration of thought
Related: llm as judge, arbiter
Related: multi agent debate
Related: multi agent debate, autogen
Related: multi agent debate, autogen
Related: agreement bias, calibration
Related: m mad, truth seeking debate
Related: multi agent debate, sparse topology
Related: groupdebate, multi agent debate
Related: m mad, hallucination
Related: red teaming
Related: sycophancy, calibration
Related: calibration, multi agent debate
Related: steelman, team discussion
Related: self consistency, experiments