A team of researchers set up the experiment most people assume is safe: give several AI models a hard question, let them discuss it across a few rounds, watch them converge. Then they counted what survived. By the end, up to 72% of the facts that actually mattered were gone — and the models agreed more than when they started.

Agree more, know less. That's the finding, and it's the line worth carrying out of this week.

The number that should change how you think about "let the agents discuss it"

The paper is "The Deliberative Illusion: Diagnosing Factual Attrition and Stance Homogenization in Multi-Agent LLM Deliberation". Its method is the part that makes the result hard to wave away. A framework called DELIBTRACE decomposes each question into atomic facts, labels the ones that are actually issue-critical, hands them out across the agents, and then tracks — round by round — which of those facts are still on the table as the discussion proceeds.

Two things happen at once. The first is factual attrition: the issue-critical facts progressively fall out of the conversation. Across ethical and news-based deliberation, with three different LLM families, multi-agent discussion erased up to 72% of them. The second is stance homogenization: the agents' positions collapse toward a shared answer. Convergence looks like deliberation working. It isn't. Stance entropy drops while the factual basis underneath it shrinks — consensus arriving precisely because the evidence that would sustain disagreement has leaked away. The paper's own summary: agents can agree more while knowing less.

If your plan for AI reliability is "have a few models talk it out," that sentence is the warning label. Discussion does not automatically add rigor. Left unstructured, it removes it — the facts thin out, the positions converge, and everyone walks away more confident about a smaller picture.

Builders reached the same wall from the other side

The same week the paper landed, a builder on r/AI_Agents walked through the Berkeley MAST taxonomy — arXiv:2503.13657, 1,600-plus hand-annotated failure traces across seven multi-agent frameworks. The breakdown of why these systems fail: specification and design, 41.8%; inter-agent misalignment, 36.9%; verification, 21.3%. Add the first two and you get roughly 78.7% of failures that are structure and handoffs — not model capability.

His conclusion is the one worth quoting verbatim: "most 'add another agent' fixes make it worse because they add more seams, not fewer." A commenter sharpened it: "handoffs are where the lie usually hides. The first agent passes a fuzzy assumption, the second treats it as fact, and by the time the final output is wrong everyone blames the model."

Two independent sources, a paper and a working engineer, arriving at the same place. The paper measured it on facts and stances. The builder saw it in production traces. Naive multi-agent discussion is a liability by default, and throwing another model at it usually deepens the hole.

The reframe: more models talking isn't a council

Here is the move that both findings point at. The thing that turns a pile of agents into something more reliable than one of them is not the pile. It's the structure imposed on it.

More models talking is a liability. Structure is what converts it to a dividend.

That distinction is the whole argument, so it's worth being concrete about what "structure" actually has to do:

Keep the facts on the table. Factual attrition is a design failure, not an inevitability. Role-defined protocols — a member whose job is to attack the answer, another whose job is to defend it — exist to keep issue-critical facts and objections alive across rounds instead of letting them quietly drop. That's what a Red Team vs. Blue Team pass is for.

Weigh the dissent instead of averaging it away. Stance homogenization is what happens when a system treats consensus as the goal. A real chairman doesn't average the room toward agreement — it looks at where the members split, decides which minority position was actually right, and says so. Averaging destroys the outlier. Synthesis preserves it and then adjudicates it.

Argue with the claim, not the byline. Anonymized review keeps a model from folding just because a "smarter" peer disagreed. Randomizing the order keeps position bias — the well-documented tendency to favor whichever answer came first — from passing itself off as merit.

Put an independent checker between the work and "done." The builder's own fix was a dedicated verifier with isolated context and scoring criteria the producing agents never see. That's the council's independence principle in ops clothing: the reviewer has to be a different mind, working from a different vantage, or it's just the producer grading its own exam.

None of that is a feature you bolt onto a debate. It's what a council is — the reason the word means something more than "several models in a room."

The honest concession

Two caveats, because the finding cuts both ways. A badly composed council loses to one well-prompted model — earlier work like DeliberationBench showed exactly that, and it stays true. And "more agents" without structure is precisely what this paper caught destroying facts and manufacturing agreement. Both are arguments for taking the structure seriously, not against the idea. The roster and the rules are the work. When one clean answer is genuinely enough, a quick single-model take is the right tool, and pretending otherwise just burns tokens.

This is why Shingikai runs the way it does: 200-plus deliberately different models so members actually diverge, the deliberation streamed live so you can see where they split rather than trusting a laundered summary, Red Team vs. Blue Team to force the objections into the open, and Chairperson Synthesis to weigh the disagreement instead of collapsing it. The point was never to get AIs to agree faster. It was to keep the facts and the dissent on the table long enough for someone to decide what to do with them.

The deliberative illusion is real, and it's cheap to fall into — just let the models chat. The way out isn't a smarter model. It's a room with rules.

Try it free — no signup. shingik.ai