A proposal arrives with a clear thesis, elegant language, balanced risks, and a recommendation that seems to have anticipated every objection.
The room relaxes.
That reaction is increasingly unreliable.
Generative systems are trained to produce continuity. They fill gaps, smooth transitions, reconcile contradictions, and return language that resembles completed thought. The output may be useful. It may also create a perceptual error: because the answer reads coherently, the underlying reasoning feels coherent.
Fluency is a property of expression. Fitness is a relationship between the work and the field it must survive.
The two can travel together. They often do not.
The new false positive
Before generative AI, weak thinking often looked weak. The presentation wandered. The logic broke. The language exposed uncertainty because no one had enough time or skill to hide it.
Now the system can repair the appearance of thought without repairing its structure.
This does not require hallucinated facts. The more common failure is subtler: a valid fact is given the wrong significance, a plausible analogy is treated as causal, a trade-off is described but not resolved, or a recommendation is written before the governing constraint is known.
NIST identifies confabulation, information integrity, human-AI configuration, and provenance as material generative-AI risks. Its guidance emphasizes context-of-use testing, traceable feedback, documentation, independent evaluation, and defined human responsibility.[1]
The concern is not that machines produce sentences. It is that organizations may mistake sentence quality for decision quality.
Ease is not measured performance
The METR developer study is useful because it measured a gap most organizations leave invisible. Participants felt faster with AI and expected measurable gains. On the studied tasks, they were slower. The result was specific to experienced developers working in familiar repositories, and later data suggested the effect was changing. That context matters.[2]
But the original finding exposes a broader pattern: the experience of reduced effort can be mistaken for improved output.
Editing feels easier than creating. Receiving options feels more productive than confronting an unresolved choice. A dashboard feels more rigorous than a conversation about what the metric cannot see.
The brain likes the reduction in friction. The organization records the increase in activity. Neither necessarily measures fitness.
Fitness has a field
A fit strategy survives the conditions that matter:
- the audience interprets it as intended or in a way the organization can absorb;
- the product and operations can carry the promise;
- the economics remain viable when attention turns into actual demand;
- the organization can execute without opening a contradiction larger than the opportunity;
- the decision remains defensible when the preferred narrative fails.
A fit answer does not need to be elegant. It needs to remain useful after contact.
This is why the XQ question is not “Is the output intelligent?” The question is “What happens when this output enters a system with history, incentives, power, human interpretation, and consequence?”
Make the output prove itself
The antidote is not uglier writing. Clarity matters. The answer is to separate presentation quality from evidence of fitness.
Ask the system—or the team—to show:
- the claims it is making;
- the evidence attached to each claim;
- the assumptions required for the recommendation;
- the strongest competing interpretation;
- the conditions under which the recommendation fails;
- the decision owner.
Then test the work in the environment where it will be used.
The memo may survive. The recommendation may improve. Occasionally the polished answer will collapse and reveal that the room had been admiring the upholstery on a vehicle with no transmission.
That is an inexpensive failure.
- Do not grade AI-assisted work by how quickly it became presentable. Grade it by whether it changes a real decision, survives independent challenge, and produces measurable movement under the conditions it claimed to understand.
- Fluent output is now baseline capability.
- Fitness is the advantage.
Evidence notes
[1] NIST, Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile, NIST AI 600-1, 2024.
[2] Becker et al., “Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity,” 2025; METR, follow-up productivity experiment update, 2026.
[3] Vaccaro, Almaatouq, and Malone, Nature Human Behaviour, 2024. Human-AI combinations showed heterogeneous performance and did not outperform the better standalone human or AI system on average.
Cross-reference
See Judgment Is the Bottleneck Now, Auditable Strategy, and The Spreadsheet Had Columns. The Room Had Weather.