← ONAEL
Thinking

Why AI pilots die in the org chart, not the codebase

Most AI failures aren't technical. They're organizational. Here's what actually kills adoption.

Every stalled AI initiative gets the same autopsy: the model wasn't accurate enough, the data wasn't clean enough, the tooling wasn't mature enough. Occasionally that's the real story. Far more often, the pilot was killed by something no engineer ever touches — an unclear owner, a workflow nobody redesigned, a metric that didn't matter to anyone with a budget. The evidence for this has gotten hard to ignore.

The failure rate is real — and it isn't about the technology

A 2024 RAND Corporation study, built on interviews with 65 data scientists and engineers who each had at least five years building AI systems in industry, found that more than 80% of AI projects fail — roughly twice the failure rate of IT projects that don't involve AI. Its authors are direct about the cause: the leading reason is that business and technical stakeholders misunderstand or miscommunicate the problem being solved, so a model gets built and optimized for the wrong thing. The technology is rarely the bottleneck.

A widely cited 2025 analysis from MIT's Project NANDA came at it from the other side and reached a similar place: about 95% of enterprise generative-AI pilots produced no measurable profit-and-loss impact, and the researchers put the gap down to how organizations approached deployment rather than to model quality. (That 95% figure has drawn methodological criticism; the RAND work is the sturdier reference. Both point the same direction.)

The codebase is the small part

None of this should surprise anyone who has shipped a machine-learning system. In the influential 2015 paper "Hidden Technical Debt in Machine Learning Systems," Google researchers noted that the ML code itself is only a small fraction of a real production system — the rest is configuration, data collection and verification, serving infrastructure, and monitoring. BCG puts a ratio on the whole effort with its 10–20–70 rule:

"10% of a company's efforts should be focused on algorithms, 20% on technology and data, and the remaining 70% — the lion's share — on people and processes."

If 70% of the work lives in the org chart, that's where most of the failures will live too.

Where pilots actually die

Four organizational failure modes account for most of it.

What the exceptions do

The MIT analysis reported that pilots pairing internal domain knowledge with outside expertise succeeded far more often — about 67% of the time — than builds handled by a technology team alone, at roughly 22%. McKinsey's 2024 survey found that among the small group of firms attributing a meaningful share of earnings to generative AI, 37% had a clear KPI structure to measure its value — versus just 13% of everyone else. The differentiators are organizational: ownership, measurement, and a real change to how work gets done.

Before the next pilot

Answer the org-chart questions first. Who owns the outcome. Whose work changes. Where it runs after the demo. How you'll know it worked, and when you'd stop. If those don't have answers, a better model won't supply them.

See where your own organization stands: take the HELM Readiness Assessment™, or schedule a conversation.

Sources

  1. James Ryseff, Brandon De Bruhl, Sydne J. Newberry, "The Root Causes of Failure for Artificial Intelligence Projects and How They Can Succeed," RAND Corporation, 2024. rand.org
  2. "MIT report: 95% of generative AI pilots at companies are failing," Fortune, 18 August 2025, on MIT Project NANDA's State of AI in Business 2025. fortune.com
  3. D. Sculley et al., "Hidden Technical Debt in Machine Learning Systems," NeurIPS 2015. papers.nips.cc
  4. "The Leader's Guide to Transforming with AI" (10–20–70 rule), BCG. bcg.com
  5. "Gartner Predicts 30% of Generative AI Projects Will Be Abandoned After Proof of Concept By End of 2025," Gartner, 29 July 2024. gartner.com
  6. "The state of AI in early 2024," McKinsey & Company, May 2024. mckinsey.com