A pilot that succeeds and then dies is not a failed experiment. It’s a decision nobody was willing to make, wearing the costume of one.
Every organization I’ve been near keeps a graveyard of successful pilots. Not failed ones — successful ones. The tool worked. The small team liked it. The numbers, such as they were, pointed the right way. And then a year later nothing had changed, and nobody could quite say why.
The failed pilot is easy. You learn something and move on. The successful pilot that goes nowhere is the expensive one, because it costs you the effort of running it and then costs you again in the quiet conclusion everyone draws afterward: we tried that, it didn’t take. That sentence closes a door that was never actually opened.
The pilot worked because it was volunteers
Six people, a few weeks, real enthusiasm. Look closer and the flaw is hiding inside the success. Pilots are staffed by the curious and the already-convinced — the people who raised their hand. That is the one condition you cannot reproduce when you scale.
A pilot measures what motivated people do with a new tool. It tells you very little about what the other thirty-four will do, because the thing that made the pilot work — wanting to be there — is precisely the variable that doesn’t come in the box. You proved the tool works for people who were going to make almost anything work. That was never in doubt.
Nobody owned the word “after”
Here is the reliable tell. At the start of a pilot there is a sponsor, a champion, and a little budget. There is almost never a named person who owns what happens if it works.
Who decides to scale it. Who absorbs the cost of the rollout — not the license, the disruption. Whose job it is to teach the thirty-four people who never volunteered, while they are busy and skeptical and temporarily worse at their own jobs for having to change. That person was never named, and the reason they were never named is that naming them would have required a decision. The pilot was chosen so the decision could wait.
Sometimes the pilot is the delay
This is the uncomfortable version, and it’s more common than anyone admits. Often the pilot isn’t a step toward adoption at all. It’s a way to look like motion without committing to any. It buys a quarter. It gives everyone something true to say in the meeting — we’re piloting it — that obliges no one to actually change how they work.
A pilot with no decision pre-committed to its outcome is not an experiment. It’s a delay with a dashboard. And the tell for that one is simple: ask what happens if the pilot succeeds, and watch whether anyone has an answer.
What a real pilot settles first
A pilot worth running answers three questions before the first person logs in, not after.
What, specifically, are we deciding at the end of this — and who decides it. What result would make us say yes, and what result would make us say no, both written down in advance, because a pilot with no defined failure condition will simply confirm whatever we already wanted to believe. And who owns the rollout if the answer is yes: named, resourced, and clear-eyed that the hard part is not the tool but the people who didn’t raise their hand.
Answer those three and you have an experiment. Skip them and you have a nice afternoon that ends in a graveyard.
The tool was never the variable under test. A pilot tests a tool. Adoption tests an organization’s willingness to decide and then to teach — and those are different problems, run by different muscles, and the second one was always going to be the hard one.
So a successful pilot that dies didn’t fail at the experiment. It passed the experiment and failed at the sentence that was supposed to come next. Three words, and nobody was willing to say them: so we’re committing.
I write about creative leadership, AI adoption, and the parts of the job nobody puts in a keynote. One post every two weeks.