Quiet Progress

Mindset

A Closed Door Is Information, Not Judgement

A Closed Door Is Information

6 min read

A rejection arrives and it does not feel like data. It feels like a ruling — as though a qualified body examined the evidence and reached a conclusion about your ability, which you are now required to accept.

Almost none of that is true, and the reason it is not true is measurable.

Gatekeeping decisions are noisier than they look

In 2014 the organisers of NIPS, one of the largest machine learning conferences in the world, ran an experiment on their own review process. They split the programme committee into two independent halves and had 10 percent of submissions — 166 papers — reviewed by both.

If the process measured quality cleanly, the two committees should have reached similar decisions. They did not. The committees disagreed about the fate of roughly a quarter of the papers, and of the papers accepted by one committee, about half would have been rejected by the other.

This was not a careless process. It was a serious peer review at a major venue, staffed by experts. And it still meant that for a large share of authors, acceptance or rejection depended substantially on which half of the committee happened to receive the submission.

A rejection is one sample from a noisy process, not a measurement of your worth. It tells you what happened, not what is true.

What a no is actually made of

It helps to know the components, because almost none of them are about you.

There is fit: they wanted something different from what you offered, often for reasons never made public. There is timing: they filled the role last week, the budget closed, they just took something similar. There is capacity: a fixed number of slots and more good candidates than slots, which means most of the rejections are of perfectly good work. There is the reviewer: their taste, their mood, their expertise, the order in which they read things.

And there is, sometimes, quality — a genuine gap between what you produced and what was needed. That component is real and it is the one worth acting on. But it arrives mixed with all the others and is rarely labelled.

Which is why the useful response to a rejection is not acceptance or defiance. It is extraction: work out which component this was, using something other than the feeling it produced.

One no is one data point

The statistical error most people make is treating a single rejection as an estimate of the whole distribution.

If a process is noisy — and gatekeeping processes demonstrably are — then a single outcome tells you very little. The pattern across ten attempts tells you a great deal. Ten rejections with the same specific criticism is a clear signal about the work. Ten rejections with ten unrelated reasons is a signal about the market, or the fit, or the volume you are attempting at.

This is why the only reliable way to learn anything from rejection is to have enough of them to see a pattern. People who stop after two never reach the point where the information becomes readable — and they usually conclude, from an unreadably small sample, that the answer was about them.

None of this is an argument that quality is irrelevant. Better work is accepted more often, and across many attempts that difference dominates. The point is narrower: at the level of any single decision, the noise is large enough that one outcome cannot separate a weak submission from an unlucky one. Improve the work because improving the work raises your rate. Do not use one rejection as the measurement of whether it worked.

Where the wall is, and where the window is

The framing that makes this usable day to day is to treat a closed door as a map update rather than a verdict.

A wall is genuinely useful information: it tells you this particular route is closed at this moment, through this door. That narrows the search. It does not tell you the building has no entrances, and it says nothing at all about whether you belong inside.

The people who do well after rejection are rarely the ones who took it best emotionally. They are the ones who kept looking — who asked what the no was made of, adjusted the specific thing if there was a specific thing, and tried the next door reasonably soon, before a single data point had time to become a conclusion.

What to do with this

A closed door is information, not judgement. It tells you where the wall is so that you can go and find the window — which is a considerably more useful thing to have been told than nothing at all.

Keep looking.

One reminder a day, under thirty seconds. Quiet Progress posts the same ideas as short films on Facebook.

Follow on Facebook