Your Structured Interview Holds Up Fine. Your Debrief Destroys It.

Most sales hiring teams have now done the work. They have competency-mapped their roles, built a scorecard, standardised the questions, trained interviewers on what a 3 looks like versus a 4. They have read the research on structured interviewing and they believe in it. And they are still making inconsistent hires. The problem is almost never the scorecard. The problem is the forty-five minutes that happen after everyone has finished interviewing, when the structure quietly dissolves and something much older takes over.

What structured interviewing actually promises

The academic case is straightforward. When interviewers evaluate the same competencies against the same anchors, using the same questions, predictive validity goes up and bias goes down. The key word in that sentence is independently. The scores need to be formed before any social information enters the room. The moment interviewers know what anyone else thought, they are no longer scoring the candidate. They are positioning themselves relative to the group.

This is not a character flaw. It is just how humans work. Social conformity under uncertainty is a feature of every team in every industry. Sales hiring teams are not special. They are just more expensive when they get it wrong. A missed-quota AE in year one, fully ramped, fully enabled, costs you somewhere north of £150k once you account for base, commission draw, manager time, and lost pipeline. That number should make the debrief format feel like a serious operational decision, not an HR formality.

The three failure modes, named

The hiring manager speaks first. This is the most common and the most destructive. The hiring manager has positional authority, and in most organisations they also have the final say. When they open with "I thought she was really sharp, loved her energy," every subsequent score tilts toward that view. People who had reservations either soften them or frame them as minor. People who were undecided land on the positive side. The scorecard becomes a retrospective justification for a decision that was made in the first thirty seconds of the debrief.

Scores are shared out loud, round the table, sequentially. The first person to speak anchors the group. The second person modifies their view slightly to account for what they just heard. By the time you reach person five, you have something that looks like consensus but is actually the first person's opinion with social smoothing applied. The scorecard was filled in independently. The debrief then efficiently destroys that independence.

Dissent requires courage rather than being structurally invited. If your process requires someone to actively contradict the room, most of the time they will not do it. Not because they are weak, but because contradiction has a social cost and agreement is free. The person who interviewed the candidate on commercial acuity and gave them a 2 while everyone else gave 3s and 4s will, in most debriefs, find a way to explain why they might have been a bit harsh. The divergence disappears. The information it contained disappears with it.

The fix is not a better scorecard

I have sat in rooms where people have responded to bad hires by adding more rows to the scorecard. More competencies, more anchors, more guidance notes. That is work displacement. It feels rigorous and changes nothing because the scorecard was not the problem.

The fix is a debrief protocol. Specifically, three rules that need to be enforced without exception.

Rule one: scores are submitted before anyone enters the debrief. Not filled in during. Not filled in the night before when you have forgotten the specifics. Submitted, timestamped, and locked before anyone knows what anyone else said. This is achievable with a shared form, a survey tool, or an ATS that supports it. If yours does not, email works. The point is that the record exists and cannot be revised in light of what you hear.

Rule two: dissent goes first. Once scores are visible to the group, the facilitator, not the hiring manager, starts with the lowest scorer on each competency and asks them to present their evidence. Not to defend themselves. To present the specific moment in the interview that produced that score, with as much verbatim recall as possible. This is uncomfortable exactly once. After that it becomes the norm and the culture shifts: divergent scores are treated as useful data rather than awkward friction.

Rule three: a named rule for divergence. If any two interviewers are more than one band apart on any competency, that divergence is not averaged away. It triggers a short specific question: what did you see that I did not? One of three things then happens. The lower scorer has evidence the higher scorer missed, and the higher scorer revises. The higher scorer has context the lower scorer lacked, and they revise. Or the divergence reflects genuine ambiguity in the candidate, which is itself useful information. What is not acceptable is for the gap to be papered over with a mid-point and never discussed.

What this looks like in practice

Here is a rough sequence for a five-interviewer panel on a senior AE role:

The hiring manager speaking last is not a power removal. It is a signal quality improvement. By the time they speak they have heard everything the panel observed, including things that did not come up in their own interview. Their decision is better informed, not undermined.

The objection worth addressing

"We already fill in scorecards before the debrief." Fine. Are they locked? Can they be changed? Do interviewers discuss the candidate informally in the five minutes before the meeting starts? If the answer to any of those is yes or I'm not sure, then the independence is nominal. The structure exists on paper and the debrief is still running on social consensus.

The test is simple. After your last three hires made via structured interviewing, could you tell me what the pre-debrief score distribution looked like, and how it changed during the debrief? If you cannot, you are not running a structured process. You are running a structured interview followed by an unstructured decision.

The scorecard is necessary. It is not sufficient. The debrief is where the hire actually gets made, and almost nobody has designed it with the same rigour they applied to the questions. That asymmetry is the problem. Fix that half and the three weeks you spent on the scorecard will finally do what you built it to do.

The tool for this: Sales Hiring Debrief Protocol: Three Rules That Protect Your Scorecard, free and no signup.