# Panel Debrief Contamination Audit: Pre-Debrief Independence Checklist > A step-by-step pre-debrief protocol for hiring managers that catches the three mechanisms most likely to corrupt panel scores before the room convenes. Run it before every sales hiring debrief loop to protect score independence, surface genuine outliers, and make better hiring decisions. Free checklist for sales managers. Topic: [Hiring, Interviewing & Team Building](https://www.peerlab.ai/library/topic/hiring-interviewing-team-building/). Published by PeerLab in the [Sales Enablement Resource Library](https://www.peerlab.ai/library/). Source: https://www.peerlab.ai/library/panel-debrief-contamination-audit-checklist/ ## How to use it Send Section 1 to your panel the day before interviews begin so competency assignments are locked. Complete Section 2 yourself before the debrief meeting opens to confirm all written scores are in. Run Section 3 as a live facilitation guide during the debrief itself, following the sequence exactly rather than letting discussion flow naturally. ## What's inside - Pre-assignment matrix: how to split competencies across panellists before a single interview takes place - Written score collection protocol with a hard deadline and a named failure mode for late submissions - Seniority bias controls: seating, speaking order, and a named recovery note for when a senior panellist has already spoken first - Shared first-impressions firewall: what panellists must not discuss before scores are submitted - Outlier-first debrief structure: the exact facilitation sequence that surfaces disagreement before consensus forms - Breach triage notes on every section so managers can recover mid-process, not just design upfront - A fast pre-flight checklist for the five minutes before the debrief room opens - A "when NOT to use this" note covering scenarios where the protocol does not apply or needs adapting **What this is for:** Hiring managers running a sales panel interview process. Use it before every debrief loop, not just for senior roles. **The three contamination mechanisms this checklist controls:** 1. **Debrief sequencing**, the first person to speak anchors the room's scores. 2. **Seniority bias**, panellists adjust their written or spoken scores once they know what the most senior person thinks. 3. **Shared first impressions**, casual post-interview chat between panellists before scores are submitted poisons independence. Each section below names the failure mode it prevents and includes a *breach triage note* for when the control has already been missed. --- ## When NOT to use this checklist - Single-interviewer processes (no panel, no debrief needed). - Informal exploratory conversations that are explicitly not scored. - Internal moves where the panel already has years of direct observation and formal scoring would be performative. If you have fewer than two independent scorers, this checklist does not apply. If your organisation has no scoring rubric at all, fix that first. --- ## Section 1: Before Interviews Begin (Complete the Day Before) **Failure mode prevented: Overlapping observation, where every panellist watches for the same things and nobody owns the gaps.** ### 1A. Competency Assignment - [ ] Identify the competencies being assessed across the full interview loop (minimum 4, maximum 8 for a single candidate pass). - [ ] Assign each competency to a primary scorer. One panellist owns each competency. They are responsible for probing it and scoring it. Others may note observations, but the primary scorer's score is the one that counts unless a formal challenge is raised in the debrief. - [ ] Record assignments in writing. Use the table below or your own equivalent. Do not leave this verbal. | Competency | Primary Scorer | Secondary Observer (optional) | |---|---|---| | [e.g. Discovery quality] | [Name] | [Name or blank] | | [e.g. Commercial acumen] | [Name] | [Name or blank] | | [e.g. Objection handling] | [Name] | [Name or blank] | | [e.g. Listening under pressure] | [Name] | [Name or blank] | - [ ] Confirm every panellist has received their assignment and knows which competencies they own before the first interview starts. **Breach triage note:** If you are reading this after interviews have already happened without assigned competencies, you have a pooled-observation problem. In the debrief, ask each panellist to name which specific moments or exchanges formed their overall impression before any scores are revealed. This does not fix the contamination, but it makes the evidence base explicit and sometimes surfaces that two panellists are rating different things. --- ## Section 2: Before the Debrief Room Opens (Complete at Least 30 Minutes Before) **Failure mode prevented: Verbal score drift, where panellists adjust their scores in real time once they hear others, meaning you never actually see independent judgement.** ### 2A. Written Score Collection - [ ] Confirm that every panellist has submitted their scores in writing before the debrief starts. Written means typed or handwritten on a form. Verbal scores stated in the room do not count as independent. - [ ] Set a hard submission deadline: scores due no later than 30 minutes before the debrief. - [ ] Collect scores yourself or via a shared form. Do not let panellists see each other's scores until you choose to reveal them in the debrief (see Section 3). - [ ] If a panellist has not submitted by the deadline, contact them directly. Do not start the debrief without scores from every panel member. A missing score is not a minor admin issue; it breaks the independence of the process. **Score format minimum:** Each panellist should submit a rating per assigned competency (use whatever scale your organisation uses, 1-5 is common), one sentence of evidence for each rating, and an overall hire/no-hire recommendation. Without the evidence sentence, the score is not auditable. ### 2B. First-Impressions Firewall Confirmation - [ ] Confirm with each panellist, individually if needed, that they have not discussed their impressions of the candidate with other panel members since the interviews ended. - [ ] This includes informal comments ("I thought she was sharp"), summary statements made in passing, and anything said in front of the candidate after the interview room closed. **Breach triage note:** If panellists have already talked, ask each one to write down, right now, what they said and what they heard. Bring that into the debrief as named context rather than pretending it did not happen. Say explicitly: "We know some impressions have been shared. We are going to note that and weight the scores accordingly." That is imperfect, but it is better than ignoring it. --- ## Section 3: Running the Debrief (Facilitation Sequence) **Failure mode prevented: Anchor-and-adjust dynamics, where the first strong voice sets the group's position and outlier scores get sanded down rather than examined.** Follow this sequence exactly. Resist the temptation to open with a general discussion or to let the most senior person in the room speak first. ### Step 1: Reveal scores simultaneously, not sequentially. - [ ] Display all written scores at the same time, for all panellists and all competencies. A shared screen, a whiteboard, or printed copies all work. The point is that no one score is seen before another. - [ ] Do not read scores aloud one by one. That is sequential and creates an anchor. ### Step 2: Identify outliers before discussing anything else. - [ ] Scan for the largest gaps: any competency where the highest and lowest score differ by 2 or more points on a 5-point scale, or equivalent on your scale. - [ ] List every outlier on the board before any discussion starts. - [ ] State this rule aloud: "We will discuss outliers first. We will not start with the areas where everyone agrees." ### Step 3: Hear the lower scorer first. - [ ] For each outlier competency, ask the panellist with the lowest score to share their evidence first. Evidence only, no scores yet restated. What did they see or hear? - [ ] Then ask the panellist with the highest score to share their evidence. - [ ] Only after both have spoken does the group discuss. **Why lower scorer first:** The instinct is to start with the highest score because it feels more positive. That instinct produces seniority bias by the back door. The lower score is more likely to contain the signal that gets suppressed in a conventional debrief. ### Step 4: Control for seniority during discussion. - [ ] If a senior panellist (line manager, director, CCO) is in the room, they speak last in every outlier discussion, not first. - [ ] If the senior person has already spoken before you read this step, name it: "I want to make sure we hear from [Name] before we continue, given [Senior Person] has already shared their view. [Name], what did you see?" ### Step 5: Call the decision on evidence, not consensus. - [ ] A hire/no-hire decision does not require unanimous scores. It requires a clear evidence trail. - [ ] If there is genuine disagreement after evidence has been shared, the hiring manager makes the call and records their reasoning. Do not average scores into a false consensus. - [ ] Record the final decision, the key evidence points used, and any dissenting view by name. This is your audit trail. **Breach triage note:** If the debrief has already run as an open discussion without score reveal or outlier sequencing, you can still ask each panellist to re-state their score and the single piece of evidence they find most compelling. It will not fully recover independence, but it often resurfaces the signal that got talked over. --- ## Pre-Flight: Five Minutes Before the Debrief Opens Run through this fast before you walk into the room. - [ ] All written scores collected. Yes / No - [ ] No panellist has seen another's scores. Yes / No - [ ] No informal impressions shared between panellists (or breach noted and documented). Yes / No - [ ] Competency ownership confirmed for each panellist. Yes / No - [ ] Senior panellist briefed to speak last in outlier discussions. Yes / No - [ ] Outlier threshold defined (e.g. 2-point gap on a 5-point scale). Yes / No If any answer is No, apply the relevant breach triage note before proceeding. Do not skip it and hope the debrief compensates. It will not. ## The thinking behind this [Panel Agreement in Sales Hiring Is a Contamination Signal, Not a Green Light.](/blog/panel-agreement-in-sales-hiring-is-a-contamination-signal-not-a-green/) is the argument this resource puts to work.