Skip to playbook

HR05·Interview Debrief

Interview Debrief & Consolidation

Consolidate interview feedback into an evidence-backed debrief with areas of agreement, open concerns, and a hiring recommendation.

Before you start

What you’ll need

  • Completed structured interviews with documented scorecards from each panel member
  • Finalized evaluation criteria from the interview preparation workflow
  • Access to the structured interview guides used by the panel
  • Interviewer Scorecards
  • Interview Format Guidelines

Who’s involved

  • RecruiterCollects interviewer scorecards, runs the debrief consolidation workflow, and distributes the final summary.
  • Hiring ManagerReviews the consolidated debrief for accuracy, resolves disagreements, and approves the hiring recommendation.
  • Interview PanelistProvides completed scorecards and clarifies feedback when the debrief flags ambiguous evidence.

Safe use

  • Data HandlingThis workflow processes interviewer scorecards containing candidate performance assessments and panel member evaluation notes. Do not paste raw scorecards or personally identifiable candidate details into public or unapproved GenAI tools.
  • VerificationGenAI may misattribute evidence to the wrong interviewer or fabricate consensus where disagreement exists. Verify every cited quote maps to the correct scorecard and that disagreement areas are faithfully represented before finalizing.

Execution steps

Hybrid

Inputs

  • Confirm all panel members have submitted completed scorecards
  • Verify the structured interview guides from the preparation workflow are available
  • Confirm the interview format guidelines including evaluation criteria are current
  • Verify no scorecard is missing ratings or criterion labels

Prompt

Extract structured evidence from interviewer scorecards

CONTEXT
You will be provided with the following source documents:
1. Structured Interview Guides
2. Interviewer Scorecards
3. Interview Format Guidelines

TASK
For each interviewer, extract the key evidence they recorded against each evaluation criterion. Produce an Individual Evidence Summaries document that preserves the interviewer's own wording and ratings.

OUTPUT FORMAT
Use a top-level markdown heading for each interviewer (by role label, e.g., "Interviewer 1 — Technical Lead"). Under each interviewer heading, list each evaluation criterion as a subheading. For each criterion, include:
- **Rating:** The rating given (e.g., Strong / Partial / Weak)
- **Key Evidence:** One to three verbatim or near-verbatim quotes from the scorecard
- **Interviewer Notes:** Any additional observations the interviewer recorded

CONSTRAINTS
Do not paraphrase evidence in a way that changes its meaning. Do not infer ratings where the scorecard is blank — flag missing ratings as "Not Rated." Do not include personally identifiable candidate information beyond what appears in the scorecards.

Outputs

  • Individual Evidence Summaries

Verification: Verify extracted evidence matches the original scorecards and no ratings were fabricated for blank entries.

GenAI

Inputs

  • Confirm Individual Evidence Summaries cover every panel member

Prompt

Cite and align evidence per criterion across interviewers

CONTEXT
You will be provided with the Individual Evidence Summaries extracted from each interviewer's scorecard and the Structured Interview Guides that define the evaluation criteria.

TASK
For each evaluation criterion, consolidate the evidence and ratings from all interviewers into a single cross-panel view. Produce a Cross-Interviewer Evidence Map that shows where interviewers converge and diverge on each criterion.

OUTPUT FORMAT
Use a markdown heading for each evaluation criterion. Under each heading, create a table with columns: Interviewer, Rating, Key Evidence Cited, Notes. Below each table, add a one-sentence convergence summary stating whether the panel broadly agrees, partially agrees, or disagrees on this criterion.

EXAMPLE
## Technical Problem-Solving
| Interviewer | Rating | Key Evidence Cited | Notes |
|---|---|---|---|
| Interviewer 1 — Technical Lead | Strong | "Described a systematic root-cause analysis approach" | Noted speed of resolution |
| Interviewer 2 — Team Lead | Partial | "Solved the problem but skipped documentation" | Flagged process gap |

**Convergence:** Partial agreement — technical capability confirmed, process discipline disputed.

CONSTRAINTS
Do not merge or average ratings across interviewers. Do not omit any interviewer's evidence even if it appears redundant. Do not introduce criteria not present in the Structured Interview Guides.

Outputs

Verification: Verify no interviewer's evidence was omitted and convergence summaries accurately reflect the ratings shown.

GenAI

Inputs

  • Cross-Interviewer Evidence Map
  • Confirm the Cross-Interviewer Evidence Map is complete for all criteria

Prompt

Highlight panel agreement and disagreement patterns

CONTEXT
You will be provided with the Cross-Interviewer Evidence Map showing each evaluation criterion with ratings and evidence from all panel members.

TASK
Analyze the evidence map to produce an Agreement and Disagreement Analysis. Identify criteria where the panel is in strong agreement, criteria where significant disagreement exists, and criteria where evidence is thin or inconclusive.

OUTPUT FORMAT
Organize the output into three sections:
- **Strong Agreement:** List each criterion where all interviewers gave consistent ratings. For each, state the consensus rating and the strongest supporting evidence.
- **Significant Disagreement:** List each criterion where ratings diverge by two or more levels or where interviewers cite contradictory evidence. For each, state the conflicting positions and the specific evidence driving the disagreement.
- **Insufficient Evidence:** List any criteria where fewer than half the interviewers provided a rating or where evidence is vague. Note what follow-up would resolve the gap.

CONSTRAINTS
Do not classify a criterion as "strong agreement" if any interviewer rated it more than one level differently. Do not speculate on reasons for disagreement — cite only what the evidence shows. Do not omit any criterion from the analysis.

Outputs

Verification: Verify disagreement classifications match the actual rating spread in the evidence map.

Hybrid

Inputs

  • Agreement and Disagreement Analysis
  • Cross-Interviewer Evidence Map
  • Confirm the Agreement and Disagreement Analysis has been reviewed for completeness

Data Handling: Do not paste candidate personal contact details or compensation expectations into the prompt when adding context to concerns.

Prompt

Flag unresolved risks and open questions for panel

CONTEXT
You will be provided with the Agreement and Disagreement Analysis and the Cross-Interviewer Evidence Map for a candidate.

TASK
Produce a Risk and Concerns Register that lists every unresolved concern, open question, and hiring risk identified from the disagreement and insufficient-evidence areas. For each item, cite the specific evidence that triggered the concern and suggest what additional information or follow-up would resolve it.

OUTPUT FORMAT
Use a numbered list. For each item include:
- **Concern:** One-sentence description of the risk or open question
- **Source Evidence:** The specific criterion, interviewer, and evidence that raised this concern
- **Suggested Resolution:** One-sentence recommendation for how to resolve (e.g., follow-up call, reference check, additional assessment)
- **Severity:** [High / Medium / Low] based on impact to the hiring decision

CONSTRAINTS
Do not flag concerns for criteria where the panel is in strong agreement. Do not recommend resolution actions that require access to systems or data not available in this workflow. Do not assign severity based on assumptions about role importance — rate based only on the degree of evidence conflict.

Outputs

  • Risk and Concerns Register
  • Confirm every flagged concern traces to specific evidence in the Cross-Interviewer Evidence Map
  • Verify severity ratings are consistent with the degree of panel disagreement

Verification: Verify the AI did not fabricate concerns for criteria where all interviewers agreed.

GenAI

Inputs

  • Cross-Interviewer Evidence Map
  • Agreement and Disagreement Analysis
  • Risk and Concerns Register
  • Confirm the Risk and Concerns Register has been reviewed and approved by the hiring manager

Prompt

Consolidate evidence into debrief with hiring recommendation

CONTEXT
You will be provided with the Cross-Interviewer Evidence Map, the Agreement and Disagreement Analysis, and the Risk and Concerns Register for a candidate.

TASK
Consolidate all inputs into a single Draft Interview Debrief Summary. The summary must present the panel's collective assessment, highlight key strengths and concerns, and conclude with a clear hiring recommendation supported by cited evidence.

OUTPUT FORMAT
Use the following sections:
- **Candidate Overview:** One paragraph summarizing the role, interview format, and panel composition.
- **Strengths (Panel Agreement):** Bulleted list of criteria where the panel agreed the candidate was strong, with the consensus rating and one supporting quote per item.
- **Concerns and Risks:** Bulleted list of unresolved disagreements and flagged risks from the register, with severity and source evidence.
- **Open Questions:** Any items from the register that require follow-up before a final decision.
- **Hiring Recommendation:** One of [Hire / Do Not Hire / Hire With Conditions]. Two to three sentences explaining the rationale, citing specific evidence from the strengths and concerns sections.

CONSTRAINTS
Do not introduce evidence not present in the source documents. Do not soften or reinterpret disagreements — present them as recorded. Do not make a recommendation based on criteria not evaluated in the interviews. Do not include personally identifiable information beyond what is necessary for the debrief.

Outputs

  • Draft Interview Debrief Summary

Verification: Verify the hiring recommendation is supported by cited evidence and does not contradict the panel's recorded disagreements.

Human

Inputs

  • Draft Interview Debrief Summary
  • Confirm the Draft Interview Debrief Summary is complete with all sections populated

Outputs

  • Confirm all cited evidence traces back to the original interviewer scorecards
  • Verify the hiring recommendation accurately reflects the panel's collective assessment
  • Confirm open questions have been addressed or documented as accepted risks

Reference

Guardrails

  • Evidence-Only AssessmentsEvery claim in the debrief must trace to a specific interviewer's scorecard — reject any AI-generated statement that cannot be sourced to an input document.
  • Preserve Interviewer VoiceUse near-verbatim quotes from scorecards when citing evidence to prevent the AI from smoothing over nuance or reinterpreting feedback.
  • Transparent DisagreementNever merge conflicting interviewer ratings into an average or consensus — present each position with its supporting evidence so reviewers see the full picture.
  • Recommendation TraceabilityThe hiring recommendation must cite at least two specific strengths and any unresolved concerns — a recommendation without cited evidence is incomplete.

Pitfalls

  • Pasting full interviewer scorecards with candidate personal details into an unapproved GenAI tool without redacting sensitive information.
  • Accepting the AI's convergence summary without verifying it against the actual rating distribution in the evidence map.
  • Allowing the AI to fabricate consensus language when interviewers clearly disagreed on a criterion.
  • Using the AI-generated hiring recommendation as the final decision without the hiring manager reviewing the underlying evidence.
  • Including specific candidate compensation or personal data in the prompt context when generating the debrief summary.

Definition of Done

  • The Individual Evidence Summaries contain extracted evidence for every criterion from every interviewer with no fabricated ratings.
  • The Cross-Interviewer Evidence Map shows a complete comparison view with convergence summaries for each criterion.
  • The Agreement and Disagreement Analysis correctly classifies every criterion and cites supporting evidence.
  • The Risk and Concerns Register lists all unresolved items with severity, source evidence, and suggested resolutions.
  • The Interview Debrief Summary contains a hiring recommendation that cites specific evidence from the panel's assessment.

GET FULL ACCESS

Unlock every step, prompt, and downloadable example — for this playbook and the rest of AGASI AiOS, our GenAI capability framework.

We'll send a magic link — no password needed.

AGASI AiOS · HR05 v1.0 · Apr 7, 2026