Interview Debrief & Consolidation
Consolidate interview feedback into an evidence-backed debrief with areas of agreement, open concerns, and a hiring recommendation.
Before you start
What you’ll need
- Completed structured interviews with documented scorecards from each panel member
- Finalized evaluation criteria from the interview preparation workflow
- Access to the structured interview guides used by the panel
- Interviewer Scorecards
- Interview Format Guidelines
Who’s involved
- Recruiter — Collects interviewer scorecards, runs the debrief consolidation workflow, and distributes the final summary.
- Hiring Manager — Reviews the consolidated debrief for accuracy, resolves disagreements, and approves the hiring recommendation.
- Interview Panelist — Provides completed scorecards and clarifies feedback when the debrief flags ambiguous evidence.
Safe use
- Data Handling — This workflow processes interviewer scorecards containing candidate performance assessments and panel member evaluation notes. Do not paste raw scorecards or personally identifiable candidate details into public or unapproved GenAI tools.
- Verification — GenAI may misattribute evidence to the wrong interviewer or fabricate consensus where disagreement exists. Verify every cited quote maps to the correct scorecard and that disagreement areas are faithfully represented before finalizing.
Execution steps
Inputs
- Structured Interview GuidesdownloadFrom HR04 — Interview Prep
- Interviewer Scorecardsdownload
- Interview Format Guidelinesdownload
- Confirm all panel members have submitted completed scorecards
- Verify the structured interview guides from the preparation workflow are available
- Confirm the interview format guidelines including evaluation criteria are current
- Verify no scorecard is missing ratings or criterion labels
Prompt
Extract structured evidence from interviewer scorecards
CONTEXT You will be provided with the following source documents: 1. Structured Interview Guides 2. Interviewer Scorecards 3. Interview Format Guidelines TASK For each interviewer, extract the key evidence they recorded against each evaluation criterion. Produce an Individual Evidence Summaries document that preserves the interviewer's own wording and ratings. OUTPUT FORMAT Use a top-level markdown heading for each interviewer (by role label, e.g., "Interviewer 1 — Technical Lead"). Under each interviewer heading, list each evaluation criterion as a subheading. For each criterion, include: - **Rating:** The rating given (e.g., Strong / Partial / Weak) - **Key Evidence:** One to three verbatim or near-verbatim quotes from the scorecard - **Interviewer Notes:** Any additional observations the interviewer recorded CONSTRAINTS Do not paraphrase evidence in a way that changes its meaning. Do not infer ratings where the scorecard is blank — flag missing ratings as "Not Rated." Do not include personally identifiable candidate information beyond what appears in the scorecards.
Outputs
- Individual Evidence Summaries
Verification: Verify extracted evidence matches the original scorecards and no ratings were fabricated for blank entries.
Inputs
- Individual Evidence Summaries
- Structured Interview GuidesdownloadFrom HR04 — Interview Prep
- Confirm Individual Evidence Summaries cover every panel member
Prompt
Cite and align evidence per criterion across interviewers
CONTEXT You will be provided with the Individual Evidence Summaries extracted from each interviewer's scorecard and the Structured Interview Guides that define the evaluation criteria. TASK For each evaluation criterion, consolidate the evidence and ratings from all interviewers into a single cross-panel view. Produce a Cross-Interviewer Evidence Map that shows where interviewers converge and diverge on each criterion. OUTPUT FORMAT Use a markdown heading for each evaluation criterion. Under each heading, create a table with columns: Interviewer, Rating, Key Evidence Cited, Notes. Below each table, add a one-sentence convergence summary stating whether the panel broadly agrees, partially agrees, or disagrees on this criterion. EXAMPLE ## Technical Problem-Solving | Interviewer | Rating | Key Evidence Cited | Notes | |---|---|---|---| | Interviewer 1 — Technical Lead | Strong | "Described a systematic root-cause analysis approach" | Noted speed of resolution | | Interviewer 2 — Team Lead | Partial | "Solved the problem but skipped documentation" | Flagged process gap | **Convergence:** Partial agreement — technical capability confirmed, process discipline disputed. CONSTRAINTS Do not merge or average ratings across interviewers. Do not omit any interviewer's evidence even if it appears redundant. Do not introduce criteria not present in the Structured Interview Guides.
Outputs
Verification: Verify no interviewer's evidence was omitted and convergence summaries accurately reflect the ratings shown.
Inputs
- Cross-Interviewer Evidence Map
- Confirm the Cross-Interviewer Evidence Map is complete for all criteria
Prompt
Highlight panel agreement and disagreement patterns
CONTEXT You will be provided with the Cross-Interviewer Evidence Map showing each evaluation criterion with ratings and evidence from all panel members. TASK Analyze the evidence map to produce an Agreement and Disagreement Analysis. Identify criteria where the panel is in strong agreement, criteria where significant disagreement exists, and criteria where evidence is thin or inconclusive. OUTPUT FORMAT Organize the output into three sections: - **Strong Agreement:** List each criterion where all interviewers gave consistent ratings. For each, state the consensus rating and the strongest supporting evidence. - **Significant Disagreement:** List each criterion where ratings diverge by two or more levels or where interviewers cite contradictory evidence. For each, state the conflicting positions and the specific evidence driving the disagreement. - **Insufficient Evidence:** List any criteria where fewer than half the interviewers provided a rating or where evidence is vague. Note what follow-up would resolve the gap. CONSTRAINTS Do not classify a criterion as "strong agreement" if any interviewer rated it more than one level differently. Do not speculate on reasons for disagreement — cite only what the evidence shows. Do not omit any criterion from the analysis.
Outputs
Verification: Verify disagreement classifications match the actual rating spread in the evidence map.
Inputs
- Agreement and Disagreement Analysis
- Cross-Interviewer Evidence Map
- Confirm the Agreement and Disagreement Analysis has been reviewed for completeness
Data Handling: Do not paste candidate personal contact details or compensation expectations into the prompt when adding context to concerns.
Prompt
Flag unresolved risks and open questions for panel
CONTEXT You will be provided with the Agreement and Disagreement Analysis and the Cross-Interviewer Evidence Map for a candidate. TASK Produce a Risk and Concerns Register that lists every unresolved concern, open question, and hiring risk identified from the disagreement and insufficient-evidence areas. For each item, cite the specific evidence that triggered the concern and suggest what additional information or follow-up would resolve it. OUTPUT FORMAT Use a numbered list. For each item include: - **Concern:** One-sentence description of the risk or open question - **Source Evidence:** The specific criterion, interviewer, and evidence that raised this concern - **Suggested Resolution:** One-sentence recommendation for how to resolve (e.g., follow-up call, reference check, additional assessment) - **Severity:** [High / Medium / Low] based on impact to the hiring decision CONSTRAINTS Do not flag concerns for criteria where the panel is in strong agreement. Do not recommend resolution actions that require access to systems or data not available in this workflow. Do not assign severity based on assumptions about role importance — rate based only on the degree of evidence conflict.
Outputs
- Risk and Concerns Register
- Confirm every flagged concern traces to specific evidence in the Cross-Interviewer Evidence Map
- Verify severity ratings are consistent with the degree of panel disagreement
Verification: Verify the AI did not fabricate concerns for criteria where all interviewers agreed.
Inputs
- Cross-Interviewer Evidence Map
- Agreement and Disagreement Analysis
- Risk and Concerns Register
- Confirm the Risk and Concerns Register has been reviewed and approved by the hiring manager
Prompt
Consolidate evidence into debrief with hiring recommendation
CONTEXT You will be provided with the Cross-Interviewer Evidence Map, the Agreement and Disagreement Analysis, and the Risk and Concerns Register for a candidate. TASK Consolidate all inputs into a single Draft Interview Debrief Summary. The summary must present the panel's collective assessment, highlight key strengths and concerns, and conclude with a clear hiring recommendation supported by cited evidence. OUTPUT FORMAT Use the following sections: - **Candidate Overview:** One paragraph summarizing the role, interview format, and panel composition. - **Strengths (Panel Agreement):** Bulleted list of criteria where the panel agreed the candidate was strong, with the consensus rating and one supporting quote per item. - **Concerns and Risks:** Bulleted list of unresolved disagreements and flagged risks from the register, with severity and source evidence. - **Open Questions:** Any items from the register that require follow-up before a final decision. - **Hiring Recommendation:** One of [Hire / Do Not Hire / Hire With Conditions]. Two to three sentences explaining the rationale, citing specific evidence from the strengths and concerns sections. CONSTRAINTS Do not introduce evidence not present in the source documents. Do not soften or reinterpret disagreements — present them as recorded. Do not make a recommendation based on criteria not evaluated in the interviews. Do not include personally identifiable information beyond what is necessary for the debrief.
Outputs
- Draft Interview Debrief Summary
Verification: Verify the hiring recommendation is supported by cited evidence and does not contradict the panel's recorded disagreements.
Inputs
- Draft Interview Debrief Summary
- Confirm the Draft Interview Debrief Summary is complete with all sections populated
Outputs
- Confirm all cited evidence traces back to the original interviewer scorecards
- Verify the hiring recommendation accurately reflects the panel's collective assessment
- Confirm open questions have been addressed or documented as accepted risks
Reference
Guardrails
- Evidence-Only Assessments — Every claim in the debrief must trace to a specific interviewer's scorecard — reject any AI-generated statement that cannot be sourced to an input document.
- Preserve Interviewer Voice — Use near-verbatim quotes from scorecards when citing evidence to prevent the AI from smoothing over nuance or reinterpreting feedback.
- Transparent Disagreement — Never merge conflicting interviewer ratings into an average or consensus — present each position with its supporting evidence so reviewers see the full picture.
- Recommendation Traceability — The hiring recommendation must cite at least two specific strengths and any unresolved concerns — a recommendation without cited evidence is incomplete.
Pitfalls
- Pasting full interviewer scorecards with candidate personal details into an unapproved GenAI tool without redacting sensitive information.
- Accepting the AI's convergence summary without verifying it against the actual rating distribution in the evidence map.
- Allowing the AI to fabricate consensus language when interviewers clearly disagreed on a criterion.
- Using the AI-generated hiring recommendation as the final decision without the hiring manager reviewing the underlying evidence.
- Including specific candidate compensation or personal data in the prompt context when generating the debrief summary.
Definition of Done
- The Individual Evidence Summaries contain extracted evidence for every criterion from every interviewer with no fabricated ratings.
- The Cross-Interviewer Evidence Map shows a complete comparison view with convergence summaries for each criterion.
- The Agreement and Disagreement Analysis correctly classifies every criterion and cites supporting evidence.
- The Risk and Concerns Register lists all unresolved items with severity, source evidence, and suggested resolutions.
- The Interview Debrief Summary contains a hiring recommendation that cites specific evidence from the panel's assessment.
GET FULL ACCESS
Unlock every step, prompt, and downloadable example — for this playbook and the rest of AGASI AiOS, our GenAI capability framework.
We'll send a magic link — no password needed.
AGASI AiOS · HR05 v1.0 · Apr 7, 2026