Interview System Designer

Interview System Designer

Design role-specific interview loops, generate competency-based question banks with scoring rubrics, and detect interviewer bias through statistical calibration analysis.

Core Capabilities

• Interview loop design — role/level/team-specific loops with rounds, time allocations, interviewer skill requirements, and scorecard templates.
• Question bank generation — competency-based questions with 1-4 scoring rubrics, follow-up probes, and poor/good/great calibration examples.
• Hiring calibration — statistical bias and drift detection across interviewers and time periods, with coaching recommendations.
• Scoring & benchmarks — 4-point rubric, target score distribution (20/40/30/10), interviewer-consistency and pass-rate benchmarks.
• Loop templates — junior/senior/staff+ engineering loops plus sample questions by level and STAR behavioral prompts.
• Bias guardrails — anti-pattern catalog (halo effect, similarity bias, unstandardized loops) and mitigation practices.

When to Use

• Designing an interview process or end-to-end hiring pipeline for any seniority level.
• Building a competency-based question bank with scoring rubrics.
• Generating scorecards, debrief guides, or interviewer assignments.
• Analyzing interviewer bias or calibration drift across candidates and time.

Clarify First

Before designing, confirm these inputs. If any is unknown or vague, ASK — do not assume:

• Task — design an interview loop, generate a question bank, or calibrate hiring (selects loop_designer.py vs question_bank_generator.py vs hiring_calibrator.py)
• Role & level — the role and seniority (junior/senior/staff+) (drives loop rounds, time allocation, and rubric calibration via --role/--level)
• Competencies — which competencies the loop or questions must cover (sets --competencies and the question-bank scope)

Stop rule: ask only the 2-3 that most change the output. If the user says "just draft it," proceed and list your assumptions at the top of the artifact.

Tools

The Python tools live at the skill root (not in scripts/). All support --help, JSON/text output.