Core Idea
The practices that reduce candidate burden in an engineering interview process also improve predictive validity — fairness and accuracy align, so optimising for candidate experience is not a trade-off with hiring quality.
Most engineering interview processes are simultaneously burdensome for candidates and inaccurate as selection mechanisms. Larson’s humane interview process framework addresses both problems at once.
The Seven Principles
1. Interview for the actual job
- Evaluate candidates on work resembling the real role, not abstract puzzles
- Failure mode: whiteboard algorithmic challenges for roles that never require them
2. Avoid gotcha questions
- Replace gotchas with open-ended questions that reveal how candidates reason
- Failure mode: trivia testing memorised facts rather than job-relevant judgment
3. Use a consistent scoring rubric
- Pre-define evaluation criteria before interviews begin
- Failure mode: free-form feedback where every interviewer assesses different dimensions
4. Calibrate interviewers
- New interviewers shadow experienced ones; regular calibration sessions compare scores on borderline candidates
- Failure mode: interviewers who have never compared their scoring to others on the same candidate
5. Keep it short
- Four to five interviews captures most available signal; six or more returns diminishing information
- Failure mode: seven-round loops designed to achieve consensus rather than accuracy
6. Reduce performance anxiety
- Take-home exercises, pair programming, or design discussions reduce anxiety unrelated to job performance
- Failure mode: standardising on formats easiest for interviewers to run, not easiest for candidates to perform in
7. Collect evidence, not opinions
- Feedback: “candidate explained the trade-off between X and Y, demonstrating understanding of Z”
- Failure mode: “candidate seems smart” or “I liked their energy”
The Implicit Principle
Fairness and accuracy align. A process that respects candidate time and reduces anxiety elicits more authentic performance, which improves predictive validity.
Connection to the Hiring Funnel
The humane interview process governs the Evaluate stage of the Hiring-Funnel. Poor evaluation design degrades the entire funnel: sourcing effort from Three-Candidate-Sources is wasted if the process filters for the wrong signals.
Related Concepts
- Hiring-Funnel
- Three-Candidate-Sources
- Calibration-System-for-Performance
- Performance-Management-System
- Larson-2019-An-Elegant-Puzzle
Sources
-
Schmidt, Frank L. and John E. Hunter (1998). “The Validity and Utility of Selection Methods in Personnel Psychology.” Psychological Bulletin, Vol. 124, No. 2, pp. 262–274. DOI: 10.1037/0033-2909.124.2.262.
- Definitive meta-analysis: structured interviews have substantially higher predictive validity (~0.51) than unstructured (~0.38)
-
Larson, Will (2019). An Elegant Puzzle: Systems of Engineering Management. Stripe Press. ISBN: 978-1-7322651-8-9.
- Chapter 6.2: Interview process design principles
-
Campion, Michael A., David K. Palmer, and James E. Campion (1997). “A Review of Structure in the Selection Interview.” Personnel Psychology, Vol. 50, No. 3, pp. 655–702. DOI: 10.1111/j.1744-6570.1997.tb00709.x.
- Fifteen dimensions of interview structure and their impact on reliability and validity
-
Bohnet, Iris (2016). What Works: Gender Equality by Design. Harvard University Press. ISBN: 978-0-674-08903-3.
- Structured evaluation criteria reduce affinity bias in hiring
-
Macan, Therese Hoff (1994). “Time Management: Test of a Process Model.” Journal of Applied Psychology, Vol. 79, No. 3, pp. 381–391.
- Cognitive load research supporting anxiety-reduction principle
Note
This content was drafted with assistance from AI tools for research, organization, and initial content generation. All final content has been reviewed, fact-checked, and edited by the author to ensure accuracy and alignment with the author’s intentions and perspective.