Structured interviews still beat everything else
Jenny William
Hiring Advisor
Latest update
26 min read
IN THIS ARTICLE
The Four Fields Problem
Proxies that survive annoymization
When the rubric itself is the bias
Feedback loops, and why they hide
What monitoring actually catches
A short checklist
10 min remaining
Almost every hiring team using AI eventually faces the same question: what does the EU AI Act actually require when automated systems influence recruitment decisions? It may seem that compliance simply means choosing a compliant AI tool. But the requirements go further. AI systems used for recruitment and candidate selection can fall under the Act’s high-risk requirements, meaning hiring teams may need to address risk management, human oversight, documentation, record-keeping, and ongoing monitoring as part of the recruitment process itself.
Each of these requirements can shape how AI is used throughout the hiring process. Some address how candidates are assessed, while others focus on the safeguards required around automated systems. The two can be difficult to separate, because once AI influences screening, ranking, or evaluation, earlier outputs can affect who reaches the next stage—making human oversight, documentation, risk management, and ongoing monitoring important throughout the recruitment workflow.
The four fields problem
After an AI-assisted hiring system has screened, ranked, or assessed candidates, teams should maintain a clear record of what happened: automated results, risk reviews, human decisions, system changes, monitoring findings, and evidence of how the AI was used. Keeping these records helps hiring teams show that proper safeguards and human oversight were applied, while also making it easier to spot recurring problems or patterns that may need closer attention.
These requirements can shape how AI is integrated across the recruitment journey. Some relate to how applicants are evaluated, while others establish the safeguards that should surround automated tools. In practice, these areas often intersect: when AI screens, ranks, or assesses large numbers of applications, its outputs can determine who progresses to the next step. That makes consistent human judgment, clear oversight, and proper documentation important throughout the hiring process.
The test we use internally
Have two reviewers independently evaluate the same AI-assisted candidate assessment. Each reviewer can explain whether they agree with the AI recommendation, whether they would reach the same conclusion, and what evidence shaped their decision. Comparing these reviews can reveal where human judgments diverge, helping hiring teams determine when stronger oversight is needed and whether AI recommendations are being applied consistently across candidates.
Proxies that survive anonymisation
The following areas can have a significant influence on how AI is incorporated into recruitment. They are listed broadly according to their potential compliance significance and the likelihood that hiring teams may overlook them.
Before relying on AI for recruitment, hiring teams should establish whether the system falls within the EU AI Act’s high-risk category. Applications that help screen, rank, or assess candidates can trigger additional requirements around risk controls, human involvement, documentation, and ongoing monitoring. Understanding the system’s classification early helps teams build the right safeguards into a structured hiring process before AI outputs influence who moves forward.
AI recommendations should support hiring decisions, not automatically determine them. Recruiters and reviewers should have a clear opportunity to understand the reasoning behind an automated recommendation, challenge it, and change the outcome when necessary. This is especially important when AI screens, ranks, or evaluates candidates, because structured human review helps prevent automated outputs from becoming hiring decisions without meaningful oversight.
AI-generated recommendations should remain one input in the hiring process rather than becoming the final decision automatically. Hiring reviewers should be able to examine the reasoning, challenge the recommendation, and override it when necessary. When AI is involved in screening, ranking, or candidate evaluation, consistent human review helps ensure that automated outputs do not replace the judgment and structure needed for fair hiring decisions.
Hiring teams should identify and assess the risks associated with AI systems used in recruitment, including how automated outputs may affect different groups of candidates. A structured risk-management approach can help teams identify potential issues, assess their impact, and put appropriate safeguards in place before AI systems influence important hiring decisions.
Hiring teams should monitor AI systems after deployment to identify unexpected patterns, errors, or outcomes that may affect candidate assessment. Regular evaluation can help reveal when certain candidate information influences automated recommendations and give teams an opportunity to review, correct, or improve how the system is being used throughout the hiring process.
When the rubric itself is the bias
When automated screening rules narrow the candidate pool too aggressively, structured interviews can help bring consistency and human judgment back into the process. Giving candidates the same job-related questions and evaluating their responses against clear criteria allows hiring teams to make fairer comparisons. Human oversight, clear documentation, and regular monitoring can further ensure that AI-assisted screening does not replace meaningful human evaluation.
Hiring teams may use specific experience, qualifications, or career backgrounds when assessing candidates, but automated screening can apply these criteria without considering context. Structured interviews provide an opportunity to evaluate candidates consistently against clearly defined, job-related requirements. By asking comparable questions and using consistent evaluation criteria, teams can make better-informed decisions while reducing the risk of excluding strong candidates based solely on rigid screening rules.
That is why hiring teams should monitor not only AI systems, but also the rules and workflows used to assess candidates. Structured interviews provide a consistent framework for evaluating applicants, making it easier to identify changes in outcomes and understand what may have influenced a decision. Clear criteria, documented evaluations, and meaningful human oversight can help teams maintain fair and consistent hiring practices.
Feedback loops, and why they hide
The most difficult hiring risks can develop gradually when the same assessment methods are used repeatedly. Structured interviews can help teams maintain consistency by asking candidates comparable questions and evaluating responses against defined criteria. Regular reviews of interview questions, scoring methods, and hiring outcomes can also help identify patterns early and ensure candidates continue to be assessed fairly and consistently.
After months of use, a hiring process may appear reliable simply because it produces consistent results. But consistency alone does not guarantee that candidates are being assessed fairly or effectively. Structured interviews offer a clear framework for evaluating candidates against the same job-related criteria, while regular reviews of questions, scoring, and outcomes can help teams identify unintended patterns and maintain a more reliable hiring process.
Hiring teams should evaluate candidates consistently at each stage of the recruitment process rather than relying only on final outcomes. Structured interviews create a clear framework for assessing candidates through consistent questions and defined evaluation criteria. Reviewing each stage separately can help teams identify inconsistencies, understand where decisions may be influenced, and determine when additional human review or safeguards are needed.
What monitoring actually catches
Small changes to hiring criteria can affect how candidates are assessed and who moves forward in the process. Structured interviews help teams evaluate applicants using consistent questions and clearly defined criteria, while still allowing relevant experience and qualifications to be considered. Any meaningful change to the interview structure or evaluation process should be documented and reviewed to understand its impact and maintain appropriate human oversight.
The lesson is not that every hiring issue can be solved by changing interview questions or evaluation criteria. It is that potential problems should be identified while candidates are being assessed, rather than only after hiring decisions are made. Structured interviews, ongoing monitoring, and timely review can help teams detect unexpected patterns early and take corrective action before they affect broader hiring outcomes.
A short checklist
Hiring teams should review the intended use of each assessment method, the criteria applied to candidates, and the role of human judgment in final decisions. Each requirement should be genuinely necessary and relevant to the role. Using structured interviews with clear, job-related criteria can help teams identify potential risks, clarify responsibilities, and maintain appropriate human oversight throughout the recruitment process.
Hiring teams should assess candidates using the same or comparable questions and consistent evaluation criteria to determine whether the recruitment process produces reliable results. Significant differences in rankings, assessments, or candidate outcomes can indicate that the process needs further review. Regular testing of structured interviews can help identify unexpected patterns and determine when additional monitoring or human oversight is needed.
Hiring teams should monitor how candidates are assessed across screening, interviews, ranking, and final evaluation as part of one consistent process. Structured interviews make it easier to compare candidates using the same questions and defined criteria. Integrating regular reviews into the existing hiring workflow can help identify unexpected results, strengthen oversight, and address potential issues before they influence important hiring decisions.
Hiring teams should not rely solely on past hiring decisions to determine whether an assessment process is working effectively. Historical patterns may reflect outdated preferences rather than the skills truly needed for a role. Structured interviews provide a more consistent way to evaluate candidates against current, job-related criteria, while ongoing testing, monitoring, and human oversight can help identify potential risks and maintain fairer hiring decisions.
Hiring teams should keep a clear record of significant changes to interview questions, evaluation criteria, and scoring methods. Maintaining version history makes it easier to understand which assessment framework was used at a particular point in time, track how changes affected hiring outcomes, and provide clear evidence for review. Consistent documentation also helps ensure structured interviews remain fair, transparent, and appropriately governed.
None of this guarantees a perfect or risk-free hiring process. It does not ensure that every AI-assisted screening decision will be consistent or appropriate. What it does provide is visibility into how AI is being used, where potential risks or unexpected outcomes appear, and how those issues can be investigated, corrected, and explained—rather than allowing automated systems to influence important hiring decisions without meaningful human review.
