Shortlisting Candidates: A Fair Process You Can Repeat

A shortlist is the smaller group of applicants who meet the agreed criteria and move to the next hiring stage. Good shortlisting is not a fast scan for familiar employers or polished CVs. It is a documented comparison against the work the person will do, applied in the same way to everyone.
This guide covers the decisions between receiving applications and inviting candidates to interview. Righteo’s shortlisting glossary entry explains the term; here the focus is a practical process recruiters and hiring managers can repeat.
Key Takeaways
- A shortlist is a selected group of applicants who advance to the next assessment stage.
- Agree essential criteria and their evidence before reviewing applications.
- Apply the same job-related questions and scoring rules to each candidate.
- Record reasons for advancing, declining or seeking clarification, then update applicants promptly.
Set the shortlist rules before you open applications
Start with the job description and separate essentials from preferences. An essential might be a licence required for the work; familiarity with a particular employer’s software might be teachable. For each criterion, write down what evidence counts and what you will do if the application is unclear. Set an initial target for the number of interviews, but do not invent a score cutoff after seeing who applied.
The Australian government’s recruitment guidance recommends stating essential and desirable selection criteria in a position description. For US employers, the EEOC’s guidance on selection procedures explains why job-related criteria matter and why seemingly neutral selection tools can raise discrimination concerns. Rules differ by jurisdiction, so use this process alongside local legal review when needed.
Use knockout questions sparingly
A knockout question should test a real non-negotiable requirement, such as a mandatory credential or the ability to work an advertised shift. Draft the question in plain language, state what acceptable evidence looks like and allow a way to clarify a missing or ambiguous answer. A yes/no filter based on an arbitrary number of years can reject someone who has performed the same tasks through a different route.
Before using any exclusion, ask whether it measures the actual job or simply mirrors the background of a previous hire. In Australia, government guidance on equal opportunity calls for fair treatment regardless of characteristics such as age, gender and race. Do not use age, family circumstances or other protected information as a proxy for availability or capability.
Score evidence, not impressions
Create a scorecard with perhaps four or five job-related criteria, a simple rating scale and a space for evidence. For a warehouse coordinator, the criteria might cover inventory records, shift handovers, error investigation and communication. Define what a strong answer looks like for each. One reviewer’s “good fit” is not useful evidence unless they can point to a relevant example in the application.
A candidate comparison template can provide a place to collect the ratings; the hiring team still has to agree on the rubric. Reviewers should score separately before discussing differences. When scores diverge, identify which piece of evidence each person relied on and whether the criterion was interpreted consistently. Document the resolution rather than averaging away a real disagreement.
Check for bias and missing information
Look for applicants who meet the essentials but were marked down for an unrelated career gap, a different job title or an unfamiliar institution. Do not infer skill from the prestige of an employer if the actual work is not described. Ask the same follow-up where equivalent evidence is missing from comparable applications. Make reasonable adjustments to assessment where applicable, and avoid collecting sensitive information that is not needed for the hiring decision.
A brief second review by someone who did not make the first pass can expose inconsistent decisions. Compare borderline files with the written criteria, not with each other’s biographies. If one criterion excludes most applicants, check whether it was genuinely essential. Keep a note of any change to the rubric and apply it fairly to the whole pool rather than changing the rule for one favoured candidate.
Move the shortlist into the next stage
Tell advancing candidates what happens next, the likely timing and any preparation needed. A structured interview can use common questions and rating guidance tied to the same role requirements. Later, reference checks can help confirm relevant work claims; they should not replace evidence from the application and interview. Avoid asking a referee about information unrelated to the role.
Notify unsuccessful applicants when the decision is settled. Keep the message accurate: an applicant who did not reach interview was not necessarily unqualified; another group may have offered stronger evidence against the same criteria. Give specific, job-related feedback when you can support it from your notes. Do not leave people waiting because the team neglected to set an owner for updates.
Keep an audit trail without collecting everything
Save the job criteria, the version of the scorecard used, reviewer notes and the reason each candidate did or did not advance. Restrict access to the people involved in hiring and follow applicable retention and privacy rules. A score alone cannot explain a decision; short evidence notes are more useful than a page of subjective adjectives.
For US teams using different terminology, Righteo also has a US shortlisting explanation. The practical rule remains the same: define the role first, compare candidates against it and keep records that make the decision understandable. A hiring process is repeatable when the next reviewer could apply the same criteria to a fresh pool without guessing what you meant.
Related Resources
- shortlisting glossary
- US shortlisting term
- candidate comparison template
- structured interview next
- reference checks after shortlist
- selection procedures and testing guidance
Common Questions About Candidate Shortlists
1. What does it mean to be shortlisted for a job?
A shortlisted applicant has passed an initial review and is being considered for the next stage. It does not mean the applicant has received an offer.
2. How many candidates should be on a shortlist?
There is no universal number. Set a manageable interview capacity, then advance candidates who meet the written criteria; do not lower the standard or invent new exclusions simply to hit a number.
3. Can an employer use a knockout question?
Yes, if it measures a genuine requirement of the role and is applied consistently. Check local discrimination and accommodation requirements before using it as an automatic rejection rule.
4. What records should a hiring team keep?
Keep the agreed criteria, scoring guidance, evidence notes and decision reasons under applicable privacy and retention rules. Avoid irrelevant sensitive personal information.
Write the Criteria Before the Names
Agree the essentials, evidence and scoring rule before anyone starts sorting applicants. Apply that rule consistently, review borderline decisions and keep a short record of why each person advanced or did not. Then give candidates a clear update about the next stage. A shortlist is defensible when it can be explained in terms of the job.
Stop hiring by intuition.
Automate reference checks and skills assessments with Righteo. Get honest, structured insights on every candidate — faster and fairer. Trusted by 1,200+ Australian businesses.