I-O Myth Busters: Common Responses to Hiring Assessment Tools
We revisited this classic blog by our team that was originally published April 22, 2015 in response to a conversation in the Wall Street Journal about assessments.
TL;DR: Hiring assessment tools don’t discriminate – they’re built to prevent it. They outperform references, complement AI screening, and predict job performance better than experience or resumes alone. The organizations getting hiring right use validated assessments alongside skills-based approaches and structured interviews to measure what actually matters: how someone will perform in the role.
The conversation about hiring assessments has never been louder. AI screening tools are everywhere. States are passing laws regulating how companies use automated hiring decisions. And the same questions that surfaced a decade ago – do assessments actually work? Are they fair? Are they worth it? – are still circulating, now tangled up with a new layer of confusion about what AI can and can’t do in hiring.
The myths haven’t changed much. But the stakes have. Here are the most common objections to hiring assessment tools – and what the science and practice of I-O psychology actually say about each one.
A note on language: "personality tests" and "hiring assessments" are often used interchangeably, but they aren't the same thing. Personality tests measure stable traits that guide our behavior. Hiring assessments include personality tests but can also include measures of problem-solving, our values, ways of working, and preferences. Hiring assessments can elevate the candidate experience and educate and engage candidates. They are built for a specific purpose — to measure the behaviors and characteristics that predict success in a particular role, validated against actual job performance data.
History (a quick trip back to 2015!). The Wall Street Journal published a much discussed article discussing the pros and cons of hiring assessments. Readers of the WSJ are often actively engaged in business and a review of the comments allow a glimpse in to common and valid concerns about assessments. The concern voiced by each of these myths was shared by many within that article.
Myth 1: Hiring assessment tools allow companies to discriminate based on age, race, and other protected classes.
Unsplash+ in collaboration with Getty Images
We're starting with the most significant misconception. To the contrary, one of the reasons for using hiring assessments is to avoid discrimination based on protected classes, or any characteristic that isn’t related to performing the job. The Equal Employment Opportunity Commission requires that assessment developers evaluate and monitor their tools to ensure they do not select a disproportionate number of any one type of group – whether it be age, race, or any other protected class. If the assessment discriminates based on those characteristics, it is illegal to use it.
Hiring assessments actually reduce the chance for illegal discrimination by focusing only on those characteristics which are related to successful job performance. Unlike people, they don’t suffer from biases or prejudice. The assessment doesn’t know or care what age or race you are when calculating the results, and it doesn’t provide the hiring manager with any information about those characteristics either. It serves as an unbiased source of information about the candidate’s fit for the job that further informs the hiring manager’s overall decision.
This matters even more now. The Equal Employment Opportunity Commission’s 2023 guidance on AI and automated hiring systems made clear that employers are liable for adverse impact whether the discrimination comes from a human decision or an algorithm. Several states now require bias audits for AI-driven hiring tools. Validated hiring assessments built by I-O psychologists already meet these standards – they’re tested for adverse impact before they ever reach a candidate. The risk isn’t in using assessments. It’s in using unvalidated AI tools that haven’t been held to the same standard.
Myth 2: It’s better to simply find someone with job-related experience than use hiring assessments.
Unfortunately, it’s difficult to know what work experience will yield success on the job, or find enough candidates with experience that closely matches your unique standards for performance. With entry-level jobs, or high-potential candidates switching to a new career, experience may not be available. Without that information, it makes it even more difficult to understand if someone is likely to be a strong performer. Hiring assessments are especially useful in this context because they provide insight into whether the person can do the job, even though they have never done it before.
Even when work experience is available, hiring assessments provide powerful information. It is entirely possible for a person with experience elsewhere to fail miserably at the same job when presented with your organization’s culture or standards. Assessments can be designed to fit your culture and standards and don’t assume performance elsewhere translates to performance at your organization.
This is where the growing interest in skills-based hiring adds an important nuance. Organizations that strip away credentials without replacing them with valid measurement often discover the gap the hard way. The ones building real influence and capability frameworks still need to assess how people apply those skills, not just whether they have them. A skills checklist tells you what someone knows. A validated assessment tells you how they’ll perform – how they’ll work with others, adapt to your culture, and handle the daily demands of the role.
The “fit” part of that statement is what hiring assessments are primarily about. While they can inform the “what” of the job – how well a person can do the activities expected – they are especially good at tapping into the “how.” For example, a tax preparer can do all the tasks required to process a customer, but the person with the right behavioral profile will do it with enthusiasm and care, leaving the customer not just with an accurately completed return, but with a positive feeling about the experience. Determining “fit” is exactly how hiring assessments help.
Myth 3: References are better than hiring assessments.
Photo by Of the hundreds of hiring managers we’ve met over the years, very few would agree with this statement. In fact, we most often hear that references aren’t useful or have very limited value. There are multiple reasons for this, but here are the top four:
Most organizations will only confirm dates of employment, position held, and pay at separation. When providing references, legal liability falls on the organization giving the information, so many only provide objective details required to verify employment. References don’t usually provide much to work with.
It’s difficult to trust the information. In the instances where a reference is willing to provide detail, they rarely share negative information – no one wants to burn bridges or hurt someone who is out of work. It’s also common for poor performers to find at least one person willing to give a good review.
They are time-intensive. Calling references means finding time during business hours, dealing with phone tag, and having conversations that take longer than most other screening methods. Most organizations treat references as a final check, not a screening tool – which is exactly why something like a hiring assessment is needed earlier in the process.
Not everyone has work experience. Entry-level candidates can’t provide work references, which means any role at that level cannot rely on references to make hiring decisions.
Hiring assessments don’t suffer from any of these limitations. They can be administered quickly, are highly reliable, don’t require work experience, and offer direct insight into how well a person is likely to fit with the organization and position. In a remote and hybrid world, where references are even harder to verify and working relationships are less visible, assessments provide a consistent, standardized data point that references simply can’t match.
Myth 4: AI can screen candidates better than any assessment.
Photo by Towfiqu barbhuiya on Unsplash
This is the newest version of an old objection. The tool changes – first it was resumes, then references, then structured interviews – but the underlying belief is the same: something else can replace what hiring assessments do.
AI screening tools are useful. They can parse resumes, match keywords, and surface candidates faster than any human recruiter. But they are pattern-matchers, trained on historical hiring data. They replicate whatever biases and blind spots exist in past decisions. If your last fifty hires in a role were all from the same background, the algorithm learns to favor that background – not because it’s predictive of performance, but because it’s what the data looks like. When that goes wrong, the consequences are real.
Validated hiring assessments work differently. They measure job-relevant behaviors directly. They’re built and tested to avoid adverse impact. They don’t rely on proxies like resume keywords or school names – they measure the characteristics that actually predict how someone will perform in the role and fit within the culture.
The organizations getting this right aren’t choosing between AI and assessments. They’re using both – AI for efficiency in the early funnel, validated assessments for accuracy where it counts. Skills-based hiring initiatives accelerate this: as organizations strip away degree requirements and focus on what candidates can actually do, they need tools that measure capability and fit with precision. That’s what validated assessments are designed for.
Myth 5: Hiring assessments don’t predict performance.
Unsplash+ in collaboration with Andrej Lišakov
How many times have you interviewed a candidate without an assessment who did not succeed on the job? Or hired someone based on their resume who demonstrated less than stellar performance at work? Those failures don’t usually lead people to throw out interviewing or resume reviews entirely – but when an assessment is involved and a hire doesn’t work out, the test is the first thing blamed.
If you find yourself hiring people who score well on assessments but fail to meet expectations, it’s worth asking a few questions before blaming the tool:
Am I measuring the things that are most needed for success? Make sure the assessment targets the characteristics most critical for the role – not just technical skills, but the right attitudes and work behaviors.
Do I fully understand what the assessment is telling me – and what it’s not? Misunderstanding what an assessment measures leads to skepticism about its results. If a new hire fails because of motivation issues, don’t blame a tool that was measuring dependability.
Is this new hire getting the tools and support needed for success? Bringing on a new hire without the training, support, and feedback they need in the beginning makes it easy for them to fail – regardless of their assessment results.
Did I select for appropriate fit with the culture and work environment? Placing someone in an environment where they don’t fit will produce failure no matter how strong their assessment results.
The key is building a solid funnel. Start by screening out applicants who don’t meet clear, easily verified job requirements. Then administer hiring assessments on your smaller pool – before the most time-intensive part of the process: the interview. This approach lets you marry experience with assessment data before the interview, enriching your time with the candidate.
Start with your competencies and job requirements before selecting predictive assessments and screens to support your hiring funnel. Do that correctly and the candidates who best fit your team and organization will stand out. Remember: we tend to hire for technical skill and experience and terminate for culture and behavior.
The broader evidence supports this approach. Decades of meta-analytic research show that well-built assessments meaningfully predict job performance, retention, and cultural fit. They aren’t foolproof – no tool in the hiring process is – but they dramatically increase your odds of finding the right person, especially when combined with structured interviews and clear competency models that define what success looks like before you start evaluating candidates.
Myth 6: Hiring assessments are useful for learning how to work with people, but using them for hiring decisions is extreme.
Hiring is a game of odds. It’s about strategy and chance, and increasing those odds by using tools that provide information you cannot get from any other part of the hiring process. Adding validated assessments to your hiring process at the right point gives you insight into behaviors that drive performance – insight that resumes, references, and interviews alone cannot reliably provide.
Start by identifying your hiring priorities: the attitudes and behaviors an ideal candidate must demonstrate on the job to succeed. Then match those to what a candidate demonstrates on a well-developed assessment. This method is a reliable way to increase your odds of making the right hire.
As hiring becomes more automated and less personal – more AI, more volume, more remote screening – validated assessments are one of the few tools that still measure what matters about a person. Not what an algorithm predicts from their resume. Not what a reference is willing to say. What they’ll actually do in the role, every day, when the job gets real.
About Corvirtus
Every Corvirtus assessment is built by I-O psychologists, validated against real job performance data, and tested for adverse impact before it reaches a candidate. Whether you’re building a hiring funnel from scratch or adding assessment to an existing process, the tools are designed to measure the behaviors that actually drive performance in your specific environment – not generic traits, not AI-generated proxies.
- Hiring Assessments – Predict success and hire with confidence
- Employee Development – Build skills and grow lasting success
- Competency Models – Define what success looks like before you start evaluating candidates
Wanting to see more? Explore a sample assessment.
Frequently Asked Questions
How do I improve my hiring process? Start with clear competency models that define the attitudes and behaviors needed for success in the role. Then build a funnel: screen for basic qualifications first, administer validated hiring assessments on the remaining pool, and reserve interviews for the candidates who demonstrate the strongest fit. This approach marries efficiency with accuracy – you spend your most time-intensive effort on the people most likely to succeed.
Do hiring assessments discriminate against candidates? No. Validated hiring assessments are specifically designed and tested to avoid adverse impact across protected classes. The EEOC requires assessment developers to monitor for disproportionate selection rates. Unlike unstructured interviews or resume screens, assessments evaluate only job-relevant characteristics and don’t introduce bias based on age, race, gender, or other protected attributes.
Are hiring assessments better than references? They serve different purposes, but assessments provide more reliable and consistent information. References are limited by legal liability, trust issues, time constraints, and the fact that not every candidate has work experience. Assessments can be administered quickly, are standardized across candidates, and directly measure the behaviors that predict on-the-job performance.
Can AI replace hiring assessments? AI screening tools are useful for efficiency – parsing resumes, matching keywords, and surfacing candidates quickly – but they are pattern-matchers trained on historical data. They replicate existing biases rather than measuring job-relevant behaviors directly. Validated assessments and AI serve complementary roles: AI narrows the funnel, assessments ensure accuracy where it counts.
Do hiring assessment tools actually predict job performance? Yes. Decades of meta-analytic research demonstrate that well-built assessments meaningfully predict job performance, retention, and cultural fit. They aren’t foolproof, but they increase hiring accuracy more than any other single tool in the process – especially when paired with structured interviews and clear competency models.
What is the difference between skills-based hiring and hiring assessments? Skills-based hiring focuses on what a candidate can do – removing degree requirements and evaluating demonstrated capabilities. Hiring assessments go further by measuring how a candidate will apply those skills: how they work with others, adapt to your culture, and handle daily demands. The two approaches are complementary. A skills checklist tells you what someone knows; a validated assessment tells you how they’ll perform.
