Most bad VA hires aren't caused by a lack of candidates — they're caused by a lack of criteria. When you don't know exactly what you're evaluating, you end up choosing whoever felt best in the interview.
A scoring matrix fixes that. It turns a subjective, gut-feel hiring decision into an objective, evidence-based one. You define what matters before you meet anyone, assign weights to those criteria, and score every candidate against the same standard.
This guide walks you through building a VA scoring matrix from scratch — including a complete template you can use in your next hire.
What Is a Scoring Matrix?
A scoring matrix (also called an interview scorecard or candidate evaluation rubric) is a structured document that:
- Lists the specific criteria you care about in a candidate
- Assigns a weight to each criterion (reflecting relative importance)
- Provides a rating scale for each criterion
- Produces a weighted score you can compare across candidates
The result is a ranked, apples-to-apples comparison of every candidate you evaluate — removing the "I just had a good feeling about them" dynamic that leads to inconsistent hires.
Why You Need a Scoring Matrix for VA Hiring
VA hiring is particularly prone to subjective decisions because:
- You're often hiring alone. Without a second opinion, your biases (availability bias, familiarity bias, communication style preferences) drive decisions.
- The candidate pool is large. There are many qualified VAs at any given time. Without criteria, more options create more confusion, not more clarity.
- VA work is varied. A VA who is excellent at executive support is not necessarily the right person for lead generation. The role definition has to drive the criteria.
- Remote hiring removes in-person cues. Without body language and office chemistry to anchor impressions, you need structure to evaluate what actually matters.
A scoring matrix gives you that structure.
Step 1: Define the Role Before Building the Matrix
Your scoring matrix should be purpose-built for a specific role. A matrix for a social media VA looks nothing like one for a research VA or a customer support VA.
Before you build the matrix, complete a role definition that answers:
- What are the 3–5 primary tasks this VA will own?
- What tools and platforms will they need to use?
- What communication requirements exist (response time, tone, client-facing vs. internal)?
- What experience level is required vs. preferred?
- What working hours or timezone alignment is needed?
- What are the dealbreakers — things that immediately disqualify a candidate?
Once you've defined the role, you have the raw material to build criteria.
Step 2: Identify Your Evaluation Criteria
Group your criteria into four categories. This keeps the matrix comprehensive without becoming unwieldy.
Category 1: Skills and Experience (40% of total weight)
What can they actually do? What have they done before?
Criteria examples:
- Relevant task experience (years and depth)
- Tool proficiency (specific software required for the role)
- Portfolio or work samples (for creative or content-heavy roles)
- Industry knowledge (relevant domain experience)
- Specialized certifications or training
Category 2: Communication (25% of total weight)
How clearly and professionally do they communicate? This matters more for VAs than most roles because almost all interaction is written and asynchronous.
Criteria examples:
- Written communication clarity (in application, email, or test task)
- Response to unclear instructions (do they ask clarifying questions or guess?)
- Professionalism and tone
- Grammar and spelling quality
- Verbal communication (if doing a video interview)
Category 3: Reliability and Work Habits (20% of total weight)
Can you count on them to do what they say, when they said they'd do it?
Criteria examples:
- References or testimonials from previous clients
- Demonstrated consistency in past roles (tenure, repeat clients)
- How they handle mistakes (do they acknowledge and correct, or deflect?)
- Responsiveness during the hiring process (on time to interviews, quick to follow up)
- Availability and timezone alignment
Category 4: Culture and Working Style Fit (15% of total weight)
Will they work well within your systems and preferences?
Criteria examples:
- Comfort with asynchronous communication
- Self-management and proactive communication style
- Openness to feedback
- Alignment with your working hours or flexibility requirements
- Attitude toward learning new tools or processes
Step 3: Assign Weights to Each Criterion
Not all criteria are equal. Assigning weights forces you to be explicit about what matters most for this specific role.
How to assign weights:
- The total across all criteria should equal 100%
- Give higher weights to criteria that are most predictive of success in the role
- Give lower weights to criteria that are "nice to have" but not critical
- Avoid giving any single criterion more than 20% — it creates too much sensitivity to one dimension
Example weight distribution for a Lead Research VA:
| Criterion | Category | Weight |
|---|---|---|
| Relevant experience (lead research, data entry) | Skills | 20% |
| Tool proficiency (LinkedIn, Apollo, Hunter.io, Google Sheets) | Skills | 15% |
| Work samples / past research deliverables | Skills | 10% |
| Written communication clarity | Communication | 15% |
| Professionalism and tone | Communication | 10% |
| References from past clients | Reliability | 15% |
| Responsiveness during hiring process | Reliability | 5% |
| Self-management style | Culture/Fit | 5% |
| Openness to feedback | Culture/Fit | 5% |
| Total | 100% |
Adjust these weights based on your role. A customer support VA might weight communication higher (30–35%). An executive assistant might weight reliability higher.
Step 4: Define the Rating Scale
Use a consistent rating scale for every criterion. A 1–5 scale works well:
| Score | Description |
|---|---|
| 5 | Exceeds expectations — strong, specific evidence; clearly a strength |
| 4 | Meets expectations — solid evidence; competent and credible |
| 3 | Mostly meets expectations — some evidence but with notable gaps |
| 2 | Below expectations — weak evidence; would require significant support |
| 1 | Does not meet expectations — missing, poor, or disqualifying |
Write brief behavioral anchors for your highest-priority criteria so that scoring stays consistent across candidates. For example:
Tool Proficiency — LinkedIn (for a sourcing VA):
- 5: Has used LinkedIn Recruiter or Sales Navigator professionally; can describe advanced Boolean search, filtering, and outreach sequences
- 3: Has used LinkedIn for basic searches and outreach; no advanced feature experience
- 1: Has not used LinkedIn for professional sourcing
Step 5: The Complete Scoring Matrix Template
Here is a complete scoring matrix you can adapt for your next VA hire.
VA Candidate Scoring Matrix
Candidate Name: ___________________________ Role: ___________________________ Evaluator: ___________________________ Interview Date: ___________________________
Section A: Skills and Experience (40%)
| Criterion | Weight | Score (1–5) | Weighted Score | Notes |
|---|---|---|---|---|
| Relevant task experience | 20% | — | — | |
| Tool proficiency (list tools) | 15% | — | — | |
| Work samples / portfolio | 5% | — | — | |
| Section Subtotal | 40% |
Section B: Communication (25%)
| Criterion | Weight | Score (1–5) | Weighted Score | Notes |
|---|---|---|---|---|
| Written clarity and quality | 15% | — | — | |
| Professionalism and tone | 5% | — | — | |
| Response to ambiguity | 5% | — | — | |
| Section Subtotal | 25% |
Section C: Reliability and Work Habits (20%)
| Criterion | Weight | Score (1–5) | Weighted Score | Notes |
|---|---|---|---|---|
| References and testimonials | 10% | — | — | |
| Demonstrated consistency | 5% | — | — | |
| Responsiveness during hiring | 5% | — | — | |
| Section Subtotal | 20% |
Section D: Culture and Working Style Fit (15%)
| Criterion | Weight | Score (1–5) | Weighted Score | Notes |
|---|---|---|---|---|
| Self-management style | 5% | — | — | |
| Openness to feedback | 5% | — | — | |
| Availability / timezone fit | 5% | — | — | |
| Section Subtotal | 15% |
Total Weighted Score: ___ / 500
Calculated as: Sum of (Weight × Score) for all criteria Score Interpretation:
- 400–500: Strong hire — proceed with confidence
- 300–399: Good candidate — proceed with awareness of gaps
- 200–299: Borderline — consider only if pool is small; address gaps in onboarding
- Below 200: Do not hire — significant misalignment with role requirements
Dealbreaker Check:
- No disqualifying factors identified
- Disqualifying factor present: [describe] → Do Not Proceed
Overall Recommendation: Hire / Proceed with Caution / Do Not Hire
Summary Notes: [3–5 sentences on the candidate's strengths, gaps, and recommendation rationale]
Step 6: Build a Test Task Into Your Evaluation
The scoring matrix evaluates what candidates tell you. A test task evaluates what they can do. For VA hiring, always include a short paid test task before extending an offer.
The test task should:
- Reflect an actual task from the role (not an invented exercise)
- Take no more than 60–90 minutes to complete
- Come with a clear brief that mirrors your SOP format
- Have a defined output you can evaluate objectively
Score the test task output using the same quality criteria on your matrix. This gives you real evidence for the Skills and Communication sections — not just interview performance.
Step 7: Compare Candidates Side by Side
Once you've scored all candidates, create a comparison table:
| Candidate | Skills (40%) | Communication (25%) | Reliability (20%) | Fit (15%) | Total | Recommendation |
|---|---|---|---|---|---|---|
| Candidate A | 148/200 | 105/125 | 84/100 | 67/75 | 404/500 | Hire |
| Candidate B | 130/200 | 95/125 | 70/100 | 52/75 | 347/500 | Proceed w/ Caution |
| Candidate C | 100/200 | 75/125 | 60/100 | 45/75 | 280/500 | Do Not Hire |
The matrix makes the decision clearer — and documents your reasoning if you ever need to explain it.
Find Pre-Vetted VAs That Score High Before You Even Interview
Building a scoring matrix is most valuable when you have quality candidates to evaluate. The challenge is that sourcing and pre-screening candidates takes significant time.
Stealth Agents does the sourcing and initial vetting for you. Their virtual assistants are screened for communication skills, reliability, and relevant experience before you ever see a profile. You apply your scoring matrix at the final selection stage — rather than filtering through dozens of unqualified applicants.
If you want the structure of an objective hiring process without spending weeks managing candidate pipelines, Stealth Agents is worth exploring.
Scoring Matrix Build Checklist
- Complete the role definition before building criteria
- Identify 8–12 evaluation criteria across the four categories
- Assign weights that total 100%
- Write behavioral anchors for your top 3–5 criteria
- Define your rating scale (1–5 recommended)
- Identify dealbreakers that auto-disqualify candidates
- Design a 60–90 minute paid test task
- Score all candidates on the same matrix
- Compare candidates in a side-by-side table
- Document your hiring decision and rationale
A VA scoring matrix takes about two hours to build the first time. After that, you adapt it for each role in 20–30 minutes. The payoff is a hiring process that's faster, more defensible, and more likely to result in a VA who actually delivers.
For more on VA hiring and management, see our guides on how to set up a VA recruiting workflow and how to build a VA training program.