Recruitment partner evaluation is when a school systematically reviews what the partnership produced over the past year, and whether to continue it, and in what form.
Without regular evaluation, the partner list only grows over time with no one reviewing it. The result is that the school spreads its resources across many relationships, most of which produce no results.
This guide sets out a four-group criteria framework and how to carry it out.
Principle: publish the criteria in advance, do not score by impression
The criteria set must be sent to partners at the start of the term, not announced at evaluation time.
The reason is very practical. If a partner knows in advance which metrics they will be evaluated on, they will adjust how they work accordingly during the year. This is the main benefit of the evaluation, far greater than the end-of-term ranking itself.
Conversely, a criteria set introduced only after the year has ended just creates disputes and a sense of unfair treatment.
Second principle: every criterion must be measurable with data, not based on impressions. A remark like this partner works enthusiastically cannot be used for any decision.
Group one: outcomes
This is the easiest group to measure, but the right metrics must be chosen, since the wrong metric creates the wrong incentive.
Number of applications referred. Recorded but not used as the main metric, since it encourages volume.
The rate of qualifying applications out of total applications referred. This metric reflects screening quality and understanding of the program.
Enrollment rate out of those admitted. Reflects the accuracy of the advice given.
Retention rate after the first year. This is the most important metric in the entire criteria set, since it shows whether students are genuinely a good fit.
For new partners, the fourth metric has no data yet, so the first year should only evaluate the other three metrics, and it should be noted clearly that this is an incomplete evaluation cycle.
Group two: compliance
This group is not for scoring highly but mainly for detecting violations.
Whether materials currently in circulation match the approved set, checked by requesting the actual materials in use.
Whether there are any self-produced materials that have not been approved.
Whether all fees charged to students are fully disclosed.
Whether any commitments beyond the partner’s authority have been recorded, through complaints or through student surveys.
Whether student data is handled according to the agreement.
This group should be scored as pass or fail, not on a scale. A serious violation in this group is enough to warrant reviewing the entire relationship, regardless of how well the other three groups score.
Group three: quality of collaboration
This group measures how easy the partner is to work with, and it affects the school’s operating costs more than people tend to think.
Quality of applications referred. Whether documentation is complete or frequently missing, and how many times follow-up requests are needed.
Response time when the school reaches out.
Quality of periodic reports. Submitted on time, in the correct format, with accurate figures.
Level of participation in training. Whether they send someone to training sessions, and whether they stay updated when materials change.
Number of repeated questions. If a partner keeps asking about things already covered in the materials, that is a sign they have not absorbed or read them.
Group four: student experience
This group draws data directly from students, and often reveals what the other three groups miss.
Survey results from enrolled students, focused on whether the information they received matched reality.
Survey results from those who applied but did not enroll. This group gives the most candid information.
Number of complaints raised, categorized by subject.
Whether any unexpected additional fees were reported.
The survey should be short, under ten questions, and should be run directly by the school rather than through the partner.
Scoring scale and how to aggregate
A simple and sufficient approach is to divide each group into three levels: excellent, satisfactory, and unsatisfactory.
Group two, on compliance, is not scored but acts as a gate condition: failing this group puts the overall result at needs review, regardless of the other three groups.
The remaining three groups can be weighted, with groups one and four weighted more heavily than group three.
The final result should lead to one of four decisions, and these four decisions should be spelled out in the contract from the start.
Expand the partnership. Increase the scope of authorized programs, or increase the level of support.
Maintain as is.
Maintain, with corrective conditions. Specify clearly what needs to improve, by when, and when it will be reassessed.
Terminate. Provided that students currently in the process are not left stranded.
How much effort does an annual recruitment partner evaluation require
This is a practical question, since a process that is too heavy will not be sustained.
For a network of fewer than ten partners, the entire evaluation cycle usually takes about one person-week, provided the data has been recorded consistently throughout the year.
That condition is the key point. If data has to be collected retroactively at the end of the term, the effort multiplies and accuracy drops significantly.
So what needs investing in is not the evaluation cycle itself but the habit of recording data throughout the year: noting the source for every application referred, the content and the partner involved for every complaint, and the outcome of every materials review.
For a larger network, it is worth splitting into two tiers: a full evaluation for high-volume partners, and a streamlined evaluation for the rest.
Communicating results to the partner
How the results are communicated determines whether the evaluation drives improvement or just creates tension.
Send it in writing beforehand, so the partner has time to read and prepare.
Follow up with a direct conversation, allowing time to hear the partner’s side. Many unusual figures have explanations the school was not aware of.
Separate the data from the conclusions. Present the figures first, so both sides look at them together, before moving to the evaluation.
State the strengths as well. A session that is all weaknesses will make the partner defensive and less receptive.
End with concrete actions for the coming year, with timelines, for both sides. The school usually has areas to improve too, such as application processing speed or the quality of its materials.
One final point worth emphasizing: an evaluation that looks only at the partner will miss causes that lie with the school itself.
When you need to put your own metrics into the broader context of the sector, the policy report from the Organisation for Economic Co-operation and Development (OECD) are a useful reference source.
For content on degree recognition that partners need to understand thoroughly, the framework of The United Nations Educational, Scientific and Cultural Organization (UNESCO) should be mandatory reading in the annual training program.
Summary
Annual recruitment partner evaluation is based on four criteria groups: outcomes, compliance, quality of collaboration, and student experience.
The compliance group acts as a gate condition rather than being scored. The most important metric in the outcomes group is the first-year retention rate.
And the condition for the evaluation cycle to be feasible is the habit of recording data consistently throughout the year, not an effort to collect it all at the end of the term.
Next Steps
Draft a criteria set covering the four groups above, fit it into two pages, and send it to all partners at the very start of the coming term.
Sending it out in advance is what generates most of the benefit, even before the first evaluation cycle takes place.
