Education & Higher Ed Calibration Playbook

Why Higher Ed Calibration Is Different

Academic institutions face calibration challenges that are structurally unlike those in corporate environments. Faculty hold academic freedom protections that constrain how performance is evaluated. Tenure-track employees operate on 5-7 year timelines for major career decisions — making annual calibration high-stakes in ways that extend beyond any single year. Non-tenure-track and adjunct populations are simultaneously the most numerous and the most underserved by formal calibration processes. And shared governance models mean HR rarely has the same authority to design and enforce calibration processes that it has in corporate settings.

The most common failure in higher ed calibration: running a single process for tenure-track faculty, non-tenure-track instructors, and administrative staff — then applying the same rubric to all three. These populations have different job descriptions, different accountability structures, and fundamentally different relationship to performance documentation.

Calibration Structure by Role Track

Tenure Review and Calibration: Keeping Them Separate

In higher education, the most common calibration design mistake is conflating annual performance calibration with the tenure review process. These two processes serve different purposes, operate on different timelines, and must be kept procedurally distinct — even when they share underlying performance data.

Annual calibration: what it is

Annual calibration produces a current-year performance rating that documents an employee's performance against their job description for that review period. For tenure-track faculty, this means evaluating teaching, research progress, and service in the current academic year. Calibration creates a contemporaneous record that is useful for merit compensation decisions, professional development planning, and — when aggregated over multiple years — as supporting evidence in tenure review.

Tenure review: what it is

Tenure review is a longitudinal career progression decision made against a multi-year dossier of evidence. It is governed by academic governance processes, typically involves external peer review, and results in a recommendation about permanent employment status. Tenure review is not a calibration — it is a credentialing decision that draws on calibration records as one input among many.

How to maintain the distinction in practice

• Annual calibration ratings must be documented separately from tenure dossier materials — they inform the dossier, not vice versa
• Annual calibration should be conducted by the direct supervisor (department chair) with HR oversight; tenure review involves peer committees, external reviewers, and dean-level governance
• Calibration feedback should be specific to the current year's performance — not a judgment about tenure trajectory. Save tenure trajectory language for the pre-tenure review process
• Inform pre-tenure faculty explicitly that annual calibration is distinct from and does not predetermine tenure outcomes

Student Evaluations: How to Use Them (and How Not To)

Student evaluations of teaching (SETs) are one of the most contested inputs in academic calibration. Decades of research show that SET scores are systematically influenced by factors unrelated to teaching quality: instructor gender, race, and physical appearance all predict SET scores independently of instructional effectiveness. Course difficulty and grading leniency also predict SET scores more strongly than actual learning outcomes in many studies.

The calibration problem with student evaluations

Using raw SET scores to compare faculty across departments, course levels, or demographic groups produces biased results. A faculty member teaching a mandatory 200-student introductory course to reluctant students will almost certainly score lower than a colleague teaching an elective seminar to motivated seniors — regardless of teaching quality.

Best practices for using student evaluations appropriately

• Normalize before comparing: Compare SET scores within course type, level, and enrollment size — not institution-wide
• Weight qualitative comments: Specific, behavioral comments are more useful than overall satisfaction ratings for calibration purposes
• Pair with peer observation data: Classroom observations by trained peer observers provide a more objective measure of teaching quality than student satisfaction
• Track trends, not snapshots: A single semester's SET scores are noisy. Multi-year trends are more meaningful
• Never use SETs as a standalone calibration input: They are one piece of evidence, not a verdict

Non-Tenure-Track and Adjunct Faculty Calibration

Non-tenure-track (NTT) faculty — including full-time instructors, lecturers, and part-time adjuncts — represent the majority of faculty at most U.S. institutions, yet they are often the population least served by formal performance calibration. This is both an equity problem and a compliance risk.

Why NTT calibration is commonly underdeveloped

• Adjunct contracts are short-term, creating disincentive to invest in formal review processes
• NTT faculty often lack the same union representation or governance standing as tenure-track faculty
• Department chairs have limited time and treat NTT review as lower priority than tenure-track review
• HR systems are often not configured to handle per-course adjunct employment relationships

Building a workable NTT calibration process

• Create a dedicated NTT track with a rubric covering teaching quality, availability, responsiveness, and curricular alignment — not research or service, which are outside their contracted scope
• Annual calibration for full-time NTT faculty; simplified per-contract review for adjuncts
• Document results even for short contracts — reappointment decisions made without calibration records create legal exposure
• Give NTT faculty access to calibration results and an opportunity to respond in writing — this is both fair practice and a risk management measure

Accreditation Compliance and Performance Documentation

Regional and specialized accreditors require evidence that your institution systematically evaluates faculty performance and uses the results to inform improvement. Performance calibration records directly satisfy these requirements — but only if they are structured to match what accreditors actually ask for.

What most accreditors require

• Documented, systematic evaluation processes for all faculty (not just tenure-track)
• Evidence that evaluation results are shared with faculty and used for professional development
• Faculty qualifications documentation (often tied to credentialing reviews, which should align with calibration)
• Continuous improvement mechanisms — evidence that patterns in faculty evaluation data inform institutional action

Accreditor-specific considerations

• AACSB (business schools): Requires Scholarly Academic (SA) vs. Practice Academic (PA) classifications tied to research productivity — calibration should document research activity that supports these classifications
• LCME (medical schools): Faculty evaluation must address clinical, research, and educational missions separately; calibration records are reviewed during accreditation visits
• CAEP (educator preparation programs): Requires evidence of continuous improvement in candidate performance — faculty calibration should document instructional quality in educator prep courses
• Regional accreditors (HLC, SACSCOC, WASC, NECHE, etc.): Standard 3 or its equivalent at most bodies requires evidence of systematic faculty evaluation — confirm your calibration process generates documentation in formats acceptable for self-study submission

Union and Shared Governance Considerations

Many academic institutions operate under collective bargaining agreements (CBAs) for faculty, staff, or both. Where CBAs exist, performance calibration processes must comply with negotiated evaluation procedures, grievance rights, and documentation requirements. Unilaterally changing evaluation processes without bargaining can constitute an unfair labor practice.

Key considerations for unionized academic environments

• Review your CBA before designing any new calibration process — evaluation procedures are typically a mandatory subject of bargaining
• If your CBA specifies evaluation forms, timelines, or rating scales, those are the floor — you cannot go below them without reopening negotiations
• Peer review provisions in CBAs often specify who may serve as evaluators — honor these requirements in your calibration session design
• Grievance procedures mean that calibration decisions may be subject to third-party review — document the rationale for every rating that deviates from expectations

Shared governance expectations extend beyond formal CBAs. Even at non-unionized institutions, faculty senates and academic governance bodies often have advisory roles in designing faculty evaluation systems. Bypassing these processes creates resistance and, in some cases, legal challenges. Involve faculty governance early in calibration design — it produces better processes and avoids downstream conflict.

Higher Ed Calibration Pre-Session Checklist

• Faculty tracks separated: tenure-track, tenured, NTT/instructional, and administrative staff in distinct calibration sessions
• Rubrics confirmed as track-appropriate — research and service expectations not applied to instructional-only contracts
• Student evaluation data normalized by course type, level, and class size before calibration
• Peer teaching observations collected and available as input alongside SET scores
• Pre-tenure faculty year confirmed — Year 3 interim review documentation prepared if applicable
• CBA compliance verified — evaluation timeline, forms, and process conform to negotiated terms
• Accreditation documentation requirements confirmed with accreditation liaison
• All calibration records stored in a format accessible for accreditation self-study submission
• Faculty notified of calibration outcomes and given written response opportunity