Rater Reliability Training

 

MCL 380.1249(5) is a new requirement for each individual who conducts an evaluation of one or more teachers to complete rater reliability training by not later than September 1, 2024, and every 3 years thereafter.  

Developing reliable evaluators of teachers is a key component to the success of any school district’s teacher evaluation system. Teachers and students benefit from principals and evaluators who are trained and certified to observe, analyze and rate instruction, before they ever step into a classroom to observe a teacher for the purpose of evaluation. 

Districts must collectively bargain the type of rater reliability training required locally, and whether or not certification is expected.  As the authorized provider of the University of Washington's Center for Educational Leadership 5D+ Rater Reliability training, MASSP provides two options to comply with MCL 380.1249(5):

  • Certification Option: 5D+ Rater Reliability Certification Training 
    • 3-day Initial RR Certification Training
    • 2-day Recertification Training 
  • Non-Certification Option: Calibration Tune-ups 
    • 1-day Non-Certification Training

5D+ Rater Reliability Certification (18 SCECHs)
5D+ Rater Reliability training provides opportunities for principals and district staff to become certified as reliable evaluators using the 5D+ Teacher Evaluation Rubric. These sessions engage leaders in discussions of best practices in evaluation and calibration, and are a significant opportunity to practice scripting, coding and rating classroom videos. Through discussion with their colleagues, evaluators become increasingly aligned in their calibration to the rubric. *Prerequisite: All six days of 5D+ Framework training and implementation.

  • Day 1: 5 Dimensions of Teaching and Learning; 5D+ Teacher Evaluation Rubric examples, Rater reliability protocol; Scripting and coding practices; Identifying evidence connected to 5D dimensions and 5D+ indicators using video observations. Match scripted evidence to 5D+ indicators with 35% accuracy.
  • Day 2: Continue to develop and redefine effective scripting and coding practices; Continue identifying evidence connected to 5D dimensions and 5D+ indicators using video observations. Match scripted evidence to 5D+ indicators with 55% accuracy.
  • Day 3: Continue to develop and redefine effective scripting and coding practices; Continue identifying evidence connected to 5D dimensions and 5D+ indicators using video observations. Match scripted evidence to 5D+ indicators with 70% accuracy.

Cost: 3 Full Days: $9,000/in-district, 3 Regional/Remote Days: $450/person

5D+ Rater Reliability Recertification (12 SCECHs)
5D+ Rater Reliability Recertification training provides opportunities for principals and district staff to re-certify as reliable evaluators using the 5D+ Teacher Evaluation Rubric. These sessions engage leaders in discussions of best practices in evaluation and calibration, and are a significant opportunity to practice scripting, coding and rating classroom videos. Through discussion with their colleagues, evaluators become increasingly aligned in their calibration to the rubric. *Prerequisite: 5D+ Rater Reliability Certification training and implementation.

  • Day 1: 5D and 5D+ Rubric Revisited; Rater reliability research, challenges and protocol. Scripting and coding practices; Identifying evidence connected to 5D+ indicators using video observations. Match scripted evidence to 5D+ indicators with >55% accuracy.
  • Day 2: Continue to develop and redefine effective scripting and coding practices; Continue identifying evidence connected to 5D dimensions and 5D+ indicators using video observations. Match scripted evidence to 5D+ indicators with >70% accuracy.

Cost: 2 Full Days: $6,000/in-district, 2 Regional/Remote Days: $300/person

Calibration Tune-Up (6 SCECHs)
Calibration Tune-ups provides opportunities for principals and district staff to observe instruction, rate evidence, and engage in calibration of ratings to deepen content clarity and increase internal reliability in scoring evidence using the 5D+ Rubric. Through discussion with their colleagues, evaluators become increasingly aligned in their calibration to the rubric.

Cost: 1 Full Day: $3000/ in-district, 1 Remote/Regional Day: $200/person


Check out all of our upcoming Framework, Rater Reliability and Calibration Tune Up Trainings!

Training Dates

Visit our Events Page to register an individual!

Individual Registration

Have a group you would like to receive training? Sign them up below!

Group Registration