Impact of Rater Training on Pediatric Simulation Assessment of Medical Students

Abstract

The role of simulation in high-stakes assessments continues to demonstrate increased demand for assessing behavioral outcomes and adoption of competency-based assessment.1 However, without rigorous processes for rater training, high-stakes assessments of student performance in simulation may be open to bias, inconsistency, and lack of fairness.2 Our pediatric simulation session was developed in 2017 to evaluate for medical student entrustability of Entrustable Professional Activity (EPA) #10 - Recognize a patient needing urgent or emergent care and initiate evaluation and management. Incorporation of rater training is essential to ensure better accuracy and reliability of student assessment by our simulation session if it is eventually utilized as a high-stakes assessment by the medical school.