Monday, December 9, 2019

Assessment in Pediatric Fellowship Training: Feasibility of Entrustable Professional Activities as a Workplace-Based Assessment Tool

Eric Velazquez
University of Minnesota

 Background: Pediatric subspecialty fellowship training is a self-directed learning, time-based learning model. Assessment of competency provides information for improvement yet incorporation into the workplace is limited. The Pediatric Subspecialty Entrustable Professional Activities (PS-EPAs) as an assessment tool, given their specificity to job-related tasks, may make them feasible for use in fellowship assessment.

Objective: A pilot study to determine feasibility of an online EPA-based assessment tool for real-time use and to compare uptake of EPA-based assessments across four different pediatric fellowship programs

Methods: 12 fellows from four different pediatric fellowship programs at the University of Minnesota used a Qualtrics-built, online, EPA-based assessment tool to actively request four assessments per month over a 10 month study period. Needs assessment surveys on feedback in fellowship training were collected at beginning and end of study. Results were analyzed for acceptance of use and selection rate of EPAs for assessments across departments.

Results: 72 total assessments (15% engagement) were completed by 10 fellows (83% participation) during study interval. EPA selection rate was variable across departments but use of the tool didn’t represent an undue burden of time on fellows or faculty. The tool could be used on any smartphone or computer, was low-cost, and required no training to use.

Conclusions: PS-EPA based assessments in different fellowship training programs are feasible. The PS-EPAs can be used in any pediatric fellowship program, but may be limited in applicability to clinic practice. EPA-assessments highlight disparity of domains of competency being assessed in training and barriers faced by faculty and fellows for feedback.