(333) Utility of a verbal case presentation exercise as a measure of skills competency

Objective :

Objective: The Advanced Geriatrics rotation, a required P4 APPE, uses a verbal case presentation as a final assessment. This work describes the utility of this exercise as a competency-based assessment. There are three aims: to describe structure and function of the exercise, to map its components to educational outcomes including ACPE Standards 2025 and AACP’s proposed Entrustable Professional Activities, and report outcome data from a 2 year period.

Methods:

Methods: Deidentified grades from all final verbal presentations, activity descriptions from facilitator instructions and, where available, completed deidentified grading rubrics were reviewed. Individual components of each rubric were mapped to an educational competency. Performance patterns were evaluated for presentation grades, overall rotation grades, and individual rubric components to assess average scores and identify competency areas associated with high or low performance.

Results:

Results: A total of 250 deidentified presentations were evaluated from two academic years, with an average grade of 88 (51-100). These were graded by 24 and 20 preceptors in years one and two, respectively. A passing score was achieved 94.8% of the time (13 failing scores). The average rotation grade was 91% (71-100). A subset of 117 rubrics were available for analysis. Rubric elements mapped to EPAs related to “determining a patient’s problems” and “creating a care plan”. Additional educational outcomes evaluated include ACPE 2025 2.1.a, 2.1.b, 2.1.c, and 2.1.e, as well as Appendix 1 content including pathophysiology, pharmacology, pharmacotherapy, patient assessment, clinical chemistry, and pharmacokinetics. Elements associated with highest and lowest performance were related to assessment of the current problem and monitoring parameters, respectively.

Conclusions:

Conclusions: The Final verbal presentation is an effective method for assessing competencies related to problem solving and care plan creation.