(51) Evaluating Students’ Experience of a Technology Designed to Support Conceptual Understanding of Sepsis Management

Objective : To evaluate perceived benefits and limitations of a new pharmacotherapy concept-mapping technology (PCMT) designed to support pharmacy students' understanding of sepsis management as a foundation for solving clinical problems.

Methods: This study was conducted at a single institution in a core course (Pharmacotherapy III) for 3rd-year doctor of pharmacy students. A mixed methods descriptive research design was utilized. Two previously validated 5-point Likert scales—the Systems Usability Scale (SUS) and the Web-based Learning Tools Scale (WBLTS)—and an open-ended questionnaire were included in a survey to evaluate perceptions of the benefits and limitations of the PCMT from multiple viewpoints, including usability, design, engagement, and overall learning experience. Quantitative data were analyzed via descriptive statistics. SUS ratings were converted to an overall score ranging from 0-100. Qualitative data were analyzed using a two-cycle inductive coding process to identify themes.

Results: 49 of the 137 students enrolled in the course completed the voluntary survey (response rate of 35.77%). WBLTS mean scores were above the midpoint for all subscales: learning (3.34±1.19), design (3.38±1.08), and engagement (3.45±1.28). Additionally, the SUS score was 57.65 out of 100, indicating room for improvement based on a well-established benchmark of 68. Finally, qualitative analysis revealed 3 themes related to students’ overall learning experience. Theme 1: The PCMT Supports Cognitive Elaboration; Theme 2: The PCMT Makes the Overall Structure of Sepsis Management More Coherent; Theme 3: The Complexity of the PCMT may result in Cognitive Overload.

Conclusions: The PCMT benefitted students by supporting their efforts to understand sepsis management. Identification of limitations in the current design provides direction for future research intended to improve and further validate the tool.