MENUCLOSE

 

Connect with us

Author: Brian S McGowan, PhD

ABSTRACT: A Global Model for Effective Use and Evaluation of e-Learning in Health

Abstract
Abstract Healthcare systems worldwide face a wide range of challenges, including demographic change, rising drug and medical technology costs, and persistent and widening health inequalities both within and between countries. Simultaneously, issues such as professional silos, static medical curricula, and perceptions of “information overload” have made it difficult for medical training and continued professional development (CPD) to adapt to the changing needs of healthcare professionals in increasingly patient-centered, collaborative, and/or remote delivery contexts. In response to these challenges, increasing numbers of medical education and CPD programs have adopted e-learning approaches, which have been shown to provide flexible, low-cost, user-centered, and easily updated learning. The effectiveness of e-learning varies from context to context, however, and has also been shown to make considerable demands on users’ motivation and “digital literacy” and on providing institutions. Consequently, there is a need to evaluate the effectiveness of e-learning in healthcare as part of ongoing quality improvement efforts. This article outlines the key issues for developing successful models for analyzing e-health learning.

via A Global Model for Effective Use and Eval… [Telemed J E Health. 2013] – PubMed – NCBI.

ABSTRACT: Recertification: What do specialists think about skill assessment?

Abstract
BACKGROUND:
Continuing medical education and objective performance assessment remain the key components of recertification. Objective skills assessment in routine practice remains challenging due to extensive variations in case selection and treatments. This study explores expert opinions regarding objective skills assessment for specialists within the framework of recertification.
METHODS:
We used a qualitative, semi-structured interview-based approach to obtain information and suggestions about key issues and recommendations relating to specialists’ skills assessment. Twenty-two face-to-face interviews were conducted. Interviews were transcribed and analysed by two reviewers.
RESULTS:
The information from the interviews was categorized under the headings of: (1) the components of specialist-level skills, (2) the methods for assessing specialist skills, (3) the types of tools and procedures used during observational assessment, (4) the unsuccessful specialists, and (5) the selection and training of assessors for specialist assessment.
CONCLUSIONS:
Outcome-based assessment of performance followed by observation of practice, were recommended as effective modes of evaluation of performance.

via Recertification: What do specialists think about ski… [Surgeon. 2013] – PubMed – NCBI.

ABSTRACT: A picture tells 1000 words: learning teamwork in primary care.

Abstract
Background:  Teamwork and patient centredness are frequently articulated concepts in medical education, but are not always explicit in the curriculum. In Ireland, recent government policy emphasises the importance of a primary care team approach to health care. We report on an appraisal of a newly introduced community-based student attachment, which focused on teamwork. Aim:  To review students’ experience of teamwork following a community clinical placement by examining student assignments: essays, poetry, music and art. Methods:  Year-2 graduate-entry students (n = 45) spent 2 weeks with a primary care team. Attachments comprised placements with members of the primary care team, emphasising team dynamics, at the end of which students submitted a representative piece of work, which captured their learning. Essays (n = 22) were analysed using a thematic content analysis. Artwork consisted of painting, collage, photography, poetry and original music (n = 23). These were analysed using Gardner’s entry points. Results:  Three core themes emerged in both written and visual work: patient centredness; communication; and an improved appreciation of the skills of other health care professionals. Students identified optimal team communication occurring when patient outcomes were prioritised. Metaphors relating to puzzles, hands and inter-connectedness feature strongly. The poems and artwork had a high impact when they were presented to tutors. Conclusion:  Primary care team placements focus student attention on teamwork and patient centredness. Student artwork shows potential as a tool to evaluate student learning in medical education.

via A picture tells 1000 words: learning teamwork in … [Clin Teach. 2013] – PubMed – NCBI.

ABSTRACT: Applying the cognitive theory of multimedia learning: an analysis of medical animations.

Abstract
Context  Instructional animations play a prominent role in medical education, but the degree to which these teaching tools follow empirically established learning principles, such as those outlined in the cognitive theory of multimedia learning (CTML), is unknown. These principles provide guidelines for designing animations in a way that promotes optimal cognitive processing and facilitates learning, but the application of these learning principles in current animations has not yet been investigated. A large-scale review of existing educational tools in the context of this theoretical framework is necessary to examine if and how instructional medical animations adhere to these principles and where improvements can be made. Methods  We conducted a comprehensive review of instructional animations in the health sciences domain and examined whether these animations met the three main goals of CTML: managing essential processing; minimising extraneous processing, and facilitating generative processing. We also identified areas for pedagogical improvement. Through Google keyword searches, we identified 4455 medical animations for review. After the application of exclusion criteria, 860 animations from 20 developers were retained. We randomly sampled and reviewed 50% of the identified animations. Results  Many animations did not follow the recommended multimedia learning principles, particularly those that support the management of essential processing. We also noted an excess of extraneous visual and auditory elements and few opportunities for learner interactivity. Conclusions  Many unrealised opportunities exist for improving the efficacy of animations as learning tools in medical education; instructors can look to effective examples to select or design animations that incorporate the established principles of CTML.

via Applying the cognitive theory of multimedia learnin… [Med Educ. 2013] – PubMed – NCBI.

ABSTRACT: Applying multimedia design principles enhances learning in medical education

Abstract
CONTEXT:
The Association of American Medical Colleges’ Institute for Improving Medical Education’s report entitled ‘Effective Use of Educational Technology’ called on researchers to study the effectiveness of multimedia design principles. These principles were empirically shown to result in superior learning when used with college students in laboratory studies, but have not been studied with undergraduate medical students as participants.
METHODS:
A pre-test/post-test control group design was used, in which the traditional-learning group received a lecture on shock using traditionally designed slides and the modified-design group received the same lecture using slides modified in accord with Mayer’s principles of multimedia design. Participants included Year 3 medical students at a private, midwestern medical school progressing through their surgery clerkship during the academic year 2009-2010. The medical school divides students into four groups; each group attends the surgery clerkship during one of the four quarters of the academic year. Students in the second and third quarters served as the modified-design group (n=91) and students in the fourth-quarter clerkship served as the traditional-design group (n=39).
RESULTS:
Both student cohorts had similar levels of pre-lecture knowledge. Both groups showed significant improvements in retention (p<0.0001), transfer (p<0.05) and total scores (p<0.0001) between the pre- and post-tests. Repeated-measures anova analysis showed statistically significant greater improvements in retention (F=10.2, p=0.0016) and total scores (F=7.13, p=0.0081) for those students instructed using principles of multimedia design compared with those instructed using the traditional design.
CONCLUSIONS:
Multimedia design principles are easy to implement and result in improved short-term retention among medical students, but empirical research is still needed to determine how these principles affect transfer of learning. Further research on applying the principles of multimedia design to medical education is needed to verify the impact it has on the long-term learning of medical students, as well as its impact on other forms of multimedia instructional programmes used in the education of medical students.

via Applying multimedia design principles enhances lear… [Med Educ. 2011] – PubMed – NCBI.

ABSTRACT: Novel educational approach for medical students: improved retention rates using interactive medical software compared with traditional lecture-based format.

Abstract
BACKGROUND:
Mannequin and computer-based simulators are useful for the practice of patient management, physical procedures, and competency. However, they are ineffective in teaching clinical medicine. StepStone Interactive Medical Software (SS) is a web-based medical learning modality that provides the user with a highly focused set of evaluative and interventional tasks to treat memorable virtual patients in a visual case-based format.
OBJECTIVE:
To determine whether the SS learning modality is superior to traditional lecture format in medical student learning and retention.
METHODS:
After Institutional Review Board (IRB) approval was obtained and the consents were signed, 30 third-year medical students were assigned randomly to 2 groups of 15 students each: The control group received two 30-minute PowerPoint lectures (Microsoft Corporation, Redmond, Washington) about torsades de pointes (TdP) and pulseless electrical activity (PEA), and the SS group was given 1 hour to review 2 SS cases teaching TdP and PEA. A preintervention test was given to assess their baseline knowledge. An immediate postintervention test was given to both groups. Twenty-two days later, a long-term retention test was administered. The results were analyzed using a Student t test for continuous variables.
RESULTS:
The mean scores for the preintervention test in the control and SS groups were 44.9 ± 3% and 44.1 ± 2%, respectively (p = 0.41). The mean scores for the postintervention test in the control and SS groups were 61.7 ± 2% and 86.7 ± 2%, respectively (p < 0.001). Improvement from baseline knowledge was calculated, and the mean improvement was 16.8 ± 3% in the control group and 42.5 ± 2% in the SS group (p < 0.001). The long-term retention test revealed the mean scores of 55.8 ± 3% in the control group and 70.1 ± 3% in the SS group (p < 0.001). Long-term improvement from baseline knowledge was calculated and the control group improved by 10.9 ± 4%, whereas the SS group improved by 26 ± 3% (p = 0.002).
CONCLUSIONS:
The SS learning modality demonstrated a significant improvement in student learning retention compared to traditional didactic lecture format. SS is an effective web-based medical education tool.

via Novel educational approach for medical students:… [J Surg Educ. 2012] – PubMed – NCBI.

ABSTRACT: Teaching for understanding in medical classrooms using multimedia design principles.

Abstract
Objectives  In line with a recent report entitled Effective Use of Educational Technology in Medical Education from the Association of American Medical Colleges Institute for Improving Medical Education (AAMC-IME), this study examined whether revising a medical lecture based on evidence-based principles of multimedia design would lead to improved long-term transfer and retention in Year 3 medical students. A previous study yielded positive effects on an immediate retention test, but did not investigate long-term effects. Methods  In a pre-test/post-test control design, a cohort of 37 Year 3 medical students at a private, midwestern medical school received a bullet point-based PowerPoint™ lecture on shock developed by the instructor as part of their core curriculum (the traditional condition group). Another cohort of 43 similar medical students received a lecture covering identical content using slides redesigned according to Mayer’s evidence-based principles of multimedia design (the modified condition group). Results  Findings showed that the modified condition group significantly outscored the traditional condition group on delayed tests of transfer given 1 week (d = 0.83) and 4 weeks (d = 1.17) after instruction, and on delayed tests of retention given 1 week (d = 0.83) and 4 weeks (d = 0.79) after instruction. The modified condition group also significantly outperformed the traditional condition group on immediate tests of retention (d = 1.49) and transfer (d = 0.76). Conclusions  This study provides the first evidence that applying multimedia design principles to an actual medical lecture has significant effects on measures of learner understanding (i.e. long-term transfer and long-term retention). This work reinforces the need to apply the science of learning and instruction in medical education.

via Teaching for understanding in medical classrooms us… [Med Educ. 2013] – PubMed – NCBI.

ABSTRACT: Improving participant feedback to continuing medical education presenters in internal medicine: a mixed-methods study.

Abstract
BACKGROUND:
Feedback is essential for improving the skills of continuing medical education (CME) presenters. However, there has been little research on improving the quality of feedback to CME presenters.
OBJECTIVES:
To validate an instrument for generating balanced and behavior-specific feedback from a national cross-section of participants to presenters at a large internal medicine CME course.
DESIGN, SETTING, AND PARTICIPANTS:
A prospective, randomized validation study with qualitative data analysis that included all 317 participants at a Mayo Clinic internal medicine CME course in 2009.
MEASUREMENTS:
An 8-item (5-point Likert scales) CME faculty assessment enhanced study form (ESF) was designed based on literature and expert review. Course participants were randomized to a standard form, a generic study form (GSF), or the ESF. The dimensionality of instrument scores was determined using factor analysis to account for clustered data. Internal consistency and interrater reliabilities were calculated. Associations between overall feedback scores and presenter and presentation variables were identified using generalized estimating equations to account for multiple observations within talk and speaker combinations. Two raters reached consensus on qualitative themes and independently analyzed narrative entries for evidence of balanced and behavior-specific comments.
RESULTS:
Factor analysis of 5,241 evaluations revealed a uni-dimensional model for measuring CME presenter feedback. Overall internal consistency (Cronbach alpha = 0.94) and internal consistency reliability (ICC range 0.88-0.95) were excellent. Feedback scores were associated with presenters’ academic ranks (mean score): Instructor (4.12), Assistant Professor (4.38), Associate Professor (4.56), Professor (4.70) (p = 0.046). Qualitative analysis revealed that the ESF generated the highest numbers of balanced comments (GSF = 11, ESF = 26; p = 0.01) and behavior-specific comments (GSF = 64, ESF = 104; p = 0.001).
CONCLUSIONS:
We describe a practical and validated method for generating balanced and behavior-specific feedback for CME presenters in internal medicine. Our simple method for prompting course participants to give balanced and behavior-specific comments may ultimately provide CME presenters with feedback for improving their presentations.

via Improving participant feedback to continuin… [J Gen Intern Med. 2012] – PubMed – NCBI.

ABSTRACT: Measuring Faculty Reflection on Medical Grand Rounds at Mayo Clinic: Associations With Teaching Experience, Clinical Exposure, and Presenter Effectiveness.

Abstract
OBJECTIVES:
To develop and validate a new instrument for measuring participant reflection on continuing medical education (CME) and determine associations between the reflection instrument scores and CME presenter, participant, and presentation characteristics.
PARTICIPANTS AND METHODS:
This was a prospective validation study of presenters and faculty at the weekly medical grand rounds at Mayo Clinic in Rochester, Minnesota, from January 1, 2011, through June 30, 2011. Eight items (5-point Likert scales) were developed on the basis of 4 reflection levels: habitual action, understanding, reflection, and critical reflection. Factor analysis was performed to account for clustered data. Interrater and internal consistency reliabilities were calculated. Associations between reflection scores and characteristics of presenters, participants, and presentations were determined.
RESULTS:
Participants completed a total of 1134 reflection forms. Factor analysis revealed a 2-dimensional model (eigenvalue; Cronbach α): minimal reflection (1.19; 0.77) and high reflection (2.51; 0.81). Item mean (SD) scores ranged from 2.97 (1.17) to 4.01 (0.83) on a 5-point scale. Interrater reliability (intraclass correlation coefficient) for individual items ranged from 0.58 (95% CI, 0.31-0.78) to 0.88 (95% CI, 0.80-0.94). Reflection scores were associated with presenters’ speaking effectiveness (P<.001) and prior CME teaching experience (P=.02), participants’ prior clinical experiences (P<.001), and presentations that were case based (P<.001) and used the audience response system (P<.001).
CONCLUSION:
We report the first validated measure of reflection on CME at medical grand rounds. Reflection scores were associated with presenters’ effectiveness and prior teaching experience, participants’ clinical exposures, and presentations that were interactive and clinically relevant. Future research should determine whether reflection on CME leads to better patient outcomes.

via Measuring Faculty Reflection on Medical Grand… [Mayo Clin Proc. 2013] – PubMed – NCBI.