MENUCLOSE

 

Connect with us

Author: Brian S McGowan, PhD

ABSTRACT: Lecture Evaluations by Medical Students: Concepts That Correlate With Scores

PURPOSE:
The didactic lecture remains one of the most popular teaching formats in medical education; yet, factors that most influence lecturing success in radiology education are unknown. The purpose of this study is to identify patterns of narrative student feedback that are associated with relatively higher and lower evaluation scores.
METHODS:
All student evaluations from our core radiology elective during 1 year were compiled. All evaluation comments were tagged, to identify discrete descriptive concepts. Correlation coefficients were calculated, for each tag with mean evaluation scores. Tags that were the most strongly associated with the highest- versus lowest-rated (> or < 1 SD) lectures were identified.
RESULTS:
A total of 3,262 comments, on 273 lectures, rated by 77 senior medical students, were analyzed. The mean lecture score was 8.96 ± 0.62. Three tags were significantly positively correlated with lecture score: “interactive”; “fun/engaging”; and “practical/important content” (r = 0.39, r = 0.34, and r = 0.32, respectively; all P < .001). More tags (n = 12) were significantly negatively correlated with score; the three tags with the strongest such correlation were: “not interactive”; “poorly structured or unevenly paced”; and “content too detailed or abundant” (r = -0.44, r = -0.39, and r = -0.36, respectively; all P < .001). Analysis of only the highest- and lowest-rated lectures yielded similar results.
CONCLUSIONS:
Several factors were identified that were strongly associated with lecture score. Among the actionable characteristics, interactive lectures with appropriately targeted content (ie, practical/useful) were the most highly rated.

via Lecture Evaluations by Medical Students: Concepts That Correlate With Scores. – PubMed – NCBI.

ABSTRACT: A Narrative Review and Novel Framework for Application of Team-Based Learning

BACKGROUND :
Team-based learning (TBL) promotes problem solving and teamwork, and has been applied as an instructional method in undergraduate medical education with purported benefits. Although TBL curricula have been implemented for residents, no published systematic reviews or guidelines exist for the development and use of TBL in graduate medical education (GME).
OBJECTIVE :
To review TBL curricula in GME, identify gaps in the literature, and synthesize a framework to guide the development of TBL curricula at the GME level.
METHODS :
We searched PubMed, MEDLINE, and ERIC databases from 1990 to 2014 for relevant articles. References were reviewed to identify additional studies. The inclusion criteria were peer-reviewed publications in English that described TBL curriculum implementation in GME. Data were systematically abstracted and reviewed for consensus. Based on included publications, a 4-element framework-system, residents, significance, and scaffolding-was developed to serve as a step-wise guide to planning a TBL curriculum in GME.
RESULTS :
Nine publications describing 7 unique TBL curricula in residency met inclusion criteria. Outcomes included feasibility, satisfaction, clinical behavior, teamwork, and knowledge application.
CONCLUSIONS :
TBL appears feasible in the GME environment, with learner reactions ranging from positive to neutral. Gaps in the literature occur within each of the 4 elements of the suggested framework, including: system, faculty preparation time and minimum length of effective TBL sessions; residents, impact of team heterogeneity and inconsistent attendance; significance, comparison to other instructional methods and outcomes measuring knowledge retention, knowledge application, and skill development; and scaffolding, factors that influence the completion of preparatory work.

via A Narrative Review and Novel Framework for Application of Team-Based Learning in Graduate Medical Education. – PubMed – NCBI.

ABSTRACT: Can Item Keyword Feedback Help Remediate Knowledge Gaps?

BACKGROUND :
In graduate medical education, assessment results can effectively guide professional development when both assessment and feedback support a formative model. When individuals cannot directly access the test questions and responses, a way of using assessment results formatively is to provide item keyword feedback.
OBJECTIVE :
The purpose of the following study was to investigate whether exposure to item keyword feedback aids in learner remediation.
METHODS :
Participants included 319 trainees who completed a medical subspecialty in-training examination (ITE) in 2012 as first-year fellows, and then 1 year later in 2013 as second-year fellows. Performance on 2013 ITE items in which keywords were, or were not, exposed as part of the 2012 ITE score feedback was compared across groups based on the amount of time studying (preparation). For the same items common to both 2012 and 2013 ITEs, response patterns were analyzed to investigate changes in answer selection.
RESULTS :
Test takers who indicated greater amounts of preparation on the 2013 ITE did not perform better on the items in which keywords were exposed compared to those who were not exposed. The response pattern analysis substantiated overall growth in performance from the 2012 ITE. For items with incorrect responses on both attempts, examinees selected the same option 58% of the time.
CONCLUSIONS :
Results from the current study were unsuccessful in supporting the use of item keywords in aiding remediation. Unfortunately, the results did provide evidence of examinees retaining misinformation.

via Can Item Keyword Feedback Help Remediate Knowledge Gaps? – PubMed – NCBI.

ABSTRACT: Educating physicians in evidence based medicine: current practices and curricular strategies

INTRODUCTION:
Evidence-based medicine (EBM) is an expectation of professional healthcare and a requisite component of medical school curricula. However, upon graduation medical students’ EBM skills have been found lacking suggesting a need to examine EBM training.
METHODS:
This PhD report presents two studies on EBM education. The first study is a literature review that describes and attempts to assess educational interventions for teaching medical students EBM. The second study presents a multi-institutional case study conducted in North America using interviews and curricular materials to identify EBM instructors’ perceptions of challenges that may impede medical students’ efforts to learn EBM.
RESULTS:
The literature review analyzed 20 learning interventions from 12 countries that were presented in classrooms (75 %) and clinics (25 %). The steps of EBM were addressed to varying degrees. It was not possible to draw conclusions about the efficacy of the interventions due to lack of detailed reporting. The qualitative study identified four learning challenges: sub-optimal role models, student lack of willingness to admit uncertainty, lack of clinical context, and difficulty mastering EBM skills. To meet these challenges, participants described interventions such as integrating EBM skills with other content/courses, incorporating clinical content into EBM teaching, providing faculty development, using whole-task EBM activities, and longitudinal integration of EBM across the curriculum.
CONCLUSION:
This PhD report takes steps to describe and assess EBM learning interventions, presents student learning challenges and looks at approaches institutions take to meet them. Educators can use these findings to examine their curriculum and learning environments and, if desired, adopt them for their training.

via Educating physicians in evidence based medicine: current practices and curricular strategies. – PubMed – NCBI.

ABSTRACT: Creativity in Medical Education: The Value of Having Medical Students Make Stuff

What is the value of having medical students engage in creative production as part of their learning? Creating something new requires medical students to take risks and even to fail–something they tend to be neither accustomed to nor comfortable with doing. “Making stuff” can help students prepare for such failures in a controlled environment that doesn’t threaten their professional identities. Furthermore, doing so can facilitate students becoming resilient and creative problem-solvers who strive to find new ways to address vexing questions. Though creating something new can be fun, this is not the main outcome of interest. Rather, the principle reason we recommend devoting precious curricular time to creative endeavors is because it helps medical students become better doctors.

via Creativity in Medical Education: The Value of Having Medical Students Make Stuff. – PubMed – NCBI.

MANUSCRIPT: Online courses to create a foundation for sex and gender accountability in biomedical research and treatment

BACKGROUND:
Sex and gender differences play a significant role in the course and outcome of conditions that affect specific organ systems in the human body. Research on differences in the effects of medical intervention has helped scientists develop a number of sex- and gender-specific guidelines on the treatment and management of these conditions. An online series of courses, “The Science of Sex and Gender in Human Health,” developed by the National Institutes of Health Office of Research on Women’s Health and the U.S. Food and Drug Administration Office of Women’s Health, examines sex and gender differences and their implications. Thus far, three online courses have been generated. The first course offers an overview of the scientific and biological basis for sex- and gender-related differences. The second course is focused on disease-specific sex and gender differences in health and behavior and their implications. Finally, the third course covers the influence of sex and gender on disease manifestation, treatment, and outcome.
METHODS:
Data were obtained using website analytics and post-course surveys.
RESULTS:
To date, over 1000 individuals have completed at least one course. Additionally, 600 users have received continuing education credit for completing a course in the series. Finally, the majority of respondents to the online course survey have indicated that the courses considerably enhanced their professional effectiveness.
CONCLUSIONS:
“The Science of Sex and Gender in Human Health” online courses are freely available sources of information that provide healthcare providers and researchers with the resources to successfully account for sex and gender in their medical practice and research programs

via The science of sex and gender in human health: online courses to create a foundation for sex and gender accountability in biomedical research and t… – PubMed – NCBI.

ABSTRACT: Increasing medical students’ engagement in public health: case studies illustrating the potential role of online learning

BACKGROUND:
The value of e-learning in medical education is widely recognized but there is little evidence of its value in teaching medical students about public health. Such evidence is needed because medical students’ engagement with public health has been low. We present three recent case studies from UK medical schools to illustrate diverse ways in which online approaches can increase medical students’ engagement with learning public health.
METHODS:
A comparative case study approach was used applying quantitative and qualitative data to examine engagement in terms of uptake/use amongst eligible students, acceptability and perceived effectiveness using an analytic framework based on Seven Principles of Effective Teaching.
RESULTS:
Across the three case studies, most (67-85%) eligible students accessed online materials, and rated them more favourably than live lectures. Students particularly valued opportunities to use e-learning flexibly in terms of time and place. Online technologies offered new ways to consolidate learning of key public health concepts. Although students found contributing to online discussions challenging, it provided opportunities for students to explore concepts in depth and enabled students that were uncomfortable speaking in face-to-face discussions to participate.
CONCLUSIONS:
E-learning can be applied in diverse ways that increase medical student engagement with public health teaching.

via Increasing medical students’ engagement in public health: case studies illustrating the potential role of online learning. – PubMed – NCBI.

ABSTRACT: Use of Free, Open Access Medical Education and Perceived Emergency Medicine Educational Needs Among Rural Physicians

Free, open access medical education (FOAM) has the potential to revolutionize continuing medical education, particularly for rural physicians who practice emergency medicine (EM) as part of a generalist practice. However, there has been little study of rural physicians’ educational needs since the advent of FOAM. We asked how rural physicians in Southwestern Ontario obtained their continuing EM education. We asked them to assess their perceived level of comfort in different areas of EM. To understand how FOAM resources might serve the rural EM community, we compared their responses with urban emergency physicians. Responses were collected via survey and interview. There was no significant difference between groups in reported use of FOAM resources. However, there was a significant difference between rural and urban physicians’ perceived level of EM knowledge, with urban physicians reporting a higher degree of confidence for most knowledge categories, particularly those related to critical care and rare procedures. This study provides the first description of EM knowledge and FOAM resource utilization among rural physicians in Southwestern Ontario. It also highlights an area of educational need — that is, critical care and rare procedures. Future work should address whether rural physicians are using FOAM specifically to improve their critical care and procedural knowledge. As well, because of the generalist nature of rural practice, future work should clarify whether there is an opportunity cost to rural physicians’ knowledge of other clinical domains if they chose to focus more time on continuing education in critical care EM.

via Use of Free, Open Access Medical Education and Perceived Emergency Medicine Educational Needs Among Rural Physicians in Southwestern Ontario. – PubMed – NCBI.

ABSTRACT: Influence of the wording of evaluation items on outcome-based evaluation results for large-group teaching in anatomy, biochemistry and legal medicine

Student learning outcome is an important dimension of teaching quality in undergraduate medical education. Measuring an increase in knowledge during teaching requires repetitive objective testing which is usually not feasible. As an alternative, student learning outcome can be calculated from student self-ratings. Comparative self-assessment (CSA) gain reflects the performance difference before and after teaching, adjusted for initial knowledge. It has been shown to be a valid proxy measure of actual learning outcome derived from objective tests. However, student self-ratings are prone to a number of confounding factors. In the context of outcome-based evaluation, the wording of self-rating items is crucial to the validity of evaluation results. This randomized trial assessed whether including qualifiers in these statements impacts on student ratings and CSA gain. First-year medical students self-rated their initial (then-test) and final (post-test) knowledge for lectures in anatomy, biochemistry and legal medicine, respectively, and 659 questionnaires were retrieved. Six-point scales were used for self-ratings with 1 being the most positive option. Qualifier use did not affect then-test ratings but was associated with slightly less favorable post-test ratings. Consecutively, mean CSA gain was smaller for items containing qualifiers than for items lacking qualifiers (50.6±15.0% vs. 56.3±14.6%, p=0.079). The effect was more pronounced (Cohen’s d=0.82) for items related to anatomy. In order to increase fairness of outcome-based evaluation and increase the comparability of CSA gain data across subjects, medical educators should agree on a consistent approach (qualifiers for all items or no qualifiers at all) when drafting self-rating statements for outcome-based evaluation.

via Influence of the wording of evaluation items on outcome-based evaluation results for large-group teaching in anatomy, biochemistry and legal medicine. – PubMed – NCBI.

MANUSCRIPT: Substance Misuse Education for Physicians: Why Older People are Important

This perspective article focuses on the need for training and education for undergraduate medical students on substance-related disorders, and describes initiatives undertaken in the United Kingdom (UK), Netherlands, United States (US), and Norway to develop the skills, knowledge, and attitudes needed by future doctors to treat patients adequately. In addition, we stress that in postgraduate training, further steps should be taken to develop Addiction Medicine as a specialized and transverse medical domain. Alcohol use disorder is a growing public health problem in the geriatric population, and one that is likely to continue to increase as the baby boomer generation ages. Prescription drug misuse is a major concern, and nicotine misuse remains problematic in a substantial minority. Thus, Addiction Medicine training should address the problems for this specific population. In recent years, several countries have started an Addiction Medicine specialty. Although addiction psychiatry has been a subspecialty in the UK and US for more than 20 years, in most countries it has been a more recent development. Additional courses on addiction should be integrated into the curriculum at both undergraduate and postgraduate levels, as well as form part of the continuous training of other medical specialists. It is recommended that further research and mapping of what is currently taught in medical programs be undertaken, so as to enhance medical education in addiction and improve treatment services.

via Substance Misuse Education for Physicians: Why Older People are Important. – PubMed – NCBI.