MENUCLOSE

 

Connect with us

Author: Brian S McGowan, PhD

ABSTRACT: Advancing faculty development in medical education: a systematic review

PURPOSE:
To (1) provide a detailed account of the nature and scope of faculty development (FD) programs in medical education, (2) assess the quality of FD studies, and (3) identify in what areas and through what means future research can purposefully build on existing knowledge.
METHOD:
The authors searched MEDLINE, CINAHL, and ERIC for articles reporting evaluations of FD initiatives published between 1989 and 2010. They applied standard systematic review procedures for sifting abstracts, scrutinizing full texts, and abstracting data, including program characteristics, evaluation methods, and outcomes. They used a modified Kirkpatrick model to guide their data abstraction.
RESULTS:
The authors included 22 articles reporting on 21 studies in their review. The most common program characteristics included a series/longitudinal format, intended for individuals, and offered to physicians only. Although the most common aim was to improve teaching effectiveness, several programs had multiple aims, including scholarship and leadership. Program evaluation focused on quantitative approaches. A number of studies employed longitudinal designs and included some follow-up component. Surveys were the most popular data collection method, participants the most common data source, and self-reported behavior changes the most commonly reported outcome.
CONCLUSIONS:
Although the authors’ findings showed some recent expansion in the scope of the FD literature, they also highlighted areas that require further focus and growth. Future research should employ more rigorous evaluation methods, explore the role of interprofessional teams and communities of practice in the workplace, and address how different organizational and contextual factors shape the success of FD programs

via Advancing faculty development in medical education:… [Acad Med. 2013] – PubMed – NCBI.

ABSTRACT: The impact of lecture attendance and other variables on how medical students evaluate faculty in a preclinical program

PURPOSE:
High-quality audiovisual recording technology enables medical students to listen to didactic lectures without actually attending them. The authors wondered whether in-person attendance affects how students evaluate lecturers.
METHOD:
This is a retrospective review of faculty evaluations completed by first- and second-year medical students at the Ohio State University College of Medicine during 2009-2010. Lecture-capture technology was used to record all lectures. Attendance at lectures was optional; however, all students were required to complete lecturer evaluation forms. Students rated overall instruction using a five-option response scale. They also reported their attendance. The authors used analysis of variance to compare the lecturer ratings of attendees versus nonattendees. The authors included additional independent variables-year of student, student grade/rank in class, and lecturer degree-in the analysis.
RESULTS:
The authors analyzed 12,092 evaluations of 220 lecturers received from 358 students. The average number of evaluations per lecturer was 55. Seventy-four percent (n = 8,968 evaluations) of students attended the lectures they evaluated, whereas 26% (n = 3,124 evaluations) viewed them online. Mean lecturer ratings from attendees was 3.85 compared with 3.80 by nonattendees (P ≤ .05; effect size: 0.055). Student’s class grade and year, plus lecturer degree, also affected students’ evaluations of lecturers (effect sizes: 0.055-0.3).
CONCLUSIONS:
Students’ attendance at lectures, year, and class grade, as well as lecturer degree, affect students’ evaluation of lecturers. This finding has ramifications on how student evaluations should be collected, interpreted, and used in promotion and tenure decisions in this evolving medical education environment.

via The impact of lecture attendance and other variable… [Acad Med. 2013] – PubMed – NCBI.

ABSTRACT: Attitudes of primary care providers and recommendations of home blood pressure monitoring

To assess primary care providers’ (PCPs) opinions related to recommending home blood pressure monitoring (HBPM) for their hypertensive patients, the authors analyzed a Web-based 2010 DocStyles survey, which included PCPs’ demographics, health-related behaviors, recommendations on HBPM, views of patient knowledge, and use of continuing medical education. Of the 1254 PCPs who responded, 539 were family practitioners, 461 were internists, and 254 were nurse practitioners; 32% recommended HBPM to ≥90% of their patients and 26% recommended it to ≤40% of their patients. Nurse practitioners were significantly more likely to recommend HBPM than were internists (odds ratio, 0.55; 95% confidence interval, 0.40-0.78). The top reasons for not recommending HBPM were “patient can’t afford it” and “patient doesn’t need it.” A total of 20% of PCPs indicated that their patients were poor to lower middle class; these PCPs were less likely to recommend HBPM to their patients than were those PCPs with most patients in higher economic classes. Additional efforts are needed to provide education to providers, especially physicians, about the benefits of HBPM in improved and cost-effective blood pressure control in the United States.

via Attitudes of primary care provi… [J Clin Hypertens (Greenwich). 2013] – PubMed – NCBI.

MANUSCRIPT: Summative assessments are more powerful drivers of student learning than resource intensive teaching formats

BACKGROUND:
Electrocardiogram (ECG) interpretation is a core clinical skill that needs to be acquired during undergraduate medical education. Intensive teaching is generally assumed to produce more favorable learning outcomes, but recent research suggests that examinations are more powerful drivers of student learning than instructional format. This study assessed the differential contribution of teaching format and examination consequences to learning outcome regarding ECG interpretation skills in undergraduate medical students.
METHODS:
A total of 534 fourth-year medical students participated in a six-group (two sets of three), partially randomized trial. Students received three levels of teaching intensity: self-directed learning (two groups), lectures (two groups) or small-group peer teaching facilitated by more advanced students (two groups). One of the two groups on each level of teaching intensity was assessed in a formative, the other in a summative written ECG examination, which provided a maximum of 1% credit points of the total curriculum. The formative examination provided individual feedback without credit points. Main outcome was the correct identification of ≥3 out of 5 diagnoses in original ECG tracings. Secondary outcome measures were time spent on independent study and use of additional study material.
RESULTS:
Compared with formative assessments, summative assessments increased the odds of correctly identifying at least three out of five ECG diagnoses (OR 5.14; 95% CI 3.26 to 8.09), of spending at least 2 h/week extra on ECG self-study (OR 4.02; 95% CI 2.65 to 6.12) and of using additional learning material (OR 2.86; 95% CI 1.92 to 4.24). Lectures and peer teaching were associated with increased learning effort only, but did not augment examination performance.
CONCLUSIONS:
Medical educators need to be aware of the paramount role of summative assessments in promoting student learning. Consequently, examinations within medical schools need to be closely matched to the desired learning outcomes. Shifting resources from implementing innovative and costly teaching formats to designing more high-quality summative examinations warrants further investigation

via Summative assessments are more powerful drivers of s… [BMC Med. 2013] – PubMed – NCBI.

ABSTRACT: History of simulation in medicine: from resusci annie to the ann myers medical center

Medical and surgical graduate medical education has historically used a halstedian approach of “see one, do one, teach one.” Increased public demand for safety, quality, and accountability in the setting of regulated resident work hours and limited resources is driving the development of innovative educational tools. The use of simulation in nonmedical, medical, and neurosurgical disciplines is reviewed in this article. Simulation has been validated as an educational tool in nonmedical fields such as aviation and the military. Across most medical and surgical subspecialties, simulation is recognized as a valuable tool that will shape the next era of medical education, postgraduate training, and maintenance of certification

via History of simulation in medicine: from resusci… [Neurosurgery. 2013] – PubMed – NCBI.

ABSTRACT: Model-based simulation for early neurosurgical learners

BACKGROUND:
Restrictions on duty hours and shift length by the Accreditation Council for Graduate Medical Education and public pressure to reduce complications and to improve outcomes in the clinical educational environment have enhanced interest in the use of procedural and surgical simulation to train neurosurgical residents.
OBJECTIVE:
To introduce simple, available, and, when possible, inexpensive model-based simulation for early learners into the initial stages of neurosurgical residency training.
METHODS:
Simulation for early-stage trainees in neurological surgery has taken advantage of model-based systems. The Society of Neurological Surgeons postgraduate year 1 courses have served as one paradigm for designing and using model-based simulators for procedural and surgical skill training as part of a purpose-designed overall curriculum. Ongoing surveys of resident and faculty course participants have supported iterative improvements in simulator models and curriculum from year to year.
RESULTS:
Simulation for basic neurosurgical and intensive care procedures has been undertaken through the use of available materials, surgical technology, and modifications of related existing model simulators. Simulation of common, standard surgical procedures for early learners may be broken into individual surgical skills and maneuvers to prepare trainees for safe practice of these component skills during live procedures under direct supervision appropriate to their training stage.
CONCLUSION:
Model-based simulation is particularly effective for early surgical learners as part of a coordinated curriculum. Almost 600 residents have used model-based simulation during the first 3 years of the Society of Neurological Surgeons boot camp courses, with ongoing modification and improvement of individual simulation models

via Model-based simulation for early neurosurgical … [Neurosurgery. 2013] – PubMed – NCBI.

MANUSCRIPT: Challenges for medical educators: Results of a survey among members of the German association for medical education

Background: Despite the increasing interest in medical education in the German-speaking countries, there is currently no information available on the challenges which medical educators face. To address this problem, we carried out a web-based survey among the members of the Association for Medical Education (Gesellschaft für medizinische Ausbildung, GMA). Methods: A comprehensive survey was carried out on the need for further qualifications, expertise and the general conditions of medical educators in Germany. As part of this study, the educators were asked to list the three main challenges which they faced and which required urgent improvement. The results were analysed by means of qualitative content analysis. Results: The questionnaire was completed by 147 of the 373 members on the GMA mailing list (response rate: 39%). The educators named a total of 346 challenges and emphasised the following areas: limited academic recognition for engagement in teaching (53.5% of educators), insufficient institutional (31.5%) and financial support (28.4%), a curriculum in need of reform (22.8%), insufficient time for teaching assignments (18,9%), inadequate teacher competence in teaching methods (18.1%), restricted faculty development programmes (18.1%), limited networking within the institution (11.0%), lack of teaching staff (10.2%), varying preconditions of students (8.7%), insufficient recognition and promotion of medical educational research (5.5%), extensive assessment requirements (4.7%), and the lack of role models within medical education (3.2%). Conclusion: The medical educators found the biggest challenges which they faced to be limited academic recognition and insufficient institutional and financial support. Consequently, improvements should be implemented to address these issues

via Challenges for medical educators: Results … [GMS Z Med Ausbild. 2013] – PubMed – NCBI.

ABSTRACT: A Multifaceted Initiative to Improve Clinician Awareness of Pain Management Disparities

Patients belonging to some racial, ethnic, and socioeconomic groups are at risk of receiving suboptimal pain management. This study identifies health care provider attitudes, knowledge, and practices regarding the treatment of chronic pain in vulnerable patient populations and assesses whether a certified continuing medical education CME intervention can improve knowledge in this area. Survey responses revealed several knowledge gaps, including a lack of knowledge that the undertreatment of pain is more common in minority patients than others. Respondents identified language barriers, miscommunication, fear of medication diversion, and financial barriers as major obstacles to optimal pain management for this patient population. Participants who completed a CME-certified activity on pain management disparities demonstrated increased confidence in caring for disadvantaged patients, but only 1 of 3 knowledge items improved. Understanding clinician factors that underlie suboptimal pain management is necessary to develop effective strategies to overcome disparities and improve quality of care for patients with chronic pain.

via A Multifaceted Initiative to Improve Clinician… [Am J Med Qual. 2013] – PubMed – NCBI.

ABSTRACT: E-Health innovations, collaboration, and healthcare disparities: Developing criteria for culturally competent evaluation.

E-Health alters how health care clinicians, institutions, patients, caregivers, families, advocates, and researchers collaborate. Few guidelines exist to evaluate the impact of social technologies on furthering family health and even less on their capacity to ameliorate health disparities. Health social media tools that help develop, sustain, and strengthen the collaborative health agenda may prove useful to ameliorate health care inequities; the linkage should not, however, be taken for granted. In this article we propose a classification of emerging social technologies in health care with the purpose of developing evaluative criteria that assess their ability to foster collaboration and positively impact health care equity. The findings are based on systematic Internet ethnographic observations, a qualitative analysis of e-health tool exemplars, and a review of the literature. To triangulate data collection and analysis, the research team consulted with social media health care experts in making recommendations for evaluation criteria. Selected cases illustrate the analytical conclusions. Lines of research that are needed to accurately rate and reliably measure the ability of social media e-health offerings to address health disparities are proposed.

via E-Health innovations, collaboration, and hea… [Fam Syst Health. 2013] – PubMed – NCBI.

Innovation rarely happens from within…

I was thrilled to recently hear from colleague and friend Neil Mehta, MBBS, MS from Cleveland Clinic Lerner College of Medicine that he was about to publish a “Perspective” piece in the journal Academic Medicine.

I have known Neil for some time and have had the pleasure of collaborating with him as a faculty member and as a learner (we engage quite frequently through Twitter chats: @Neil_Mehta), so it came as no surprise to me that he sees the world in much the same way I do. Neil was kind enough to send me his article – the abstract can be found here – for review.

Before I offer my comments on his work, first let me share the key elements of his perspective:

To advance solutions, the authors review innovations that are disrupting higher education and describe a vision for using these to create a new model for competency-based, learner-centered medical education that can better meet the needs of the health care system while adhering to the spirit of the above proposals. These innovations include:

  1. collaboration amongst medical schools to develop massive open online courses for didactic content;
  2. faculty working in small groups to leverage this online content in a “flipped-classroom” model; and
  3. digital badges for credentialing entrustable professional activities over the continuum of learning.

In many ways the ideas that Neil presents are perfectly aligned with those I describe in #socialQI: Simple Solutions for Improving Your Healthcare (see Chapter 9) and those I have written about in my Medical Meetings article from 2011, “Re-engineering the Data Stream from Meetings to Medical Practices” – though Neil does provide a bit more detail.

Neil begins by articulating the problem, and he pulls no punches:

A stark inventory of the shortcomings of the current model of medical education includes inefficiency, inflexibility, and lack of learner-centeredness. Current teaching models often depend on arcane assessment methods (e.g., multiplechoice examinations), and learning often focuses on test performance rather than developing professional competencies. Students’ grades in basic science courses and on clinical rotations, though a key factor in their selection for residency training, may not be based on direct observation or assessment of knowledge application and problem-solving ability. Thus, these grades likely do not reflect true skills, behaviors, and attributes needed to be an effective physician…basic science faculty face increasing pressure to obtain research funding in a highly competitive environment with declining funding resources. Productivity pressures limit clinical faculty members’ teaching time. Providing small-group instruction in either area is challenged by financial constraints on faculty growth.

And, Neil introduces this community to any number of models to learn from and adopt.

…the Khan Academy started in 2006 as a series of short YouTube videos created by an individual with a laptop and an Internet connection. Since then, the Khan Academy has grown into a series of over 3,300 video lessons that cover K–12 topics. Over 180 million lessons have been delivered to date. The site offers practice tests for skill building and resources for teachers to monitor their students’ progress and intervene if students get stuck.

 

…the concept of massive open online courses (MOOCs) was popularized by a group of learning researchers when a course on “Connectivism and Connected Knowledge” in 2008 attracted over 2,300 worldwide participants. The model of this MOOC was based on learners generating content by working collaboratively in social networks.

 

…previous generations of learning management systems faltered because they focused more on tracking and managing instruction and content, these new systems are student-centered …They aim to promote active, retrieval-based learning; customized feedback based on analysis of vast amounts of data created by students’ performance; real-time collaboration; and peer learning while also creating an experience mimicking one-on-one tutoring.

 

Badges encode metadata containing information such as the badge recipient’s name, the institution (or individual) awarding the badge, information about the endorser (i.e., the organization that certifies or approves the badge or the badge provider), information about what the recipient had to do to get the badge, and evidence that the recipient met the criteria to earn the badge. Thus, digital badges can provide concrete evidence of skills, achievements, and qualities in a more granular manner than traditional grades and degrees.

How can these movements help solve the resource problems facing medical education today? We could develop a central online collaborative learning environment for didactics, peer learning, and assessment of knowledge, instead of multiple medical schools teaching the same content at multiple sites. We could ensure multidisciplinary collaboration by building communities of learning. The vast numbers of students in these MOOCs would ensure that they would always have other students online at the same time helping to build a virtual, and most likely multidisciplinary, collaborative environment…Such a virtual  learning environment would help build an interprofessional community of practice that could lead to improved communication and collaboration in a team-based practice model of the future.

And perhaps the solution I like the most:

Students would be provided a list of knowledge, skills, attitudes, and behaviors that are required to demonstrate knowledge and mastery of skills at different levels through medical school and for graduation. Students could choose their badge providers and schedule their advancement through the curriculum guided by the parameters set by the medical school and ultimately by the accreditation bodies. Students could create custom paths for progressing through and augmenting their training…In this process, badges can be used to capture learning across the continuum of medical education and potentially enable tracking for the purpose of maintenance of licensure….No longer will a limited number of medical schools or faculty constrain our ability to educate medical students. Learning communities will form naturally, and students will need to take ownership of their education.

To be clear, having spent years arguing the strengths and weaknesses of Khan Academy or ‘flipped’ classroom or MOOCs…I believe wholeheartedly that the current renditions for these models will NOT be the silver bullet we need in medical education – they are, more often than not, pedagologically unsound and, in ways, short-sighted in their innovation. But the innovations are fundamentally better than what we have today…and this is the point that Neil makes. Neil glances out at the what is happening in other realms of education and seems to see the opportunity that far too few see, flaws and all.

What is most impressive is that this vision of what may be comes from inside the house of medicine, and rarely do the problem and the solution arise from the same source. While Neil may not be your average clinician, and he is certainly not your average educator, he is by all accounts an ‘insider’ and a ‘champion of innovation.’ With this in mind, as I read his work I was left with one slightly derivative but all-too-critical question: ‘how do we ensure that more clinician educators think the way Neil thinks?’ Because it is unlikely that we will ever overcome the challenges that plague medical education (or healthcare more broadly) without ensuring that more clinician educators teach the way Neil wants us all to teach…

Let me know what you think?

Brian

Continue Reading