MENUCLOSE

 

Connect with us

Author: Brian S McGowan, PhD

MANUSCRIPT: Putting performance in context: the perceived influence of environmental factors on work-based performance

INTRODUCTION:
Context shapes behaviours yet is seldom considered when assessing competence. Our objective was to explore attending physicians’ and trainees’ perceptions of the Internal Medicine Clinical Teaching Unit (CTU) environment and how they thought contextual factors affected their performance.
METHOD:
29 individuals recently completing CTU rotations participated in nine level-specific focus groups (2 with attending physicians, 3 with senior and 2 with junior residents, and 2 with students). Participants were asked to identify environmental factors on the CTU and to describe how these factors influenced their own performance across CanMEDS roles. Discussions were analyzed using constructivist grounded theory.
RESULTS:
Five major contextual factors were identified: Busyness, Multiple Hats, Other People, Educational Structures, and Hospital Resources and Policies. Busyness emerged as the most important, but all factors had a substantial perceived impact on performance. Participants felt their performance on the Manager and Scholar roles was most affected by environmental factors (mostly negatively, due to decreased efficiency and impact on learning).
CONCLUSIONS:
In complex workplace environments, numerous factors shape performance. These contextual factors and their impact need to be considered in observations and judgements made about performance in the workplace, as without this understanding conclusions about competency may be flawed.

via Putting performance in context: the perceived influence of environmental factors on work-based performance. – PubMed – NCBI.

ABSTRACT: Reviews of theoretical frameworks: Challenges and judging the quality of theory application

BACKGROUND:
Rigorous reviews of available information, from a range of resources, are required to support medical and health educators in their decision making.
AIM:
The aim of this article is to highlight the importance of a review of theoretical frameworks specifically as a supplement to reviews that focus on a synthesis of the empirical evidence alone. Establishing a shared understanding of theory as a concept is highlighted as a challenge and some practical strategies to achieving this are presented. This article also introduces the concept of theoretical quality, arguing that a critique of how theory is applied should complement the methodological appraisal of the literature in a review.
METHOD:
We illustrate the challenge of establishing a shared meaning of theory through reference to experiences of an on-going review of this kind conducted in the field of interprofessional education (IPE) and use a high scoring paper selected in this review to illustrate how theoretical quality can be assessed.
FINDINGS:
In reaching a shared understanding of theory as a concept, practical strategies that promote experiential and practical ways of knowing are required in addition to more propositional ways of sharing knowledge. Concepts of parsimony, testability, operational adequacy and empirical adequacy are explored as concepts that establish theoretical quality.
CONCLUSIONS:
Reviews of theoretical frameworks used in medical education are required to inform educational practice. Review teams should make time and effort to reach a shared understanding of the term theory. Theory reviews, and reviews more widely, should add an assessment of theory application to the protocol of their review method.

via Reviews of theoretical frameworks: Challenges and judging the quality of theory application. – PubMed – NCBI.

ABSTRACT: Critical Appraisal of Emergency Medicine Education Research: The Best Publications of 2014

OBJECTIVES:

The objective was to critically appraise and highlight rigorous education research study articles published in 2014 whose outcomes advance the science of emergency medicine (EM) education.

METHODS:

A search of the English language literature in 2014 querying Education Resources Information Center (ERIC), PsychINFO, PubMed, and Scopus identified 243 EM-related articles using either quantitative (hypothesis-testing or observational investigations of educational interventions) or qualitative (exploring important phenomena in EM education) methods. Two reviewers independently screened all of the publications using previously established exclusion criteria. Six reviewers then independently scored the 25 selected publications using either a qualitative or a quantitative scoring system. Each scoring system consisted of nine criteria. Selected criteria were based on accepted educational review literature and chosen a priori. Both scoring systems use parallel scoring metrics and have been used previously within this annual review.

RESULTS:

Twenty-five medical education research papers (22 quantitative, three qualitative) met the criteria for inclusion and were reviewed. Five quantitative and two qualitative studies were ranked most highly by the reviewers as exemplary and are summarized in this article.

CONCLUSIONS:

This annual critical appraisal series highlights seven excellent EM education research studies, meeting a priori criteria and published in 2014. Methodologic strengths in the 2014 papers are noted, and current trends in medical education research in EM are discussed.

Getting Started with Nudges and Choice Architecture

There may not be an area of behavioral science that I am more in enthralled by than “nudges” and “choice architecture” so I couldn’t be happier to share my passion with you!

In brief, these concepts address how humans are unrelentingly irrational. As a result, our choices are often neither rational or constructive – worse yet, our everyday choices are usually just the opposite. We struggle to balance long-term and short-term benefits and risks, we are more in tune with negatives than positives when reflecting and more in tune with positives than negatives when forecasting…and this undermines our lives, moods, and careers more so than just about any other element of ‘being human’….The research behind these statements has been masterfully summarized and explored in the following works:

To help construct a practical value proposition – this NY Times article from 2013 is a great place to start: Britain’s Ministry of Nudges 

And, just to end with one, more analytical perspective – check out the work of Stanford professor BJ Fogg…I love this simplification so much I have considered it as a potential tattoo 😉

BJ Fogg Behavior Model Grapic

I love Dr. Fogg’s work because of how simple he has connected decades of research into Behavioral economics (Motivation), Adult Learning (Ability), Nudge Theory (Triggers)…B = M x A x T!

As you explore this work, it might become increasingly obvious where my ideas around learning models and instructional design are grounded 😉

I’d love to discuss this in depth, if you have any questions!

MANUSCRIPT: Tackling student neurophobia in neurosciences block with team-based learning

INTRODUCTION:
Traditionally, neurosciences is perceived as a difficult course in undergraduate medical education with literature suggesting use of the term “Neurophobia” (fear of neurology among medical students). Instructional strategies employed for the teaching of neurosciences in undergraduate curricula traditionally include a combination of lectures, demonstrations, practical classes, problem-based learning and clinico-pathological conferences. Recently, team-based learning (TBL), a student-centered instructional strategy, has increasingly been regarded by many undergraduate medical courses as an effective method to assist student learning.
METHODS:
In this study, 156 students of year-three neuroscience block were divided into seven male and seven female groups, comprising 11-12 students in each group. TBL was introduced during the 6 weeks of this block, and a total of eight TBL sessions were conducted during this duration. We evaluated the effect of TBL on student learning and correlated it with the student’s performance in summative assessment. Moreover, the students’ perceptions regarding the process of TBL was assessed by online survey.
RESULTS:
We found that students who attended TBL sessions performed better in the summative examinations as compared to those who did not. Furthermore, students performed better in team activities compared to individual testing, with male students performing better with a more favorable impact on their grades in the summative examination. There was an increase in the number of students achieving higher grades (grade B and above) in this block when compared to the previous block (51.7% vs. 25%). Moreover, the number of students at risk for lower grades (Grade B- and below) decreased in this block when compared to the previous block (30.6% vs. 55%). Students generally elicited a favorable response regarding the TBL process, as well as expressed satisfaction with the content covered and felt that such activities led to improvement in communication and interpersonal skills.
CONCLUSION:
We conclude that implementing TBL strategy increased students’ responsibility for their own learning and helped the students in bridging the gap in their cognitive knowledge to tackle ‘neurophobia’ in a difficult neurosciences block evidenced by their improved performance in the summative assessment

via Tackling student neurophobia in neurosciences block with team-based learning. – PubMed – NCBI.

ABSTRACT: Barriers and Facilitators to Effective Feedback: A Qualitative Analysis of Data From Multispecialty Resident Focus Groups

BACKGROUND:
Despite the importance of feedback, the literature suggests that there is inadequate feedback in graduate medical education.
OBJECTIVE:
We explored barriers and facilitators that residents in anesthesiology, emergency medicine, obstetrics and gynecology, and surgery experience with giving and receiving feedback during their clinical training.
METHODS:
Residents from 3 geographically diverse teaching institutions were recruited to participate in focus groups in 2012. Open-ended questions prompted residents to describe their experiences with giving and receiving feedback, and discuss facilitators and barriers. Data were transcribed and analyzed using the constant comparative method associated with a grounded theory approach.
RESULTS:
A total of 19 residents participated in 1 of 3 focus groups. Five major themes related to feedback were identified: teacher factors, learner factors, feedback process, feedback content, and educational context. Unapproachable attendings, time pressures due to clinical work, and discomfort with giving negative feedback were cited as major barriers in the feedback process. Learner engagement in the process was a major facilitator in the feedback process.
CONCLUSIONS:
Residents provided insights for improving the feedback process based on their dual roles as teachers and learners. Time pressures in the learning environment may be mitigated by efforts to improve the quality of teacher-learner relationships. Forms for collecting written feedback should be augmented by faculty development to ensure meaningful use. Efforts to improve residents’ comfort with giving feedback and encouraging learners to engage in the feedback process may foster an environment conducive to increasing feedback.

via Barriers and Facilitators to Effective Feedback: A Qualitative Analysis of Data From Multispecialty Resident Focus Groups. – PubMed – NCBI.

MANUSCRIPT: How well do health professionals interpret diagnostic information? A systematic review

OBJECTIVE:
To evaluate whether clinicians differ in how they evaluate and interpret diagnostic test information.
DESIGN:
Systematic review.
DATA SOURCES:
MEDLINE, EMBASE and PsycINFO from inception to September 2013; bibliographies of retrieved studies, experts and citation search of key included studies.
ELIGIBILITY CRITERIA FOR SELECTING STUDIES:
Primary studies that provided information on the accuracy of any diagnostic test (eg, sensitivity, specificity, likelihood ratios) to health professionals and that reported outcomes relating to their understanding of information on or implications of test accuracy.
RESULTS:
We included 24 studies. 6 assessed ability to define accuracy metrics: health professionals were less likely to identify the correct definition of likelihood ratios than of sensitivity and specificity. -25 studies assessed Bayesian reasoning. Most assessed the influence of a positive test result on the probability of disease: they generally found health professionals’ estimation of post-test probability to be poor, with a tendency to overestimation. 3 studies found that approaches based on likelihood ratios resulted in more accurate estimates of post-test probability than approaches based on estimates of sensitivity and specificity alone, while 3 found less accurate estimates. 5 studies found that presenting natural frequencies rather than probabilities improved post-test probability estimation and speed of calculations.
CONCLUSIONS:
Commonly used measures of test accuracy are poorly understood by health professionals. Reporting test accuracy using natural frequencies and visual aids may facilitate improved understanding and better estimation of the post-test probability of disease.

via How well do health professionals interpret diagnostic information? A systematic review. – PubMed – NCBI.

MANUSCRIPT: Effectiveness of interprofessional education by on-field training for medical students, with a pre-post design

BACKGROUND:
Interprofessional Education (IPE) implies how to achieve successful teamwork, and is based on collaborative practice which enhance occasions for relationships between two or more healthcare professions. This study evaluates the effectiveness of IPE in changing attitudes after a training recently introduced to medical education for second-year students at the University of Padova, Italy.
METHODS:
All medical students following a new program for IPE were enrolled in this study. The Interdisciplinary Education Perception Scale (IEPS) was administered before and after training, according to observation-based and practice-based learning. Data were analysed with Student’s paired t-test and Wilcoxon’s signed rank test.
RESULTS:
277 medical students completed both questionnaires. Statistically significant improvements were found in students’ overall attitudes as measured by the IEPS and four subscale scores. Gender-stratified analyses showed that improvements were observed only in female students in subscale 4 (“Understanding Others’ Values”). Students who had a physician and/or health worker in their family did not show any improvement in subscales 2 (“Perceived need for cooperation”) or 4 (“Understanding Others’ Values”).
CONCLUSIONS:
Our results indicate that IPE training has a positive influence on students’ understanding of collaboration and better attitudes in interprofessional teamwork. More research is needed to explore other factors which may influence specific perceptions among medical students.

via Effectiveness of interprofessional education by on-field training for medical students, with a pre-post design. – PubMed – NCBI.

ABSTRACT: Interprofessional Podiatric Surgical Simulation A Pilot Study.

BACKGROUND:
Interprofessional collaboration is key to quality outcomes in the health-care systems of today. Simulation is a common tool in podiatric medical education, and interprofessional education has become more common in podiatric medicine programs. Interprofessional simulation is the blending of these educational strategies.
METHODS:
A quantitative design was used to determine the impact of an isolated interprofessional podiatric surgical simulation between nurse anesthesia and podiatric medical students.
RESULTS:
Statistically significant differences were observed among participants between preintervention and postintervention surveys using the revised Interdisciplinary Education Perception Scale.
CONCLUSIONS:
Interprofessional simulation can be an effective educational opportunity for podiatric medical and nurse anesthesia students.

via Interprofessional Podiatric Surgical Simulation A Pilot Study. – PubMed – NCBI.

ABSTRACT: Emotional Intelligence and Simulation

Emotional intelligence (EI) is an established concept in the business literature with evidence that it is an important factor in determining career achievement. There is increasing interest in the role that EI has in medical training, but it is still a nascent field. This article reviews the EI literature most relevant to surgical training and proposes that simulation offers many benefits to the development of EI. Although there are many unanswered questions, it is expected that future research will demonstrate the effectiveness of using simulation to develop EI within surgery.

via Emotional Intelligence and Simulation. – PubMed – NCBI.