MENUCLOSE

 

Connect with us

Author: Brian S McGowan, PhD

MANUSCRIPT: The impact on medical practice of commitments to change following CME lectures: A randomized controlled trial

Abstract
Background: Self-reported commitment to change (CTC) could be a potentially valuable method to address the need for continuing medical education (CME) to demonstrate clinical outcomes. Aim: This study determines: (1) are clinicians who make CTCs more likely to report changes in their medical practices and (2) do these changes persist over time? Methods: Intervention participants (N¼80) selected up to three commitments from a predefined list following the lecture, while control participants (N¼64) generated up to three commitments at 7 days post-lecture. At 7 and 30 days post-lecture, participants were queried if any practice change occurred as a result of attending the lecture. Results: About 91% of the intervention group reported practice changes consistent with their commitments at 7 days. Only 32% in the control group reported changes (z¼7.32, p50.001). At 30 days, more participants in the intervention group relative to the control group reported change (58% vs. 22%, z¼3.74, p50.01). Once a participant from either group made a commitment, there were no differences in reported changes (63% vs. 67%, z¼50.00, p¼0.38). Conclusion: Integration of CTC is an effective method of reinforcing learning and measuring outcomes.

 

http://acmd615.pbworks.com/f/committmenttochange.pdf

ABSTRACT: Unanticipated learning outcomes associated with commitment to change in continuing medical education

Abstract
INTRODUCTION:
Educator-derived, predetermined instructional objectives are integral to the traditional instructional model and form the linkage between instructional design and postinstruction evaluation. The traditional model does not consider unanticipated learning outcomes. We explored the contribution of learner-identified desired outcomes compared with learner outcomes that were not named in the instructional design.
METHOD:
This study was conducted at a short course in pediatrics in which 43 physicians, advanced practice nurses, nurses, and physician assistants voluntarily self-identified committed- to changes (CTCs). We compared these CTC predicates with the predetermined instructional objectives that had been published in advance in the conference brochure and syllabus. CTCs whose predicates described the same features as the instructional objectives were considered to be anticipated learning outcomes. CTCs lacking correspondence with instructional objectives were considered to represent unanticipated learning outcomes.
RESULTS:
Of the 157 CTCs, 68% were anticipated learning outcomes because their predicates could be linked to the instructional objectives. The remaining 32% of CTCs did not correspond to any of the instructional objectives and thus represented unanticipated learning outcomes.
DISCUSSION:
These findings demonstrate that evaluations based on instructional objectives, although valuable, are incomplete because educational activities may also stimulate many unanticipated learning outcomes. Continuing medical education planners can gain a fuller assessment of the effect of their educational endeavors by including predetermined instructional objectives and encouraging the constructivist practice of recognizing unanticipated learning.

via Unanticipated learning outcomes as… [J Contin Educ Health Prof. 2003] – PubMed – NCBI.

ABSTRACT: Information about barriers to planned change: a randomized controlled trial involving continuing medical education lectures and commitment to change.

Abstract
PURPOSE:
To determine whether practicing physicians receiving only clinical information at a traditional continuing medical education (CME) lecture (control group) and physicians receiving clinical information plus information about barriers to behavioral change (study group) would alter their clinical behaviors at the same rate.
METHOD:
In a randomized controlled trial, the investigators matched 13 pairs of U.S. and Canadian medical schools, assigning one school from each pair to study or control conditions. Following the commitment-to-change model, the investigators asked the primary care physicians attending control or study lectures on the management of cardiovascular risks whether they intended to make behavioral changes as a result of participating in the lectures and, if so, to indicate the specific changes. Thirty to 45 days later, the investigators surveyed the responding physicians to learn whether they had implemented those changes.
RESULTS:
Information about barriers to change did not increase the likelihood that physicians in the study group would report successful changes; they were no more likely to change than those in the control group. However, the physicians in both study and control groups were significantly more likely to change (47% vs 7%, p < .001) if they indicated an intent to change immediately following the lecture.
CONCLUSIONS:
Successful change in practice may depend less on clinical and barriers information than on other factors that influence physicians’ performances. To further develop the commitment-to-change strategy in measuring the effects of planned change, it is important to isolate and learn the powers of individual components of the strategy as well as their collective influence on physicians’ clinical behaviors.

via Information about barriers to planned change: a ran… [Acad Med. 1998] – PubMed – NCBI.

ABSTRACT: Commitment to change statements: a way of understanding how participants use information and skills taught in an educational session.

Abstract
BACKGROUND:
Commitment to change has gained increasing use in assessing short course effectiveness. This study examined the changes that learners intended to make in practice following an intensive day-long course offered at multiple sites, counted changes relative to the curriculum’s focus, and analyzed which changes were implemented in practice.
METHODS:
Participants at a course on the management of male sexual dysfunction were asked to identify the changes to which they would commit. Six months after the course, they were asked to indicate which changes they implemented fully, partially, or not at all.
RESULTS:
A total of 352 physicians attended the courses held in 21 centers. A majority of attendees (344 or 97.7%) completed forms at the end of the course, providing 1,635 commitment statements. Six months later, 197 (57.3%) physicians provided follow-up data about 935 (55.4%) of the commitment statements originally submitted. Of these, 602 (66.52%) were completely implemented. Many of the changes related to two specific aspects of the course, namely, sexual history taking and medical intervention, accounting for 45.93% of the intended commitments and 47.67% of the changes completely implemented. Slightly over half (58%) of the course time was devoted to these two areas. There was a significant correlation between the number of changes and the amount of time allocated to that content within the course.
FINDINGS:
Commitment to change statements offered by course participants can be used to examine the impact of a course relative to its learning focus. Continuing medical education providers must take a critical look at commitment to change statements as an “intervention” in their own right and determine how the tool can best be used as a continuing medical education intervention.

via Commitment to change statements: a… [J Contin Educ Health Prof. 2001] – PubMed – NCBI.

ABSTRACT: Improving performance of natural language processing part-of-speech tagging on clinical narratives through domain adaptation

Abstract:

Objective Natural language processing NLP tasks are commonly decomposed into subtasks, chained together to form processing pipelines. The residual error produced in these subtasks propagates, adversely affecting the end objectives. Limited availability of annotated clinical data remains a barrier to reaching state-of-the-art operating characteristics using statistically based NLP tools in the clinical domain. Here we explore the unique linguistic constructions of clinical texts and demonstrate the loss in operating characteristics when out-of-the-box part-of-speech POS tagging tools are applied to the clinical domain. We test a domain adaptation approach integrating a novel lexical-generation probability rule used in a transformation-based learner to boost POS performance on clinical narratives.Methods Two target corpora from independent healthcare institutions were constructed from high frequency clinical narratives. Four leading POS taggers with their out-of-the-box models trained from general English and biomedical abstracts were evaluated against these clinical corpora. A high performing domain adaptation method, Easy Adapt, was compared to our newly proposed method ClinAdapt. Results The evaluated POS taggers drop in accuracy by 8.5–15% when tested on clinical narratives. The highest performing tagger reports an accuracy of 88.6%. Domain adaptation with Easy Adapt reports accuracies of 88.3–91.0% on clinical texts. ClinAdapt reports 93.2–93.9%. Conclusions ClinAdapt successfully boosts POS tagging performance through domain adaptation requiring a modest amount of annotated clinical data. Improving the performance of critical NLP subtasks is expected to reduce pipeline error propagation leading to better overall results on complex processing tasks.

via Improving performance of natural language processing part-of-speech tagging on clinical narratives through domain adaptation — Ferraro et al. — Journal of the American Medical Informatics Association.

MANUSCRIPT: THE EFFECT OF THE FLIPPED CLASSROOM ON STUDENT ACHIEVEMENT AND STRESS

In this investigation, the effect of the flipped classroom and associated differentiation was studied to measure the impact on student achievement and student stress levels. For the second semester of their senior year, students watched video lectures outside of class and completed assignments during class time. Students reported lower stress levels in this type of classroom environment compared to other classes. While semester grades showed improvement, exam grades did not show significant improvement. Overall, students displayed positive feelings towards the treatment and enjoyed the associated benefits of being able to choose their own assignments and explore concepts they found interesting more in-depth.

http://etd.lib.montana.edu/etd/2012/marlowe/MarloweC0812.pdf

RESOURCE: Flipping the Classroom

“Flipping the classroom” has become something of a buzzword in the last several years, driven in part by high profile publications in The New York Times (Fitzpatrick, 2012); The Chronicle of Higher Education (Berrett, 2012); and Science (Mazur, 2009); In essence, “flipping the classroom” means that students gain first exposure to new material outside of class, usually via reading or lecture videos, and then use class time to do the harder work of assimilating that knowledge, perhaps through problem-solving, discussion, or debates.

Bloom’s Taxonomy (Revised)
In terms of Bloom’s revised taxonomy (2001), this means that students are doing the lower levels of cognitive work (gaining knowledge and comprehension) outside of class, and focusing on the higher forms of cognitive work (application, analysis, synthesis, and/or evaluation) in class, where they have the support of their peers and instructor. This model contrasts from the traditional model in which “first exposure” occurs via lecture in class, with students assimilating knowledge through homework; thus the term “flipped classroom.”

via Flipping the Classroom | Center for Teaching | Vanderbilt University.

RESOURCE: San Jose State U. Says Replacing Live Lectures With Videos Increased Test Scores – Wired Campus – The Chronicle of Higher Education

The 85 students in the flipped course at San Jose State watched the edX lecture videos at home and attended class twice a week to practice what they had learned and ask questions. Two other sections of students took a traditional version of the course.

The midterm-examination scores of students in the flipped section were higher than those in the traditional sections, said Mr. Ghadiri. Although the midterm questions were more difficult for the flipped students, their median score was 10 to 11 points higher.

The final reckoning of whether the students have learned better through the flipped classroom will come in the class’s last week. Professors plan to give the same final exam to all of the sections. Researchers will then control the data for grade-point average and prerequisite knowledge to “prove to ourselves and fellow faculty that we didn’t stuff the classroom with dead ringers,” Mr. Parent said.

The university will also survey students’ views of their experience in the alternative format before deciding whether to develop more flipped-classroom courses. “I think, in a way, that’s more important,” said Ping Hsu, interim dean of engineering. “If students feel this is a better way to learn, then that says a lot, perhaps more than exam scores.”

via San Jose State U. Says Replacing Live Lectures With Videos Increased Test Scores – Wired Campus – The Chronicle of Higher Education.

RESOURCE: Gathering Evidence that Flipping the Classroom can Enhance Learning Outcomes | Emerging Education Technology

Three universities provide empirical evidence supporting the potential for ‘the flip’ to make a measurable difference in engagement and learning.

As an advocate of the potential of the flipped classroom, it’s rewarding and encouraging when student and teacher feedback supports the benefits of this approach, and this happens quite often. However, a wealth of measurable evidence that the technique can improve learning outcomes would go a long way towards convincing educators everywhere that this is an important technique to consider leveraging further in our schools.

Not long ago I stumbled across an article about San Jose State University that discusses measurable improvements in test scores in a course in which some students used a flipped model. This weekend I went in search of more such examples, and share these findings here.

via Gathering Evidence that Flipping the Classroom can Enhance Learning Outcomes | Emerging Education Technology.

ABSTRACT: The use of personal digital assistants in clinical decision making by health care professionals: A systematic review

Abstract:
Ownership of personal digital assistants PDAs and smartphones by health professionals is increasingly common. Providing the best available evidence at the point of care is important for time-poor clinical staff and may lead to benefits in the processes and outcomes of clinical care. This review was performed to investigate the usefulness of PDAs in the clinical setting. MEDLINE, Embase, CINAHL and the Cochrane Central Register of Controlled Trials were searched from 2000 to March 2010. Randomised controlled trials that evaluated the effects on the processes or outcomes of clinical care of using PDAs compared with not using a PDA were included. Two reviewers independently reviewed citations and abstracts, assessed full text articles and abstracted data from the studies. Seven trials met the review inclusion criteria, of which only three were of satisfactory quality. Studies investigated the use of PDAs either in recording patient information or in decision support for diagnoses or treatment. An increase in data collection quality was reported, and the appropriateness of diagnosis and treatment decisions was improved. PDAs appear to have potential in improving some processes and outcomes of clinical care, but the evidence is limited and reliable conclusions on whether they help, in what circumstances and how they should be used are not possible. Further research is required to assess their value and ensure full benefits from their widespread use, but the pace of technological development creates problems for the timely evaluation of these devices and their applications.

via The use of personal digital assistants in clinical decision making by health care professionals: A systematic review.