MENUCLOSE

 

Connect with us

Author: Brian S McGowan, PhD

Commitment to Change Statements in CME: The Impact of the Natural Learning Actions

Over the past year as I have been building the ‘Natural Learning Actions’ model I have had the opportunity to speak with a whole host of medical educators and learners. One of the areas of medical education research that has consistently come up in these conversations is how a learner’s note taking and reminders might be structured and improved to help extend learning and enable practice change – these are very real, very practical conversations and I look forward to sharing my lessons through the posts on this blog.

From these conversations it has become clear that while there is a general appreciation of the need for our new natural learning action model, there may not be a full appreciation of how much evidence has already been accumulated to support the elements of the model itself. For example, one of the most well-described forms of a ‘learning architecture’ is that of the commitment to change statement. Below is a list of 10 references that provide an evidence-based review of what we now know about the impact of commitment to change statements and the various ways that they may be implemented in practice.

 http://25.media.tumblr.com/tumblr_lxcioiAyso1qjf359o1_500.jpg

Commitment to change instrument enhances program planning, implementation, and evaluation.

Commitment to change statements can predict actual change in practice.

Effectiveness of commitment contracts in facilitating change in continuing medical education intervention.

Requesting a commitment to change: conditions that produce behavioral or attitudinal commitment.

Effects of a signature on rates of change: a randomized controlled trial involving continuing education and the commitment-to-change model.

Effect of a primary care continuing education program on clinical practice of chronic obstructive pulmonary disease: translating theory into practice.

The impact on medical practice of commitments to change following CME lectures: A randomized controlled trial.

Unanticipated learning outcomes associated with commitment to change in continuing medical education.

Information about barriers to planned change: a randomized controlled trial involving continuing medical education lectures and commitment to change.

Commitment to change statements: a way of understanding how participants use information and skills taught in an educational session.

If you have the time I highly recommend that you read through this body of evidence. Doing so will almost certainly provide some much needed perspective on how note taking and reminders (when effectively structured) can lead to changes in knowledge, attitude, skills, behavior, and outcomes. This is very much the goal of my research and our goal at ArchemedX!

For example:

  • From Wakefield et al we learn that physicians who expressed a commitment to change were significantly more likely to change their actual prescribing for the target medications in the following 6 months
  • From Mazmanian et al and Domino et al we learn that primary care clinicians encouraged to make a commitment to change statement are 3-7 x’s as likely to report a change in practice.
  • From Lockyer et al we learn that providers must take a critical look at commitment to change statements as an “intervention” in their own right and determine how the tool can best be used as a CME intervention.
  • From Dolcourt and Zuckerman we learn that, if learners are given a chance to craft their own commitment to change statements, up to 32% of statement do not correspond to any of the instructional objectives and thus represent unanticipated learning outcomes
  • From Mazmanian et al we learn that a formal signature on a commitment to change statement is less important than making the commitment and being reminded efficiently about the commitment
  • From White et al we learn that commitment to change statements provide planners with meaningful feedback to (1) assess congruence of intended changes in physician behavior with program objectives, (2) document unanticipated learning outcomes, and (3) enable and reinforce intended behavior change.

By sharing these resources I hope that the community can begin to familiarize themselves with how critical the natural learning actions like note taking and setting reminders (the core elements of the commitment to change statement) are to the learning process and I would love to continue the dialog to explore ArcheMedX can help you engineer these solutions. But even more than that, I hope that by (re)introducing you to these data that you will begin to appreciate how successful medical is much more than simply ‘developing and delivering’ content to learners…we must, as a community, help structure the learning experience in ways that simplifies what it means to learn.

 

 

Continue Reading

ABSTRACT: Development of an internet-based cohort of patients with inflammatory bowel diseases (CCFA Partners): methodology and initial results.

Abstract
BACKGROUND:
The widespread use of the Internet allows for unique research opportunities. We aimed to develop and follow an Internet-based cohort (e-cohort) of patients with self-reported inflammatory bowel diseases (IBD) over time.
METHODS:
We established an e-cohort of adults with IBD (CCFA Partners) by recruiting through Crohn’s and Colitis Foundation of America (CCFA) email rosters, CCFA Website promotion, social media, and other publicity mechanisms. The baseline survey included modules on disease course and activity, diet and exercise, and patient-reported outcomes (PROs). Baseline characteristics of the cohort are summarized using descriptive statistics.
RESULTS:
A total of 7819 adults with IBD joined CCFA Partners through August, 2011. The median age was 42 years (interquartile range [IQR] 30-54), 5074 (72.3%) were female. A total of 4933 (63.1%) had Crohn’s disease (CD), 2675 (34.2%) had ulcerative colitis (UC), and 211 (2.7%) had IBD unspecified. For CD, the mean short CD Activity Index (CDAI) was 151.9 (standard deviation [SD] 106.4), with 2274 (59.4%) in remission. For UC, the mean simple clinical colitis activity index (SCCAI) was 3.6 (SD 2.8), with 937 (42.9%) in remission. The mean short IBD questionnaire (SIBDQ) score was 48.7 (SD 11.8). SIBDQ was inversely correlated with disease activity (P < 0.01). The mean Morisky medication adherence score (MMAS) was 5.7 (SD 2.0). MMAS scores were inversely correlated with disease activity (P < 0.01).
CONCLUSIONS:
CCFA Partners is a novel e-cohort. Enrollment is ongoing, with surveys twice yearly. CCFA Partners represents a unique resource to study PROs and changes in disease management over time.

via Development of an internet-based cohort of… [Inflamm Bowel Dis. 2012] – PubMed – NCBI.

MANUSCRIPT: Improving participant feedback to continuing medical education presenters in internal medicine: a mixed-methods study.

Abstract
BACKGROUND:
Feedback is essential for improving the skills of continuing medical education (CME) presenters. However, there has been little research on improving the quality of feedback to CME presenters.
OBJECTIVES:
To validate an instrument for generating balanced and behavior-specific feedback from a national cross-section of participants to presenters at a large internal medicine CME course.
DESIGN, SETTING, AND PARTICIPANTS:
A prospective, randomized validation study with qualitative data analysis that included all 317 participants at a Mayo Clinic internal medicine CME course in 2009.
MEASUREMENTS:
An 8-item (5-point Likert scales) CME faculty assessment enhanced study form (ESF) was designed based on literature and expert review. Course participants were randomized to a standard form, a generic study form (GSF), or the ESF. The dimensionality of instrument scores was determined using factor analysis to account for clustered data. Internal consistency and interrater reliabilities were calculated. Associations between overall feedback scores and presenter and presentation variables were identified using generalized estimating equations to account for multiple observations within talk and speaker combinations. Two raters reached consensus on qualitative themes and independently analyzed narrative entries for evidence of balanced and behavior-specific comments.
RESULTS:
Factor analysis of 5,241 evaluations revealed a uni-dimensional model for measuring CME presenter feedback. Overall internal consistency (Cronbach alpha = 0.94) and internal consistency reliability (ICC range 0.88-0.95) were excellent. Feedback scores were associated with presenters’ academic ranks (mean score): Instructor (4.12), Assistant Professor (4.38), Associate Professor (4.56), Professor (4.70) (p = 0.046). Qualitative analysis revealed that the ESF generated the highest numbers of balanced comments (GSF = 11, ESF = 26; p = 0.01) and behavior-specific comments (GSF = 64, ESF = 104; p = 0.001).
CONCLUSIONS:
We describe a practical and validated method for generating balanced and behavior-specific feedback for CME presenters in internal medicine. Our simple method for prompting course participants to give balanced and behavior-specific comments may ultimately provide CME presenters with feedback for improving their presentations.

via Improving participant feedback to continuin… [J Gen Intern Med. 2012] – PubMed – NCBI.

RESOURCE: Small, rural hospitals lag on some quality measures

Although fewer people are dying shortly after treatment for heart attacks, heart failure and pneumonia at most U.S. hospitals than a decade ago, the same trend doesn’t apply to certain small, rural facilities, a new study suggests.

So-called critical access hospitals – which have no more than 25 beds and are typically miles from the nearest other hospital – are exempt from reporting those sort of quality and outcomes data to the government.

via Small, rural hospitals lag on some quality measures – chicagotribune.com.

RESOURCE: Integrating EHR with medical education for improved care

Physicians and other healthcare providers are mandated to complete anywhere from 12 to 50 hours of continuing medical education (CME) yearly. The problem is that few clinicians know whether those hours of education have a meaningful impact on real-world patient outcomes. In other words, does learning a new diagnostic strategy or treatment option, for example, lead to patients living healthier lives with fewer medical complications?
We can do a better job of understanding the correlation between CME and better patient outcomes today. Utilization of electronic health record (EHR) systems to integrate clinical data analytics and CME will facilitate more prescriptive education designed to specifically meet gaps in knowledge and care while improving patient outcomes. Moreover, we can better design extended curriculums that best serve a clinician’s interest and define clinical care gaps by particular patient populations.

via Integrating EHR with medical education for improved care | EHRintelligence.com.

ABSTRACT: Social media in dermatology: moving to Web 2.0

Abstract
Patient use of social media platforms for accessing medical information has accelerated in parallel with overall use of the Internet. Dermatologists must keep pace with our patients’ use of these media through either passive or active means are outlined in detail for 4 specific social media outlets. A 5-step plan for active engagement in social media applications is presented. Implications for medical professionalism, Health Insurance Portability and Accountability Act compliance, and crisis management are discussed.

via Social media in dermatology: moving to … [Semin Cutan Med Surg. 2012] – PubMed – NCBI.

ABSTRACT: Why Don’t We Know Whether Care Is Safe?

Abstract

Reliable data are essential to ensuring that health care is delivered safely and appropriately. Yet the availability of reliable data on safety remains surprisingly poor, as does our knowledge of what it costs (and should cost) to generate such data. The authors suggest the following as priorities: (1) develop valid and reliable measures of the common causes of preventable deaths; (2) evaluate whether a global measure of safety is valid, feasible, and useful; (3) explore the incremental value of collecting data for each patient safety measure; (4) evaluate if/how patient safety reporting systems can be used to influence outcomes at all levels; (5) explore the value—and the unintended consequences—of creating a list of reportable events; (6) evaluate the infrastructure required to monitor patient safety; and (7) explore the validity and usefulness of measurements of patient safety climate.

via Why Don’t We Know Whether Care Is Safe?.

MANUSCRIPT: Tweeting the meeting: an in-depth analysis of Twitter activity at Kidney Week 2011

Abstract
In recent years, the American Society of Nephrology (ASN) has increased its efforts to use its annual conference to inform and educate the public about kidney disease. Social media, including Twitter, has been one method used by the Society to accomplish this goal. Twitter is a popular microblogging service that serves as a potent tool for disseminating information. It allows for short messages (140 characters) to be composed by any author and distributes those messages globally and quickly. The dissemination of information is necessary if Twitter is to be considered a tool that can increase public awareness of kidney disease. We hypothesized that content, citation, and sentiment analyses of tweets generated from Kidney Week 2011 would reveal a large number of educational tweets that were disseminated to the public. An ideal tweet for accomplishing this goal would include three key features: 1) informative content, 2) internal citations, and 3) positive sentiment score. Informative content was found in 29% of messages, greater than that found in a similarly sized medical conference (2011 ADA Conference, 16%). Informative tweets were more likely to be internally, rather than externally, cited (38% versus 22%, p<0.0001), thereby amplifying the original information to an even larger audience. Informative tweets had more negative sentiment scores than uninformative tweets (means -0.162 versus 0.199 respectively, p<0.0001), therefore amplifying a tweet whose content had a negative tone. Our investigation highlights significant areas of promise and improvement in using Twitter to disseminate medical information in nephrology from a scientific conference. This goal is pertinent to many nephrology-focused conferences that wish to increase public awareness of kidney disease.

via Tweeting the meeting: an in-depth analysis of Twitt… [PLoS One. 2012] – PubMed – NCBI.

MANUSCRIPT: Verification in referral-based crowdsourcing

Abstract
Online social networks offer unprecedented potential for rallying a large number of people to accomplish a given task. Here we focus on information gathering tasks where rare information is sought through “referral-based crowdsourcing”: the information request is propagated recursively through invitations among members of a social network. Whereas previous work analyzed incentives for the referral process in a setting with only correct reports, misreporting is known to be both pervasive in crowdsourcing applications, and difficult/costly to filter out. A motivating example for our work is the DARPA Red Balloon Challenge where the level of misreporting was very high. In order to undertake a formal study of verification, we introduce a model where agents can exert costly effort to perform verification and false reports can be penalized. This is the first model of verification and it provides many directions for future research, which we point out. Our main theoretical result is the compensation scheme that minimizes the cost of retrieving the correct answer. Notably, this optimal compensation scheme coincides with the winning strategy of the Red Balloon Challenge.

via Verification in referral-based crowdsourcing. [PLoS One. 2012] – PubMed – NCBI.

ABSTRACT: Physician preferences for accredited online continuing medical education

Abstract
INTRODUCTION:
The need for up-to-date and high-quality continuing medical education (CME) is growing while the financial investment in CME is shrinking. Despite online technology’s potential to efficiently deliver electronic CME (eCME) to large numbers of users, it has not yet displaced traditional CME. The purpose of this study was to explore what health care providers want in eCME and how they want to use it.
METHODS:
This was a qualitative study. Two 3-hour focus groups were held with physicians in both academic and community practices as well as trainees knowledgeable in the hypertension clinical practice guidelines with a willingness to discuss eCME. Content/thematic analysis was used to examine the data.
RESULTS:
Three main themes emerged: credibility, content/context, and control. Credibility was the most consistent and dominant theme. Affiliations with medical organizations and accreditation were suggested as methods by which eCME can gain credibility. The content and need for discussion of the content emerged as a key pivot point between eCME and traditional CME: a greater need for discussion was linked to a preference for traditional face-to-face CME. Control over the content and how it was accessed was an emergent theme, giving learners the ability to control the depth of learning and the time spent. They valued the ability to quickly find information that was in a format (podcast, video, mobile device) that best suited their learning needs or preferences at the time.
DISCUSSION:
This study provides insight into physician preferences for eCME and hypotheses that can be used to guide further research.

via Physician preferences for accredit… [J Contin Educ Health Prof. 2011] – PubMed – NCBI.