MENUCLOSE

 

Connect with us

Author: Brian S McGowan, PhD

MANUSCRIPT: Clinical epidemiology in the era of big data: new opportunities, familiar challenges

Routinely recorded health data have evolved from mere by-products of health care delivery or billing into a powerful research tool for studying and improving patient care through clinical epidemiologic research. Big data in the context of epidemiologic research means large interlinkable data sets within a single country or networks of multinational databases. Several Nordic, European, and other multinational collaborations are now well established. Advantages of big data for clinical epidemiology include improved precision of estimates, which is especially important for reassuring (“null”) findings; ability to conduct meaningful analyses in subgroup of patients; and rapid detection of safety signals. Big data will also provide new possibilities for research by enabling access to linked information from biobanks, electronic medical records, patient-reported outcome measures, automatic and semiautomatic electronic monitoring devices, and social media. The sheer amount of data, however, does not eliminate and may even amplify systematic error. Therefore, methodologies addressing systematic error, clinical knowledge, and underlying hypotheses are more important than ever to ensure that the signal is discernable behind the noise.

via Clinical epidemiology in the era of big data: new opportunities, familiar challenges. – PubMed – NCBI.

What We’ve Learned about Note-taking in Continuing Education

If we go all the way back (now nearly 6 years ago) to the original Learning Actions research project, one of the first insights gained was that note-taking is a nearly universal behavior that clinician-learners rely on to support their learning process. In fact, from my initial interviews I found that nearly 85% of clinician learners acknowledged that their learning process begins with taking notes. Interestingly, the other 15% of learners – those who claimed that they didn’t actively take notes during their continuing education experiences – acknowledged that they never developed an effective note-taking strategy and that over time they simply gave up trying!

One way to look at the Learning Actions Model is that it simplifies and centralizes the critical actions learners rely on – actions that while necessary, are largely unevolved. Over time we have now validated the model in tens of thousands of clinician learners – this is how we now know how well it works: Learners learn more when their learning actions are optimized!

As our data sets have grown, we have been able to dig more deeply into the intrinsic complexity and the inter-connectedness of each learning action. One of the more recent findings we’ve uncovered is that the notes that clinician learners take appear to come in three flavors: linear, tangential, and derivative. 

Linear notes = a learner records exactly what was shared by faculty.
Examples may include jotting down specific diagnosis criteria, details about new trials, specific case conclusions that faculty present, or new dosing information. From a learning analytics approach, linear notes point to areas of the content that learners were ‘moved’ by and the content of the note often provides insights into understanding, agreement, or confusion.

Tangential notes = a learner relates what is being shared by faculty to some deeper thinking or plan of action.
Examples may include connecting what they are hearing/seeing to a recent patient, to a forthcoming patient, or to a case a peer may have recently had. They may record an action that they want to take, for example a desire to share some nugget with their peers or care team. Or they may relate new research to foundational or prior research exploring similarities or contradictions. From a learning analytics approach, tangential notes appear to represent higher-level or deeper thinking; again, the content of the note often provides insights into specific actions or barriers to action.

Derivative notes = a learner records thoughts that seem to have no obvious relationship to what is being shared by faculty.
Examples may include just about anything under the sun 😉 Seriously though, they often seem out of left field and from a learning analytics approach I haven’t quite figured out what to do with tangential notes…and certainly not at any meaningful scale. For now, I am left considering these as outliers and generally exclude them from any analysis.

—-

In terms of proportionality of the three types of notes, I haven’t rigorously quantified them yet but quick analysis suggests that the breakdown is somewhere in the ballpark of 60-70% Linear, 20-30% Derivative, and <5% Tangential.

In terms of importance of the three types of notes, I currently look at it this way: Tangential >> Linear >>>>>>> Derivative.

Over the coming months I will undoubtedly be working with our Partners and digging further into our data sets. We will be looking for new ways to nudge note-taking and we will be rolling out new means by which notes can be taken (eg., audio or visual capture married to a note). As this research evolves, I will try to share more about our general lessons!

In the meantime, take a moment to think about the notes you take, how you hope to use them, and how (at times) they go to waste. As I journey down the path of Learning Actions research, I continue to be fascinated by how much we still have to learn about learning. 😉

MANUSCRIPT: Strengthening care teams to improve adherence in cystic fibrosis: a qualitative practice assessment and quality improvement initiative

Background

Treatment regimens for patients with cystic fibrosis (CF) are complex, time consuming, and burdensome, and adherence to CF treatment is suboptimal. CF care teams play a critical role in supporting patients’ chronic self-management skills, but there is no uniform method for assessing patients’ adherence to treatment or standard interventions to help patients improve when necessary.

Methods

Between May 2015 and March 2016, care team members from 10 CF centers in the USA participated in a practice assessment and quality improvement (QI) initiative. The intervention included a baseline practice assessment survey, personalized continuing medical education (CME)-certified Webconferences with expert study faculty, targeted reinforcement of key practice points, and follow-up online survey and telephone interviews to evaluate the benefits and limitations of the intervention.

Results

Responses to the baseline practice assessment survey were received from 50 multidisciplinary care team members representing 10 CF centers. Primary barriers to adherence-related aspects of care in their clinics were motivating patients and caregivers to improve adherence and obtaining accurate information about adherence from patients. At the conclusion of the initiative, participants reported improvements in communication within their care team, implementation of new approaches to asking about adherence, and a renewed commitment to asking patients and caregivers about adherence at each clinic visit.

Conclusion

Structured QI interventions that bring multidisciplinary care teams together to reflect on clinic processes and elicit objective insights from outside faculty have the potential to improve practice patterns related to the assessment and improvement of patient adherence in CF.

via Strengthening care teams to improve adherence in cystic fibrosis: a qualitative practice assessment and quality improvement initiative.

ABSTRACT: Root Cause Analysis and Actions for the Prevention of Medical Errors: Quality Improvement and Resident Education

The quality of care delivered by orthopedic surgeons continues to grow in importance. Multiple orthopedic programs, organizations, and committees have been created to measure the quality of surgical care and reduce the incidence of medical adverse events. Structured root cause analysis and actions (RCA2) has become an area of interest. If performed thoroughly, RCA2 has been shown to reduce surgical errors across many subspecialties. The Accreditation Council for Graduate Medical Education has a new mandate for programs to involve residents in quality improvement processes. Resident engagement in the RCA2 process has the dual benefit of educating trainees in patient safety and producing meaningful changes to patient care that may not occur with traditional quality improvement initiatives. The RCA2 process described in this article can provide a model for the development of quality improvement programs. In this article, the authors discuss the history and methods of the RCA2 process, provide a stepwise approach, and give a case example.

via Root Cause Analysis and Actions for the Prevention of Medical Errors: Quality Improvement and Resident Education. – PubMed – NCBI.

MANUSCRIPT: Effectiveness of an individual, online e-learning program about sexually transmitted infections: a prospective cohort study

Background: Primary health-care professionals play an important role in the treatment and prevention of Sexually Transmitted Infections (STI). Continuing Medical Education (CME)-courses can influence the knowledge and behavior of health-care professionals concerning STI. We performed a prospective cohort study to evaluate if the individual and online e-learning program “The STI-consultation”, which uses the Commitment-to-Change (CtC)-method, is able to improve the knowledge, attitude and behavior of Dutch General Practitioners (GPs), concerning the STI-consultation. This e-learning program is an individual, accredited, online CME-program, which is freely available for all GPs and GP-trainees in the Netherlands.
Methods: In total 2192 participants completed the questionnaire before completing the e-learning program and 249 participants completed the follow-up questionnaire after completing the e-learning program. The effect of the program on their knowledge, attitude and behavior concerning the STI-consultation was evaluated.

Results: In total 193 participants formulated 601 learning points that matched the learning objectives of the program. The knowledge and attitude of the participants improved, which persisted up to two years after completing the program. Another 179 participants formulated a total of 261 intended changes concerning the sexual history taking, additional investigation and treatment of STI, 97.2% of these changes was partially or fully implemented in daily practice. Also, 114 participants formulated a total of 180 “unintended” changes in daily practice. These changes concerned the attitude of participants towards STI and the working conditions concerning the STI-consultation.

Conclusion: The individual, online e-learning program “The STI-consultation”, which uses the CtC-method, has a small but lasting, positive effect on the knowledge, attitude, and behavior of GPs concerning the STI-consultation.

To read the full article click here…

ABSTRACT: How Exemplary Inpatient Teaching Physicians Foster Clinical Reasoning

PURPOSE:
Clinical reasoning is a crucial component of training in health professions. These cognitive skills are necessary to provide quality care and avoid diagnostic error. Much previous literature has focused on teaching clinical reasoning in non-clinical environments and does not include learner reflections. The authors sought to explore, through multiple perspectives including learners, techniques employed by exemplary inpatient clinician-educators for explicitly cultivating clinical reasoning.
METHODS:
The authors conducted (2014-2015) a multi-site, exploratory qualitative study examining how excellent clinician-educators foster clinical reasoning during general medicine rounds. This was accomplished through interviews of educators, focus group discussions with learners, and direct observations of clinical teaching. The authors reviewed field notes and transcripts using techniques of thematic analysis.
RESULTS:
Twelve clinician-educators, 57 current learners, and 26 former learners participated in observations and interviews. The techniques and behaviors of educators were categorized into four themes including 1) emphasizing organization and prioritization, 2) accessing prior knowledge, 3) thinking aloud, and 4) analyzing the literature.
CONCLUSIONS:
The findings of this comprehensive study both confirm strategies found in previous literature and provide novel approaches. This is the first study to incorporate the perspectives of learners. Educators’ techniques and behaviors, identified through direct observation and supported by reflections from the entire team, can inform best practices for the teaching of clinical reasoning.

via How Exemplary Inpatient Teaching Physicians Foster Clinical Reasoning. – PubMed – NCBI.

ABSTRACT: Motivating medical students by utilizing dermatology-oriented online quizzes

BACKGROUND:
Online quiz competitions can facilitate extra-classroom interactions between faculty and medical students. Owing to decreased class attendance nationwide, teaching faculty might revamp their approach to medical education by providing online resources and methods for communication.
OBJECTIVE:
To explore if the use of online quizzes and social media can result in improved interactions between faculty and students.
METHODS:
A pilot study conducted from April 7th, 2015 to June 11th, 2015 at Northeast Ohio Medical University (NEOMED) among participants from the second year medical school class. Ten one-question quizzes created using Google Forms were announced over Twitter and email at the rate of one quiz per week. The first correct responder of each quiz chose a five-dollar coffee shop gift card, movie ticket, or a meeting with a NEOMED faculty person as their prize.
RESULTS:
An average of 23.8% of the second year medical student class at NEOMED participated per quiz. A total of 80 individuals (55.9%) submitted 340 responses during the competition.
LIMITATIONS:
This is a single-center study with a limited sample size.
CONCLUSIONS AND RELEVANCE:
This study presents a process evaluation for the use of online quiz competitions amongst medical students. Optional online quizzes with small incentives may foster motivational competition among medical students, increase online interactions with faculty, and serve as study material for exams.

via Motivating medical students by utilizing dermatology-oriented online quizzes. – PubMed – NCBI.

RESOURCE: About our Paper – What data and analytics can and do say about effective learning | npj Science of Learning Community

Our article, “What data and analytics can and do say about effective learning”, was published in the journal npj Science of Learning recently. The Nature Research team had a few questions for us about our article, which Linda Corrin and I have answered below.

What is learning analytics, and how does it differ from ‘traditional’ analysis of classroom learning through tests, essays and student–teacher interactions?

Learning analytics refers to the collection, integration and analysis of data across multiple sources (predominantly digital learning environments, student information systems etc.) for the purpose of understanding and enhancing student learning. The scope of learning analytics includes these “traditional” analyses and seeks to find new ways to understand and visualize the outcomes of the analysis. It also builds on these previous forms of analysis in education in that the data can now be derived from multiple sources and integrated to allow more sophisticated statistical analysis. The combined datasets can end up being quite large with many possible indicators of student progress and performance. These data can be used to detect patterns in student learning behaviour and performance beyond what was possible previously.

via About our Paper – What data and analytics can and do say about effective learning | npj Science of Learning Community.

MANUSCRIPT: What data and analytics can and do say about effective learning

The collection and analysis of data about learning is a trend that is growing exponentially in all levels of education. Data science is poised to have a substantial influence on the understanding of
learning in online and blended learning environments. The mass of data already being collected about student learning provides a source of greater insights into student learning that have not
previously been available, and therefore is liable to have a substantial impact on and be impacted by the science of learning in the years ahead.1
However, despite the potential evident in the application of data science to education, several recent articles, e.g.,2, 3 have pointed out that student behavioural data collected en masse do
not holistically capture student learning. Rogers4 contends that this positivist view of analytics in education is symptomatic of issues in the social sciences more broadly. While there is
undeniable merit in bringing a critical perspective to the use of data and analytics, we suggest that the power and intent of data science for understanding learning is now becoming apparent.
The intersection of the science of learning with data and analytics enables more sophisticated ways of making meaning to support student learning.

To read more click here…

 

Innovations in Education 2017 Symposium

Woke up this morning still energized by the lessons and discussions from yesterday! It was an absolute pleasure learning and sharing with more than 160 medical educators from throughout eastern Pennsylvania. Congratulations are deserved by the Division of Education in Lehigh Valley Health Network (@LVHN) for a wonderful event.

Here is a snapshot of what they pulled together (and what I was able to participate in):

  1. Crafting a Story of You for Resilience and Vitality Within Professional Identity Formation – Hedy S. Wald, PhD
  2. The Top Three Creative Teaching Strategies for 2017: Be Wise to What’s Up and Coming – Michele L. Deck, MEd
  3. Beyond the Classroom: Using Virtual and Social Learning Tools – Virginia Cooney, MS and Andrew Katz, MA
  4. How to Conquer Presentation Challenges and Avoid Common Pitfalls – Amy B. Smith, PhD, and Nicole Defenbaugh, PhD
  5. Igniting the Fire Presentation Style: Hospital-Based Interprofessional Simulation Program – Deborah S. Arnold, MSN, RN
  6. Effective Learning and Behavior Change Requires Time – yours truly

There is nothing like being there – and I have made many new connections that may last a career – but to give a sense of what was shared, I have pulled together my notes from the event in a simple Storify:

Continue Reading