MENUCLOSE

 

Connect with us

Author: Brian S McGowan, PhD

RESOURCE: Why Online Programs Fail, and 5 Things We Can Do About It | Online Learning | HYBRID PEDAGOGY

Online learning in its current iterations will fail.

The failure of online education programs is not logistical, nor political, nor economic: it’s cultural, rooted in our perspectives and biases about how learning happens and how the internet works (these things too often seen in opposition). For learning to change drastically — a trajectory suggested but not yet realized by the rise of MOOCs — teaching must change drastically. And in order for that to happen, we must conceive of the activity of teaching, as an occupation and preoccupation, in entirely new and unexpected ways. We must unseat ourselves, unnerve ourselves. Online learning is uncomfortable, and so educators must become uncomfortable in their positions as teachers and pedagogues. And the administration of online programs must follow suit.

It’s important for us to be very specific about what we mean by failure. There are two kinds of failure we want to discuss here. The first kind of failure — an improper failure — does damage, breeds limitations, shuts down critical thinking, and disengages us from our pedagogical or learning processes. Our ethical commitment to students and the enterprise of education is too strong to abide this kind of failure.

via Why Online Programs Fail, and 5 Things We Can Do About It | Online Learning | HYBRID PEDAGOGY.

RESOURCE: First look at analysing threaded Twitter discussions from large archives using NodeXL #moocmooc Jisc CETIS MASHe

There are three main reactions that are relatively easy to extract from twitter: retweets, favouring and replies. There are issues with what these actions actually indicate as well as the reliability of the data. For example users will use ‘favouring’ in different ways, and not everyone uses a twitter client that can or uses a reply tweet (if you start a message @reply without clicking a reply button Twitter looses the thread).

But lets ignore these issues for now and start with the hypothesis that a reaction to a tweet is worth further study. Lets also, for now, narrow down on threaded discussions. How might we do this? As mentioned in Sheila’s post we’ve been archiving #moocmooc tweets using Twitter Archiving Google Spreadsheet TAGS v3. As well as the tweet text other metadata is recorded including a tweet unique identifier and, where available the id of the tweet it is replying to.

via First look at analysing threaded Twitter discussions from large archives using NodeXL #moocmooc Jisc CETIS MASHe.

RESOURCE: MOOCagogy: Assessment, Networked Learning, and the Meta-MOOC | Online Learning | HYBRID PEDAGOGY

Instruction does not equate to learning. This is the fundamental fly in the ointment of instructional design, and the epistemological failing of learning management systems and most MOOC platforms. Learning, unfortunately, is something no instruction has ever quite put its finger on, and something that no methodology or approach can guarantee. Instead, pedagogical praxis creates roads along which learning may take place along with plenty of other experiences; and assessment is merely a system of checkpoints along the way to evaluate how well the road, the vehicle, and the driver are cooperating. In other words, assessment doesn’t measure learning. Assessment measures the design of the instruction.According to old systems of instruction, massive open online courses are no different from other forms of online learning which are no different from correspondence courses. They are click-to-read-the-next-lesson environments that guide readers/students down a specific path where information in the guise of learning material has been contained so that it may be mastered. Learning is meant to happen in coordinated steps, and as long as preconceived outcomes appear to be met, it’s a supposed win-win for students and teachers.

via MOOCagogy: Assessment, Networked Learning, and the Meta-MOOC | Online Learning | HYBRID PEDAGOGY.

Is adult learning theory enough?

For the past 20 years the professional guild of healthcare educators has been increasingly leveraging adult learning theory in the development of content and in the delivery of content to clinician learners. And every few years a meta-analysis is published exploring the impact of this education on knowledge change or attitudes or skills development.  And while there is little doubt that progress has been made, there remains this persistent reality that healthcare professional education is far from perfect, that despite what appear to be short-term advances in understanding and confidence, these changes rarely lead to the sustained ‘rapid learning healthcare system’ that is so desperately needed. This begs the question, why is knowledge transfer and knowledge translation so challenging in healthcare? And, what is missing from these educational programs that prevents them from driving broad scale and meaningful change?

These questions have bothered me for some time – without answers it seems that the profession of healthcare educators will continue to employ the same models, leveraging the same adult learning theory time after time after time again, without understanding what is missing. By all accounts, this is the definition of insanity…

Over the past 8-12 months we have spent a lot of time exploring these questions, but we have framed our exploration around a rather contradictory hypothesis: Instead of assuming the secret lies in the currently recognized adult learning theory, we began by assuming that these theories in and of themselves ARE NOT sufficient to drive learning. That is not to say that they are not important, simply to say that something else is needed.

This lead to our deconstruction of the learning process itself – what do clinician learners do as they receive the educational content being developed and delivered by healthcare educators?

And in brief, here is what we found:

Clinicians learners acknowledge that there are a distinct set of actions that they must take to ensure that medical education is successful. When these actions are efficiently and effectively taken learners describe their participation in medical education activities as being among ‘the most memorable learning experiences of their careers.’ But, when learners struggle to employ these learning  actions they describe their participation in medical education activities as being ‘hit or miss at best.’ This preliminary research suggests that without an adequate structure to support the ‘natural learning actions’ clinician learners are unable to learn effectively and instead are forced to take away one or two nuggets of information, ignoring 80-90% of the content that is available. And this, it seems, is the norm, not the exception.Self-Directed Clinician Learning_Small

Over the coming weeks we will be rolling out the next stages of our research program, we will be studying how clinicians leverage their learning actions in different settings, and we will be exploring whether different subsets of clinicians leverage different learning actions in different ways. These data will be collected from a number of continuing educational initiatives that we will be launching with our partner groups, and these data will be collected in partnership with several leading Academic Medical Centers, Medical Schools, and Medical Societies who have agreed to conduct more controlled studies in both the undergraduate and post-graduate settings and with different clinical disciplines.As an educator, this is truly frustrating and it is hard to look past the missed opportunities, but it is also very exciting – with this new understanding of what is needed we have begun to redefine the roles and obligations of the educator. It is no longer acceptable to develop, package, and deliver content to learners absent of a supportive structure that ensures the learning actions are effectively employed. Being an educator is more than understanding needs and creating content. Being an educator is more than providing lip service to the adult learning theory.

While there is little doubt that medical education is an essential element in the quality of healthcare both in the US and abroad, there is also very little doubt that our existing medical education models are far from having the impact that is needed. Our goal is to take a novel and evidence-based approach to this challenge. Our ask is that you think through how these new lessons might be applied in your setting and in you programs and that you remain open to the reality that the adult learning theories we have leveraged for decades, may not be enough to drive sustainable, critical learning and change.

 

 

 

ABSTRACT: A tailored educational intervention improves doctor’s performance in managing depression: a randomized controlled trial.

RATIONAL AND OBJECTIVES:
To assess the effects of a tailored and activating educational intervention, based on a three-stage modified Prochaska model of readiness-to-change, on the performance of general physicians in primary care (GPs) regarding management of depressive disorders.
METHODS:
Parallel group, randomized control trial. Primary hypothesis was that performance would improve by 20 percentage units in the intervention arm. The setting was primary care in southern Tehran. The participants were 192 GPs stratified on stage of readiness-to-change, sex, age and work experience. The intervention was a 2-day interactive workshop for a small group of GPs’ at a higher stage of readiness-to-change (‘intention’) and a 2-day interactive large group meeting for those with lower propensity to change (‘attitude’) at the pre-assessment. GPs in the control arm participated in a standard educational programme on the same topic. The main outcome measures were validated tools to assess GPs’ performance by unannounced standardized patients, regarding diagnosis and treatment of depressive disorders. The assessments were made 2 months before and 2 months after the intervention.
RESULTS:
GPs in the intervention arm significantly improved their overall mean scores for performance regarding both diagnosis, with an intervention effect of 14 percentage units (P = 0.007), and treatment and referral, with an intervention effect of 20 percentage units (P < 0.0001). The largest improvement after the intervention appeared in the small group: 30 percentage units for diagnosis (P = 0.027) and 29 percentage units for treatment and referral (P < 0.0001).
CONCLUSIONS:
Activating learning methods, tailored according to the participants’ readiness to change, improved clinical performance of GPs in continuing medical education and can be recommended for continuing professional development.

via A tailored educational intervention improv… [J Eval Clin Pract. 2013] – PubMed – NCBI.

MANUSCRIPT: To observe or not to observe peers when learning physical examination skills; that is the question

BACKGROUND:
Learning physical examination skills is an essential element of medical education. Teaching strategies include practicing the skills either alone or in-group. It is unclear whether students benefit more from training these skills individually or in a group, as the latter allows them to observing their peers. The present study, conducted in a naturalistic setting, investigated the effects of peer observation on mastering psychomotor skills necessary for physical examination.
METHODS:
The study included 185 2nd-year medical students, participating in a regular head-to-toe physical examination learning activity. Students were assigned either to a single-student condition (n = 65), in which participants practiced alone with a patient instructor, or to a multiple-student condition (n = 120), in which participants practiced in triads under patient instructor supervision. The students subsequently carried out a complete examination that was videotaped and subsequently evaluated. Student’s performance was used as a measure of learning.
RESULTS:
Students in the multiple-student condition learned more than those who practiced alone (81% vs 76%, p < 0.004). This result possibly derived from a positive effect of observing peers; students who had the possibility to observe a peer (the second and third students in the groups) performed better than students who did not have this possibility (84% vs 76%, p <. 001). There was no advantage of observing more than one peer (83.7% vs 84.1%, p > .05).
CONCLUSIONS:
The opportunity to observe a peer during practice seemed to improve the acquisition of physical examination skills. By using small groups instead of individual training to teach physical examination skills, health sciences educational programs may provide students with opportunities to improve their performance by learning from their peers through modelli

via To observe or not to observe peers when learnin… [BMC Med Educ. 2013] – PubMed – NCBI.

ABSTRACT: Medical Education: Part of the Problem and Part of the Solution.

Medical education today is pedagogically superb, but the graduates of our educational programs are still unable to successfully translate decades of biomedical advances into health care that reliably meets the Institute of Medicine quality criteria. Realizing the promise of high-quality health care will require that medical educators accept that they must fulfill their contract with society to reduce the burden of suffering and disease through the education of physicians. Educational redesign must begin with the understanding that the professional identity of the physician who was successful in the acute disease era of the 20th century will not be effective in the complex chronic disease era of the 21st century. Medical schools and residency programs must restructure their views of basic and clinical science and workplace learning to give equal emphasis to the science and skills needed to practice in and lead in complex systems. They must also rethink their relationships with clinical environments so that the education of students and residents accelerates the transformation in health care delivery needed to fulfill our contract with society.

via Medical Education: Part of the Problem and P… [JAMA Intern Med. 2013] – PubMed – NCBI.

ABSTRACT: Assessing competencies during education in psychiatry

Abstract The utilization of competencies in medical education is relatively recent. In 1999 the United States Accreditation Council for Graduate Medical Education (ACGME) established six main competencies. Since then, the American Board of Psychiatry and Neurology have approved a specific list of competencies for their specialities in each of the ACGME’s core competency areas. Assessment of competencies in both medical students and residents can be achieved through such methods as structured case discussion, direct observation, simulation, standardized patients, and 360-degree assessments, etc. Each assessment methodology has specific applications in the discipline of psychiatry. This paper reviews the different methods for assessing competencies with specific examples in psychiatric education. It is not intended as a comprehensive review of all assessment methods, but to provide examples and strategies to guide psychiatric educators in their practice. Students and residents were intentionally separated because there are differences in the teaching goals and objectives, and thus in the assessment purposes and design. Students are general, undifferentiated physicians-in-training who need to learn about psychiatric nosology, examinations, and treatment. Residents are mental health professionals who need more in-depth supervision in order to hone skills in all the specialized areas that arise in psychiatric practices, making supervision a vital part of residency programs.

via Assessing competencies during education i… [Int Rev Psychiatry. 2013] – PubMed – NCBI.

ABSTRACT: Journal club for faculty or residents: A model for lifelong learning and maintenance of certification

Abstract The journal club offers a model for lifelong learning and maintenance of certification (MOC) for residents and faculty staff. First, it sharpens participants’ critical appraisal skills by providing a space to discuss relevant medical literature. Second, it motivates participants to seek new medical literature on their own using technology. Our model sets forth a four-year journal club curriculum that could be used as one continuous curriculum or in bits and pieces. In the first year, the focus is teaching residents how to read an article. The second year focuses on what is of interests to the reader. The third year applies the resident’s appraisal skills to assigned articles to test whether they can determine which have reliable and valid findings and which are flawed. In the fourth year residents are asked to distinguish whether articles are well researched and referenced. Our model also motivates participants to read articles in faculty journal clubs throughout their career. In most academic settings category 1 continuing medical education (CME) credits can be awarded so journal club can have the added benefit of satisfying maintenance of certification CME credits. From journal club both residents and faculty can learn what is new and learn to apply this new information in their practice. Finally, because technology creates an overabundance of relevant medical literature, participants using our model can develop strong critical appraisal skills and methods for organizing the information they find that make this information readily available for future use and retrieval.

via Journal club for faculty or residents: A … [Int Rev Psychiatry. 2013] – PubMed – NCBI.

ABSTRACT: Methodologies and study designs relevant to medical education research

Abstract Research is an important part of educational scholarship. Knowledge of research methodologies is essential for both conducting research as well as determining the soundness of the findings from published studies. Our goals for this paper therefore are to inform medical education researchers of the range and key components of educational research designs. We will discuss both qualitative and quantitative approaches to educational research. Qualitative methods will be presented according to traditions that have a distinguished history in particular disciplines. Quantitative methods will be presented according to an evidence-based hierarchy akin to that of evidence-based medicine with the stronger designs (systematic reviews and well conducted educational randomized controlled trials) at the top, and weaker designs (descriptive studies without comparison groups, or single case studies) at the bottom. It should be appreciated, however, that the research question determines the study design. Therefore, the onus is on the researcher to choose a design that is appropriate to answering the question. We conclude with an overview of how educational researchers should describe the study design and methods in order to provide transparency and clarity

via Methodologies and study designs relevant … [Int Rev Psychiatry. 2013] – PubMed – NCBI.