MENUCLOSE

 

Connect with us

Author: Brian S McGowan, PhD

ABSTRACT: Enhancing retrieval of best evidence for health care from bibliographic databases: calibration of the hand search of the literature.

Abstract
BACKGROUND:
Medical practitioners have unmet information needs. Health care research dissemination suffers from both “supply” and “demand” problems. One possible solution is to develop methodologic search filters (“hedges”) to improve the retrieval of clinically relevant and scientifically sound study reports from bibliographic databases. To develop and test such filters a hand search of the literature was required to determine directly which articles should be retrieved, and which not retrieved.
OBJECTIVE:
To determine the extent to which 6 research associates can agree on the classification of articles according to explicit research criteria when hand searching the literature.
DESIGN:
Blinded, inter-rater reliability study.
SETTING:
Health Information Research Unit, McMaster University, Hamilton, Ontario, Canada. Participants: 6 research associates with extensive training and experience in research methods for health care research. Main outcome measure: Inter-rater reliability measured using the kappa statistic for multiple raters.
RESULTS:
After one year of intensive calibration exercises research staff were able to attain a level of agreement at least 80% greater than that expected by chance (kappa statistic) for all classes of articles.
CONCLUSION:
With extensive training multiple raters are able to attain a high level of agreement when classifying articles in a hand search of the literature.

via Enhancing retrieval of best evide… [Stud Health Technol Inform. 2001] – PubMed – NCBI.

MANUSCRIPT: The effect of training on question formulation among public health practitioners: results from a randomized controlled trial.

Abstract
OBJECTIVE:
To improve understanding of the information-seeking behaviors of public health professionals, the authors conducted this randomized controlled trial involving sixty participants to determine whether library and informatics training, with an emphasis on PubMed searching skills, increased the frequency and sophistication of participants’ practice-related questions.
METHODS:
The intervention group (n = 34) received evidence-based public health library and informatics training first, whereas the control group (n = 26) received identical training two weeks later. The frequency and sophistication of the questions generated by both intervention and control groups during the interim two-week period served as the basis for comparison.
RESULTS:
The intervention group reported an average of almost 1.8 times more questions than those reported by the control group (1.24 vs. 0.69 questions per participant); however, this difference did not reach statistical significance. The intervention group overall produced more sophisticated (foreground) questions than the control group (18 vs. 9); however, this difference also did not reach statistical significance.
CONCLUSION:
The training provided in the current study seemed to prompt public health practitioners to identify and articulate questions more often. Training appears to create the necessary precondition for increased information-seeking behavior among public health professionals.

via The effect of training on question formulat… [J Med Libr Assoc. 2008] – PubMed – NCBI.

ABSTRACT: Errors in search strategies were identified by type and frequency.

Abstract
OBJECTIVE:
Errors in the electronic search strategy of a systematic review may undermine the integrity of the evidence base used in the review. We studied the frequency and types of errors in reviews published by the Cochrane Collaboration.
STUDY DESIGN AND SETTING:
Data sources were MEDLINE searches from reviews in the Cochrane Library, Issue 3, 2002. To be eligible, systematic reviews must have been of randomized or quasi-randomized controlled trials, reported included and excluded studies, and used one or more sections of the Cochrane Collaboration’s Highly Sensitive Search Strategy. MEDLINE search strategies not reported in enough detail to be assessed or that were duplicates of a search strategy already assessed for the study were excluded. Two librarians assessed eligibility and scored the eligible electronic search strategies for 11 possible errors. Dual review with consensus was used.
RESULTS:
Of 105 MEDLINE search strategies examined, 63 were assessed; 31 were excluded because they were inadequately reported, and 11 were duplicates of assessed search strategies. Most (90.5%) of the assessed search strategies contained > or =1 errors (median 2, interquartile range [IQR] 1.0-3.0). Errors that could potentially lower recall of relevant studies were found in 82.5% (median 1, IQR 1.0-2.0) and inconsequential errors (to the evidence base) were found in 60.3% (median 1, IQR 0.0-1.0) of the search strategies. The most common search errors were missed MeSH terms (44.4%), unwarranted explosion of MeSH terms (38.1%), and irrelevant MeSH or free text terms (28.6%). Missed spelling variants, combining MeSH and free text terms in the same line, and failure to tailor the search strategy for other databases occurred with equal frequency (20.6%). Logical operator error occurred in 19.0% of searches.
CONCLUSION:
When the MEDLINE search strategy used in a systematic review is reported in enough detail to allow assessment, errors are commonly revealed. Additional peer review steps are needed to ensure search quality and freedom from errors.

via Errors in search strategies were identified… [J Clin Epidemiol. 2006] – PubMed – NCBI.

MANUSCRIPT: A survey of the use of electronic scientific information resources among medical and dental students.

Abstract
BACKGROUND:
To evaluate medical and dental students’ utilization of electronic information resources.
METHODS:
A web survey sent to 837 students (49.9% responded).
RESULTS:
Twenty-four per cent of medical students and nineteen per cent of dental students searched MEDLINE 2+ times/month for study purposes, and thiry-two per cent and twenty-four per cent respectively for research. Full-text articles were used 2+ times/month by thirty-three per cent of medical and ten per cent of dental students. Twelve per cent of respondents never utilized either MEDLINE or full-text articles. In multivariate models, the information-searching skills among students were significantly associated with use of MEDLINE and full-text articles.
CONCLUSION:
Use of electronic resources differs among students. Forty percent were non-users of full-text articles. Information-searching skills are correlated with the use of electronic resources, but the level of basic PC skills plays not a major role in using these resources. The student data shows that adequate training in information-searching skills will increase the use of electronic information resources.

via A survey of the use of electronic scientific in… [BMC Med Educ. 2006] – PubMed – NCBI.

MANUSCRIPT: Searching bibliographic databases for literature on chronic disease and work participation.

Abstract
BACKGROUND:
The work participation of people with chronic diseases is a growing concern within the field of occupational medicine. Information on this topic is dispersed across a variety of data sources, making it difficult for health professionals to find relevant studies for literature reviews and guidelines.
AIM:
The goal of this project was to identify bibliographic databases and search terms that could be most useful for retrieving relevant studies on this topic.
METHODS:
Five broad questions regarding work participation and chronic disease were formulated, focusing on angina pectoris, depression, diabetes mellitus, hearing impairment and rheumatoid arthritis. A search strategy for retrieving information on these questions was developed and run in five bibliographic databases: Medline, EMBASE, PsycINFO, Cinahl and OSHROM. Relevant publications were selected from the search results. The utility of the selected databases and search terms was evaluated by analysing the number of relevant publications that were retrieved.
RESULTS:
The number of relevant publications retrieved from each database varied. Most (84%) of the relevant publications that were retrieved from each database were unique to that source. For each database, specific search terms for the concept of ‘work’ were useful for retrieving relevant publications.
CONCLUSION:
Medline, EMBASE and PsycINFO are useful databases for quick searches. Useful search terms for the concept of ‘work’ are work capacity, work disability, vocational rehabilitation, occupational health, sick leave, absenteeism, return to work, retirement, employment status and work status. For comprehensive searches, we recommend additional searches in Cinahl and OSHROM, adapting the search terms to specific databases

via Searching bibliographic databases for liter… [Occup Med (Lond). 2006] – PubMed – NCBI.

MANUSCRIPT: Developing optimal search strategies for detecting clinically sound and relevant causation studies in EMBASE.

Abstract
BACKGROUND:
Evaluating the existence and strength of an association between a putative cause and adverse clinical outcome is complex and best done by assessing all available evidence. With the increasing burden of chronic disease, greater time demands on health professionals, and the explosion of information, effective retrieval of best evidence has become both more important and more difficult. Optimal search retrieval can be hampered by a number of obstacles, especially poor search strategies, but using empirically tested methodological search filters can enhance the accuracy of searches for sound evidence concerning etiology. Although such filters have previously been developed for studies of relevance to causation in MEDLINE, no empirically tested search strategy exists for EMBASE.
METHODS:
An analytic survey was conducted, comparing hand searches of journals with retrievals from EMBASE for candidate search terms and combinations. 6 research assistants read all issues of 55 journals indexed in EMBASE. All articles were rated using purpose and quality indicators and categorized into clinically relevant original studies, review articles, general papers, or case reports. The original and review articles were then categorized as ‘pass’ or ‘fail’ for scientific merit according to explicit criteria in the areas of causation (etiology) and other clinical topics. Candidate search strategies were developed for causation, then run in a subset of 55 EMBASE journals, the retrievals being compared with the hand search data. The sensitivity, specificity, precision, and accuracy of the search strategies were calculated.
RESULTS:
Of the 1489 studies classified as causation, 14% were methodologically sound. When search terms were combined, sensitivity reached 92%. Compared with the best single-term strategy, the best combination of terms resulted in an absolute increase in sensitivity (19%) and specificity (5.2%). Maximizing specificity for combined terms resulted in an increase of 7.1% compared with the single term but this came at an expense of sensitivity (39% absolute decrease). A search strategy that optimized the trade-off between sensitivity and specificity achieved 81.9% for sensitivity and 81.4% for specificity.
CONCLUSION:
We have discovered search strategies that retrieve high quality studies of causation from EMBASE with high sensitivity, high specificity, or an optimal balance of each.

via Developing optimal search strategie… [BMC Med Inform Decis Mak. 2005] – PubMed – NCBI.

ABSTRACT: Evaluating information skills training in health libraries: a systematic review.

Abstract
INTRODUCTION:
Systematic reviews have shown that there is limited evidence to demonstrate that the information literacy training health librarians provide is effective in improving clinicians’ information skills or has an impact on patient care. Studies lack measures which demonstrate validity and reliability in evaluating the impact of training.
AIM:
To determine what measures have been used; the extent to which they are valid and reliable; to provide guidance for health librarians who wish to evaluate the impact of their information skills training.
METHODS:
Data sources: Systematic review methodology involved searching seven databases, and personal files. Study selection: Studies were included if they were about information skills training, used an objective measure to assess outcomes, and occurred in a health setting.
RESULTS:
Fifty-four studies were included in the review. Most outcome measures used in the studies were not tested for the key criteria of validity and reliability. Three tested for validity and reliability are described in more detail.
CONCLUSIONS:
Selecting an appropriate measure to evaluate the impact of training is a key factor in carrying out any evaluation. This systematic review provides guidance to health librarians by highlighting measures used in various circumstances, and those that demonstrate validity and reliability.

via Evaluating information skills training in… [Health Info Libr J. 2007] – PubMed – NCBI.

MANUSCRIPT: Management of bibliographic information by Dutch researchers in general practice.

Abstract
BACKGROUND:
As a result of changes in information technology and the rapid growth of publications methods of searching the literature have changed. Systematic searching of the growing literature has become very important. It is not known whether researchers in general practice search systematically, and whether they have incorporated computerized sources in their research practice.
OBJECTIVES AND METHODS:
We aimed to assess the methods of literature research used by GPs. We interviewed eight GP researchers, two information specialists and a psychologist working in primary health care organizations.
RESULTS:
The GP researchers began their search in their private book collections, or asked colleagues for information. Later in the search process, they used computerized information sources. Medline on CD-ROM and the computer-based indexes of two Dutch journals were most widely used. The GPs found it difficult to locate the appropriate terms to describe their research questions. Knowledge of the methodology of literature research, and skills required to use the information sources efficiently were lacking. There was a need for instruction and training in the use of information sources. GPs need a telephone help desk where their questions can be answered adequately.
CONCLUSIONS:
GP researchers search the literature unsystematically. Although computerized databases were being used, knowledge and skills related to the use of these information sources must be improved.

via Management of bibliographic information by Dutch r… [Fam Pract. 1997] – PubMed – NCBI.

ABSTRACT: Teaching and assessing the database searching skills of student nurses.

Abstract
Critical appraisal and application of the evidence to practice cannot proceed without first finding the evidence. To teach evidence-based practice database searching skills to students, a nurse educator partnered with a librarian to design, conduct, and assess instruction. The authors describe the creation, administration, and findings from the assessments and the implications for instruction.

via Teaching and assessing the database searc… [Nurse Educ. 2007 Nov-Dec] – PubMed – NCBI.

MANUSCRIPT: Teaching clinical informatics to third-year medical students: negative results from two controlled trials.

Abstract
BACKGROUND:
Prior educational interventions to increase seeking evidence by medical students have been unsuccessful.
METHODS:
We report two quasirandomized controlled trials to increase seeking of medical evidence by third-year medical students. In the first trial (1997-1998), we placed computers in clinical locations and taught their use in a 6-hour course. Based on negative results, we created SUMSearch, an Internet site that automates searching for medical evidence by simultaneous meta-searching of MEDLINE and other sites. In the second trial (1999-2000), we taught SUMSearch’s use in a 5(1/2)-hour course. Both courses were taught during the medicine clerkship. For each trial, we surveyed the entire third-year class at 6 months, after half of the students had taken the course (intervention group). The students who had not received the intervention were the control group. We measured self-report of search frequency and satisfaction with search quality and speed.
RESULTS:
The proportion of all students who reported searching at least weekly for medical evidence significantly increased from 19% (1997-1998) to 42% (1999-2000). The proportion of all students who were satisfied with their search results increased significantly between study years. However, in neither study year did the interventions increase searching or satisfaction with results. Satisfaction with the speed of searching was 27% in 1999-2000. This did not increase between studies years and was not changed by the interventions.
CONCLUSION:
None of our interventions affected searching habits. Even with automated searching, students report low satisfaction with search speed. We are concerned that students using current strategies for seeking medical evidence will be less likely to seek and appraise original studies when they enter medical practice and have less time.

via Teaching clinical informatics to third-year med… [BMC Med Educ. 2001] – PubMed – NCBI.