Can electronic search engines optimize screening of search results in systematic reviews: an empirical study.

Abstract:

BACKGROUND:Most electronic search efforts directed at identifying primary studies for inclusion in systematic reviews rely on the optimal Boolean search features of search interfaces such as DIALOG and Ovid. Our objective is to test the ability of an Ultraseek search engine to rank MEDLINE records of the included studies of Cochrane reviews within the top half of all the records retrieved by the Boolean MEDLINE search used by the reviewers. METHODS:Collections were created using the MEDLINE bibliographic records of included and excluded studies listed in the review and all records retrieved by the MEDLINE search. Records were converted to individual HTML files. Collections of records were indexed and searched through a statistical search engine, Ultraseek, using review-specific search terms. Our data sources, systematic reviews published in the Cochrane library, were included if they reported using at least one phase of the Cochrane Highly Sensitive Search Strategy (HSSS), provided citations for both included and excluded studies and conducted a meta-analysis using a binary outcome measure. Reviews were selected if they yielded between 1000-6000 records when the MEDLINE search strategy was replicated. RESULTS:Nine Cochrane reviews were included. Included studies within the Cochrane reviews were found within the first 500 retrieved studies more often than would be expected by chance. Across all reviews, recall of included studies into the top 500 was 0.70. There was no statistically significant difference in ranking when comparing included studies with just the subset of excluded studies listed as excluded in the published review. CONCLUSION:The relevance ranking provided by the search engine was better than expected by chance and shows promise for the preliminary evaluation of large results from Boolean searches. A statistical search engine does not appear to be able to make fine discriminations concerning the relevance of bibliographic records that have been pre-screened by systematic reviewers.

journal_name

BMC Med Res Methodol

authors

Sampson M,Barrowman NJ,Moher D,Clifford TJ,Platt RW,Morrison A,Klassen TP,Zhang L

doi

10.1186/1471-2288-6-7

keywords:

subject

Has Abstract

pub_date

2006-02-24 00:00:00

pages

7

issn

1471-2288

pii

1471-2288-6-7

journal_volume

6

pub_type

杂志文章
  • Crowding in the emergency department in the absence of boarding - a transition regression model to predict departures and waiting time.

    abstract:BACKGROUND:Crowding in the emergency department (ED) is associated with increased mortality, increased treatment cost, and reduced quality of care. Crowding arises when demand exceed resources in the ED and a first sign may be increasing waiting time. We aimed to quantify predictors for departure from the ED, and relat...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0710-3

    authors: Eiset AH,Kirkegaard H,Erlandsen M

    更新日期:2019-03-29 00:00:00

  • On the censored cost-effectiveness analysis using copula information.

    abstract:BACKGROUND:Information and theory beyond copula concepts are essential to understand the dependence relationship between several marginal covariates distributions. In a therapeutic trial data scheme, most of the time, censoring occurs. That could lead to a biased interpretation of the dependence relationship between ma...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0305-9

    authors: Fontaine C,Daurès JP,Landais P

    更新日期:2017-02-15 00:00:00

  • Parental compliance--an emerging problem in Liverpool community child health surveys 1991-2006.

    abstract:BACKGROUND:Compliance is a critical issue for parental questionnaires in school based epidemiological surveys and high compliance is difficult to achieve. The objective of this study was to determine trends and factors associated with parental questionnaire compliance during respiratory health surveys of school childre...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-53

    authors: Koshy G,Brabin BJ

    更新日期:2012-04-20 00:00:00

  • Telephone and face to face methods of assessment of veteran's community reintegration yield equivalent results.

    abstract:BACKGROUND:The Community Reintegration of Service Members (CRIS) is a new measure of community reintegration developed to measure veteran's participation in life roles. It consists of three sub-scales: Extent of Participation (Extent), Perceived Limitations with Participation (Perceived), and Satisfaction with Particip...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/1471-2288-11-98

    authors: Resnik LJ,Clark MA,Borgia M

    更新日期:2011-06-25 00:00:00

  • Forecasts of COPD mortality in Australia: 2006-2025.

    abstract:BACKGROUND:Chronic Obstructive Pulmonary Disease (COPD) is currently the fifth leading cause of death in Australia, and there are marked differences in mortality trends between men and women. In this study, we have sought to model and forecast age related changes in COPD mortality over time for men and women separately...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-17

    authors: Erbas B,Ullah S,Hyndman RJ,Scollo M,Abramson M

    更新日期:2012-02-21 00:00:00

  • A methodological systematic review of what's wrong with meta-ethnography reporting.

    abstract:BACKGROUND:Syntheses of qualitative studies can inform health policy, services and our understanding of patient experience. Meta-ethnography is a systematic seven-phase interpretive qualitative synthesis approach well-suited to producing new theories and conceptual models. However, there are concerns about the quality ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/1471-2288-14-119

    authors: France EF,Ring N,Thomas R,Noyes J,Maxwell M,Jepson R

    更新日期:2014-11-19 00:00:00

  • Outcome-sensitive multiple imputation: a simulation study.

    abstract:BACKGROUND:Multiple imputation is frequently used to deal with missing data in healthcare research. Although it is known that the outcome should be included in the imputation model when imputing missing covariate values, it is not known whether it should be imputed. Similarly no clear recommendations exist on: the util...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0281-5

    authors: Kontopantelis E,White IR,Sperrin M,Buchan I

    更新日期:2017-01-09 00:00:00

  • The use of relative incidence ratios in self-controlled case series studies: an overview.

    abstract:BACKGROUND:The self-controlled case series (SCCS) is a useful design for investigating associations between outcomes and transient exposures. The SCCS design controls for all fixed covariates, but effect modification can still occur. This can be evaluated by including interaction terms in the model which, when exponent...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0225-0

    authors: Hawken S,Potter BK,Little J,Benchimol EI,Mahmud S,Ducharme R,Wilson K

    更新日期:2016-09-23 00:00:00

  • Flexible parametric modelling of cause-specific hazards to estimate cumulative incidence functions.

    abstract:BACKGROUND:Competing risks are a common occurrence in survival analysis. They arise when a patient is at risk of more than one mutually exclusive event, such as death from different causes, and the occurrence of one of these may prevent any other event from ever happening. METHODS:There are two main approaches to mode...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-13

    authors: Hinchliffe SR,Lambert PC

    更新日期:2013-02-06 00:00:00

  • Estimating cardiovascular disease incidence from prevalence: a spreadsheet based model.

    abstract:BACKGROUND:Disease incidence and prevalence are both core indicators of population health. Incidence is generally not as readily accessible as prevalence. Cohort studies and electronic health record systems are two major way to estimate disease incidence. The former is time-consuming and expensive; the latter is not av...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0288-y

    authors: Hu XF,Young K,Chan HM

    更新日期:2017-01-23 00:00:00

  • Pan-Canadian assessment of pandemic immunization data collection: study methodology.

    abstract:BACKGROUND:The collection of individual-level pandemic (H1N1) 2009 influenza immunization data was considered important to facilitate optimal vaccine delivery and accurate assessment of vaccine coverage. These data are also critical for research aimed at evaluating the new vaccine's safety and effectiveness. Systems us...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-10-51

    authors: Pereira JA,Quach S,Heidebrecht C,Foisy J,Quan S,Finkelstein M,Sikora CA,Bettinger JA,Buckeridge DL,McCarthy A,Deeks S,Kwong JC,Public Health Agency of Canada\/Canadian Institutes of Health Research Influenza Research Network Vacc

    更新日期:2010-06-08 00:00:00

  • Randomised controlled comparison of the Health Survey Short Form (SF-12) and the Graded Chronic Pain Scale (GCPS) in telephone interviews versus self-administered questionnaires. Are the results equivalent?

    abstract:BACKGROUND:The most commonly used survey methods are self-administered questionnaires, telephone interviews, and a mixture of both. But until now evidence out of randomised controlled trials as to whether patient responses differ depending on the survey mode is lacking. Therefore this study assessed whether patient res...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/1471-2288-7-50

    authors: Lungenhausen M,Lange S,Maier C,Schaub C,Trampisch HJ,Endres HG

    更新日期:2007-11-22 00:00:00

  • Assessing genetic polymorphisms using DNA extracted from cells present in saliva samples.

    abstract:BACKGROUND:Technical advances following the Human Genome Project revealed that high-quality and -quantity DNA may be obtained from whole saliva samples. However, usability of previously collected samples and the effects of environmental conditions on the samples during collection have not been assessed in detail. In fi...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-170

    authors: Nemoda Z,Horvat-Gordon M,Fortunato CK,Beltzer EK,Scholl JL,Granger DA

    更新日期:2011-12-19 00:00:00

  • A random effects meta-analysis model with Box-Cox transformation.

    abstract:BACKGROUND:In a random effects meta-analysis model, true treatment effects for each study are routinely assumed to follow a normal distribution. However, normality is a restrictive assumption and the misspecification of the random effects distribution may result in a misleading estimate of overall mean for the treatmen...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0376-7

    authors: Yamaguchi Y,Maruo K,Partlett C,Riley RD

    更新日期:2017-07-19 00:00:00

  • Suitability of administrative claims databases for bariatric surgery research - is the glass half-full or half-empty?

    abstract:BACKGROUND:Claims databases are generally considered inadequate for obesity research due to suboptimal capture of body mass index (BMI) measurements. This might not be true for bariatric surgery because of reimbursement requirements and changes in coding systems. We assessed the availability and validity of claims-base...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01106-8

    authors: Li X,Lewis KH,Callaway K,Wharam JF,Toh S

    更新日期:2020-09-07 00:00:00

  • Primary outcome reporting in adolescent depression clinical trials needs standardization.

    abstract:BACKGROUND:Evidence-based health care is informed by results of randomized clinical trials (RCTs) and their syntheses in meta-analyses. When the trial outcomes measured are not clearly described in trial publications, knowledge synthesis, translation, and decision-making may be impeded. While heterogeneity in outcomes ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01019-6

    authors: Monsour A,Mew EJ,Patel S,Chee-A-Tow A,Saeed L,Santos L,Courtney DB,Watson PN,Monga S,Szatmari P,Offringa M,Butcher NJ

    更新日期:2020-05-25 00:00:00

  • Estimating the loss of lifetime function using flexible parametric relative survival models.

    abstract:BACKGROUND:Within cancer care, dynamic evaluations of the loss in expectation of life provides useful information to patients as well as physicians. The loss of lifetime function yields the conditional loss in expectation of life given survival up to a specific time point. Due to the inevitable censoring in time-to-eve...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0661-8

    authors: Jakobsen LH,Andersson TM,Biccler JL,El-Galaly TC,Bøgsted M

    更新日期:2019-01-28 00:00:00

  • Consistency between stated and revealed preferences: a discrete choice experiment and a behavioural experiment on vaccination behaviour compared.

    abstract:BACKGROUND:Discrete Choice Experiments (DCEs) are increasingly used in studies in healthcare research but there is still little empirical evidence for the predictive value of these hypothetical situations in similar real life circumstances. The aim of this paper is to compare the stated preferences in a DCE and the acc...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-015-0010-5

    authors: Lambooij MS,Harmsen IA,Veldwijk J,de Melker H,Mollema L,van Weert YW,de Wit GA

    更新日期:2015-03-12 00:00:00

  • Using an onset-anchored Bayesian hierarchical model to improve predictions for amyotrophic lateral sclerosis disease progression.

    abstract:BACKGROUND:Amyotrophic Lateral Sclerosis (ALS), also known as Lou Gehrig's disease, is a rare disease with extreme between-subject variability, especially with respect to rate of disease progression. This makes modelling a subject's disease progression, which is measured by the ALS Functional Rating Scale (ALSFRS), ver...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-018-0479-9

    authors: Karanevich AG,Statland JM,Gajewski BJ,He J

    更新日期:2018-02-06 00:00:00

  • Getting under the skin of the primary care consultation using video stimulated recall: a systematic review.

    abstract:BACKGROUND:Video stimulated recall (VSR) is a method of enhancing participants' accounts of the consultation using a video recording of the event to encourage and prompt recall in a post consultation interview. VSR is used in education and education research, and to a lesser extent in medical and nursing research. Litt...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/1471-2288-14-101

    authors: Paskins Z,McHugh G,Hassell AB

    更新日期:2014-08-30 00:00:00

  • Measuring sidewalk distances using Google Earth.

    abstract:BACKGROUND:Physical activity is an important determinant of health. Walking is the most common physical activity performed by adults and the presence of sidewalks along roads is a determinant of walking. Geographic information systems (GIS) can be used to measure sidewalks; however, GIS sidewalk data are difficult to a...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-39

    authors: Janssen I,Rosu A

    更新日期:2012-03-29 00:00:00

  • The role of the clinical research coordinator--data manager--in oncology clinical trials.

    abstract:BACKGROUND:The purpose of this study was to determine the standard tasks performed by clinical research coordinators (CRCs) in oncology clinical trials. METHODS:Forty-one CRCs were anonymously surveyed, using a four-page self-administered questionnaire focused on demographics, qualifications, and professional experien...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-4-6

    authors: Rico-Villademoros F,Hernando T,Sanz JL,López-Alonso A,Salamanca O,Camps C,Rosell R

    更新日期:2004-03-25 00:00:00

  • A systematic review to investigate the measurement properties of goal attainment scaling, towards use in drug trials.

    abstract:BACKGROUND:One of the main challenges for drug evaluation in rare diseases is the often heterogeneous course of these diseases. Traditional outcome measures may not be applicable for all patients, when they are in different stages of their disease. For instance, in Duchenne Muscular Dystrophy, the Six Minute Walk Test ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/s12874-016-0205-4

    authors: Gaasterland CM,Jansen-van der Weide MC,Weinreich SS,van der Lee JH

    更新日期:2016-08-17 00:00:00

  • A system for rating the stability and strength of medical evidence.

    abstract:BACKGROUND:Methods for describing one's confidence in the available evidence are useful for end-users of evidence reviews. Analysts inevitably make judgments about the quality, quantity consistency, robustness, and magnitude of effects observed in the studies identified. The subjectivity of these judgments in several a...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-6-52

    authors: Treadwell JR,Tregear SJ,Reston JT,Turkelson CM

    更新日期:2006-10-19 00:00:00

  • Imputation of a true endpoint from a surrogate: application to a cluster randomized controlled trial with partial information on the true endpoint.

    abstract:BACKGROUND:The Anglia Menorrhagia Education Study (AMES) is a randomized controlled trial testing the effectiveness of an education package applied to general practices. Binary data are available from two sources; general practitioner reported referrals to hospital, and referrals to hospital determined by independent a...

    journal_title:BMC medical research methodology

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1186/1471-2288-3-17

    authors: Nixon RM,Duffy SW,Fender GR

    更新日期:2003-09-24 00:00:00

  • A random effects variance shift model for detecting and accommodating outliers in meta-analysis.

    abstract:BACKGROUND:Meta-analysis typically involves combining the estimates from independent studies in order to estimate a parameter of interest across a population of studies. However, outliers often occur even under the random effects model. The presence of such outliers could substantially alter the conclusions in a meta-a...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-19

    authors: Gumedze FN,Jackson D

    更新日期:2011-02-16 00:00:00

  • Measuring health-related quality of life in chronic obstructive pulmonary disease: properties of the EQ-5D-5L and PROMIS-43 short form.

    abstract:BACKGROUND:The Patient Reported Outcomes Measurement Information System 43-item short form (PROMIS-43) and the five-level EQ-5D (EQ-5D-5L) are recently developed measures of health-related quality of life (HRQL) that have potentially broad application in evaluating treatments and capturing burden of respiratory-related...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,多中心研究

    doi:10.1186/1471-2288-14-78

    authors: Lin FJ,Pickard AS,Krishnan JA,Joo MJ,Au DH,Carson SS,Gillespie S,Henderson AG,Lindenauer PK,McBurnie MA,Mularski RA,Naureckas ET,Vollmer WM,Lee TA,CONCERT Consortium.

    更新日期:2014-06-16 00:00:00

  • Health Equity Assessment Toolkit (HEAT): software for exploring and comparing health inequalities in countries.

    abstract:BACKGROUND:It is widely recognised that the pursuit of sustainable development cannot be accomplished without addressing inequality, or observed differences between subgroups of a population. Monitoring health inequalities allows for the identification of health topics where major group differences exist, dimensions of...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0229-9

    authors: Hosseinpoor AR,Nambiar D,Schlotheuber A,Reidpath D,Ross Z

    更新日期:2016-10-19 00:00:00

  • Novel study design to assess the utility of the copd assessment test in a primary care setting.

    abstract::The quality of a consultation provided by a physician can have a profound impact on the quality of care and patient engagement in treatment decisions. When the COPD Assessment Test (CAT) was developed, one of its aims was to aid the communication between physician and patient about the impact of COPD. We developed a n...

    journal_title:BMC medical research methodology

    pub_type: 信件

    doi:10.1186/1471-2288-13-63

    authors: Gruffydd-Jones K,Marsden H,Holmes S,Kardos P,Escamilla R,Dal Negro R,Roberts J,Nadeau G,Leather D,Jones P

    更新日期:2013-05-10 00:00:00

  • Using the Bernoulli trial approaches for detecting ordered alternatives.

    abstract:BACKGROUND:Diagnostic problems in clinical trials are sometimes ordinal. For example, colon tumor staging was performed according to the TNM classification. However, clinical data are limited by markedly small sample sizes in some stage. METHODS:We propose a distribution-free test for detecting ordered alternatives in...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-148

    authors: Chang CH,Chin CC,Yu WW,Huang YY

    更新日期:2013-12-05 00:00:00