Potential impact of missing outcome data on treatment effects in systematic reviews: imputation study.

Abstract:

OBJECTIVE:To assess the risk of bias associated with missing outcome data in systematic reviews. DESIGN:Imputation study. SETTING:Systematic reviews. POPULATION:100 systematic reviews that included a group level meta-analysis with a statistically significant effect on a patient important dichotomous efficacy outcome. MAIN OUTCOME MEASURES:Median percentage change in the relative effect estimate when applying each of the following assumption (four commonly discussed but implausible assumptions (best case scenario, none had the event, all had the event, and worst case scenario) and four plausible assumptions for missing data based on the informative missingness odds ratio (IMOR) approach (IMOR 1.5 (least stringent), IMOR 2, IMOR 3, IMOR 5 (most stringent)); percentage of meta-analyses that crossed the threshold of the null effect for each method; and percentage of meta-analyses that qualitatively changed direction of effect for each method. Sensitivity analyses based on the eight different methods of handling missing data were conducted. RESULTS:100 systematic reviews with 653 randomised controlled trials were included. When applying the implausible but commonly discussed assumptions, the median change in the relative effect estimate varied from 0% to 30.4%. The percentage of meta-analyses crossing the threshold of the null effect varied from 1% (best case scenario) to 60% (worst case scenario), and 26% changed direction with the worst case scenario. When applying the plausible assumptions, the median percentage change in relative effect estimate varied from 1.4% to 7.0%. The percentage of meta-analyses crossing the threshold of the null effect varied from 6% (IMOR 1.5) to 22% (IMOR 5) of meta-analyses, and 2% changed direction with the most stringent (IMOR 5). CONCLUSION:Even when applying plausible assumptions to the outcomes of participants with definite missing data, the average change in pooled relative effect estimate is substantive, and almost a quarter (22%) of meta-analyses crossed the threshold of the null effect. Systematic review authors should present the potential impact of missing outcome data on their effect estimates and use this to inform their overall GRADE (grading of recommendations assessment, development, and evaluation) ratings of risk of bias and their interpretation of the results.

journal_name

BMJ

authors

Kahale LA,Khamis AM,Diab B,Chang Y,Lopes LC,Agarwal A,Li L,Mustafa RA,Koujanian S,Waziry R,Busse JW,Dakik A,Schünemann HJ,Hooft L,Scholten RJ,Guyatt GH,Akl EA

doi

10.1136/bmj.m2898

subject

Has Abstract

pub_date

2020-08-26 00:00:00

pages

m2898

eissn

0959-8138

issn

1756-1833

journal_volume

370

pub_type

杂志文章,评审
  • Increasing incidence of aortic aneurysms in England and Wales.

    abstract::The numbers of patients being admitted to hospital with aortic aneurysms have increased recently. A study was carried out to try to find out whether this was a true increase in incidence or whether it could be attributable to more accurate diagnosis and better surgical techniques. From analyses of routine statistics i...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.298.6665.33

    authors: Fowkes FG,Macintyre CC,Ruckley CV

    更新日期:1989-01-07 00:00:00

  • Cholesterol screening and life assurance.

    abstract:OBJECTIVES:To examine how insurance companies assess proposals for life assurance from applicants with raised cholesterol concentrations and to determine the excess mortality rating applied. DESIGN:Survey of 49 companies underwriting term life assurance. SETTING:United Kingdom. SUBJECTS:Four fictional men aged 30 se...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.302.6781.891

    authors: Neil HA,Mant D

    更新日期:1991-04-13 00:00:00

  • Dental disease and risk of coronary heart disease and mortality.

    abstract:OBJECTIVE:To investigate a reported association between dental disease and risk of coronary heart disease. SETTING:National sample of American adults who participated in a health examination survey in the early 1970s. DESIGN:Prospective cohort study in which participants underwent a standard dental examination at bas...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.306.6879.688

    authors: DeStefano F,Anda RF,Kahn HS,Williamson DF,Russell CM

    更新日期:1993-03-13 00:00:00

  • Status of care for end stage kidney disease in countries and regions worldwide: international cross sectional survey.

    abstract:OBJECTIVE:To determine the global capacity (availability, accessibility, quality, and affordability) to deliver kidney replacement therapy (dialysis and transplantation) and conservative kidney management. DESIGN:International cross sectional survey. SETTING:International Society of Nephrology (ISN) survey of 182 cou...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.l5873

    authors: Bello AK,Levin A,Lunney M,Osman MA,Ye F,Ashuntantang GE,Bellorin-Font E,Benghanem Gharbi M,Davison SN,Ghnaimat M,Harden P,Htay H,Jha V,Kalantar-Zadeh K,Kerr PG,Klarenbach S,Kovesdy CP,Luyckx VA,Neuen BL,O'Donoghue D

    更新日期:2019-10-31 00:00:00

  • How are abnormal results for liver function tests dealt with in primary care? Audit of yield and impact.

    abstract:OBJECTIVE:To determine whether abnormal results for liver function tests are investigated in primary care and findings on full investigation. DESIGN:Retrospective audit and prospective clinical investigation. SETTING:University hospital and surrounding general practices serving around 330 000 people. SUBJECTS:Adults...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.322.7281.276

    authors: Sherwood P,Lyburn I,Brown S,Ryder S

    更新日期:2001-02-03 00:00:00

  • Associations between macrolide antibiotics prescribing during pregnancy and adverse child outcomes in the UK: population based cohort study.

    abstract:OBJECTIVE:To assess the association between macrolide antibiotics prescribing during pregnancy and major malformations, cerebral palsy, epilepsy, attention deficit hyperactivity disorder, and autism spectrum disorder in children. DESIGN:Population based cohort study. SETTING:The UK Clinical Practice Research Datalink...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.m331

    authors: Fan H,Gilbert R,O'Callaghan F,Li L

    更新日期:2020-02-19 00:00:00

  • Dietary underreporting by obese individuals--is it specific or non-specific?

    abstract:OBJECTIVE:To examine the distribution of patterns of macronutrient density in relation to obesity. DESIGN:Cross sectional. SETTING:Denmark. SUBJECTS:323 men and women aged 35-65 years, selected randomly from a larger population sample of Danish adults. MAIN OUTCOME MEASURE:Bias in dietary reporting of energy and pr...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.311.7011.986

    authors: Heitmann BL,Lissner L

    更新日期:1995-10-14 00:00:00

  • Outcome of breech delivery at term.

    abstract:OBJECTIVE:To compare neonatal mortality and morbidity in term infants presenting by the breech and delivered vaginally or by caesarean section. DESIGN:Population based comparison of outcomes. Data derived from the St Mary's maternity information system. SETTING:North West Thames Regional Health Authority, 1988-90. S...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.305.6856.746

    authors: Thorpe-Beeston JG,Banfield PJ,Saunders NJ

    更新日期:1992-09-26 00:00:00

  • A study of general practitioners' reasons for changing their prescribing behaviour.

    abstract:OBJECTIVES:To explore general practitioners' reasons for recent changes in their prescribing behaviour. DESIGN:Qualitative analysis of semistructured interviews. SETTING:General practice in south east London. SUBJECTS:A heterogeneous sample of 18 general practitioners. RESULTS:Interviewees were able to identify bet...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.312.7036.949

    authors: Armstrong D,Reyburn H,Jones R

    更新日期:1996-04-13 00:00:00

  • Re-evaluation of link between interpregnancy interval and adverse birth outcomes: retrospective cohort study matching two intervals per mother.

    abstract:OBJECTIVE:To re-evaluate the causal effect of interpregnancy interval on adverse birth outcomes, on the basis that previous studies relying on between mother comparisons may have inadequately adjusted for confounding by maternal risk factors. DESIGN:Retrospective cohort study using conditional logistic regression (mat...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.g4333

    authors: Ball SJ,Pereira G,Jacoby P,de Klerk N,Stanley FJ

    更新日期:2014-07-23 00:00:00

  • Unhealthy behaviours and disability in older adults: three-City Dijon cohort study.

    abstract:OBJECTIVES:To examine the individual and combined associations of unhealthy behaviours (low/intermediate physical activity, consuming fruit and vegetables less than once a day, current smoking/short term ex-smoking, never/former/heavy alcohol drinking), assessed at start of follow-up, with hazard of disability among ol...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.f4240

    authors: Artaud F,Dugravot A,Sabia S,Singh-Manoux A,Tzourio C,Elbaz A

    更新日期:2013-07-23 00:00:00

  • Population based cost utility study of interferon beta-1b in secondary progressive multiple sclerosis.

    abstract:OBJECTIVE:To evaluate the cost utility of interferon beta-1b in secondary progressive multiple sclerosis. DESIGN:Population based cost utility model (healthcare perspective). Data on use of health services were obtained from case records and routine morbidity data and utility values from a EuroQol survey. Local and pu...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.319.7224.1529

    authors: Forbes RB,Lees A,Waugh N,Swingler RJ

    更新日期:1999-12-11 00:00:00

  • The accuracy of clinical symptoms and signs for the diagnosis of serious bacterial infection in young febrile children: prospective cohort study of 15 781 febrile illnesses.

    abstract:OBJECTIVES:To evaluate current processes by which young children presenting with a febrile illness but suspected of having serious bacterial infection are diagnosed and treated, and to develop and test a multivariable model to distinguish serious bacterial infections from self limiting non-bacterial illnesses. Design T...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.c1594

    authors: Craig JC,Williams GJ,Jones M,Codarini M,Macaskill P,Hayen A,Irwig L,Fitzgerald DA,Isaacs D,McCaskill M

    更新日期:2010-04-20 00:00:00

  • Written informed consent and selection bias in observational studies using medical records: systematic review.

    abstract:OBJECTIVES:To determine whether informed consent introduces selection bias in prospective observational studies using data from medical records, and consent rates for such studies. DESIGN:Systematic review. DATA SOURCES:Embase, Medline, and the Cochrane Library up to March 2008, reference lists from pertinent article...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章,评审

    doi:10.1136/bmj.b866

    authors: Kho ME,Duffett M,Willison DJ,Cook DJ,Brouwers MC

    更新日期:2009-03-12 00:00:00

  • Interventions for non-metastatic squamous cell carcinoma of the skin: systematic review and pooled analysis of observational studies.

    abstract:OBJECTIVES:To assess the effects of treatments for non-metastatic invasive squamous cell carcinoma (SCC) of the skin using evidence from observational studies, given the paucity of evidence from randomised controlled trials. DESIGN:Systematic review of observational studies. DATA SOURCES:Medline, Embase, to December ...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章,meta分析,评审

    doi:10.1136/bmj.f6153

    authors: Lansbury L,Bath-Hextall F,Perkins W,Stanton W,Leonardi-Bee J

    更新日期:2013-11-04 00:00:00

  • Prevalence of Chlamydia trachomatis infection in women having cervical smear tests.

    abstract:OBJECTIVE:To determine the prevalence of sexually transmitted diseases in patients with normal and abnormal cervical smears. DESIGN:A prospective study of asymptomatic women with normal cervical smears attending their general practitioner and newly referred patients with abnormal smears attending a colposcopy clinic. ...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.302.6768.82

    authors: Smith JR,Murdoch J,Carrington D,Frew CE,Dougall AJ,MacKinnon H,Baillie D,Byford DM,Forrest CA,Davis JA

    更新日期:1991-01-12 00:00:00

  • Comparison of three regimens for malaria prophylaxis in travellers to east, central, and southern Africa.

    abstract:OBJECTIVES:Confirmation of breakthroughs in three different malaria chemoprophylactic regimens (chloroquine 300 mg weekly and proguanil 100 mg daily; chloroquine 300 mg weekly and proguanil 200 mg daily; proguanil 200 mg daily) and assessment of compliance. DESIGN:Prospective, randomised multicentre trial. SETTING:Fi...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 临床试验,杂志文章,多中心研究,随机对照试验

    doi:10.1136/bmj.307.6911.1041

    authors: Wetsteyn JC,de Geus A

    更新日期:1993-10-23 00:00:00

  • Mumps, measles, and rubella vaccine and the incidence of autism recorded by general practitioners: a time trend analysis.

    abstract:OBJECTIVE:To estimate changes in the risk of autism and assess the relation of autism to the mumps, measles, and rubella (MMR) vaccine. DESIGN:Time trend analysis of data from the UK general practice research database (GPRD). SETTING:General practices in the United Kingdom. SUBJECTS:Children aged 12 years or younger...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.322.7284.460

    authors: Kaye JA,del Mar Melero-Montes M,Jick H

    更新日期:2001-02-24 00:00:00

  • Health and social inequality in Europe.

    abstract::In most European countries health has been shown to be linked to social circumstances--gradients in health status have persisted for decades, despite major changes in the principal causes of death. In central and eastern Europe life expectancy has stagnated since the mid-60s, whereas in the West it has increased; but ...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章,评审

    doi:10.1136/bmj.308.6937.1153

    authors: Power C

    更新日期:1994-04-30 00:00:00

  • Drug treatments for covid-19: living systematic review and network meta-analysis.

    abstract:OBJECTIVE:To compare the effects of treatments for coronavirus disease 2019 (covid-19). DESIGN:Living systematic review and network meta-analysis. DATA SOURCES:WHO covid-19 database, a comprehensive multilingual source of global covid-19 literature, up to 3 December 2020 and six additional Chinese databases up to 12 ...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.m2980

    authors: Siemieniuk RA,Bartoszko JJ,Ge L,Zeraatkar D,Izcovich A,Kum E,Pardo-Hernandez H,Rochwerg B,Lamontagne F,Han MA,Liu Q,Agarwal A,Agoritsas T,Chu DK,Couban R,Darzi A,Devji T,Fang B,Fang C,Flottorp SA,Foroutan F,Ghad

    更新日期:2020-07-30 00:00:00

  • What do I want from health research and researchers when I am a patient?

    abstract::I have attempted to adopt the perspective of a patient--albeit one with a rather atypical background--to explore what I want from health research and researchers. This has left me with the impression that health researchers could serve the interests of the public more effectively in a variety of ways, and that they wo...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.310.6990.1315

    authors: Chalmers I

    更新日期:1995-05-20 00:00:00

  • The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed.

    abstract:OBJECTIVES:To examine the reporting characteristics and methodological details of randomised trials indexed in PubMed in 2000 and 2006 and assess whether the quality of reporting has improved after publication of the Consolidated Standards of Reporting Trials (CONSORT) Statement in 2001. DESIGN:Comparison of two cross...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.c723

    authors: Hopewell S,Dutton S,Yu LM,Chan AW,Altman DG

    更新日期:2010-03-23 00:00:00

  • Antiretroviral treatment can reduce the risk of HIV transmission between male partners to 'zero'.

    abstract::The studyA Rodger, V Cambiano, T Bruun, et al. Risk of HIV transmission through condomless sex in serodifferent gay couples with the HIV-positive partner taking suppressive antiretroviral therapy (PARTNER): final results of a multicentre, prospective, observational study. Lancet 2019;393:2428-38.This project was funde...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 评论,杂志文章

    doi:10.1136/bmj.l4915

    authors: Cook R,Davidson P,clinical adviser,.,Martin R,NIHR Dissemination Centre.

    更新日期:2019-08-27 00:00:00

  • Factors associated with the presence of diabetic ketoacidosis at diagnosis of diabetes in children and young adults: a systematic review.

    abstract:OBJECTIVE:To identify the factors associated with diabetic ketoacidosis at diagnosis of type 1 diabetes in children and young adults. DESIGN:Systematic review. DATA SOURCES:PubMed, EMBASE, Web of Science, Scopus, and Cinahl and article reference lists. STUDY SELECTION:Cohort studies including unselected groups of ch...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章,评审

    doi:10.1136/bmj.d4092

    authors: Usher-Smith JA,Thompson MJ,Sharp SJ,Walter FM

    更新日期:2011-07-07 00:00:00

  • Understanding influences on smoking in Bangladeshi and Pakistani adults: community based, qualitative study.

    abstract:OBJECTIVE:To gain detailed understanding of influences on smoking behaviour in Bangladeshi and Pakistani communities in the United Kingdom to inform the development of effective and culturally acceptable smoking cessation interventions. DESIGN:Qualitative study using community participatory methods, purposeful samplin...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.326.7396.962

    authors: Bush J,White M,Kai J,Rankin J,Bhopal R

    更新日期:2003-05-03 00:00:00

  • Multiple component patient safety intervention in English hospitals: controlled evaluation of second phase.

    abstract:OBJECTIVE:To independently evaluate the impact of the second phase of the Health Foundation's Safer Patients Initiative (SPI2) on a range of patient safety measures. Design A controlled before and after design. Five substudies: survey of staff attitudes; review of case notes from high risk (respiratory) patients in med...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.d199

    authors: Benning A,Dixon-Woods M,Nwulu U,Ghaleb M,Dawson J,Barber N,Franklin BD,Girling A,Hemming K,Carmalt M,Rudge G,Naicker T,Kotecha A,Derrington MC,Lilford R

    更新日期:2011-02-03 00:00:00

  • Outcomes of elective surgery undertaken in independent sector treatment centres and NHS providers in England: audit of patient outcomes in surgery.

    abstract:OBJECTIVE:To compare characteristics of patients and outcomes after elective surgery in independent sector treatment centres (ISTCs) and NHS providers. DESIGN:Follow-up study with outcomes reported by patients three to six months after surgery. SETTING:25 ISTCs and 72 NHS providers in England. Population Consecutive ...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.d6404

    authors: Chard J,Kuczawski M,Black N,van der Meulen J,POiS Audit Steering Committee.

    更新日期:2011-10-19 00:00:00

  • Does vasectomy accelerate testicular tumour? Importance of testicular examinations before and after vasectomy.

    abstract::An association between vasectomy and the development of testicular tumors, and the importance of testicular examinations both before and after a vasectomy is discussed. Patients diagnosed with testicular tumors within the last ten years were examined at Bangour General Hospital in Scotland. From 1977-87, 37 patients...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.300.6721.370

    authors: Cale AR,Farouk M,Prescott RJ,Wallace IW

    更新日期:1990-02-10 00:00:00

  • Factors affecting early unplanned readmission of elderly patients to hospital.

    abstract::A random sample of 133 elderly patients who had an unplanned readmission to a district general hospital within 28 days of discharge from hospital was studied and compared with a matched control sample of patients who were not readmitted. The total group was drawn from all specialties in the hospital, and by interviewi...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.297.6651.784

    authors: Williams EI,Fitton F

    更新日期:1988-09-24 00:00:00

  • Investigation of long term problems after obstetric epidural anaesthesia.

    abstract:OBJECTIVE:To examine the association between obstetric epidural anaesthesia and subsequent long term problems. DESIGN:Postal questionnaire on health problems after childbirth linked to maternity case note data. SETTING:Maternity hospital in Birmingham. SUBJECTS:11701 women who delivered their most recent child durin...

    journal_title:BMJ (Clinical research ed.)

    pub_type: 杂志文章

    doi:10.1136/bmj.304.6837.1279

    authors: MacArthur C,Lewis M,Knox EG

    更新日期:1992-05-16 00:00:00