Testing multiple statistical hypotheses resulted in spurious associations: a study of astrological signs and health.

Abstract:

OBJECTIVES:To illustrate how multiple hypotheses testing can produce associations with no clinical plausibility. STUDY DESIGN AND SETTING:We conducted a study of all 10,674,945 residents of Ontario aged between 18 and 100 years in 2000. Residents were randomly assigned to equally sized derivation and validation cohorts and classified according to their astrological sign. Using the derivation cohort, we searched through 223 of the most common diagnoses for hospitalization until we identified two for which subjects born under one astrological sign had a significantly higher probability of hospitalization compared to subjects born under the remaining signs combined (P<0.05). RESULTS:We tested these 24 associations in the independent validation cohort. Residents born under Leo had a higher probability of gastrointestinal hemorrhage (P=0.0447), while Sagittarians had a higher probability of humerus fracture (P=0.0123) compared to all other signs combined. After adjusting the significance level to account for multiple comparisons, none of the identified associations remained significant in either the derivation or validation cohort. CONCLUSIONS:Our analyses illustrate how the testing of multiple, non-prespecified hypotheses increases the likelihood of detecting implausible associations. Our findings have important implications for the analysis and interpretation of clinical studies.

journal_name

J Clin Epidemiol

authors

Austin PC,Mamdani MM,Juurlink DN,Hux JE

doi

10.1016/j.jclinepi.2006.01.012

subject

Has Abstract

pub_date

2006-09-01 00:00:00

pages

964-9

issue

9

eissn

0895-4356

issn

1878-5921

pii

S0895-4356(06)00124-7

journal_volume

59

pub_type

杂志文章
  • Weighing gains and losses in criterion validity studies with test-based enrollment.

    abstract::Criterion validity studies sometimes use designs with test-based enrollment schemes. In such incomplete studies, a Reference Instrument (RI) is applied to unequal sampling fractions of subjects previously identified as positives or negatives by a new Test Instrument (TI+ and TI-). Focusing on sensitivity (Se) and spec...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(03)00162-8

    authors: Reichenheim ME

    更新日期:2003-10-01 00:00:00

  • Indices of abdominal obesity are better discriminators of cardiovascular risk factors than BMI: a meta-analysis.

    abstract:OBJECTIVE:To determine which simple index of overweight and obesity is the best discriminator of cardiovascular risk factors. STUDY DESIGN AND SETTING:This is a meta-analysis of published literature. MEDLINE was searched. Studies that used receiver-operating characteristics (ROC) curve analysis and published area unde...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,meta分析,评审

    doi:10.1016/j.jclinepi.2007.08.012

    authors: Lee CM,Huxley RR,Wildman RP,Woodward M

    更新日期:2008-07-01 00:00:00

  • Insulin sensitivity markers: predictors of accidents and suicides in Helsinki Heart Study screenees.

    abstract::The purpose of this study was to evaluate whether elements signifying relative insulin sensitivity (IS) were prospectively linked to accidents and suicides in 14,976 Helsinki Heart Study (HHS) screenees. The main outcome measure was hospitalizations and deaths from accidents and suicide attempts determined from Finnis...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(02)00407-9

    authors: Golomb BA,Tenkanen L,Alikoski T,Niskanen T,Manninen V,Huttunen M,Mednick SA

    更新日期:2002-08-01 00:00:00

  • Assessment of generalized lymphadenopathy in AIDS research: the degree of clinical agreement.

    abstract::The degree of clinical agreement amongst different physicians on the presence or absence of generalized lymphadenopathy was assessed in 32 randomly selected participants from a prospective study of male sexual contacts of men with AIDS or an AIDS-related condition (ARC). Three physicians completed the same standard ex...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(88)90131-x

    authors: Coates RA,Fanning MM,Johnson JK,Calzavara L

    更新日期:1988-01-01 00:00:00

  • A reliable and valid index was developed to measure appropriate psychotropic drug use in dementia.

    abstract:OBJECTIVES:The aim of this study was to develop an index derived from the Medication Appropriateness Index (MAI) items that is suited for clinical studies evaluating appropriateness of psychotropic drug use (PDU) for neuropsychiatric symptoms (NPS) in patients with dementia in nursing homes and to test its reliability ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2015.03.012

    authors: van der Spek K,Gerritsen DL,Smalbrugge M,Nelissen-Vrancken MH,Wetzels RB,Smeets CH,Zuidema SU,Koopmans RT

    更新日期:2015-08-01 00:00:00

  • Dyspepsia: how should we measure it?

    abstract::This study developed and validated a multidimensional measure of dyspepsia. A questionnaire was administered to 126 patients with dyspepsia who presented for care at a VA outpatient clinic and a family physician's private office. Dyspepsia-specific health was measured by self-report using: (1) an existing dyspepsia sc...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(97)00245-x

    authors: Kuykendall DH,Rabeneck L,Campbell CJ,Wray NP

    更新日期:1998-02-01 00:00:00

  • Time-to-event methodology improved statistical evaluation in register-based health services research.

    abstract:OBJECTIVES:Complex longitudinal sampling and the observational structure of patient registers in health services research are associated with methodological challenges regarding data management and statistical evaluation. We exemplify common pitfalls and want to stimulate discussions on the design, development, and dep...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.jclinepi.2016.11.001

    authors: Bluhmki T,Bramlage P,Volk M,Kaltheuner M,Danne T,Rathmann W,Beyersmann J

    更新日期:2017-02-01 00:00:00

  • Toxic oil syndrome: survival in the whole cohort between 1981 and 1995.

    abstract:BACKGROUND AND OBJECTIVE:In 1981, toxic oil syndrome (TOS) appeared in Spain, affecting more than 20,000 persons and causing over 2500 deaths to date. Previous studies have addressed mortality only by gender and age. We analyzed possible prognostic factors in the survival of the cohort. METHODS:The study period was 1 ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(03)00119-7

    authors: Sánchez-Porro Valadés P,Posada de la Paz M,de Andrés Copa P,Gimenez Ribota O,Abaitua Borda I

    更新日期:2003-07-01 00:00:00

  • Measuring the impact of trauma care on survival: rates of preventable death, effectiveness, and efficacy.

    abstract::This paper focuses on the appropriateness of outcome measures to evaluate trauma care. The preventable death rate (PDR), based on the study of deceased patients only, has been the traditional measure of the impact of trauma care on improving the survival of patients with severe trauma. Another measure frequently used ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(90)90125-9

    authors: Salmi LR,Williams JI,Waxweiler RJ

    更新日期:1990-01-01 00:00:00

  • The comprehensive diagnostic study is suggested as a design to model the diagnostic process.

    abstract:OBJECTIVES:The classical diagnostic cross-sectional study has a focus on one disease only. Generalist clinicians, however, are confronted with a wide range of diagnoses. We propose the "comprehensive diagnostic study design" to evaluate diagnostic tests regarding more than one disease outcome. STUDY DESIGN AND SETTING...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2013.05.019

    authors: Donner-Banzhoff N,Haasenritter J,Hüllermeier E,Viniol A,Bösner S,Becker A

    更新日期:2014-02-01 00:00:00

  • A method is presented to plan the required sample size when estimating regression-based reference limits.

    abstract:BACKGROUND AND OBJECTIVE:Reference limits are widely used in anthropometry, the behavioral sciences, medicine, and clinical chemistry. They describe the distribution of a quantitative variable in a healthy population, and are often a smooth function of age or another determinant. Thus, instead of estimating reference l...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2006.09.004

    authors: Bellera CA,Hanley JA

    更新日期:2007-06-01 00:00:00

  • Result dissemination from clinical trials conducted at German university medical centers was delayed and incomplete.

    abstract:OBJECTIVES:Timely and comprehensive reporting of clinical trial results builds the backbone of evidence-based medicine and responsible research. The proportion of timely disseminated trial results can inform alternative national and international benchmarking of university medical centers (UMCs). STUDY DESIGN AND SETT...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2019.06.002

    authors: Wieschowski S,Riedel N,Wollmann K,Kahrass H,Müller-Ohlraun S,Schürmann C,Kelley S,Kszuk U,Siegerink B,Dirnagl U,Meerpohl J,Strech D

    更新日期:2019-11-01 00:00:00

  • Covariate adjustment increased power in randomized controlled trials: an example in traumatic brain injury.

    abstract:OBJECTIVE:We aimed to determine to what extent covariate adjustment could affect power in a randomized controlled trial (RCT) of a heterogeneous population with traumatic brain injury (TBI). STUDY DESIGN AND SETTING:We analyzed 14-day mortality in 9,497 participants in the Corticosteroid Randomization After Significan...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.jclinepi.2011.08.012

    authors: Turner EL,Perel P,Clayton T,Edwards P,Hernández AV,Roberts I,Shakur H,Steyerberg EW,CRASH trial collaborators.

    更新日期:2012-05-01 00:00:00

  • Asymptomatic peripheral arterial occlusive disease predicted cardiovascular morbidity and mortality in a 7-year follow-up study.

    abstract:OBJECTIVE:Asymptomatic peripheral arterial occlusive disease (PAOD) is a common atherosclerotic disorder among the elderly population. Scarce data are available on the risk of nonfatal and fatal cardiovascular diseases in these subjects. We investigated cardiovascular morbidity and mortality of asymptomatic PAOD subjec...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.jclinepi.2003.09.003

    authors: Hooi JD,Kester AD,Stoffers HE,Rinkens PE,Knottnerus JA,van Ree JW

    更新日期:2004-03-01 00:00:00

  • A stroke prediction score in the elderly: validation and Web-based application.

    abstract::The objective of this study was to construct a prediction model for predicting stroke in an elderly U.S. population, and to assess the accuracy in this population of other previously published prediction models. The subjects were participants in the Cardiovascular Health Study: 2,495 men and 3,393 women age 65 years a...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(01)00434-6

    authors: Lumley T,Kronmal RA,Cushman M,Manolio TA,Goldstein S

    更新日期:2002-02-01 00:00:00

  • Using postal randomization to replace telephone randomization had no significant effect on recruitment of patients.

    abstract:OBJECTIVE:To test the effect of postal randomization on recruitment of patients into a randomized trial in primary care. STUDY DESIGN AND SETTING:General practices used a telephone service to randomize patients in our trial. Delays in the start of recruitment at some sites led us to modify the randomization procedure....

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.jclinepi.2007.04.003

    authors: Brealey SD,Atwell C,Bryan S,Coulton S,Cox H,Cross B,Fylan F,Garratt A,Gilbert FJ,Gillan MG,Hendry M,Hood K,Houston H,King D,Morton V,Orchard J,Robling M,Russell IT,Torgerson D,Wadsworth V,Wilkinson C

    更新日期:2007-10-01 00:00:00

  • The level of alcohol consumption at which all-cause mortality is least.

    abstract::Moderate consumers of alcohol have lower mortality than either nondrinkers or heavy drinkers. This systematic review aimed to quantify the level of alcohol consumption (termed the nadir) at which the lowest mortality occurs. Twenty cohort studies reported analyses of all-cause mortality for at least three categories o...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,meta分析

    doi:10.1016/s0895-4356(99)00076-1

    authors: White IR

    更新日期:1999-10-01 00:00:00

  • Cochrane Qualitative and Implementation Methods Group guidance series-paper 3: methods for assessing methodological limitations, data extraction and synthesis, and confidence in synthesized qualitative findings.

    abstract::The Cochrane Qualitative and Implementation Methods Group develops and publishes guidance on the synthesis of qualitative and mixed-method implementation evidence. Choice of appropriate methodologies, methods, and tools is essential when developing a rigorous protocol and conducting the synthesis. Cochrane authors who...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2017.06.020

    authors: Noyes J,Booth A,Flemming K,Garside R,Harden A,Lewin S,Pantoja T,Hannes K,Cargo M,Thomas J

    更新日期:2018-05-01 00:00:00

  • Hematocrit was not validated as a surrogate end point for survival among epoetin-treated hemodialysis patients.

    abstract:OBJECTIVE:To evaluate the use of hematocrit as a surrogate end point for survival among end-stage renal disease (ESRD) patients treated with epoetin. STUDY DESIGN AND SETTING:Using United States Renal Data System (USRDS) data, we conducted an observational prospective study to analyze the relationships among epoetin d...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2004.05.002

    authors: Cotter DJ,Stefanik K,Zhang Y,Thamer M,Scharfstein D,Kaufman J

    更新日期:2004-10-01 00:00:00

  • Clinical replicability of rehabilitation interventions in randomized controlled trials reported in main journals is inadequate.

    abstract:OBJECTIVE:The objective of this study was to study if randomized controlled trials (RCTs) in rehabilitation (a field where complex interventions prevail) published in main journals include all the details needed to replicate the intervention in clinical practice (clinical replicability). STUDY DESIGN AND SETTING:Forty...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2019.06.008

    authors: Negrini S,Arienti C,Pollet J,Engkasan JP,Francisco GE,Frontera WR,Galeri S,Gworys K,Kujawa J,Mazlan M,Rathore FA,Schillebeeckx F,Kiekens C,REREP study participants.

    更新日期:2019-10-01 00:00:00

  • Analysis of nonresponse bias in a population-based case-control study on lung cancer.

    abstract::The objective of this study was to identify characteristics of nonrespondents and late respondents in a population-based case-control study on lung cancer conducted in the city of Turin (Italy). Information about demographic and socioeconomic variables of 634 cases and 859 controls who responded to an interview, as we...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(02)00455-9

    authors: Richiardi L,Boffetta P,Merletti F

    更新日期:2002-10-01 00:00:00

  • Risk adjustment in claims-based research: the search for efficient approaches.

    abstract::Claims-based indices of comorbidity and severity, as well as other measures derived from routinely collected administrative data, are developed and tested. The extent to which risk adjustments using claims can be improved by adding information from one well-known measure based on chart review and patient examination (...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(89)90118-2

    authors: Roos LL,Sharp SM,Cohen MM,Wajda A

    更新日期:1989-01-01 00:00:00

  • Assessment of sun sensitivity by questionnaire: validity of items and formulation of a prediction rule.

    abstract::Sun sensitivity is a major risk factor for melanoma, basal cell carcinoma, and squamous cell carcinoma of the skin. Several variables have been used in epidemiologic studies to measure sun sensitivity. The present study assesses their validity and combines them to form a prediction rule for an objective measure of sun...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(92)90104-u

    authors: Weinstock MA

    更新日期:1992-05-01 00:00:00

  • Misclassification of exposure is high when interview data on drug use are used as a proxy measure of chronic drug use during follow-up.

    abstract:BACKGROUND AND OBJECTIVE:In many observational studies, the association between drugs and disease is analyzed with information from a baseline interview. We investigated the magnitude and direction of exposure misclassification by comparing interview data at baseline with prospectively gathered pharmacy data. METHODS:...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2003.12.017

    authors: Beiderbeck AB,Sturkenboom MC,Coebergh JW,Leufkens HG,Stricker BH

    更新日期:2004-09-01 00:00:00

  • A combination of serum low albumin and above-average cholesterol level was associated with excess mortality.

    abstract:BACKGROUND:There is no population-based prospective study concerning the relation between serum albumin and mortality in a non-Western population, and few previous studies included the subgroup analysis stratified by serum cholesterol level. METHODS:A 13.7-year cohort study was conducted on 6,957 males and females age...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2004.02.019

    authors: Okamura T,Hayakawa T,Kadowaki T,Kita Y,Okayama A,Elliott P,Ueshima H,NIPPON DATA80 research group.

    更新日期:2004-11-01 00:00:00

  • Heritabilities and shared environmental effects were estimated from household clustering in national health survey data.

    abstract:OBJECTIVES:The relative contributions of genetic and environmental variables to within-household clustering of quantitative traits in household surveys are poorly characterized. We estimated shared genetic and shared environmental contributions to within-household correlation for anthropometric variables and cardiovasc...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2006.02.015

    authors: Saunders CL,Gulliford MC

    更新日期:2006-11-01 00:00:00

  • Time-dependent variability in repeated measurements of cholesterol levels: clinical implications for risk misclassification and intervention monitoring.

    abstract::Intraindividual variability (IIV) in total cholesterol levels based on measurements taken 1 week apart is compared with an estimate based on measurements taken 2 years apart. Single-subject 95% confidence intervals around the mean of two repeated measurements were Xi +/- 21 and +/- 28 mg/dl, respectively, and Xi +/- 3...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(93)90115-h

    authors: Roeback JR,Cook JR,Guess HA,Heyse JF

    更新日期:1993-10-01 00:00:00

  • GRADE guidelines: 10. Considering resource use and rating the quality of economic evidence.

    abstract:OBJECTIVES:In this article, we describe how to include considerations about resource utilization when making recommendations according to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach. STUDY DESIGN AND SETTINGS:We focus on challenges with rating the confidence in effect estima...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2012.04.012

    authors: Brunetti M,Shemilt I,Pregno S,Vale L,Oxman AD,Lord J,Sisk J,Ruiz F,Hill S,Guyatt GH,Jaeschke R,Helfand M,Harbour R,Davoli M,Amato L,Liberati A,Schünemann HJ

    更新日期:2013-02-01 00:00:00

  • Estimating risk difference from relative association measures in meta-analysis can infrequently pose interpretational challenges.

    abstract:OBJECTIVE:Risk difference (RD) is often estimated from relative association measures generated by meta-analysis and a particular group's baseline risk. We describe a problematic situation in using this approach. STUDY DESIGN AND SETTING:We encountered a meta-analysis in which a confidence interval (CI) of relative ris...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2008.11.005

    authors: Murad MH,Montori VM,Walter SD,Guyatt GH

    更新日期:2009-08-01 00:00:00

  • Montreal Accord on Patient-Reported Outcomes (PROs) use series - Paper 5: patient-reported outcomes can be linked to epidemiologic measures to monitor populations and inform public health decisions.

    abstract:BACKGROUND:A comprehensive picture of population health status can be captured by the incorporation of patient-reported outcome measures into population health monitoring. OBJECTIVE:The aim of the study was to identify the current state, opportunities, and future research related to the utilization of patient-reported...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2017.04.018

    authors: Mamiya H,Lix LM,Gardner W,Bartlett SJ,Ahmed S,Buckeridge DL

    更新日期:2017-09-01 00:00:00