Judging a plethora of p-values: how to contend with the problem of multiple testing--part 10 of a series on evaluation of scientific publications.

Abstract:

BACKGROUND:When reading reports of medical research findings, one is usually confronted with p-values. Publications typically contain not just one p-value, but an abundance of them, mostly accompanied by the word "significant." This article is intended to help readers understand the problem of multiple p-values and how to deal with it. METHODS:When multiple p-values appear in a single study, this is usually a problem of multiple testing. A number of valid approaches are presented for dealing with the problem. This article is based on classical statistical methods as presented in many textbooks and on selected specialized literature. RESULTS:Conclusions from publications with many "significant" results should be judged with caution if the authors have not taken adequate steps to correct for multiple testing. Researchers should define the goal of their study clearly at the outset and, if possible, define a single primary endpoint a priori. If the study is of an exploratory or hypothesis-generating nature, it should be clearly stated that any positive results might be due to chance and will need to be confirmed in further targeted studies. CONCLUSIONS:It is recommended that the word "significant" be used and interpreted with care. Readers should assess articles critically with regard to the problem of multiple testing. Authors should state the number of tests that were performed. Scientific articles should be judged on their scientific merit rather than by the number of times they contain the word "significant."

journal_name

Dtsch Arztebl Int

authors

Victor A,Elsässer A,Hommel G,Blettner M

doi

10.3238/arztebl.2010.0050

subject

Has Abstract

pub_date

2010-01-01 00:00:00

pages

50-6

issue

4

issn

1866-0452

journal_volume

107

pub_type

杂志文章
  • Spontaneous Pneumothorax.

    abstract:BACKGROUND:Few reliable data are available on the epidemiology and treatment of spontaneous pneumothorax. We studied the sex and age distribution, frequency of hospitalization, mortality, and conservative versus surgical care of this condition in Germany in order to draw well-founded conclusions about its in-hospital d...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章

    doi:10.3238/arztebl.2017.0739

    authors: Schnell J,Koryllos A,Lopez-Pastorini A,Lefering R,Stoelben E

    更新日期:2017-11-03 00:00:00

  • Cluster-Randomized Studies.

    abstract:BACKGROUND:Cluster-randomized trials (CRT) are needed to compare interventions that are allocated to entire groups of subjects, rather than to individuals. Publications about CRT have become steadily more common over the past decade. Readers of such publications should be able to categorize and interpret the findings o...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章,评审

    doi:10.3238/arztebl.2018.0163

    authors: Lorenz E,Köpke S,Pfaff H,Blettner M

    更新日期:2018-03-09 00:00:00

  • Organ Donor Cards in Resuscitation Room Patients.

    abstract:BACKGROUND:The percentage of organ donors among the German population is very low, and the supply of organs does not meet the demand. Relatively few organ explantations are performed in Germany, compared to other countries. The central element leading up to organ explantation is the donor's consent. This can be express...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章

    doi:10.3238/arztebl.2020.0183

    authors: Küpers M,Dudda M,Kauther MD,Schwarz B,Hausen SA,Jöckel KH

    更新日期:2020-03-13 00:00:00

  • Aggression and violence against primary care physicians—a nationwide questionnaire survey.

    abstract:BACKGROUND:International studies show that aggressive behavior against primary care physicians is not an uncommon occurrence. There has been no systematic study to date of the nature and frequency of such occurrences in Germany. METHODS:A four-page questionnaire was sent to a nationwide random sample of 1500 primary c...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章

    doi:10.3238/arztebl.2015.0159

    authors: Vorderwülbecke F,Feistle M,Mehring M,Schneider A,Linde K

    更新日期:2015-03-06 00:00:00

  • Gout--current diagnosis and treatment.

    abstract:BACKGROUND:Because of the changing dietary habits of an aging population, hyperuricemia is frequently found in combination with other metabolic disorders. Longstanding elevation of the serum uric acid level can lead to the deposition of monosodium urate crystals, causing gout (arthritis, urate nephropathy, tophi). In G...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章,评审

    doi:10.3238/arztebl.2009.0549

    authors: Tausche AK,Jansen TL,Schröder HE,Bornstein SR,Aringer M,Müller-Ladner U

    更新日期:2009-08-01 00:00:00

  • Hematological Malignancies in Adults With a Family Predisposition.

    abstract:BACKGROUND:Some hematological malignancies arise in persons with a hereditary predisposition. The hereditary nature of these diseases often goes unrecognized, particularly when symptoms begin in adulthood. METHODS:This review is based on pertinent publications retrieved by a selective search in PubMed. RESULTS:Many r...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章,评审

    doi:10.3238/arztebl.2018.0848

    authors: Bochtler T,Haag GM,Schott S,Kloor M,Krämer A,Müller-Tidow C

    更新日期:2018-12-14 00:00:00

  • Ovarian cancer: diagnosis and treatment.

    abstract:BACKGROUND:Patients with ovarian cancer usually present to a family physician with nonspecific symptoms, most often abdominal pain. The outcome depends above all on the stage of the disease when it is diagnosed and on the quality of treatment. METHODS:This article is based on a review of selected publications from 200...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章,评审

    doi:10.3238/arztebl.2011.0635

    authors: Burges A,Schmalfeldt B

    更新日期:2011-09-01 00:00:00

  • The Interdisciplinary Diagnosis and Treatment of Intraocular Tumors.

    abstract:BACKGROUND:Recent years have seen major changes in the diagnosis and treatment of solid intraocular tumors, mainly owing to an improved molecular biological understanding of their pathogenesis, new therapeutic approaches for the local treatment of tumors in children, and long-term follow-up observations in clinical tri...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章,评审

    doi:10.3238/arztebl.2018.0106

    authors: Bornfeld N,Biewald E,Bauer S,Temming P,Lohmann D,Zeschnigk M

    更新日期:2018-02-16 00:00:00

  • Quality of life and occupational disability in endocrine orbitopathy.

    abstract:BACKGROUND:In endocrine orbitopathy (EO), disfiguring proptosis and diplopia impair patients' quality of life both at home and at work. METHODS:From late 2006 to the beginning of 2008, 250 outpatients in an interdisciplinary thyroid and eye clinic filled out a questionnaire about their quality of life, occupational di...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章

    doi:10.3238/arztebl.2009.0283

    authors: Ponto KA,Pitz S,Pfeiffer N,Hommel G,Weber MM,Kahaly GJ

    更新日期:2009-04-01 00:00:00

  • Breast cancer in young women after treatment for Hodgkin's disease during childhood or adolescence--an observational study with up to 33-year follow-up.

    abstract:BACKGROUND:The treatment of Hodgkin's disease (HD; also called Hodgkin's lymphoma) in children and adolescents with radiotherapy and chemotherapy leads to high survival rates but has a number of late effects. The most serious one is the development of a secondary malignant tumor, usually in the field that was irradiate...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章

    doi:10.3238/arztebl.2014.0003

    authors: Schellong G,Riepenhausen M,Ehlert K,Brämswig J,Dörffel W,German Working Group on the Long-Term Sequelae of Hodgkin's Disease.,Schmutzler RK,Rhiem K,Bick U,German Consortium for Hereditary Breast and Ovarian Cancer.

    更新日期:2014-01-06 00:00:00

  • Adjuvant therapy for women over age 65 with breast cancer.

    abstract:BACKGROUND:Women over age 65 with breast cancer are often not treated in accordance with current guidelines as far as adjuvant therapy is concerned, because of the lack of adequate scientific evidence. METHODS:This article is based on a selective review of pertinent literature retrieved by a PubMed search, as well as ...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章,评审

    doi:10.3238/arztebl.2011.0365

    authors: Sautter-Bihl ML,Souchon R,Gerber B

    更新日期:2011-05-01 00:00:00

  • Intrauterine surgery--choices and limitations.

    abstract:BACKGROUND:The past decade has seen much progress in intrauterine surgery. Randomized trials have documented the benefit of some procedures of this type for the unborn child. METHOD:Selective literature review RESULTS:Randomized trials have demonstrated the benefit of fetoscopic laser coagulation of placental anastom...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章,评审

    doi:10.3238/arztebl.2012.0603

    authors: Diemert A,Diehl W,Glosemeyer P,Deprest J,Hecher K

    更新日期:2012-09-01 00:00:00

  • Vitamin and Mineral Status in a Vegan Diet.

    abstract:BACKGROUND:In Germany, public interest in a vegan diet is steadily growing. There are, however, no current data on the macro- and micronutrient status of vegans. METHODS:In a cross-sectional study entitled "The Risks and Benefits of a Vegan Diet" (RBVD), we investigated the dietary intake, basic laboratory parameters,...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章

    doi:10.3238/arztebl.2020.0575

    authors: Weikert C,Trefflich I,Menzel J,Obeid R,Longree A,Dierkes J,Meyer K,Herter-Aeberli I,Mai K,Stangl GI,Müller SM,Schwerdtle T,Lampen A,Abraham K

    更新日期:2020-08-31 00:00:00

  • Indirect Comparisons and Network Meta-Analyses.

    abstract:BACKGROUND:Systematic reviews provide a structured summary of the results of trials that have been carried out on any particular subject. If the data from multiple trials are sufficiently homogenous, a meta-analysis can be performed to calculate pooled effect estimates. Traditional meta-analysis involves groups of tria...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章,meta分析,评审

    doi:10.3238/arztebl.2015.0803

    authors: Kiefer C,Sturtz S,Bender R

    更新日期:2015-11-20 00:00:00

  • Indicated prevention of schizophrenia.

    abstract:INTRODUCTION:Despite recent advances in their treatment, schizophrenic disorders are still among the diseases that most severely impair patients' quality of life. For this reason, centers for the early recognition of schizophrenic disorders have come into existence worldwide. In these centers, much effort is devoted to...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章

    doi:10.3238/arztebl.2008.0532

    authors: Klosterkötter J

    更新日期:2008-07-01 00:00:00

  • Direct Oral Anticoagulants in Emergency Trauma Admissions.

    abstract:BACKGROUND:Direct (non-vitamin-K-dependent) oral anticoagulants (DOAC) are given as an alternative to vitamin K antagonists (VKA) to prevent stroke and embolic disease in patients with atrial fibrillation that is not due to pathology of the heart valves. Fatal hemorrhage is rarer when DOACs are given (nonvalvular atria...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章,评审

    doi:10.3238/arztebl.2016.0575

    authors: Maegele M,Grottke O,Schöchl H,Sakowitz OA,Spannagl M,Koscielny J

    更新日期:2016-09-05 00:00:00

  • Non-specific, functional, and somatoform bodily complaints.

    abstract:BACKGROUND:4-10% of the general population and 20% of primary care patients have what are called "non-specific, functional, and somatoform bodily complaints." These often take a chronic course, markedly impair the sufferers' quality of life, and give rise to high costs. They can be made worse by inappropriate behavior ...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章

    doi:10.3238/arztebl.2012.0803

    authors: Schaefert R,Hausteiner-Wiehle C,Häuser W,Ronel J,Herrmann M,Henningsen P

    更新日期:2012-11-01 00:00:00

  • The Treatment of Incisional Hernia.

    abstract:BACKGROUND:A meta-analysis of studies from multiple countries has shown that the incidence of incisional hernia varies from 4% to 10% depending on the type of operation. No epidemiological surveys have been conducted so far. The worst possible complication of an incisional hernia if it is not treated surgically is inca...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章,meta分析

    doi:10.3238/arztebl.2018.0031

    authors: Dietz UA,Menzel S,Lock J,Wiegering A

    更新日期:2018-01-19 00:00:00

  • Non-vitamin K Antagonist Oral Anticoagulants (NOAC) as an Alternative Treatment Option in Tumor-Related Venous Thromboembolism.

    abstract:BACKGROUND:The risk of venous thromboembolism (VTE) is 4 to 7 times higher in cancer patients than in the normal population. Moreover, cancer patients who take anticoagulants suffer more frequently from hemorrhagic complications and VTE recurrences. Patients often find low-molecular-weight heparin (LMWH) treatment unpl...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章

    doi:10.3238/arztebl.2019.0031

    authors: Beyer-Westendorf J,Klamroth R,Kreher S,Langer F,Matzdorff A,Riess H

    更新日期:2019-01-18 00:00:00

  • Familial hypercholesterolemia: developments in diagnosis and treatment.

    abstract:BACKGROUND:Familial hypercholesterolemia (FH) is a congenital disorder of lipid metabolism characterized by a marked elevation of the plasma concentration of LDL (low-density lipoprotein) cholesterol beginning in childhood and by the early onset of coronary heart disease. It is among the commonest genetic disorders, wi...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章,评审

    doi:10.3238/arztebl.2014.0523

    authors: Klose G,Laufs U,März W,Windler E

    更新日期:2014-08-04 00:00:00

  • Mental Disorders in Early Childhood.

    abstract:BACKGROUND:About 17% of all children suffer from a mental disorder in early childhood, defined as the period up to the age of 6 years. METHODS:This review is based on publications retrieved by a selective search in PubMed and the Web of Science, as well as on the authors' clinical and scientific experience. RESULTS:I...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章,评审

    doi:10.3238/arztebl.2015.0375

    authors: von Klitzing K,Döhnert M,Kroll M,Grube M

    更新日期:2015-05-25 00:00:00

  • The Conservative Treatment of Traumatic Thoracolumbar Vertebral Fractures.

    abstract:BACKGROUND:The conservative treatment of traumatic thoracolumbar vertebral fractures is often not clearly defined. METHODS:This review is based on articles retrieved by a systematic search in the PubMed and Web of Science databases for publications up to February 2018 dealing with the conservative treatment of traumat...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章,评审

    doi:10.3238/arztebl.2018.0697

    authors: Spiegl UJ,Fischer K,Schmidt J,Schnoor J,Delank S,Josten C,Schulte T,Heyde CE

    更新日期:2018-10-19 00:00:00

  • Isolated non-compaction cardiomyopathy.

    abstract:BACKGROUND:Isolated non-compaction cardiomyopathy (NCCM) was first described in 1984. This disorder, a primary genetic cardiomyopathy, is now attracting increased attention. METHOD:The current state of the epidemiology, pathogenesis, pathophysiology, clinical features, diagnosis, treatment, and prognosis of NCCM are d...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章,评审

    doi:10.3238/arztebl.2010.0206

    authors: Engberding R,Stöllberger C,Ong P,Yelbuz TM,Gerecke BJ,Breithardt G

    更新日期:2010-03-01 00:00:00

  • The pharmacotherapy of neuropsychiatric symptoms of dementia: a cross-sectional study in 18 homes for the elderly in Berlin.

    abstract:BACKGROUND:The neuropsychiatric symptoms of dementia, including aggressiveness, agitation, depression, and apathy are often treated with psychotropic drugs and are a frequent reason for hospitalization, placing an economic burden on the health care system. International guidelines recommend syndrome-specific pharmacoth...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章,多中心研究

    doi:10.3238/arztebl.2010.0320

    authors: Majic T,Pluta JP,Mell T,Aichberger MC,Treusch Y,Gutzmann H,Heinz A,Rapp MA

    更新日期:2010-05-01 00:00:00

  • Epilepsy in the elderly.

    abstract:BACKGROUND:Epilepsy is the third most common disease affecting the brain in the elderly. Current demographic trends will lead to an increased prevalence of epilepsy in the general population. METHOD:A selective literature search revealed 102 relevant publications as of September 2008, 50 of which were original article...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章,评审

    doi:10.3238/arztebl.2009.0135

    authors: Werhahn KJ

    更新日期:2009-02-01 00:00:00

  • Smoking and passive smoking exposure in young people: results of the German Health Interview and Examination Survey for Children and Adolescents (KiGGS).

    abstract:INTRODUCTION:This study analyzes the prevalence and associated factors for smoking and passive smoking among young people. METHODS:The data are derived from a subsample of the German Health Interview and Examination Survey for Children and Adolescents (KiGGS), carried out by the Robert Koch Institute between May 2003 ...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章

    doi:10.3238/arztebl.2008.0265

    authors: Lampert T

    更新日期:2008-04-01 00:00:00

  • Acute liver failure: a life-threatening disease.

    abstract:BACKGROUND:An estimated 200 to 500 patients develop life-threatening acute liver failure (ALF) in Germany each year. Only sparse data are currently available on the epidemiology and causes of this condition and on potential treatments for it. This article summarizes our current knowledge of the causes, clinical course,...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章,评审

    doi:10.3238/arztebl.2011.0714

    authors: Canbay A,Tacke F,Hadem J,Trautwein C,Gerken G,Manns MP

    更新日期:2011-10-01 00:00:00

  • Identification of adverse drug events: the use of ICD-10 coded diagnoses in routine hospital data.

    abstract:BACKGROUND:Adverse drug events (ADE) are a common cause of hospital admission as well as a common complication of inpatient care. The current reporting systems in Germany are of only limited use for the identification of ADE. The aim of this study is to examine the potential usefulness of ICD-10 coded diagnoses in rout...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章

    doi:10.3238/arztebl.2010.0023

    authors: Stausberg J,Hasford J

    更新日期:2010-01-01 00:00:00

  • Pulsatile tinnitus: imaging and differential diagnosis.

    abstract:BACKGROUND:Pulsatile tinnitus, unlike idiopathic tinnitus, usually has a specific, identifiable cause. Nonetheless, uncertainty often arises in clinical practice about the findings to be sought and the strategy for work-up. METHODS:Selective literature review and evaluation of our own series of patients. RESULTS:Puls...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章,评审

    doi:10.3238/arztebl.2013.0451

    authors: Hofmann E,Behr R,Neumann-Haefelin T,Schwager K

    更新日期:2013-06-01 00:00:00

  • The treatment of anterior dental trauma.

    abstract:BACKGROUND:Avulsed frontal teeth often cannot be saved because of improper or lack of initial treatment. The result is a need for multiple interventions over the patient's lifetime, which also carry a high financial cost. METHODS:We explored the subject of lost anterior teeth in young patients with a PubMed search bas...

    journal_title:Deutsches Arzteblatt international

    pub_type: 杂志文章,评审

    doi:10.3238/arztebl.2011.0565

    authors: Brüllmann D,Schulze RK,d'Hoedt B

    更新日期:2010-08-01 00:00:00