Incongruence between test statistics and P values in medical papers.

Abstract:

BACKGROUND:Given an observed test statistic and its degrees of freedom, one may compute the observed P value with most statistical packages. It is unknown to what extent test statistics and P values are congruent in published medical papers. METHODS:We checked the congruence of statistical results reported in all the papers of volumes 409-412 of Nature (2001) and a random sample of 63 results from volumes 322-323 of BMJ (2001). We also tested whether the frequencies of the last digit of a sample of 610 test statistics deviated from a uniform distribution (i.e., equally probable digits). RESULTS:11.6% (21 of 181) and 11.1% (7 of 63) of the statistical results published in Nature and BMJ respectively during 2001 were incongruent, probably mostly due to rounding, transcription, or type-setting errors. At least one such error appeared in 38% and 25% of the papers of Nature and BMJ, respectively. In 12% of the cases, the significance level might change one or more orders of magnitude. The frequencies of the last digit of statistics deviated from the uniform distribution and suggested digit preference in rounding and reporting. CONCLUSIONS:This incongruence of test statistics and P values is another example that statistical practice is generally poor, even in the most renowned scientific journals, and that quality of papers should be more controlled and valued.

journal_name

BMC Med Res Methodol

authors

García-Berthou E,Alcaraz C

doi

10.1186/1471-2288-4-13

keywords:

subject

Has Abstract

pub_date

2004-05-28 00:00:00

pages

13

issn

1471-2288

pii

1471-2288-4-13

journal_volume

4

pub_type

杂志文章
  • Using the Beta distribution in group-based trajectory models.

    abstract:BACKGROUND:We demonstrate an application of Group-Based Trajectory Modeling (GBTM) based on the beta distribution. It is offered as an alternative to the normal distribution for modeling continuous longitudinal data that are poorly fit by the normal distribution even with censoring. The primary advantage of the beta di...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-018-0620-9

    authors: Elmer J,Jones BL,Nagin DS

    更新日期:2018-11-26 00:00:00

  • Bias due to censoring of deaths when calculating extra length of stay for patients acquiring a hospital infection.

    abstract:BACKGROUND:In many studies the information of patients who are dying in the hospital is censored when examining the change in length of hospital stay (cLOS) due to hospital-acquired infections (HIs). While appropriate estimators of cLOS are available in literature, the existence of the bias due to censoring of deaths w...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-018-0500-3

    authors: Rahman S,von Cube M,Schumacher M,Wolkewitz M

    更新日期:2018-05-30 00:00:00

  • Reliability of routinely collected anthropometric measurements in primary care.

    abstract:BACKGROUND:Measuring body mass index (BMI) has been proposed as a method of screening for preventive primary care and population surveillance of childhood obesity. However, the accuracy of routinely collected measurements has been questioned. The purpose of this study was to assess the reliability of height, length and...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0726-8

    authors: Carsley S,Parkin PC,Tu K,Pullenayegum E,Persaud N,Maguire JL,Birken CS,TARGet Kids! Collaboration.

    更新日期:2019-04-24 00:00:00

  • Blood spots as an alternative to whole blood collection and the effect of a small monetary incentive to increase participation in genetic association studies.

    abstract:BACKGROUND:Collection of buccal cells from saliva for DNA extraction offers a less invasive and convenient alternative to venipuncture blood collection that may increase participation in genetic epidemiologic studies. However, dried blood spot collection, which is also a convenient method, offers a means of collecting ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-9-76

    authors: Bhatti P,Kampa D,Alexander BH,McClure C,Ringer D,Doody MM,Sigurdson AJ

    更新日期:2009-11-13 00:00:00

  • Recruiting and motivating black subjects to complete a lengthy survey in a large cohort study: an exploration of different strategies.

    abstract:BACKGROUND:The effectiveness of multiple innovative recruitment strategies for enrolling Black/African American participants to the Adventist Health Study-2 (AHS-2) is described. The study's focus is diet and breast, prostate and colon cancer. METHODS:Promotions centered on trust, relationship building and incentives ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-14-46

    authors: Herring P,Butler T,Hall S,Bennett H,Montgomery SB,Fraser G

    更新日期:2014-04-03 00:00:00

  • Consistency between stated and revealed preferences: a discrete choice experiment and a behavioural experiment on vaccination behaviour compared.

    abstract:BACKGROUND:Discrete Choice Experiments (DCEs) are increasingly used in studies in healthcare research but there is still little empirical evidence for the predictive value of these hypothetical situations in similar real life circumstances. The aim of this paper is to compare the stated preferences in a DCE and the acc...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-015-0010-5

    authors: Lambooij MS,Harmsen IA,Veldwijk J,de Melker H,Mollema L,van Weert YW,de Wit GA

    更新日期:2015-03-12 00:00:00

  • Reliability of the modified child and adolescent physical activity and nutrition survey, physical activity (CAPANS-PA) questionnaire among Chinese-Australian youth.

    abstract:BACKGROUND:Evidence suggests that differences exist in physical activity (PA) participation among Culturally and Linguistically Diverse (CALD) children and adolescents. It is possible that these differences could be influenced by variations in measurement technique and instrument reliability. However, culturally sensit...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-122

    authors: Strugnell C,Renzaho A,Ridley K,Burns C

    更新日期:2011-08-25 00:00:00

  • Methods to increase response rates to a population-based maternity survey: a comparison of two pilot studies.

    abstract:BACKGROUND:Surveys are established methods for collecting population data that are unavailable from other sources; however, response rates to surveys are declining. A number of methods have been identified to increase survey returns yet response rates remain low. This paper evaluates the impact of five selected methods...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0702-3

    authors: Harrison S,Henderson J,Alderdice F,Quigley MA

    更新日期:2019-03-20 00:00:00

  • The Platino project: methodology of a multicenter prevalence survey of chronic obstructive pulmonary disease in major Latin American cities.

    abstract:BACKGROUND:The prevalence of Chronic Obstructive Pulmonary Disease (COPD) in many developed countries appears to be increasing. There is some evidence from Latin America that COPD is a growing cause of death, but information on prevalence is scant. It is possible that, due to the high frequency of smoking in these coun...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-4-15

    authors: Menezes AM,Victora CG,Perez-Padilla R,PLATINO Team.

    更新日期:2004-06-17 00:00:00

  • Combining estimates of interest in prognostic modelling studies after multiple imputation: current practice and guidelines.

    abstract:BACKGROUND:Multiple imputation (MI) provides an effective approach to handle missing covariate data within prognostic modelling studies, as it can properly account for the missing data uncertainty. The multiply imputed datasets are each analysed using standard prognostic modelling techniques to obtain the estimates of ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,实务指引

    doi:10.1186/1471-2288-9-57

    authors: Marshall A,Altman DG,Holder RL,Royston P

    更新日期:2009-07-28 00:00:00

  • Correction for retest effects across repeated measures of cognitive functioning: a longitudinal cohort study of postoperative delirium.

    abstract:BACKGROUND:Few studies have compared methods to correct for retest effects or practice effects in settings where an acute event could influence test performance, such as major surgery. Our goal in this study was to evaluate the use of different methods to correct for the effects of practice or retest on repeated test a...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-018-0530-x

    authors: Racine AM,Gou Y,Fong TG,Marcantonio ER,Schmitt EM,Travison TG,Inouye SK,Jones RN

    更新日期:2018-07-03 00:00:00

  • Reported frequency of physical activity in a large epidemiological study: relationship to specific activities and repeatability over time.

    abstract:BACKGROUND:How overall physical activity relates to specific activities and how reported activity changes over time may influence interpretation of observed associations between physical activity and health. We examine the relationships between various physical activities self-reported at different times in a large coh...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-97

    authors: Armstrong ME,Cairns BJ,Green J,Reeves GK,Beral V,Million Women Study Collaborators.

    更新日期:2011-06-22 00:00:00

  • Estimating required information size by quantifying diversity in random-effects model meta-analyses.

    abstract:BACKGROUND:There is increasing awareness that meta-analyses require a sufficiently large information size to detect or reject an anticipated intervention effect. The required information size in a meta-analysis may be calculated from an anticipated a priori intervention effect or from an intervention effect suggested b...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-9-86

    authors: Wetterslev J,Thorlund K,Brok J,Gluud C

    更新日期:2009-12-30 00:00:00

  • Measurement and control of bias in patient reported outcomes using multidimensional item response theory.

    abstract:BACKGROUND:Patient-reported outcome (PRO) measures play a key role in the advancement of patient-centered care research. The accuracy of inferences, relevance of predictions, and the true nature of the associations made with PRO data depend on the validity of these measures. Errors inherent to self-report measures can ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0161-z

    authors: Dowling NM,Bolt DM,Deng S,Li C

    更新日期:2016-05-26 00:00:00

  • A transdisciplinary team approach to scoping reviews: the case of pediatric polypharmacy.

    abstract:BACKGROUND:Polypharmacy can be either beneficial or harmful to children. We conducted a scoping review to examine the concept of pediatric polypharmacy: its definition, prevalence, extent and gaps in research. In this manuscript, we report our transdisciplinary scoping review methodology. METHODS:After establishing a ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-018-0560-4

    authors: Bakaki PM,Staley J,Liu R,Dawson N,Golchin N,Horace A,Johnson H,Waldron J,Winterstein A,Kleinman LC,Bolen SD

    更新日期:2018-10-04 00:00:00

  • The use of individual cut points from treadmill walking to assess free-living moderate to vigorous physical activity in obese subjects by accelerometry: is it useful?

    abstract:BACKGROUND:Variation in counts between subjects at a given speed or work rate are the most important source of error in physical activity (PA) measurements with accelerometers. The aim of this study was to explore how the use of individual accelerometer cut points (ICPs) affected the analysis of PA field data. METHODS...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-172

    authors: Aadland E,Steene-Johannessen J

    更新日期:2012-11-15 00:00:00

  • Psychometric properties of a short version of the Job Anxiety Scale.

    abstract:BACKGROUND:Occupational stress and specifically job anxiety are crucial factors in determining health outcomes, job satisfaction as well as performance. In order to assess this phenomenon, the Job Anxiety Scale is one of the instruments available. It consists of 70 items that are clustered in 14 subscales and five dime...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,收录出版

    doi:10.1186/s12874-020-00974-4

    authors: Schmalbach B,Kalkbrenner A,Bassler M,Hinz A,Petrowski K

    更新日期:2020-04-21 00:00:00

  • Prediction intervals for future BMI values of individual children: a non-parametric approach by quantile boosting.

    abstract:BACKGROUND:The construction of prediction intervals (PIs) for future body mass index (BMI) values of individual children based on a recent German birth cohort study with n = 2007 children is problematic for standard parametric approaches, as the BMI distribution in childhood is typically skewed depending on age. METHO...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-6

    authors: Mayr A,Hothorn T,Fenske N

    更新日期:2012-01-25 00:00:00

  • Variance constraints strongly influenced model performance in growth mixture modeling: a simulation and empirical study.

    abstract:BACKGROUND:Growth Mixture Modeling (GMM) is commonly used to group individuals on their development over time, but convergence issues and impossible values are common. This can result in unreliable model estimates. Constraining variance parameters across classes or over time can solve these issues, but can also serious...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01154-0

    authors: Sijbrandij JJ,Hoekstra T,Almansa J,Peeters M,Bültmann U,Reijneveld SA

    更新日期:2020-11-12 00:00:00

  • Validating and updating a risk model for pneumonia - a case study.

    abstract:BACKGROUND:The development of risk prediction models is of increasing importance in medical research - their use in practice, however, is rare. Among other reasons this might be due to the fact that thorough validation is often lacking. This study focuses on two Bayesian approaches of how to validate a prediction rule ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-99

    authors: Held U,Bové DS,Steurer J,Held L

    更新日期:2012-07-20 00:00:00

  • Validation of the French version of the Vulnerable Elders Survey-13 (VES-13).

    abstract:BACKGROUND:Identifying and assessing degree and type of frailty among older persons is a major challenge when targeting high risk populations to identify preventive interventions. The Vulnerable Elders Survey-(VES-13) is a simple instrument to identify frailty defined as risk for death, functional decline or institutio...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-0910-x

    authors: Belmin J,Khellaf L,Pariel S,Jarzebowski W,Valembois L,Zeisel J,Lafuente-Lafuente C

    更新日期:2020-02-05 00:00:00

  • Workplace restructurings in intervention studies - a challenge for design, analysis and interpretation.

    abstract:BACKGROUND:Interventions in occupational health often target worksites rather than individuals. The objective of this paper is to describe the (lack of) stability in units of analysis in occupational health and safety intervention projects directed toward worksites. METHODS:A case study approach is used to describe na...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-8-39

    authors: Olsen O,Albertsen K,Nielsen ML,Poulsen KB,Gron SM,Brunnberg HL

    更新日期:2008-06-13 00:00:00

  • Scratch lottery tickets are a poor incentive to respond to mailed questionnaires.

    abstract:BACKGROUND:It has been demonstrated that the enclosure of money with a mailed questionnaire increases the response rate significantly. We evaluated scratch lottery tickets as an alternative to cash. METHODS:1500 randomly selected Norwegians between the ages of 40 and 65 years were sent a short questionnaire. 250 recei...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/1471-2288-6-19

    authors: Finsen V,Storeheier AH

    更新日期:2006-04-28 00:00:00

  • Simulation-based estimation of mean and standard deviation for meta-analysis via Approximate Bayesian Computation (ABC).

    abstract:BACKGROUND:When conducting a meta-analysis of a continuous outcome, estimated means and standard deviations from the selected studies are required in order to obtain an overall estimate of the mean effect and its confidence interval. If these quantities are not directly reported in the publications, they must be estima...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-015-0055-5

    authors: Kwon D,Reis IM

    更新日期:2015-08-12 00:00:00

  • European Medicines Agency Policy 0070: an exploratory review of data utility in clinical study reports for academic research.

    abstract:BACKGROUND:Clinical study reports (CSRs) have been increasingly utilised within academic research in recent years. European Medicines Agency (EMA) Policy 0070 'Phase 1,' which came into effect in January 2015, requires the publication of regulatory documents such as CSRs from central applications in an anonymised forma...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/s12874-019-0836-3

    authors: Ferran JM,Nevitt SJ

    更新日期:2019-11-05 00:00:00

  • The rise of multiple imputation: a review of the reporting and implementation of the method in medical research.

    abstract:BACKGROUND:Missing data are common in medical research, which can lead to a loss in statistical power and potentially biased results if not handled appropriately. Multiple imputation (MI) is a statistical method, widely adopted in practice, for dealing with missing data. Many academic journals now emphasise the importa...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/s12874-015-0022-1

    authors: Hayati Rezvan P,Lee KJ,Simpson JA

    更新日期:2015-04-07 00:00:00

  • Suitability of measures of self-reported medication adherence for routine clinical use: a systematic review.

    abstract:BACKGROUND:There is a recognised need to build primary care medication adherence services which are tailored to patients' needs. Continuous quality improvement of such services requires a regular working method of measuring adherence in order to monitor effectiveness. Self report has been considered the method of choic...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/1471-2288-11-149

    authors: Garfield S,Clifford S,Eliasson L,Barber N,Willson A

    更新日期:2011-11-03 00:00:00

  • Evaluation of a modified version of the Posttraumatic Growth Inventory-Short Form.

    abstract:BACKGROUND:Posttraumatic growth is the positive change resulting from traumatic experiences and is typically assessed with retrospective measures like the Posttraumatic Growth Inventory (PTGI). The PTGI was designed to include reference to a specific traumatic event, making it difficult to implement, without change, in...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0344-2

    authors: Kaur N,Porter B,LeardMann CA,Tobin LE,Lemus H,Luxton DD,Millennium Cohort Study Team.

    更新日期:2017-04-20 00:00:00

  • Feasibility and validity of a statistical adjustment to reduce self-report bias of height and weight in wave 1 of the Add Health study.

    abstract:BACKGROUND:Bias in adolescent self-reported height and weight is well documented. Given the importance and widespread use of the National Longitudinal Study of Adolescent to Adult Health (Add Health) data for obesity research, we developed and tested the feasibility and validity of an empirically derived statistical co...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0227-y

    authors: Liechty JM,Bi X,Qu A

    更新日期:2016-09-22 00:00:00

  • Forecasts of COPD mortality in Australia: 2006-2025.

    abstract:BACKGROUND:Chronic Obstructive Pulmonary Disease (COPD) is currently the fifth leading cause of death in Australia, and there are marked differences in mortality trends between men and women. In this study, we have sought to model and forecast age related changes in COPD mortality over time for men and women separately...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-17

    authors: Erbas B,Ullah S,Hyndman RJ,Scollo M,Abramson M

    更新日期:2012-02-21 00:00:00