The Problem with "Magnitude-based Inference".

Abstract:

PURPOSE:A statistical method called "magnitude-based inference" (MBI) has gained a following in the sports science literature, despite concerns voiced by statisticians. Its proponents have claimed that MBI exhibits superior type I and type II error rates compared with standard null hypothesis testing for most cases. I have performed a reanalysis to evaluate this claim. METHODS:Using simulation code provided by MBI's proponents, I estimated type I and type II error rates for clinical and nonclinical MBI for a range of effect sizes, sample sizes, and smallest important effects. I plotted these results in a way that makes transparent the empirical behavior of MBI. I also reran the simulations after correcting mistakes in the definitions of type I and type II error provided by MBI's proponents. Finally, I confirmed the findings mathematically; and I provide general equations for calculating MBI's error rates without the need for simulation. RESULTS:Contrary to what MBI's proponents have claimed, MBI does not exhibit "superior" type I and type II error rates to standard null hypothesis testing. As expected, there is a tradeoff between type I and type II error. At precisely the small-to-moderate sample sizes that MBI's proponents deem "optimal," MBI reduces the type II error rate at the cost of greatly inflating the type I error rate-to two to six times that of standard hypothesis testing. CONCLUSIONS:Magnitude-based inference exhibits worrisome empirical behavior. In contrast to standard null hypothesis testing, which has predictable type I error rates, the type I error rates for MBI vary widely depending on the sample size and choice of smallest important effect, and are often unacceptably high. Magnitude-based inference should not be used.

journal_name

Med Sci Sports Exerc

authors

Sainani KL

doi

10.1249/MSS.0000000000001645

subject

Has Abstract

pub_date

2018-10-01 00:00:00

pages

2166-2176

issue

10

eissn

0195-9131

issn

1530-0315

journal_volume

50

pub_type

杂志文章
  • Identifying children's nocturnal sleep using 24-h waist accelerometry.

    abstract:PURPOSE:The purposes of this study were 1) to add layers and features to a previously published fully automated algorithm designed to identify children's nocturnal sleep and to exclude episodes of nighttime nonwear/wakefulness and potentially misclassified daytime sleep episodes and 2) to validate this refined sleep al...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1249/MSS.0000000000000486

    authors: Barreira TV,Schuna JM Jr,Mire EF,Katzmarzyk PT,Chaput JP,Leduc G,Tudor-Locke C

    更新日期:2015-05-01 00:00:00

  • Arterial morphology and blood volumes of rats following 10-14 weeks of tail suspension.

    abstract::We hypothesized that the structure of systemic arteries would be altered following 10-14 wk of hindlimb unloading (tail suspension) in female Sprague-Dawley rats. Tail suspension resulted in atrophy of the soleus muscle (P < or = 0.01) but no significant differences in the mass of the extensor digitorum muscle, heart,...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1097/00005768-199710000-00005

    authors: Chew HG Jr,Segal SS

    更新日期:1997-10-01 00:00:00

  • Reconsidering the effects of respiratory constraints on the optimal running speed.

    abstract:INTRODUCTION:Although both humans and quadrupeds frequently coordinate breathing and limb movement during running, early studies in humans focused on how increased breathing flexibility in humans allowed for relaxed or even transient coordination during locomotion. This difference was used to explain why quadrupeds had...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1249/MSS.0b013e318248d907

    authors: Willcockson MA,Wall-Scheffler CM

    更新日期:2012-07-01 00:00:00

  • Physical activity and active commuting to elementary school.

    abstract:PURPOSE:This study was conducted to determine if fifth-grade students who walked or bicycled to school on a regular basis were more physically active than those that did not. METHODS:The sample consists of 219 fifth-grade students (10.3 +/- 0.6 yr, 44% male, 58% minority) from eight randomly selected urban and suburba...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1249/01.mss.0000179102.17183.6b

    authors: Sirard JR,Riner WF Jr,McIver KL,Pate RR

    更新日期:2005-12-01 00:00:00

  • Prevalence of and traits associated with low BMD among female adolescent runners.

    abstract:PURPOSE:Identify the prevalence of and traits that may increase the risk of low bone mineral density (BMD) among 93 female adolescent competitive endurance runners. METHODS:Participants were 93 high school runners, ages 13-18 yr, from southern California. Eating attitudes and behaviors were assessed using the Eating D...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1249/MSS.0b013e3181822ea0

    authors: Barrack MT,Rauh MJ,Nichols JF

    更新日期:2008-12-01 00:00:00

  • Water running with and without a flotation vest in competitive and recreational runners.

    abstract::The purpose of this study was to determine whether competitive and recreational runners would replicate land training intensity during water immersion (WI) running with (V) and without (NV) a flotation vest and during treadmill running (Tm). Seven female competitive runners (CR) and seven female noncompetitive runners...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1097/00005768-199710000-00015

    authors: Gehring MM,Keller BA,Brehm BA

    更新日期:1997-10-01 00:00:00

  • Physical activity levels in patients with chronic kidney disease entering the LORD trial.

    abstract:PURPOSE:To assess physical activity, and its associations with health, clinical, and biochemical factors, in patients with stages 2-4 of chronic kidney disease (CKD). METHODS:Cross-sectional data were collected from 120 patients with CKD enrolled in the Lipid lowering and Onset of Renal Disease (LORD) trial. Patients ...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1249/MSS.0b013e3181940aef

    authors: Fassett RG,Robertson IK,Geraghty DP,Ball MJ,Burton NW,Coombes JS

    更新日期:2009-05-01 00:00:00

  • Mouth rinsing and ingesting a bitter solution improves sprint cycling performance.

    abstract:PURPOSE:There is evidence that carbohydrate (CHO) mouth rinsing can improve endurance exercise performance as well as muscle force production and sprint performance. Whether the oral administration of non-CHO tastants also affects exercise performance is not known. The purpose of this study was to investigate whether m...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1249/MSS.0000000000000271

    authors: Gam S,Guelfi KJ,Fournier PA

    更新日期:2014-08-01 00:00:00

  • Exercise-induced Changes in Soluble ST2 Concentrations in Marathon Runners.

    abstract:PURPOSE:Previous studies have suggested that extreme endurance exercise may induce cardiac microdamage that could lead to subsequent myocardial fibrosis. Soluble suppression of tumorigenicity 2 (sST2) is a cardiac biomarker for assessment of myocardial fibrosis, inflammation, and strain. We evaluated baseline and exerc...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1249/MSS.0000000000001806

    authors: Aengevaeren VL,VAN Kimmenade RRJ,Hopman MTE,VAN Royen N,Snider JV,Januzzi JL,George KP,Eijsvogels TMH

    更新日期:2019-03-01 00:00:00

  • Muscle-specific creatine kinase gene polymorphisms in elite endurance athletes and sedentary controls.

    abstract::The purpose of this study was to investigate the association between elite endurance athlete (EEA) status and two restriction fragment length polymorphisms (RFLPs) at the muscle-specific creatine kinase (CKMM) gene locus. Genomic DNA was extracted from white blood cells or lymphoblastoid cell lines of 124 unrelated Ca...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1097/00005768-199711000-00009

    authors: Rivera MA,Dionne FT,Wolfarth B,Chagnon M,Simoneau JA,Pérusse L,Boulay MR,Gagnon J,Song TM,Keul J,Bouchard C

    更新日期:1997-11-01 00:00:00

  • Delayed metabolic activation of oxidative phosphorylation in skeletal muscle at exercise onset.

    abstract::In "normal" conditions (e.g., normoxia, absence of pathological conditions) convective and diffusive O(2) delivery to skeletal muscle fibers do not seem to represent important determinants for the kinetics of adjustment of oxidative phosphorylation following increases in metabolic demand. Whereas a limiting role by PD...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章,评审

    doi:10.1249/01.mss.0000177472.67419.0a

    authors: Grassi B

    更新日期:2005-09-01 00:00:00

  • Stingers, transient quadriplegia, and cervical spinal stenosis: return to play criteria.

    abstract::This article focuses on sports related spinal cord and nerve injuries, ranging from mild "stinger" syndrome to complete quadriplegia. Particular emphasis is placed on recommendations for return to competition after such injuries. Cervical spinal cord symptoms after a spine injury from contact sports require a more pre...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1097/00005768-199707001-00005

    authors: Cantu RC

    更新日期:1997-07-01 00:00:00

  • Ground reaction forces and bone parameters in females with tibial stress fracture.

    abstract:PURPOSE:Tibial stress fracture is a common overuse running injury that results from the interplay of repetitive mechanical loading and bone strength. This research project aimed to determine whether female runners with a history of tibial stress fracture (TSF) differ in ground reaction force (GRF) parameters during run...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1249/01.mss.0000117116.90297.e1

    authors: Bennell K,Crossley K,Jayarajan J,Walton E,Warden S,Kiss ZS,Wrigley T

    更新日期:2004-03-01 00:00:00

  • Diaphragm Recruitment Increases during a Bout of Targeted Inspiratory Muscle Training.

    abstract:PURPOSE:The extent to which the diaphragm is targeted during a bout of inspiratory muscle training (IMT) is unknown. The purpose of this study was to characterize the relative activation patterns of the diaphragm and extradiaphragmatic inspiratory muscles during a bout of IMT and to determine whether diaphragmatic recr...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1249/MSS.0000000000000881

    authors: Ramsook AH,Koo R,Molgat-Seon Y,Dominelli PB,Syed N,Ryerson CJ,Sheel AW,Guenette JA

    更新日期:2016-06-01 00:00:00

  • Carbohydrate-electrolyte replacement improves distance running performance in the heat.

    abstract::The effects of a 7% carbohydrate-electrolyte drink (CE) and an artificially sweetened placebo (P) on performance and physiological function were compared during a 40-km run in the heat. Eight highly trained male runners completed two runs on a measured outdoor course. The first 35 km of each run was performed at self-...

    journal_title:Medicine and science in sports and exercise

    pub_type: 临床试验,杂志文章

    doi:

    authors: Millard-Stafford ML,Sparling PB,Rosskopf LB,DiCarlo LJ

    更新日期:1992-08-01 00:00:00

  • Healthy lifestyles of former Finnish world class athletes.

    abstract::Recently, Sarna et al. (Med. Sci. Sports Exerc. 25:237-244, 1993) reported increased mean life expectancy in former world class athletes. Because lifestyle is associated with longevity, we have examined whether health habits of former Finnish male athletes (N = 1274; present mean age: 57.5, range: 36-94 yr) differed f...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1249/00005768-199402000-00013

    authors: Fogelholm M,Kaprio J,Sarna S

    更新日期:1994-02-01 00:00:00

  • Symmetry and reproducibility of kinematic parameters during various running techniques.

    abstract:PURPOSE:This study examined the validity of the assumption of lower-extremity kinematic parameter reproducibility and symmetry during running with different velocities and stride frequencies. METHODS:Each of 12 female long-distance runners ran on a treadmill in combinations of three different velocities (2.5, 3.0, and...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1249/01.MSS.0000069337.49567.F0

    authors: Karamanidis K,Arampatzis A,Brüggemann GP

    更新日期:2003-06-01 00:00:00

  • Elite and amateur orienteers' running biomechanics on three surfaces at three speeds.

    abstract:PURPOSE:Orienteering athletes must adapt to running on various surfaces, with biomechanics likely contributing to performance. Here, our aims were to identify the effect of athletic status and of surface on the running biomechanics of orienteers. METHODS:Seven elite and seven amateur male orienteers ran 20 m on road, ...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1249/MSS.0000000000000413

    authors: Hébert-Losier K,Mourot L,Holmberg HC

    更新日期:2015-02-01 00:00:00

  • Lack of effect of oral Mg-supplementation on Mg in serum, blood cells, and calf muscle.

    abstract:UNLABELLED:Magnesium (Mg) is important for regulating ion transport and cellular metabolism in all body tissues. In skeletal muscle Mg is involved in the neuromuscular activity, excitation, and muscle contraction. Mg deficiency can cause muscle weakness and muscle cramps. Less than 1% of total body Mg is found in serum...

    journal_title:Medicine and science in sports and exercise

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1097/00005768-199811000-00005

    authors: Weller E,Bachert P,Meinck HM,Friedmann B,Bärtsch P,Mairbäurl H

    更新日期:1998-11-01 00:00:00

  • Plasma catecholamine response to acute psychological stress in humans: relation to aerobic fitness and exercise training.

    abstract::Existing cross-sectional studies on plasma catecholamine activity provide no support for the concept that a markedly high level of aerobic fitness modifies sympathoadrenal response to an acute psychological challenge in humans. In contrast, compromised sympathetic nervous system activity has been observed in individua...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章,评审

    doi:

    authors: Sothmann MS,Hart BA,Horn TS

    更新日期:1991-07-01 00:00:00

  • Ethnic differences in titratable acid excretion and bone mineralization.

    abstract:PURPOSE:To test our hypothesis that differences in urinary calcium excretion among blacks and whites may be secondary to ethnic variations in acid (H(+)) metabolism and to prove that increases in titratable acid excretion would be found among individuals predisposed to the development of stress fractures. METHODS:We a...

    journal_title:Medicine and science in sports and exercise

    pub_type: 临床试验,杂志文章

    doi:10.1097/00005768-200202000-00018

    authors: Vaitkevicius H,Witt R,Maasdam M,Walters K,Gould M,Mackenzie S,Farrow S,Lockette W

    更新日期:2002-02-01 00:00:00

  • The effect of rope skipping rate on energy expenditure of males and females.

    abstract::The purpose was to study the effects of skipping rate on energy expenditure and sex differences in response to rope skipping. Responses of 19 males and 11 females were measured while skipping for 5 min at 125, 135 and 145 skips . min-1. Expired air was routed through a hollow handle to collection bags to provide unint...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:

    authors: Town GP,Sol N,Sinning WE

    更新日期:1980-01-01 00:00:00

  • Associations of Muscle Mass and Strength with All-Cause Mortality among US Older Adults.

    abstract:INTRODUCTION:Recent studies suggested that muscle mass and muscle strength may independently or synergistically affect aging-related health outcomes in older adults; however, prospective data on mortality in the general population are sparse. METHODS:We aimed to prospectively examine individual and joint associations ...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1249/MSS.0000000000001448

    authors: Li R,Xia J,Zhang XI,Gathirua-Mwangi WG,Guo J,Li Y,McKenzie S,Song Y

    更新日期:2018-03-01 00:00:00

  • Energy expenditure by heart rate in children: an evaluation of calibration techniques.

    abstract:PURPOSE:To evaluate the impact of applying seven calibration equations (CE) in the estimation of free-living total energy expenditure (TEE) over 2-3 d in seven boys (mean +/- SD age 9.4+/-0.4 yr) by the Flex heart rate (HR) method. METHODS:HR and oxygen consumption were measured simultaneously for eight activities (ly...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1097/00005768-200008000-00022

    authors: Livingstone MB,Robson PJ,Totton M

    更新日期:2000-08-01 00:00:00

  • Mechanisms of compensating for anterior cruciate ligament deficiency during gait.

    abstract:INTRODUCTION:The quadriceps avoidance gait pattern may not be as common in ACL deficient (ACLd) gait as previously described. PURPOSE:The purpose of this study was to investigate the existence of the quadriceps avoidance pattern in ACL deficient patients and to further identify gait compensations that may exist in thi...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1249/01.mss.0000135797.09291.71

    authors: Torry MR,Decker MJ,Ellis HB,Shelburne KB,Sterett WI,Steadman JR

    更新日期:2004-08-01 00:00:00

  • Tape that increases medial longitudinal arch height also reduces leg muscle activity: a preliminary study.

    abstract:PURPOSE:: To evaluate the initial effects of antipronation taping (APT) on foot posture and electromyographic (EMG) activity of tibialis anterior (TA), tibialis posterior (TP), and peroneus longus (PL) muscles during walking. METHODS:: Five asymptomatic individuals who exhibited lower medial longitudinal arch height o...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1249/MSS.0b013e318162134f

    authors: Franettovich M,Chapman A,Vicenzino B

    更新日期:2008-04-01 00:00:00

  • Breathlessness predicts perceived exertion in young women with mild asthma.

    abstract::We examined ratings of breathlessness (BRE) as a predictor of perceived exertion (RPE) during incremental cycling at power outputs of 50, 75, and 100 W. Young females (21 yr +/- 1.9) diagnosed with mild asthma (N = 25) were compared with females having normal lung function (N = 25) matched for age, VO2peak, trait anxi...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:

    authors: Yorio JM,Dishman RK,Forbus WR,Cureton KJ,Graham RE

    更新日期:1992-08-01 00:00:00

  • The influence of body mass in cross-country skiing.

    abstract::The influence of body weight on the performance in cross-country skiing has been studied by: dimensional analysis of the ratio (R) between the factors of importance to power production (VO2max, acceleration of gravity) and the braking powers, e.g., friction and air resistance; measuring the energy cost of level skiing...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:

    authors: Bergh U

    更新日期:1987-08-01 00:00:00

  • A simple, reliable method of assessing exercise capacity in patients with chronic heart failure.

    abstract:OBJECTIVE:The accurate determination of limitations in physical activity is important in evaluating patients with heart failure and in assessing the efficacy of treatment. However, the conventional measures used to evaluate hemodynamics, functional class, and exercise capacity all have limitations. Our objective was to...

    journal_title:Medicine and science in sports and exercise

    pub_type: 杂志文章

    doi:10.1097/00005768-199901000-00010

    authors: Asakuma S,Fujiwara M,Ohyanagi M,Iwasaki T

    更新日期:1999-01-01 00:00:00

  • Six weeks of training does not change running mechanics or improve running economy.

    abstract::Running technique and economy (VO2submax) were examined before and after a 6-wk period of running training. Fifteen males were filmed and performed 10-min economy runs at 3.36 m.s-1 on a treadmill. An incremental treadmill test was used to record running performance and maximal oxygen consumption (VO2max). Subjects we...

    journal_title:Medicine and science in sports and exercise

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1097/00005768-199607000-00013

    authors: Lake MJ,Cavanagh PR

    更新日期:1996-07-01 00:00:00