Multivariable adjustments counteract spectrum and test review bias in accuracy studies.

Abstract:

OBJECTIVES:The STAndards for Reporting studies of Diagnostic accuracy (STARD) for investigators and editors and the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) for reviewers and readers offer guidelines for the quality and reporting of test accuracy studies. These guidelines address and propose some solutions to two major threats to validity: spectrum bias and test review bias. STUDY DESIGN AND SETTING:Using a clinical example, we demonstrate that these solutions fail and propose an alternative solution that concomitantly addresses both sources of bias. We also derive formulas that prove the generality of our arguments. RESULTS:A logical extension of our ideas is to extend STARD item 23 by adding a requirement for multivariable statistical adjustment using information collected in QUADAS items 1, 2, and 12 and STARD items 3-5, 11, 15, and 18. CONCLUSION:We recommend reporting not only variation of diagnostic accuracy across subgroups (STARD item 23) but also the effects of the multivariable adjustments on test performance. We also suggest that the QUADAS be supplemented by an item addressing the appropriateness of statistical methods, in particular whether multivariable adjustments have been included in the analysis.

journal_name

J Clin Epidemiol

authors

Bachmann LM,ter Riet G,Weber WE,Kessels AG

doi

10.1016/j.jclinepi.2008.02.007

subject

Has Abstract

pub_date

2009-04-01 00:00:00

pages

357-361.e2

issue

4

eissn

0895-4356

issn

1878-5921

pii

S0895-4356(08)00056-5

journal_volume

62

pub_type

杂志文章
  • Methods to evaluate risks for composite end points and their individual components.

    abstract:OBJECTIVE:Both randomized and observational studies commonly examine composite end points, but the literature on model development and criticism in this setting is limited. STUDY DESIGN AND SETTING:We examined approaches for evaluating heterogeneity in the effects of risk factors for different components of the end po...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2003.02.001

    authors: Glynn RJ,Rosner B

    更新日期:2004-02-01 00:00:00

  • Sieve analysis: methods for assessing from vaccine trial data how vaccine efficacy varies with genotypic and phenotypic pathogen variation.

    abstract::A key component in the evaluation of efficacy of a vaccine to protect against disease caused by an antigenically diverse infectious pathogen in a preventative vaccine trial is assessing how vaccine-induced protection depends on genotypic and phenotypic variations of the exposing pathogen. This assessment is made by co...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/s0895-4356(00)00258-4

    authors: Gilbert P,Self S,Rao M,Naficy A,Clemens J

    更新日期:2001-01-01 00:00:00

  • The evolving clinical status of patients after a myocardial infarction: the importance of post-hospital data for mortality prediction.

    abstract::Studies predicting mortality after myocardial infarction (MI) usually rely on in-hospital data, and combine patients admitted for the first MI with recurrent MI patients. Since treatment decisions are often made or modified at the first outpatient clinic visit, this study was designed to evaluate the importance of pos...

    journal_title:Journal of clinical epidemiology

    pub_type: 临床试验,杂志文章,多中心研究,随机对照试验

    doi:10.1016/s0895-4356(96)00221-1

    authors: Elmore JG,Viscoli CM,Horwitz RI

    更新日期:1996-11-01 00:00:00

  • Simultaneous interval estimates of the odds ratio in studies with two or more comparisons.

    abstract::More than one odds ratio estimate will often arise from a single epidemiologic study. Examples of designs where this may occur include those where there is more than one case or control group, and investigations of several risk factors as part of the same study. Various methods for presenting multiple interval estimat...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(89)90132-7

    authors: Holford TR,Walter SD,Dunnett CW

    更新日期:1989-01-01 00:00:00

  • Larger effect sizes in nonrandomized studies are associated with higher rates of EMA licensing approval.

    abstract:OBJECTIVES:The aim of this study was to evaluate how often the European Medicines Agency (EMA) has authorized drugs based on nonrandomized studies and whether there is an association between treatment effects and EMA preference for further testing in randomized clinical trials (RCTs). STUDY DESIGN AND SETTING:We revie...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2018.01.011

    authors: Djulbegovic B,Glasziou P,Klocksieben FA,Reljic T,VanDenBergh M,Mhaskar R,Ioannidis JPA,Chalmers I

    更新日期:2018-06-01 00:00:00

  • The qualification period.

    abstract::For randomized trials that do not require prompt onset of therapy, a pre-admission preparation, called the qualification period, can deal with certain customary difficulties in design, analysis, and ethics. For the patients' baseline state, the qualification period can be used to "wash out" effects of previous treatme...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(91)90208-q

    authors: Knipschild P,Leffers P,Feinstein AR

    更新日期:1991-01-01 00:00:00

  • Developing a stroke severity index based on administrative data was feasible using data mining techniques.

    abstract:OBJECTIVES:Case-mix adjustment is difficult for stroke outcome studies using administrative data. However, relevant prescription, laboratory, procedure, and service claims might be surrogates for stroke severity. This study proposes a method for developing a stroke severity index (SSI) by using administrative data. ST...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2015.01.009

    authors: Sung SF,Hsieh CY,Kao Yang YH,Lin HJ,Chen CH,Chen YW,Hu YH

    更新日期:2015-11-01 00:00:00

  • Examination by logistic regression modelling of the variables which increase the relative risk of elderly women falling compared to elderly men.

    abstract::In a community based, prospective study to determine risk factors for falls, 465 women and 296 men 70 years and over were followed for 1 year and 507 falls were documented. A greater proportion of women (32.7%) than men (23.0%) experienced at least one fall in which there was no or minimal external contribution. Using...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(90)90110-b

    authors: Campbell AJ,Spears GF,Borrie MJ

    更新日期:1990-01-01 00:00:00

  • Conflict of interest as ethical shorthand: understanding the range and nature of "non-financial conflict of interest" in biomedicine.

    abstract:OBJECTIVES:The aim of the study was to identify the range of issues labeled as "non-financial conflicts of interest" in biomedicine, articulate the associated concerns, and analyze the implications of defining these issues as conflicts of interest. STUDY DESIGN AND SETTING:This was a qualitative study, triangulating d...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2019.12.014

    authors: Grundy Q,Mayes C,Holloway K,Mazzarello S,Thombs BD,Bero L

    更新日期:2020-04-01 00:00:00

  • Reporting of core items in hierarchical Bayesian analysis for aggregating N-of-1 trials to estimate population treatment effects is suboptimal.

    abstract:OBJECTIVES:N-of-1 trials can be aggregated to estimate population treatment effects using hierarchical Bayesian models. It is very important to report core items in hierarchical Bayesian analysis. In this study, we assessed reporting of items in hierarchical Bayesian analysis for aggregating N-of-1 trials to estimate p...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2016.02.023

    authors: Zhai J,Cao H,Ren M,Mu W,Lv S,Si J,Wang H,Chen J,Shang H

    更新日期:2016-08-01 00:00:00

  • Variation in the duration of protection given by screening using the Pap test for cervical cancer.

    abstract::The duration of protection offered by Pap screening for cervical cancer was examined using data on 101 cases of invasive cervical cancer and 396 controls from a Maryland case-control study. Receipt of a Pap test up to 4 years ago afforded significant protection, compared to women screened 11 or more years ago, or neve...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(89)90166-2

    authors: Klassen AC,Celentano DD,Brookmeyer R

    更新日期:1989-01-01 00:00:00

  • An embedded mixed-methods study highlighted a lack of discussions on retention in clinical trial consultations.

    abstract:OBJECTIVES:This study investigated trial consultations to identify whether and to what extent discussions of retention are present. STUDY DESIGN AND SETTING:This embedded mixed-methods study design included a purposive sample of audio-recorded trial consultations obtained from four sites of a large multicenter UK-base...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2020.03.011

    authors: Tunji-Ajayi P,Duncan EM,Gillies K

    更新日期:2020-07-01 00:00:00

  • Use of goal attainment scaling in measuring clinically important change in cognitive rehabilitation patients.

    abstract::Measuring the effectiveness of cognitive rehabilitation programs poses both conceptual and practical challenges. We compared several standardized outcome measures with goal attainment scaling (GAS) to assess their sensitivity to changes in health status in patients undergoing cognitive rehabilitation. GAS is a measure...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(97)00014-0

    authors: Rockwood K,Joyce B,Stolee P

    更新日期:1997-05-01 00:00:00

  • The measurement of health: a comparison of indices of disease severity.

    abstract::This study compared the utility of different health indicators in frail older people, as a component of a larger study of medical evaluations of 183 adult day care participants in five Maryland centers. Indices examined included: number of disease categories, number of active categories, number of severe categories, n...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(01)00389-4

    authors: Cohen-Mansfield J,Pawlson G,Lipson S,Volpato S

    更新日期:2001-11-01 00:00:00

  • GRADE guidelines: 10. Considering resource use and rating the quality of economic evidence.

    abstract:OBJECTIVES:In this article, we describe how to include considerations about resource utilization when making recommendations according to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach. STUDY DESIGN AND SETTINGS:We focus on challenges with rating the confidence in effect estima...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2012.04.012

    authors: Brunetti M,Shemilt I,Pregno S,Vale L,Oxman AD,Lord J,Sisk J,Ruiz F,Hill S,Guyatt GH,Jaeschke R,Helfand M,Harbour R,Davoli M,Amato L,Liberati A,Schünemann HJ

    更新日期:2013-02-01 00:00:00

  • Frailty bias in comorbidity risk adjustments of community-dwelling elderly populations.

    abstract::Our objective was to describe distortion in outcome studies due to "frailty bias" or differential susceptibility to adverse health outcomes due to frailties but attributed to other factors. We linked an administrative database to survey data (n = 5934) containing functional, condition, and outcome measures. The diseas...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(99)00056-6

    authors: Pressley JC,Patrick CH

    更新日期:1999-08-01 00:00:00

  • A case-control study found that low albumin and smoking were associated with aortic dissection.

    abstract:OBJECTIVE:Hypertension is a risk factor for aortic dissection. Besides hypertension, associated factors for incidence of aortic dissection are not clear. The aim of this study was to examine whether other factors exist by an epidemiologic case-control approach. STUDY DESIGN AND SETTING:240 consecutive cases suffering ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2003.09.010

    authors: Takeuchi T,Adachi H,Ohuchida M,Nakamura T,Satoh A,Jacobs DR Jr,Imaizumi T

    更新日期:2004-04-01 00:00:00

  • Abbreviated literature searches were viable alternatives to comprehensive searches: a meta-epidemiological study.

    abstract:OBJECTIVE:To assess the effects of abbreviated literature searches on evidence syntheses conclusions. STUDY DESIGN AND SETTING:We randomly selected 60 Cochrane reviews of clinical interventions and repeated literature searches using 14 abbreviated approaches (combinations of MEDLINE, Embase, CENTRAL with and without s...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,meta分析

    doi:10.1016/j.jclinepi.2018.05.022

    authors: Nussbaumer-Streit B,Klerings I,Wagner G,Heise TL,Dobrescu AI,Armijo-Olivo S,Stratil JM,Persad E,Lhachimi SK,Van Noord MG,Mittermayr T,Zeeb H,Hemkens L,Gartlehner G

    更新日期:2018-10-01 00:00:00

  • Optimal survey design for community intervention evaluations: cohort or cross-sectional?

    abstract::Community intervention evaluations that measure changes over time may conduct repeated cross-sectional surveys, follow a cohort of residents over time, or (often) use both designs. Each survey design has implications for precision and cost. To explore these issues, we assume that two waves of surveys are conducted, an...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(95)00055-0

    authors: Diehr P,Martin DC,Koepsell T,Cheadle A,Psaty BM,Wagner EH

    更新日期:1995-12-01 00:00:00

  • Comparison of the statistical efficiency of case-crossover and case-control designs: application to severe cutaneous adverse reactions.

    abstract::Although case-crossover analyses have lately emerged as an alternative to case-control analyses in epidemiological studies, it is not yet known in which situations they give reliable conclusions. In this work, the case-crossover and the case-control designs were first compared on the basis of a dataset from a publishe...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(01)00404-8

    authors: Viboud C,Boëlle PY,Kelly J,Auquier A,Schlingmann J,Roujeau JC,Flahault A

    更新日期:2001-12-01 00:00:00

  • Changes to the subscales of two vision-related quality of life questionnaires are proposed.

    abstract:BACKGROUND AND OBJECTIVE:Psychometrically sound questionnaires for the assessment of vision-related quality of life (QOL) are scarce. Therefore, the objective was to further validate two vision-related QOL questionnaires in a Dutch population of visually impaired elderly. METHODS:A total of 329 visually impaired older...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2005.04.007

    authors: de Boer MR,de Vet HC,Terwee CB,Moll AC,Völker-Dieben HJ,van Rens GH

    更新日期:2005-12-01 00:00:00

  • Statistically significant meta-analyses of clinical trials have modest credibility and inflated effects.

    abstract:OBJECTIVE:To assess whether nominally statistically significant effects in meta-analyses of clinical trials are true and whether their magnitude is inflated. STUDY DESIGN AND SETTING:Data from the Cochrane Database of Systematic Reviews 2005 (issue 4) and 2010 (issue 1) were used. We considered meta-analyses with bina...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2010.12.012

    authors: Pereira TV,Ioannidis JP

    更新日期:2011-10-01 00:00:00

  • The Indonesian Drug Advisory Committee and the drug approval process.

    abstract::The Indonesian Food and Drug Agency began to evaluate drug applications in the early 1970s through an Advisory Committee. This was in response to the perestroika-like policy applied to our drug industry; nowadays there are more than 300 drug companies formulating some 13,5600 drug products. During 1977-1988, 603 drugs...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(91)90111-l

    authors: Darmansjah I,Wardhini S

    更新日期:1991-01-01 00:00:00

  • External validation of prognostic models for critically ill patients required substantial sample sizes.

    abstract:OBJECTIVE:To investigate the behavior of predictive performance measures that are commonly used in external validation of prognostic models for outcome at intensive care units (ICUs). STUDY DESIGN AND SETTING:Four prognostic models (Simplified Acute Physiology Score II, the Acute Physiology and Chronic Health Evaluati...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2006.08.011

    authors: Peek N,Arts DG,Bosman RJ,van der Voort PH,de Keizer NF

    更新日期:2007-05-01 00:00:00

  • Confirmation of self-report of HIV testing among a cohort of pregnant women.

    abstract::Early identification of pregnant women infected with the human immunodeficiency virus (HIV) is becoming increasingly important in light of recent findings that interventions during and shortly after pregnancy can reduce the rates of vertical transmission. The ability of patients to accurately self-report previous HIV ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(96)00301-0

    authors: O'Campo P,de Boer M,Faden R,Kass N,Gielen A,Barbacci M

    更新日期:1997-01-01 00:00:00

  • Asymptomatic peripheral arterial occlusive disease predicted cardiovascular morbidity and mortality in a 7-year follow-up study.

    abstract:OBJECTIVE:Asymptomatic peripheral arterial occlusive disease (PAOD) is a common atherosclerotic disorder among the elderly population. Scarce data are available on the risk of nonfatal and fatal cardiovascular diseases in these subjects. We investigated cardiovascular morbidity and mortality of asymptomatic PAOD subjec...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.jclinepi.2003.09.003

    authors: Hooi JD,Kester AD,Stoffers HE,Rinkens PE,Knottnerus JA,van Ree JW

    更新日期:2004-03-01 00:00:00

  • Plasma fibrinogen and coronary risk factors: the Scottish Heart Health Study.

    abstract::Plasma fibrinogen was measured in a sample of 8824 men and women aged 40-59 years participating in the Scottish Heart Health Study, and related to cardiovascular risk factors. Women had higher fibrinogen levels than men. In both sexes, multivariate analysis showed that fibrinogen was positively associated with age, sm...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(90)90075-z

    authors: Lee AJ,Smith WC,Lowe GD,Tunstall-Pedoe H

    更新日期:1990-01-01 00:00:00

  • An e-mail survey identified unpublished studies for systematic reviews.

    abstract:BACKGROUND AND OBJECTIVE:A large number of trials remain difficult to locate or unpublished for systematic reviews. The objective of this article was to determine the usefulness of making e-mail contact with authors of clinical trials and literature reviews found in MEDLINE to identify unpublished or difficult to locat...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2005.11.022

    authors: Reveiz L,Cardona AF,Ospina EG,de Agular S

    更新日期:2006-07-01 00:00:00

  • Time-to-event methodology improved statistical evaluation in register-based health services research.

    abstract:OBJECTIVES:Complex longitudinal sampling and the observational structure of patient registers in health services research are associated with methodological challenges regarding data management and statistical evaluation. We exemplify common pitfalls and want to stimulate discussions on the design, development, and dep...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.jclinepi.2016.11.001

    authors: Bluhmki T,Bramlage P,Volk M,Kaltheuner M,Danne T,Rathmann W,Beyersmann J

    更新日期:2017-02-01 00:00:00

  • Public and private hypotheses.

    abstract::The uses of hypothesis in scientific medicine and in clinical medicine are broadly similar; but they differ in subtle but important logical details. The key distinction is that scientific medicine deals with broad ("public") hypotheses about entire populations; and the predominant problem of inference is statistics in...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(89)90028-0

    authors: Murphy EA

    更新日期:1989-01-01 00:00:00