Validating and updating a risk model for pneumonia - a case study.

Abstract:

BACKGROUND:The development of risk prediction models is of increasing importance in medical research - their use in practice, however, is rare. Among other reasons this might be due to the fact that thorough validation is often lacking. This study focuses on two Bayesian approaches of how to validate a prediction rule for the diagnosis of pneumonia, and compares them with established validation methods. METHODS:Expert knowledge was used to derive a risk prediction model for pneumonia. Data on more than 600 patients presenting with cough and fever at a general practitioner's practice in Switzerland were collected in order to validate the expert model and to examine the predictive performance of it. Additionally, four modifications of the original model including shrinkage of the regression coefficients, and two Bayesian approaches with the expert model used as prior mean and different weights for the prior covariance matrix were fitted. We quantify the predictive performance of the different methods with respect to calibration and discrimination, using cross-validation. RESULTS:The predictive performance of the unshrinked regression coefficients was poor when applied to the Swiss cohort. Shrinkage improved the results, but a Bayesian model formulation with unspecified weight of the informative prior lead to large AUC and small Brier score, naïve and after cross-validation. The advantage of this approach is the flexibility in case of a prior-data conflict. CONCLUSIONS:Published risk prediction rules in clinical research need to be validated externally before they can be used in new settings. We propose to use a Bayesian model formulation with the original risk prediction rule as prior. The posterior means of the coefficients, given the validation data showed best predictive performance with respect to cross-validated calibration and discriminative ability.

journal_name

BMC Med Res Methodol

authors

Held U,Bové DS,Steurer J,Held L

doi

10.1186/1471-2288-12-99

subject

Has Abstract

pub_date

2012-07-20 00:00:00

pages

99

issn

1471-2288

pii

1471-2288-12-99

journal_volume

12

pub_type

杂志文章
  • Health Equity Assessment Toolkit (HEAT): software for exploring and comparing health inequalities in countries.

    abstract:BACKGROUND:It is widely recognised that the pursuit of sustainable development cannot be accomplished without addressing inequality, or observed differences between subgroups of a population. Monitoring health inequalities allows for the identification of health topics where major group differences exist, dimensions of...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0229-9

    authors: Hosseinpoor AR,Nambiar D,Schlotheuber A,Reidpath D,Ross Z

    更新日期:2016-10-19 00:00:00

  • Impact of preconception enrollment on birth enrollment and timing of exposure assessment in the initial vanguard cohort of the U.S. National Children's Study.

    abstract:BACKGROUND:The initial vanguard cohort of the U.S. National Children's Study was a pregnancy and birth cohort study that sought to enroll some women prior to pregnancy, and to assess exposures early in pregnancy. METHODS:During the recruitment phase (2009-2010), geographically based sampling was used to recruit women ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-015-0067-1

    authors: Stanford JB,Brenner R,Fetterer D,Palmer L,Schoendorf KC,U.S. National Children’s Study.

    更新日期:2015-09-24 00:00:00

  • The Platino project: methodology of a multicenter prevalence survey of chronic obstructive pulmonary disease in major Latin American cities.

    abstract:BACKGROUND:The prevalence of Chronic Obstructive Pulmonary Disease (COPD) in many developed countries appears to be increasing. There is some evidence from Latin America that COPD is a growing cause of death, but information on prevalence is scant. It is possible that, due to the high frequency of smoking in these coun...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-4-15

    authors: Menezes AM,Victora CG,Perez-Padilla R,PLATINO Team.

    更新日期:2004-06-17 00:00:00

  • Does the association between adherence to statin medications and mortality depend on measurement approach? A retrospective cohort study.

    abstract:BACKGROUND:The aim of this study was to examine the relationship between mortality and statin adherence using two different approaches to adherence measurement (summary versus repeated-measures). METHODS:A retrospective cohort study was conducted using administrative data from Saskatchewan, Canada between 1994 and 200...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0339-z

    authors: Alsabbagh MW,Eurich D,Lix LM,Wilson TW,Blackburn DF

    更新日期:2017-04-20 00:00:00

  • Outcome-sensitive multiple imputation: a simulation study.

    abstract:BACKGROUND:Multiple imputation is frequently used to deal with missing data in healthcare research. Although it is known that the outcome should be included in the imputation model when imputing missing covariate values, it is not known whether it should be imputed. Similarly no clear recommendations exist on: the util...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0281-5

    authors: Kontopantelis E,White IR,Sperrin M,Buchan I

    更新日期:2017-01-09 00:00:00

  • Psychometric properties of an English short version of the Trier Inventory for chronic Stress.

    abstract:BACKGROUND:Although a variety of instruments are available that capture stress experience, the assessment of chronic stress has been hindered by the lack of economical screening instruments. Recently, an English-language version of the Trier Inventory for Chronic Stress (TICS-EN) consisting of 57 items according to a s...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01156-y

    authors: Petrowski K,Braehler E,Schmalbach B,Hinz A,Bastianon C,Ritz T

    更新日期:2020-12-16 00:00:00

  • Blood spots as an alternative to whole blood collection and the effect of a small monetary incentive to increase participation in genetic association studies.

    abstract:BACKGROUND:Collection of buccal cells from saliva for DNA extraction offers a less invasive and convenient alternative to venipuncture blood collection that may increase participation in genetic epidemiologic studies. However, dried blood spot collection, which is also a convenient method, offers a means of collecting ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-9-76

    authors: Bhatti P,Kampa D,Alexander BH,McClure C,Ringer D,Doody MM,Sigurdson AJ

    更新日期:2009-11-13 00:00:00

  • The triple variable index combines information generated over time from common monitoring variables to identify patients expressing distinct patterns of intraoperative physiology.

    abstract:BACKGROUND:Mean arterial pressure (MAP), bispectral index (BIS), and minimum alveolar concentration (MAC) represent valuable, yet dynamic intraoperative monitoring variables. They provide information related to poor outcomes when considered together, however their collective behavior across time has not been characteri...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0660-9

    authors: Schnetz MP,Hochheiser HS,Danks DJ,Landsittel DP,Vogt KM,Ibinson JW,Whitehurst SL,McDermott SP,Duque MG,Kaynar AM

    更新日期:2019-01-14 00:00:00

  • Comparison of sample characteristics in two pregnancy cohorts: community-based versus population-based recruitment methods.

    abstract:BACKGROUND:One of the biggest challenges for population health studies is the recruitment of participants. Questions that investigators have asked are "who volunteers for studies?" and "does recruitment method influence characteristics of the samples?" The purpose of this paper was to compare sample characteristics of ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-149

    authors: Leung BM,McDonald SW,Kaplan BJ,Giesbrecht GF,Tough SC

    更新日期:2013-12-06 00:00:00

  • Network-meta analysis made easy: detection of inconsistency using factorial analysis-of-variance models.

    abstract:BACKGROUND:Network meta-analysis can be used to combine results from several randomized trials involving more than two treatments. Potential inconsistency among different types of trial (designs) differing in the set of treatments tested is a major challenge, and application of procedures for detecting and locating inc...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-14-61

    authors: Piepho HP

    更新日期:2014-05-10 00:00:00

  • Simulation-based estimation of mean and standard deviation for meta-analysis via Approximate Bayesian Computation (ABC).

    abstract:BACKGROUND:When conducting a meta-analysis of a continuous outcome, estimated means and standard deviations from the selected studies are required in order to obtain an overall estimate of the mean effect and its confidence interval. If these quantities are not directly reported in the publications, they must be estima...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-015-0055-5

    authors: Kwon D,Reis IM

    更新日期:2015-08-12 00:00:00

  • Randomised controlled comparison of the Health Survey Short Form (SF-12) and the Graded Chronic Pain Scale (GCPS) in telephone interviews versus self-administered questionnaires. Are the results equivalent?

    abstract:BACKGROUND:The most commonly used survey methods are self-administered questionnaires, telephone interviews, and a mixture of both. But until now evidence out of randomised controlled trials as to whether patient responses differ depending on the survey mode is lacking. Therefore this study assessed whether patient res...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/1471-2288-7-50

    authors: Lungenhausen M,Lange S,Maier C,Schaub C,Trampisch HJ,Endres HG

    更新日期:2007-11-22 00:00:00

  • A multi-country comparison of stochastic models of breast cancer mortality with P-splines smoothing approach.

    abstract:BACKGROUND:Precise predictions of incidence and mortality rates due to breast cancer (BC) are required for planning of public health programs as well as for clinical services. A number of approaches has been established for prediction of mortality using stochastic models. The performance of these models intensely depen...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01187-5

    authors: Mubarik S,Hu Y,Yu C

    更新日期:2020-12-09 00:00:00

  • The challenges of recruiting cancer patient/caregiver dyads: informing randomized controlled trials.

    abstract:BACKGROUND:Family members are increasingly involved in the care of cancer patients, however many are not prepared for this challenging role. Intervention-based studies are valuable to inform the most appropriate and effective support for caregivers. Barriers in the recruitment of patient/caregiver dyads exist but the r...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,多中心研究,随机对照试验

    doi:10.1186/s12874-018-0614-7

    authors: Heckel L,Gunn KM,Livingston PM

    更新日期:2018-11-21 00:00:00

  • Data enhancement for co-morbidity measurement among patients referred for sleep diagnostic testing: an observational study.

    abstract:BACKGROUND:Observational outcome studies of patients with obstructive sleep apnea (OSA) require adjustment for co-morbidity to produce valid results. The aim of this study was to evaluate whether the combination of administrative data and self-reported data provided a more complete estimate of co-morbidity among patien...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-9-50

    authors: Ronksley PE,Tsai WH,Quan H,Faris P,Hemmelgarn BR

    更新日期:2009-07-15 00:00:00

  • A random effects meta-analysis model with Box-Cox transformation.

    abstract:BACKGROUND:In a random effects meta-analysis model, true treatment effects for each study are routinely assumed to follow a normal distribution. However, normality is a restrictive assumption and the misspecification of the random effects distribution may result in a misleading estimate of overall mean for the treatmen...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0376-7

    authors: Yamaguchi Y,Maruo K,Partlett C,Riley RD

    更新日期:2017-07-19 00:00:00

  • The efficiency and effectiveness of utilizing diagrams in interviews: an assessment of participatory diagramming and graphic elicitation.

    abstract:BACKGROUND:This paper focuses on measuring the efficiency and effectiveness of two diagramming methods employed in key informant interviews with clinicians and health care administrators. The two methods are 'participatory diagramming', where the respondent creates a diagram that assists in their communication of answe...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-8-53

    authors: Umoquit MJ,Dobrow MJ,Lemieux-Charles L,Ritvo PG,Urbach DR,Wodchis WP

    更新日期:2008-08-08 00:00:00

  • Should we embed randomized controlled trials within action research: arguing from a case study of telemonitoring.

    abstract:BACKGROUND:Action research (AR) and randomized controlled trials (RCTs) are usually considered to be theoretically and practically incompatible. However, we argue that their respective strengths and weaknesses can be complementary. We illustrate our argument from a recent study assessing the effect of telemonitoring on...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/s12874-016-0175-6

    authors: Day K,Kenealy TW,Sheridan NF

    更新日期:2016-06-08 00:00:00

  • A factorial cluster-randomised controlled trial combining home-environmental and early child development interventions to improve child health and development: rationale, trial design and baseline findings.

    abstract:BACKGROUND:Exposure to unhealthy environments and inadequate child stimulation are main risk factors that affect children's health and wellbeing in low- and middle-income countries. Interventions that simultaneously address several risk factors at the household level have great potential to reduce these negative effect...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-00950-y

    authors: Hartinger SM,Nuño N,Hattendorf J,Verastegui H,Karlen W,Ortiz M,Mäusezahl D

    更新日期:2020-04-02 00:00:00

  • An information-motivation-behavioural skills analysis of long-lasting insecticidal net use among pregnant women in a hospital in North-Eastern Nigeria.

    abstract:BACKGROUND:Sleeping under a long-lasting insecticidal net (LLIN) is recommended for all pregnant women in sub-Saharan Africa, due to the high prevalence of malaria infection and its associated complications in the region. Despite this, LLIN use has still remained sub-optimal among pregnant women in Maiduguri, Nigeria. ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0803-z

    authors: Balami AD,Said SM,Zulkefli NAM,Bachok N,Balami EL

    更新日期:2019-07-18 00:00:00

  • An exploration of how developers use qualitative evidence: content analysis and critical appraisal of guidelines.

    abstract:BACKGROUND:Clinical practice guidelines have become increasingly widely used to guide quality improvement of clinical practice. Qualitative research may be a useful way to improve the quality and implementation of guidelines. The methodology for qualitative evidence used in guidelines development is worthy of further r...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01041-8

    authors: Wang YY,Liang DD,Lu C,Shi YX,Zhang J,Cao Y,Fang C,Huang D,Jin YH

    更新日期:2020-06-17 00:00:00

  • Power and sample size determination for the group comparison of patient-reported outcomes using the Rasch model: impact of a misspecification of the parameters.

    abstract:BACKGROUND:Patient-reported outcomes (PRO) are important as endpoints in clinical trials and epidemiological studies. Guidelines for the development of PRO instruments and analysis of PRO data have emphasized the need to report methods used for sample size planning. The Raschpower procedure has been proposed for sample...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-015-0011-4

    authors: Blanchin M,Guilleux A,Perrot B,Bonnaud-Antignac A,Hardouin JB,Sébille V

    更新日期:2015-03-15 00:00:00

  • Estimating required information size by quantifying diversity in random-effects model meta-analyses.

    abstract:BACKGROUND:There is increasing awareness that meta-analyses require a sufficiently large information size to detect or reject an anticipated intervention effect. The required information size in a meta-analysis may be calculated from an anticipated a priori intervention effect or from an intervention effect suggested b...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-9-86

    authors: Wetterslev J,Thorlund K,Brok J,Gluud C

    更新日期:2009-12-30 00:00:00

  • Social media as a recruitment platform for a nationwide online survey of COVID-19 knowledge, beliefs, and practices in the United States: methodology and feasibility analysis.

    abstract:BACKGROUND:The COVID-19 pandemic has evolved into one of the most impactful health crises in modern history, compelling researchers to explore innovative ways to efficiently collect public health data in a timely manner. Social media platforms have been explored as a research recruitment tool in other settings; however...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01011-0

    authors: Ali SH,Foreman J,Capasso A,Jones AM,Tozan Y,DiClemente RJ

    更新日期:2020-05-13 00:00:00

  • Sample size calculations for cluster randomised controlled trials with a fixed number of clusters.

    abstract:BACKGROUND:Cluster randomised controlled trials (CRCTs) are frequently used in health service evaluation. Assuming an average cluster size, required sample sizes are readily computed for both binary and continuous outcomes, by estimating a design effect or inflation factor. However, where the number of clusters are fix...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-102

    authors: Hemming K,Girling AJ,Sitch AJ,Marsh J,Lilford RJ

    更新日期:2011-06-30 00:00:00

  • Does updating improve the methodological and reporting quality of systematic reviews?

    abstract:BACKGROUND:Systematic reviews (SRs) must be of high quality. The purpose of our research was to compare the methodological and reporting quality of original versus updated Cochrane SRs to determine whether updating had improved these two quality dimensions. METHODS:We identified updated Cochrane SRs published in issue...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-6-27

    authors: Shea B,Boers M,Grimshaw JM,Hamel C,Bouter LM

    更新日期:2006-06-13 00:00:00

  • Cross-cultural validation of the Functional Vision Questionnaire for Children and Young People (FVQ_CYP) with visual impairment in the Dutch population: challenges and opportunities.

    abstract:BACKGROUND:To assess cross-cultural validity between Dutch and English versions of the FVQ_CYP, a patient-reported outcome measure developed in the United Kingdom (UK) for children and adolescents with (severe) visual impairment or blindness (VI for brevity) to measure functional vision. METHODS:The 36-item FVQ_CYP wa...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0875-9

    authors: Elsman EBM,Tadić V,Peeters CFW,van Rens GHMB,Rahi JS,van Nispen RMA

    更新日期:2019-12-03 00:00:00

  • An evaluation of DistillerSR's machine learning-based prioritization tool for title/abstract screening - impact on reviewer-relevant outcomes.

    abstract:BACKGROUND:Systematic reviews often require substantial resources, partially due to the large number of records identified during searching. Although artificial intelligence may not be ready to fully replace human reviewers, it may accelerate and reduce the screening burden. Using DistillerSR (May 2020 release), we eva...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01129-1

    authors: Hamel C,Kelly SE,Thavorn K,Rice DB,Wells GA,Hutton B

    更新日期:2020-10-15 00:00:00

  • An international survey of physicians regarding clinical trials: a comparison between Kyoto University Hospital and Seoul National University Hospital.

    abstract:BACKGROUND:International clinical trials are now rapidly expanding into Asia. However, the proportion of global trials is higher in South Korea compared to Japan despite implementation of similar governmental support in both countries. The difference in clinical trial environment might influence the respective physicia...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-130

    authors: Ito-Ihara T,Hong JH,Kim OJ,Sumi E,Kim SY,Tanaka S,Narita K,Hatta T,Choi EK,Choi KJ,Miyagawa T,Minami M,Murayama T,Yokode M

    更新日期:2013-10-25 00:00:00

  • Collecting household water usage data: telephone questionnaire or diary?

    abstract:BACKGROUND:Quantitative Microbial Risk Assessment (QMRA), a modelling approach, is used to assess health risks. Inputs into the QMRA process include data that characterise the intensity, frequency and duration of exposure to risk(s). Data gaps for water exposure assessment include the duration and frequency of urban no...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-9-72

    authors: O'Toole JE,Sinclair MI,Leder K

    更新日期:2009-11-09 00:00:00