Computer programs to estimate overoptimism in measures of discrimination for predicting the risk of cardiovascular diseases.

Abstract:

BACKGROUND:Development of chronic disease risk prediction models has become a growing area of research in recent years. The internal validity of such models is sometimes lower than estimated from the development sample. Overfitting or overoptimism of the developed model and/or differences between the samples are likely causes for this. For modelling of an uncommon outcome, bootstrapping for overoptimism is the preferred method for afterwards shrinking of regression coefficients and the model's discrimination and calibration for overoptimism. However, computer programs for different types of bootstrap validation are not readily available. We developed two SAS macro programs--one for the simple bootstrap that compares the discriminatory performance of the Cox proportional hazards model from the original sample in bootstrap samples; and another (which is more efficient), known as stepwise bootstrap validation, that makes the same comparison but from models developed by variable selection from bootstrap samples in the original sample. These are illustrated through an example from cardiovascular disease (CVD) risk prediction. METHODS:Two SAS macro programs for Cox proportional hazards model using Proc PHREG were developed for estimating overoptimism in Harrell's C and Somers' D statistics. The computer programs were applied to data on CVD incidence for a Framingham cohort that combined both the original and offspring exams. The risk factors considered were current smoking, diabetes, age, sex, systolic blood pressure, diastolic blood pressure, total cholesterol, high-density lipoprotein cholesterol, triglycerides and body mass index. RESULTS:The degree of overoptimism in both Harrell's C and Somers' D statistics were low. Both these statistics were corrected for overoptimism by subtracting overoptimism from their observed values. Between the two bootstrap validation algorithms, the degree of overoptimism was estimated to be higher for stepwise bootstrap validation. CONCLUSION:The programs are very useful for evaluating the 'overoptimism corrected' predictive performance of Cox proportional hazards model.

journal_name

J Eval Clin Pract

authors

Mannan HR,McNeil JJ

doi

10.1111/j.1365-2753.2012.01834.x

subject

Has Abstract

pub_date

2013-04-01 00:00:00

pages

358-62

issue

2

eissn

1356-1294

issn

1365-2753

journal_volume

19

pub_type

杂志文章
  • Thiele massage as a therapeutic option for women with chronic pelvic pain caused by tenderness of pelvic floor muscles.

    abstract:AIMS AND OBJECTIVES:Musculoskeletal system has been found to be involved in genesis and perpetuation of chronic pelvic pain (CPP) and has strong evidences that up to 80% of women with CPP present dysfunction of the musculoskeletal system. In this study, we report a series of women with CPP caused by tenderness of pelvi...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/j.1365-2753.2009.01202.x

    authors: Montenegro ML,Mateus-Vasconcelos EC,Candido dos Reis FJ,Rosa e Silva JC,Nogueira AA,Poli Neto OB

    更新日期:2010-10-01 00:00:00

  • Managing asthma in primary care through imperative outcomes.

    abstract:RATIONALE, AIMS AND OBJECTIVES:To evaluate asthma management and control in primary care clinics so as to design improvements based on guideline-directed outcomes. METHODS:In this study, all medical records of asthma-diagnosed patients (children as well as adults, entire lifespan, asthma-related visits or not) were re...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/j.1365-2753.2011.01803.x

    authors: du Plessis JM,Gerber JJ,Brand L

    更新日期:2013-04-01 00:00:00

  • Resilience, health perceptions, (QOL), stressors, and hospital admissions-Observations from the real world of clinical care of unstable health journeys in Monash Watch (MW), Victoria, Australia.

    abstract:RATIONALE, AIMS, AND OBJECTIVES:Monash Watch (MW) aims to reduce potentially preventable hospitalisations in a cohort above a risk "threshold" identified by Health Links Chronic Care (HLCC) algorithms using personal, diagnostic, and service data. MW conducted regular patient monitoring through outbound phone calls usin...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/jep.13031

    authors: Martin C,Hinkley N,Stockman K,Campbell D

    更新日期:2018-12-01 00:00:00

  • First-trimester Down syndrome screening in women younger than 35 years old and cost-effectiveness analysis in Taiwan population.

    abstract:OBJECTIVES:Outcome of the first-trimester Down syndrome screening in younger population was less reported before. We present the outcome of this screening in Taiwanese women younger than 35 years old. We also test whether or not the first-trimester Down syndrome screening of women <35 years of age and women >35 years o...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/j.1365-2753.2008.01095.x

    authors: Chou CY,Hsieh FJ,Cheong ML,Lee FK,She BQ,Tsai MS

    更新日期:2009-10-01 00:00:00

  • Beyond checkboxes: A qualitative assessment of physicians' experiences providing care in a patient-centred medical home.

    abstract:RATIONALE, AIMS, AND OBJECTIVES:The patient-centred medical home (PCMH) is an innovative approach to health care reform. Despite a well-established process for recognizing PCMH practices, fidelity to, and/or adaptation of, the PCMH model can limit health care and population health improvements. This study explored the ...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/jep.13136

    authors: Sklar M,Seijo C,Goldman RE,Eaton CB

    更新日期:2019-12-01 00:00:00

  • The ends of outcomes assessment.

    abstract::Outcomes assessment holds great promise to improve the quality and efficiency of health care. By subjecting practices to rigorous and systematic analysis, we should be in a position to make judgments about what does and does not work in clinical practice. However, the outcomes of outcomes assessment themselves should ...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/j.1365-2753.1998.tb00098.x

    authors: Gunderman R

    更新日期:1998-11-01 00:00:00

  • Characteristics of shared decision making in Romania from the patient perspective: A cross-sectional multicentric study.

    abstract:BACKGROUND:Shared decision making (SDM) is very important from patients' perspective. This process has not yet been evaluated in Romania. The study aims to evaluate SDM from the patients' perspective and to evaluate patients' characteristics that associate with SDM. MATERIAL AND METHODS:A cross-sectional multicentric ...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章,多中心研究

    doi:10.1111/jep.13257

    authors: Baicus C,Balanescu P,Zeh S,Oprisan E,Lapadatu R,Gurghean A,Padureanu V,Rezus C,Mitu F,Jurcut R,Balanescu AR,Daha I,Balanescu E,Bojinca M,Pinte L,Constantin AM,Dima N,Floria M,Leon-Constantin MM,Roca M,Mitu M,Chi

    更新日期:2019-12-01 00:00:00

  • Closing the safety loop: evaluation of the National Patient Safety Agency's guidance regarding wristband identification of hospital inpatients.

    abstract:RATIONALE, AIMS AND OBJECTIVES:Wristbands are essential for accurate patient identification. Some evidence suggests that missing wristbands is not an infrequent occurrence in acute hospitals. The National Patient Safety Agency (NPSA) has developed guidance on patient identification for hospitals in England and Wales. H...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/j.1365-2753.2008.01004.x

    authors: Sevdalis N,Norris B,Ranger C,Bothwell S,Wristband Project Team.

    更新日期:2009-04-01 00:00:00

  • Effects of occupational violence on Australian general practitioners' provision of home visits and after-hours care: a cross-sectional study.

    abstract:RATIONALE, AIMS AND OBJECTIVES:Occupational violence is increasingly recognized as a problem in general practice, and has been suggested as adversely affecting general practitioners' (GPs) provision of services to patients. The aim of this study was to investigate the association of experiences of violence and percepti...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/j.1365-2753.2007.00864.x

    authors: Magin PJ,Adams J,Sibbritt DW,Joy E,Ireland MC

    更新日期:2008-04-01 00:00:00

  • Reflexivity and metapositions: strategies for appraisal of clinical evidence.

    abstract::According to Sackett, evidence-based medicine is the conscientious, explicit and judicious use of current best evidence in making decisions about the care of the individual patient. In this article, clinical reasoning is depicted as multilayered processes of evidence construction by means of social interaction and hum...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1046/j.1365-2753.2002.00353.x

    authors: Malterud K

    更新日期:2002-05-01 00:00:00

  • Comparing different venous thromboembolism risk assessment machine learning models in Chinese patients.

    abstract:OBJECTIVE:Venous thromboembolism (VTE) is a fatal complication and the most common preventable cause of death in hospitals. The risk-to-benefit ratio of thromboprophylaxis depends on the performance of the risk assessment model. A linear model, the Padua model, is recommended for medical inpatients in the United States...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/jep.13324

    authors: Wang X,Yang YQ,Liu SH,Hong XY,Sun XF,Shi JH

    更新日期:2020-02-01 00:00:00

  • The German version of the Assessment of Chronic Illness Care: instrument translation and cultural adaptation.

    abstract:BACKGROUND:In Switzerland, there is a dearth of information on the extent to which patients with chronic illnesses receive care congruent with the Chronic Care Model (CCM). To drive quality improvement programmes, it is necessary to have practical assessment tools in the country's own language to evaluate the delivery ...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/j.1365-2753.2010.01511.x

    authors: Steurer-Stey C,Frei A,Schmid-Mohler G,Malcolm-Kohler S,Zoller M,Rosemann T

    更新日期:2012-02-01 00:00:00

  • Selective prevention of cardiometabolic diseases in general practice: attitudes and working methods of male and female general practitioners before and after the introduction of the Prevention Consultation guideline in the Netherlands.

    abstract:RATIONALE, AIMS AND OBJECTIVES:In 2011 the module cardiometabolic risk of the Prevention Consultation guideline was introduced in the Netherlands in order to prevent cardiometabolic diseases. We aimed to compare attitudes and working methods of Dutch general practitioners (GPs) towards selective prevention of cardiomet...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/jep.12179

    authors: Vos HM,Van Delft DH,De Kleijn MJ,Nielen MM,Schellevis FG,Lagro-Janssen AL

    更新日期:2014-08-01 00:00:00

  • User involvement in clinical audit: a review of developments and issues of good practice.

    abstract::There have been considerable political and organizational moves to involve 'consumers' (patients, carers, service users, potential users, local communities and the public at large) in the provision, planning and monitoring of health services. Such developments beg the question 'what constitutes good practice in user i...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章,评审

    doi:10.1111/j.1365-2753.1996.tb00034.x

    authors: Kelson M

    更新日期:1996-05-01 00:00:00

  • Health of the Nation Outcome Scales in a psychiatric inpatient setting: assessing clinical change.

    abstract:RATIONALE, AIMS AND OBJECTIVES:The aim of this study was to examine the validity of the Health of the Nation Outcome Scales (HoNOS) in terms of change in relation to sex, clinical characteristics and level of clinical change as assessed using other measures. METHODS:The sample consisted of N = 690 admissions from one ...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/jep.12296

    authors: Egger ST,Weniger G,Prinz S,Vetter S,Müller M

    更新日期:2015-04-01 00:00:00

  • Using the Internet to teach melanoma management guidelines to primary care physicians.

    abstract::The aim of this study was to determine whether a brief Internet-based education programme could improve physicians' abilities to manage pigmented skin lesions. A pre-test-post-test assessment was used of subjects' knowledge of skin cancer, confidence in their management abilities and actual ability to recommend approp...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1046/j.1365-2753.1999.00194.x

    authors: Harris JM Jr,Salasche SJ,Harris RB

    更新日期:1999-05-01 00:00:00

  • The application of Cartwright's concept of capacities to complex interventions in psychiatry.

    abstract::Cartwright and Munro argued that extrapolation of findings from randomized controlled trials to other settings can be difficult because information about the underlying causal structure and subgroups is often not available. They advocated the use of 'capacities' - that is fixed causal contributions - in predicting eff...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/j.1365-2753.2012.01909.x

    authors: Hubbeling D

    更新日期:2012-10-01 00:00:00

  • Is there life after evidence-based medicine?

    abstract::Recent years have witnessed the rising star of evidence-based medicine (EBM) as an approach towards rationalizing clinical practice in the face of an exponentially growing body of knowledge. Along with it, however, a sense of unease is rising among practising doctors, as they feel that well-intentioned principles may ...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/j.1365-2753.2003.00473.x

    authors: Porta M

    更新日期:2004-05-01 00:00:00

  • Advancing the standards of clinical research: the urgent need for new methods and better data.

    abstract::Some of the weaknesses of the randomized controlled trial (RCT) are pointed out, among them unavoidable biases, the possibility of coming to erroneous conclusions by the 'luck of the draw' and the fact that most such experiments lack a doctor/patient relationship and are of little assistance in clinical decision makin...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1046/j.1365-2753.1997.00007.x

    authors: Herman J

    更新日期:1997-08-01 00:00:00

  • The uptake of technologies designed to influence medication safety in Canadian hospitals.

    abstract:BACKGROUND:There are many technologies designed to improve medication safety. Although limited evidence supports their use, there are pressures to implement them. OBJECTIVE:To determine the uptake of technologies designed to improve medication safety, plans for adopting technologies, attitudes towards technology use, ...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章,多中心研究

    doi:10.1111/j.1365-2753.2007.00780.x

    authors: Saginur M,Graham ID,Forster AJ,Boucher M,Wells GA

    更新日期:2008-02-01 00:00:00

  • A review of the current evidence base for significant event analysis.

    abstract:OBJECTIVE:To review the literature on the perceived benefits and disadvantages associated with significant event analysis (SEA) and identify reported barriers and facilitating factors. METHOD:A comprehensive search of electronic databases and peer reviewed journals was conducted during June 2006. Studies which explore...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章,评审

    doi:10.1111/j.1365-2753.2007.00908.x

    authors: Bowie P,Pope L,Lough M

    更新日期:2008-08-01 00:00:00

  • Protocol-based care: impact on roles and service delivery*.

    abstract:OBJECTIVE:To evaluate the impact of protocol-based care on nursing roles, practice and service delivery. DESIGN:Case study evaluation informed by realistic evaluation methodology. Qualitative data collection methods were used including non-participant observation, post-observation interviews with nurses and patients, ...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/j.1365-2753.2008.01015.x

    authors: Rycroft-Malone J,Fontenla M,Bick D,Seers K

    更新日期:2008-10-01 00:00:00

  • Quality improvement opportunities for handover practices in birth centres: A case study from a process perspective.

    abstract:RATIONALE, AIMS AND OBJECTIVES:Handovers within and between health care settings are known to affect quality of care. Health care organizations, struggle how to guarantee best care during handovers. The aim of this paper is to evaluate handover practices in Dutch birth centres from a process perspective, to identify ob...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/jep.12939

    authors: Hitzert M,Boesveld IC,Hermus MAA,de Graaf JP,Wiegers TA,Steegers EAP,Meijboom BR,Akkermans HA

    更新日期:2018-06-01 00:00:00

  • Prescribing pattern of antihypertensive drugs by family physicians and general practitioners in the primary care setting in Bahrain.

    abstract::The aim was to determine whether there are differences among family physicians (FPs) and general practitioners (GPs) in terms of their preference for different classes of antihypertensives, either alone or in combinations, in uncomplicated cases of hypertension and to determine the extent of adherence to WHO/ISH guide...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1046/j.1365-2753.2002.00370.x

    authors: Sequeira RP,Jassim KA,Damanhori AH,Mathur VS

    更新日期:2002-11-01 00:00:00

  • Knowledge and attitudes of trainee physicians regarding evidence-based medicine: a questionnaire survey in Tehran, Iran.

    abstract:RATIONALE, AIMS AND OBJECTIVES:Knowledge in evidence-based medicine (EBM) is increasingly becoming a core competence in medical education. We evaluated the trainee doctors' attitudes and knowledge of EBM to obtain the basis required for developing appropriate teaching and learning opportunities. METHODS:Trainee physic...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/j.1365-2753.2008.01073.x

    authors: Ahmadi-Abhari S,Soltani A,Hosseinpanah F

    更新日期:2008-10-01 00:00:00

  • The use of maternal weight measurements during antenatal care. A national survey of midwifery practice throughout the United Kingdom.

    abstract::The aim of the present study was to examine the use of maternal weight measurements during antenatal care throughout the United Kingdom. A postal questionnaire and follow-up letter were sent to 1500 midwives throughout the United Kingdom, selected at random from the UKCC register. The postal survey achieved a response...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1046/j.1365-2753.1997.t01-1-00007.x

    authors: Ellison GT,Holliday M

    更新日期:1997-11-01 00:00:00

  • Impact of automated dispensing cabinets on medication selection and preparation error rates in an emergency department: a prospective and direct observational before-and-after study.

    abstract:RATIONALE, AIMS AND OBJECTIVES:The implementation of automated dispensing cabinets (ADCs) in healthcare facilities appears to be increasing, in particular within Australian hospital emergency departments (EDs). While the investment in ADCs is on the increase, no studies have specifically investigated the impacts of ADC...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/jep.12445

    authors: Fanning L,Jones N,Manias E

    更新日期:2016-04-01 00:00:00

  • Strategies for ensuring effective surveillance in post-transplant patients: practical organization and clinical evaluation.

    abstract::Results of renal transplantation have improved steadily over the years. This article reviews the current status of patient and graft survival and discusses major causes of mortality and renal allograft failure. Review of recent literature demonstrates that the traditional enemies of transplantation, acute rejection an...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章,评审

    doi:10.1111/j.1365-2753.2003.00408.x

    authors: Jurewicz WA,Miles A

    更新日期:2004-02-01 00:00:00

  • Perspectives on an amended law addressing pharmacists' availability in community pharmacies.

    abstract:RATIONALE, AIMS, AND OBJECTIVES:Little attention has been given to perceptions of pharmacist availability and role in the community setting following policy changes. The Pakistani model is particularly interesting as it encompasses three different pharmacy practice licensure types with major differences in credentials,...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/jep.13405

    authors: Qadeer G,Amin MEK

    更新日期:2020-04-22 00:00:00

  • Effect of a 7-day acute inpatient neurophysiotherapy service on physiotherapy provision, length of stay, and patient experience.

    abstract:RATIONALE, AIMS, AND OBJECTIVES:National policy, guided by research, suggests several patient and service benefits achieved by providing 7-day health care. Therefore, a 7-day inpatient neurophysiotherapy service was introduced at a large teaching hospital in London. The study's aim was to evaluate the effect of the 7-d...

    journal_title:Journal of evaluation in clinical practice

    pub_type: 杂志文章

    doi:10.1111/jep.13237

    authors: McGlinchey MP,Buttery C

    更新日期:2020-06-01 00:00:00