Assessing the generalizability of prognostic information.

Abstract:

:Physicians are often asked to make prognostic assessments but often worry that their assessments will prove inaccurate. Prognostic systems were developed to enhance the accuracy of such assessments. This paper describes an approach for evaluating prognostic systems based on the accuracy (calibration and discrimination) and generalizability (reproducibility and transportability) of the system's predictions. Reproducibility is the ability to produce accurate predictions among patients not included in the development of the system but from the same population. Transportability is the ability to produce accurate predictions among patients drawn from a different but plausibly related population. On the basis of the observation that the generalizability of a prognostic system is commonly limited to a single historical period, geographic location, methodologic approach, disease spectrum, or follow-up interval, we describe a working hierarchy of the cumulative generalizability of prognostic systems. This approach is illustrated in a structured review of the Dukes and Jass staging systems for colon and rectal cancer and applied to a young man with colon cancer. Because it treats the development of the system as a "black box" and evaluates only the performance of the predictions, the approach can be applied to any system that generates predicted probabilities. Although the Dukes and Jass staging systems are discrete, the approach can also be applied to systems that generate continuous predictions and, with some modification, to systems that predict over multiple time periods. Like any scientific hypothesis, the generalizability of a prognostic system is established by being tested and being found accurate across increasingly diverse settings. The more numerous and diverse the settings in which the system is tested and found accurate, the more likely it will generalize to an untested setting.

journal_name

Ann Intern Med

authors

Justice AC,Covinsky KE,Berlin JA

doi

10.7326/0003-4819-130-6-199903160-00016

subject

Has Abstract

pub_date

1999-03-16 00:00:00

pages

515-24

issue

6

eissn

0003-4819

issn

1539-3704

pii

199903160-00009

journal_volume

130

pub_type

杂志文章
  • Emergency brain resuscitation. A Working Group on Emergency Brain Resuscitation.

    abstract::Past efforts to reverse or limit the effects of acute stroke have been largely unsuccessful, in part because of the inability to evaluate and treat most patients soon after stroke onset. One important factor in the delay of treatment has been the nihilistic attitude of medical personnel, including physicians, toward t...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,评审

    doi:

    authors:

    更新日期:1995-04-15 00:00:00

  • The influence of standard of care and severity of injury on the resolution of medical malpractice claims.

    abstract:OBJECTIVE:To explore how frequently physicians lose medical malpractice cases despite providing standard care and to assess whether severity of patient injury influences the frequency of plaintiff payment. DESIGN:Retrospective cohort study. SETTING:Physicians from the state of New Jersey insured by one insurance comp...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-117-9-780

    authors: Taragin MI,Willett LR,Wilczek AP,Trout R,Carson JL

    更新日期:1992-11-01 00:00:00

  • Neuroblastoma: clinical perspectives, monoclonal antibodies, and retinoic acid.

    abstract::Neuroblastoma, the second commonest solid tumor in children, is a neoplasm of the peripheral autonomic nervous system that usually occurs before children are 6 years old. Therapy of localized tumor (clinical stage I and II) and of a special form of metastatic tumor (clinical stage IV-S) is usually successful, but trea...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,评审

    doi:10.7326/0003-4819-97-6-873

    authors: Seeger RC,Siegel SE,Sidell N

    更新日期:1982-12-01 00:00:00

  • Comparing costs and quality of care at retail clinics with that of other medical settings for 3 common illnesses.

    abstract:BACKGROUND:Retail clinics are an increasingly popular source for medical care. Concerns have been raised about the effect of these clinics on the cost, quality, and delivery of preventive care. OBJECTIVE:To compare the care received at retail clinics for 3 acute conditions with that received at other care settings. D...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-151-5-200909010-00006

    authors: Mehrotra A,Liu H,Adams JL,Wang MC,Lave JR,Thygeson NM,Solberg LI,McGlynn EA

    更新日期:2009-09-01 00:00:00

  • Prevention of intravascular catheter-related infections.

    abstract:PURPOSE:To review the literature on prevention of intravascular catheter-related infections. DATA SOURCES:The MEDLINE database, conference proceedings, and bibliographies of review articles and book chapters were searched for relevant articles. Primary authors were contacted directly if data were incomplete. STUDY SE...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,meta分析

    doi:10.7326/0003-4819-132-5-200003070-00009

    authors: Mermel LA

    更新日期:2000-03-07 00:00:00

  • Severe candidal infections: clinical perspective, immune defense mechanisms, and current concepts of therapy.

    abstract::Disseminated candidiasis has become an important infection, particularly in immunocompromised and postoperative patients. Although serologic tests may, in some settings, facilitate a premortem diagnosis, the disease is usually diagnosed by comprehensive clinical evaluation. Detection of the relatively newly recognized...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,评审

    doi:10.7326/0003-4819-89-1-91

    authors: Edwards JE Jr,Lehrer RI,Stiehm ER,Fischer TJ,Young LS

    更新日期:1978-07-01 00:00:00

  • Acute postoperative confusion and hallucinations in Parkinson disease.

    abstract:STUDY OBJECTIVE:To determine whether patients with Parkinson disease are at an increased risk for postoperative confusion. DESIGN:Retrospective chart review of patients with Parkinson disease who remained in the hospital at least 48 hours after their surgery. Current data were compared with published historical contro...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-111-3-218

    authors: Golden WE,Lavender RC,Metzer WS

    更新日期:1989-08-01 00:00:00

  • Care of the Patient Using Cannabis.

    abstract::The past 2 decades have seen a revolution in legal access to cannabis, driven largely by activists and business interests. As a result, the population of cannabis users nationwide-especially daily users-has grown significantly. An estimated 4.5-7 million persons in the United States now meet criteria for cannabis use ...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,评审

    doi:10.7326/AITC202011030

    authors: Williams AR,Hill KP

    更新日期:2020-11-03 00:00:00

  • Cost-effectiveness of dabigatran compared with warfarin for stroke prevention in atrial fibrillation.

    abstract:BACKGROUND:Warfarin reduces the risk for ischemic stroke in patients with atrial fibrillation (AF) but increases the risk for hemorrhage. Dabigatran is a fixed-dose, oral direct thrombin inhibitor with similar or reduced rates of ischemic stroke and intracranial hemorrhage in patients with AF compared with those of war...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-154-1-201101040-00289

    authors: Freeman JV,Zhu RP,Owens DK,Garber AM,Hutton DW,Go AS,Wang PJ,Turakhia MP

    更新日期:2011-01-04 00:00:00

  • The common hyperlipoproteinemias: an understanding of disease mechanisms and their control.

    abstract::Our review focuses on low density lipoprotein (LD lipoprotein) and very low density lipoprotein (VLD lipoprotein) in their roles as transporters of cholesterol and triglyceride and as factors contributing to premature arteriovascular disease. We describe the clinical manifestations of the common, primary hyperlipoprot...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,评审

    doi:10.7326/0003-4819-85-4-497

    authors: Fisher WR,Truitt DH

    更新日期:1976-10-01 00:00:00

  • Role of aluminum in dialysis dementia.

    abstract::Between September 1972 and January 1976 an outbreak of dialysis dementia affected 20 patients maintained by long-term hemodialysis. The clinical picture was characterized by an insidious onset of altered behaviour, dementia, speech disturbance, myoclonus, and convulsions. Nineteen patients died, but one patient has su...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-88-4-502

    authors: Dunea G,Mahurkar SD,Mamdani B,Smith EC

    更新日期:1978-04-01 00:00:00

  • Disease from infection with Vibrio mimicus, a newly recognized Vibrio species. Clinical characteristics and edipemiology.

    abstract::Clinical and epidemiologic characteristics of disease associated with a newly described nonhalophilic Vibrio species, Vibrio mimicus, were identified by studying isolates from 21 patients referred to the Centers for Disease Control between 1977 and 1981. Two isolates were from the ears of patients with otitis who had ...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:

    authors: Shandera WX,Johnston JM,Davis BR,Blake PA

    更新日期:1983-08-01 00:00:00

  • The downsizing of internal medicine residency programs.

    abstract::A variety of forces are converging to reduce the number of internal medicine residency positions offered in this country. This reduction, referred to as downsizing, has been proposed as the solution to several of the problems facing internal medicine. We examine the forces that underlie the current enthusiasm for down...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-117-10-839

    authors: Asch DA,Ende J

    更新日期:1992-11-15 00:00:00

  • The bioavailability of folic acid added to wine.

    abstract::Folate deficiency is a frequent cause of anemia in alcoholics, but little attention has been paid to its prevention. Folic acid was readily soluble in wines of high ethanol content at concentrations of 10 microgram/ml. Lactobacillus casei folate activity of folic acid added to wines was well maintained during a month'...

    journal_title:Annals of internal medicine

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.7326/0003-4819-87-5-542

    authors: Kaunitz JD,Lindenbaum J

    更新日期:1977-11-01 00:00:00

  • Relapsing polychondritis.

    abstract::Relapsing polychondritis, an uncommon, chronic, multisystem disorder characterized by recurrent episodes of inflammation of cartilaginous tissues, can be life-threatening, debilitating, and difficult to diagnose. This review is based on the authors' experience with 36 patients with relapsing polychondritis who were fo...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,评审

    doi:10.7326/0003-4819-129-2-199807150-00011

    authors: Trentham DE,Le CH

    更新日期:1998-07-15 00:00:00

  • Health implications of overweight and obesity in the United States.

    abstract::The second National Health and Nutrition Examination Survey found that 26% of U.S. adults, or about 34 million people aged 20 to 75 years, are overweight. The survey used a body mass index of 27.8 kg/m2 or greater for men and 27.3 or greater for women to define overweight. Prevalence of overweight increases with advan...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-103-6-983

    authors: Van Itallie TB

    更新日期:1985-12-01 00:00:00

  • Why change? A look at the current system of disability determination and workers' compensation for occupational lung disease.

    abstract::Under the current system of disability determination and workers' compensation for occupational lung disease, disabled workers or their survivors can reasonably count on being compensated. However, by rejecting established scientific truth in order to pay workers' compensation in circumstances where disability or deat...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-97-6-908

    authors: Richman SI

    更新日期:1982-12-01 00:00:00

  • HemoQuant, a new quantitative assay for fecal hemoglobin. Comparison with Hemoccult.

    abstract::HemoQuant, an assay based on heme-derived porphyrin, quantifies both total fecal hemoglobin ant that fraction already converted to porphyrin by gut flora (the intestinal converted fraction). Recovery by HemoQuant of blood added to stools exceeded 99% and was not affected by ascorbic acid, iron, or other additives. Hem...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-101-3-297

    authors: Ahlquist DA,McGill DB,Schwartz S,Taylor WF,Ellefson M,Owen RA

    更新日期:1984-09-01 00:00:00

  • The relation of blood pressure to stroke prognosis.

    abstract::The relation between blood pressure before stroke and survival after the event, was examined in the Manitoba study cohort of 3983 men. The last recorded blood pressure before the first stroke and the change in blood pressure from a measurement 5 years earlier were used. Increasing magnitude of systolic blood pressure ...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-89-1-15

    authors: Rabkin SW,Mathewson FA,Tate RB

    更新日期:1978-07-01 00:00:00

  • Acute pancreatitis.

    abstract::The exocrine pancreas secretes into the gut on demand more than 20 proteins that are indispensable for digestion. In-vivo autodigestion is prevented by an array of natural safeguards. In acute pancreatitis, inappropriate intrapancreatic activation and release of pancreatic hydrolases occur, but the pathogenetic mechan...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,评审

    doi:10.7326/0003-4819-103-1-86

    authors: Geokas MC,Baltaxe HA,Banks PA,Silva J Jr,Frey CF

    更新日期:1985-07-01 00:00:00

  • Sex differences in access to coronary revascularization after cardiac catheterization: importance of detailed clinical data.

    abstract:BACKGROUND:Although some studies suggest that access to cardiac procedures may differ by sex, others have found no evidence of gender bias in cardiac care. OBJECTIVE:To study rates of percutaneous coronary intervention (PCI) or coronary artery bypass graft (CABG) surgery in men and women after cardiac catheterization....

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-136-10-200205210-00007

    authors: Ghali WA,Faris PD,Galbraith PD,Norris CM,Curtis MJ,Saunders LD,Dzavik V,Mitchell LB,Knudtson ML,Alberta Provincial Project for Outcome Assessment in Coronary Heart Disease (APPROACH) Investigators.

    更新日期:2002-05-21 00:00:00

  • Right-sided endocarditis in intravenous drug users. Prognostic features in 102 episodes.

    abstract:OBJECTIVE:To describe the clinical, laboratory, and echocardiographic findings in a large group of patients with right-sided endocarditis and to determine whether any of these findings is predictive of prognosis. DESIGN:Retrospective survey of medical records to evaluate the course of hospitalization with follow-up on...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-117-7-560

    authors: Hecht SR,Berger M

    更新日期:1992-10-01 00:00:00

  • Direct binding studies of adrenergic receptors: biochemical, physiologic, and clinical implications.

    abstract::Recently developed radioligand binding techniques permit direct investigation of the alpha- and beta-adrenergic receptors for catecholamines in a wide variety of tissues. These techniques allow the receptors to be quantitated, characterized, and studied under varying conditions of physiologic and pathophysiologic inte...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,评审

    doi:10.7326/0003-4819-91-3-450

    authors: Lefkowitz RJ

    更新日期:1979-09-01 00:00:00

  • Changes in DNA methylation in neoplasia: pathophysiology and therapeutic implications.

    abstract::Methylation of DNA is a biochemical modification that can influence gene expression and is involved in inactivating one of the two X chromosomes in women. Evidence that has accumulated in the past 10 years suggests that cancer cells usurp this physiologic mechanism and use it to their benefit by inactivating tumor sup...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,评审

    doi:10.7326/0003-4819-134-7-200104030-00011

    authors: Santini V,Kantarjian HM,Issa JP

    更新日期:2001-04-03 00:00:00

  • The safety of treadmill exercise stress testing in patients with abdominal aortic aneurysms.

    abstract:BACKGROUND:Exercise stress testing in patients with abdominal aortic aneurysms may cause enlargement or rupture of aneurysms. OBJECTIVE:To evaluate the safety of treadmill exercise stress testing in patients with abdominal aortic aneurysms. DESIGN:Retrospective descriptive study. SETTING:Tertiary care center. PATIE...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-129-8-199810150-00008

    authors: Best PJ,Tajik AJ,Gibbons RJ,Pellikka PA

    更新日期:1998-10-15 00:00:00

  • Toward a 21st-century health care system: recommendations for health care reform.

    abstract::The coverage, cost, and quality problems of the U.S. health care system are evident. Sustainable health care reform must go beyond financing expanded access to care to substantially changing the organization and delivery of care. The FRESH-Thinking Project (www.fresh-thinking.org) held a series of workshops during whi...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-150-7-200904070-00115

    authors: Arrow K,Auerbach A,Bertko J,Brownlee S,Casalino LP,Cooper J,Crosson FJ,Enthoven A,Falcone E,Feldman RC,Fuchs VR,Garber AM,Gold MR,Goldman D,Hadfield GK,Hall MA,Horwitz RI,Hooven M,Jacobson PD,Jost TS,Kotlikoff LJ

    更新日期:2009-04-07 00:00:00

  • Elevated levels of circulating platelet aggregates and beta-thromboglobulin in scleroderma.

    abstract::Levels of circulating platelet aggregates and plasma beta-thromboglobulin reflect the degree of platelet activation in vascular injury and repair. Both values were evaluated in 38 patients with scleroderma and 18 control subjects matched for age, sex, and race. Circulating platelet aggregates (expressed as percentage ...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-96-5-610

    authors: Kahaleh MB,Osborn I,Leroy EC

    更新日期:1982-05-01 00:00:00

  • Barrett's esophagus.

    abstract::Barrett's esophagus denotes the presence of columnar epithelium in the esophagus instead of the usual stratified squamous epithelium. Barrett's esophagus had been thought to represent a mediastinal extension of the stomach in patients with a congenital short esophagus. Subsequent clinical and experimental data have es...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,评审

    doi:10.7326/0003-4819-97-1-103

    authors: Bozymski EM,Herlihy KJ,Orlando RC

    更新日期:1982-07-01 00:00:00

  • Effects of alcohol and fluvastatin on lipid metabolism and hepatic function.

    abstract:OBJECTIVE:To determine the effects of fluvastatin, a synthetic 3-hydroxy-3-methylglutaryl coenzyme A (HMG-CoA) reductase inhibitor, combined with moderate alcohol consumption on lipid profiles and hepatic function in patients with primary hypercholesterolemia. DESIGN:Randomized, placebo-controlled, crossover study. S...

    journal_title:Annals of internal medicine

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.7326/0003-4819-122-9-199505010-00006

    authors: Smit JW,Wijnne HJ,Schobben F,Sitsen A,De Bruin TW,Erkelens DW

    更新日期:1995-05-01 00:00:00

  • Pleural effusions in hospitalized patients with AIDS.

    abstract:OBJECTIVE:To determine the incidence, cause, and characteristics of pleural effusions in hospitalized patients with the acquired immunodeficiency syndrome (AIDS). DESIGN:Retrospective. PARTICIPANTS:A total of 222 patients with AIDS hospitalized between January 1986 and January 1992 at the Medical University of South ...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-118-11-199306010-00005

    authors: Joseph J,Strange C,Sahn SA

    更新日期:1993-06-01 00:00:00