Reliability of clinical guideline development using mail-only versus in-person expert panels.

Abstract:

BACKGROUND:Clinical practice guidelines quickly become outdated. One reason they might not be updated as often as needed is the expense of collecting expert judgment regarding the evidence. The RAND-UCLA Appropriateness Method is one commonly used method for collecting expert opinion. We tested whether a less expensive, mail-only process could substitute for the standard in-person process normally used. METHODS:We performed a 4-way replication of the appropriateness panel process for coronary revascularization and hysterectomy, conducting 3 panels using the conventional in-person method and 1 panel entirely by mail. All indications were classified as inappropriate or not (to evaluate overuse), and coronary revascularization indications were classified as necessary or not (to evaluate underuse). Kappa statistics were calculated for the comparison in ratings from the 2 methods. RESULTS:Agreement beyond chance between the 2 panel methods ranged from moderate to substantial. The kappa statistic to detect overuse was 0.57 for coronary revascularization and 0.70 for hysterectomy. The kappa statistic to detect coronary revascularization underuse was 0.76. There were no cases in which coronary revascularization was considered inappropriate by 1 method, but necessary or appropriate by the other. Three of 636 (0.5%) hysterectomy cases were categorized as inappropriate by 1 method but appropriate by the other. CONCLUSIONS:The reproducibility of the overuse and underuse assessments from the mail-only compared with the conventional in-person conduct of expert panels in this application was similar to the underlying reproducibility of the process. This suggests a potential role for updating guidelines using an expert judgment process conducted entirely through the mail.

journal_name

Med Care

journal_title

Medical care

authors

Washington DL,Bernstein SJ,Kahan JP,Leape LL,Kamberg CJ,Shekelle PG

doi

10.1097/01.MLR.0000100583.76137.3E

keywords:

subject

Has Abstract

pub_date

2003-12-01 00:00:00

pages

1374-81

issue

12

eissn

0025-7079

issn

1537-1948

journal_volume

41

pub_type

杂志文章
  • Emphasizing "level of care" over "length of stay" in hospital utilization review.

    abstract::Utilization review has heretofore emphasized "length of stay" as the criterion for deciding when the patient is ready to leave the hospital. We suggest that "level of care" (the type, number, and/or intensity of a combination of physician, skilled nursing, and ancillary services) received by the patient should replace...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/00005650-197506000-00004

    authors: Goldberg GA,Holloway DC

    更新日期:1975-06-01 00:00:00

  • Comparison of two VA laboratory data repositories indicates that missing data vary despite originating from the same source.

    abstract:BACKGROUND:Assessing accuracy and completeness of data is an important component of conducting research. VA Healthcare System benefits from a highly developed electronic medical information system. The Immunology Case Registry was designed to monitor costs and quality of HIV care. The Decision Support System was develo...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/MLR.0b013e31817d69c2

    authors: McGinnis KA,Skanderson M,Levin FL,Brandt C,Erdos J,Justice AC

    更新日期:2009-01-01 00:00:00

  • Meaningful variation in performance: what does variation in quality tell us about improving quality?

    abstract:BACKGROUND:Variance reduction is sometimes considered as a goal of clinical quality improvement. Variance among physicians, hospitals, or health plans has been evaluated as the proportion of total variance (or intraclass correlation, ICC) in a quality measure; low ICCs have been interpreted to indicate low potential fo...

    journal_title:Medical care

    pub_type: 杂志文章,多中心研究

    doi:10.1097/MLR.0b013e3181c15a6e

    authors: Selby JV,Schmittdiel JA,Lee J,Fung V,Thomas S,Smider N,Crosson FJ,Hsu J,Fireman B

    更新日期:2010-02-01 00:00:00

  • Physician decision making and variation in hospital admission rates for suspected acute cardiac ischemia. A tale of two towns.

    abstract::The authors tested the "uncertainty hypothesis," which holds that variations in rates of hospitalization or surgeries across small geographic areas reflect differences in physicians' decision making when confronting uncertainty. A small-areas variation analysis of suspected acute cardiac ischemia (ACI) admissions in n...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/00005650-199411000-00002

    authors: Green LA,Becker MP

    更新日期:1994-11-01 00:00:00

  • Why consider patients' preferences? A discourse analysis of clinical practice guideline developers.

    abstract:BACKGROUND:Several organizations are advocating for patients' preferences to be considered in clinical practice guideline development and implementation. However, lack of agreement on the goal and meaning of this policy curtails evaluation and development of patient involvement programs. GOAL:To describe guideline dev...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/MLR.0b013e3181a81158

    authors: Boivin A,Green J,van der Meulen J,Légaré F,Nolte E

    更新日期:2009-08-01 00:00:00

  • Needs-based planning for generalist physicians.

    abstract:OBJECTIVES:The Manitoba Centre for Health Policy and Evaluation (MCHPE) collaborated with a provincially-appointed Physician Resource Committee in an assessment of provincial physician resources. RESEARCH DESIGN:Beginning with map-based analyses of physician supply and contacts across the province, compared with the h...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/00005650-199906001-00017

    authors: Roos NP,Fransoo R,Bogdanovic B,Carriere KC,Frohlich N,Friesen D,Patton D,Wall R

    更新日期:1999-06-01 00:00:00

  • Health Insurance Portability and Accountability Act of 1996: lessons from the States.

    abstract:OBJECTIVES:To assess the likely effects of the 1996 Health Insurance Portability and Accessibility Act (HIPAA), based on small firms' experiences under state small group insurance reforms that were similar in design to HIPAA. METHODS:Data on 17,818 small businesses (range, 2-50 employees) nationwide from the 1994 Nati...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/00005650-199907000-00009

    authors: Hing E,Jensen GA

    更新日期:1999-07-01 00:00:00

  • Predictors of Multiple Emergency Department Utilization Among Frequent Emergency Department Users in 3 States.

    abstract:BACKGROUND:Research on frequent emergency department (ED) use shows that a subgroup of patients visits multiple EDs. This study characterizes these individuals. OBJECTIVE:The objective of this study was to determine how many frequent ED users seek care at multiple EDs and to identify sociodemographic, clinical, and co...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/MLR.0000000000001228

    authors: Giannouchos TV,Washburn DJ,Kum HC,Sage WM,Ohsfeldt RL

    更新日期:2020-02-01 00:00:00

  • Relationship between processes of care and coronary bypass operative mortality and morbidity.

    abstract:BACKGROUND:Information is limited regarding the effects of processes of care on cardiac surgical outcomes. Correspondingly, many recommended cardiac surgical processes of care are derived from animal experiments or clinical judgment. This report from the VA Cooperative Study in Health Services, "Processes, Structures, ...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/01.mlr.0000102295.08379.57

    authors: O'Brien MM,Shroyer AL,Moritz TE,London MJ,Grunwald GK,Villanueva CB,Thottapurathu LG,MaWhinney S,Marshall G,McCarthy M Jr,Henderson WG,Sethi GK,Grover FL,Hammermeister KE,VA Cooperative Study Group on Processes, Structures, a

    更新日期:2004-01-01 00:00:00

  • Associations between health status and utilities implications for policy.

    abstract:BACKGROUND:If shape of a person's utility function is associated with his health status, as is predicted by Prospect Theory, the use of utilities from the healthy could result in 'de facto' discrimination against the sick. OBJECTIVES:To determine if patients' utilities for hypothetical states and for their current hea...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/00005650-199905000-00007

    authors: Lenert LA,Treadwell JR,Schwartz CE

    更新日期:1999-05-01 00:00:00

  • Predictors of aggressive therapy for nonmetastatic prostate carcinoma in Massachusetts from 1998 to 2002.

    abstract:BACKGROUND:Most studies have found that black men are less likely to receive aggressive therapy for nonmetastatic prostate cancer, even after controlling for covariates. However, previous studies have not accounted for the clustering of outcomes by facility. OBJECTIVE:We sought to compare the proportions of black and ...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/01.mlr.0000257144.29928.f0

    authors: Rose AJ,Backus BM,Gershman ST,Santos P,Ash AS,Battaglia TA

    更新日期:2007-05-01 00:00:00

  • Medicare part D data: major changes on the horizon.

    abstract:BACKGROUND:The 3 primary administrative data sets developed by the Centers for Medicare and Medicaid services (CMS) to support the Medicare Part D program implementation represent a valuable source of data for health services researchers. This paper describes the structure of the Medicare Part D program and the related...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/MLR.0b013e318041385f

    authors: Greenwald LM

    更新日期:2007-10-01 00:00:00

  • The effect of improving primary care depression management on employee absenteeism and productivity. A randomized trial.

    abstract:OBJECTIVE:To test whether an intervention to improve primary care depression management significantly improves productivity at work and absenteeism over 2 years. SETTING AND SUBJECTS:Twelve community primary care practices recruiting depressed primary care patients identified in a previsit screening. RESEARCH DESIGN:...

    journal_title:Medical care

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1097/00005650-200412000-00007

    authors: Rost K,Smith JL,Dickinson M

    更新日期:2004-12-01 00:00:00

  • Rural-Urban Differences in Medicare Quality Outcomes and the Impact of Risk Adjustment.

    abstract:BACKGROUND:There has been considerable debate in recent years about whether, and how, to risk-adjust quality measures for sociodemographic characteristics. However, geographic location, especially rurality, has been largely absent from the discussion. OBJECTIVE:To examine differences by rurality in quality outcomes, a...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/MLR.0000000000000761

    authors: Henning-Smith C,Kozhimannil K,Casey M,Prasad S,Moscovice I

    更新日期:2017-09-01 00:00:00

  • Influence of Peer Physicians on Intensity of End-of-Life Care for Cancer Decedents.

    abstract:BACKGROUND:The intensity of end-of-life care varies substantially both within and between areas. Differing practice patterns of individual physicians are likely influenced by their peers. OBJECTIVE:To assess whether intensity of end-of-life care previously provided by a physician's peers influences patterns of care at...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/MLR.0000000000001124

    authors: Keating NL,O'Malley AJ,Onnela JP,Gray SW,Landon BE

    更新日期:2019-06-01 00:00:00

  • 27. CPHA patient care data system for long-term care facilities.

    abstract::Earlier efforts of the Commission on Professional and Hospital Activities (CPHA) to develop a patient care data system for long-term care facilities were discontinued for lack of user interest and shortage of funds; however, the facilities were encouraged to participate in the hospital data system (PAS) and to use opt...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/00005650-197605001-00033

    authors: Slee VN

    更新日期:1976-05-01 00:00:00

  • Use of Medicare Claims Data for the Identification of Myocardial Infarction: The Reasons for Geographic And Racial Differences in Stroke Study.

    abstract:OBJECTIVES:Assess the validity of Medicare claims for identifying myocardial infarction (MI). METHODS:We used data from 9951 Medicare beneficiaries 65 years and above in the Reasons for Geographic And Racial Differences in Stroke study. Between 2003 and 2012, 669 participants had an MI identified and adjudicated throu...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/MLR.0000000000001004

    authors: Colantonio LD,Levitan EB,Yun H,Kilgore ML,Rhodes JD,Howard G,Safford MM,Muntner P

    更新日期:2018-12-01 00:00:00

  • Impact of predialysis therapeutic practices on patient outcomes during the first year of dialysis: the Pharmacoepidemiologic AVENIR study.

    abstract:BACKGROUND:Studies evaluating patient outcomes in dialysis as a function of quality of predialysis therapeutic care are lacking. OBJECTIVE:To evaluate the association of quality of predialysis therapeutic practices with survival and hospitalization during the first year of dialysis. RESEARCH DESIGN:The AVantagE de la...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/MLR.0b013e3181d56926

    authors: Thilly N,Boini S,Loos-Ayav C,Kessler M,Briançon S,Frimat L

    更新日期:2012-01-01 00:00:00

  • Medicaid Health Home Reducing Costs and Reliance on Emergency Department: Evidence From Iowa.

    abstract:BACKGROUND:The Affordable Care Act allowed an optional Medicaid State Plan benefit for states to establish Health Homes coordinating care for people who have chronic conditions. Differences in medical home program incentives and implementation styles are important to understand in evaluating effects on key outcomes suc...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/MLR.0000000000000555

    authors: Shane DM,Nguyen-Hoang P,Bentler SE,Damiano PC,Momany ET

    更新日期:2016-08-01 00:00:00

  • Cost-related Nonadherence to Medication Treatment Plans: Native Hawaiian and Pacific Islander National Health Interview Survey, 2014.

    abstract:BACKGROUND:Adherence to medication treatment plans is important for chronic disease (CD) management. Cost-related nonadherence (CRN) puts patients at risk for complications. Native Hawaiians and Pacific Islanders (NHPI) suffer from high rates of CD and socioeconomic disparities that could increase CRN behaviors. OBJEC...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/MLR.0000000000000887

    authors: McElfish PA,Long CR,Payakachat N,Felix H,Bursac Z,Rowland B,Hudson JS,Narcisse MR

    更新日期:2018-04-01 00:00:00

  • Novel Health Information Technology to Aid Provider Recognition and Treatment of Major Depressive Disorder and Posttraumatic Stress Disorder in Primary Care.

    abstract:BACKGROUND:Millions of traumatized refugees worldwide have resettled in the United States. For one of the largest, the Cambodian community, having their mental health needs met has been a continuing challenge. A multicomponent health information technology screening tool was designed to aid provider recognition and tre...

    journal_title:Medical care

    pub_type: 杂志文章,随机对照试验

    doi:10.1097/MLR.0000000000001036

    authors: Sorkin DH,Rizzo S,Biegler K,Sim SE,Nicholas E,Chandler M,Ngo-Metzger Q,Paigne K,Nguyen DV,Mollica R

    更新日期:2019-06-01 00:00:00

  • The use of attitudinal data for public policy: the case of unnecessary hospital use.

    abstract::A national sample of both hospital administrators and hospital review chair-persons (the two adversarial providers in the hospital regulatory milieu) were surveyed and asked to estimate the degree and kind of unnecessary hospital utilization taking place both in the U.S. and at their own institution. Both groups indic...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/00005650-198101000-00006

    authors: Rothberg DL,Gertman PM

    更新日期:1981-01-01 00:00:00

  • Healthcare restructuring and hierarchical alignment: why do staff and managers perceive change outcomes differently?

    abstract:PURPOSE:Healthcare organizations have undergone major change efforts in the past decade. Sustained change is related to continued alignment among organizational participants and may fail with incongruent perceptions of change. This study identifies factors contributing to the alignment in perceptions of organizational ...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/01.mlr.0000220692.39762.bf

    authors: Walston SL,Chou AF

    更新日期:2006-09-01 00:00:00

  • Does Offering Battlefield Acupuncture Lead to Subsequent Use of Traditional Acupuncture?

    abstract:OBJECTIVES:Veterans Health Administration encourages auricular acupuncture (Battlefield Acupuncture/BFA) as a nonpharmacologic approach to pain management. Qualitative reports highlighted a "gateway hypothesis": providing BFA can lead to additional nonpharmacologic treatments. This analysis examines subsequent use of t...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/MLR.0000000000001367

    authors: Thomas ER,Zeliadt SB,Coggeshall S,Gelman H,Resnick A,Giannitrapani K,Olson J,Kligler B,Taylor SL

    更新日期:2020-09-01 00:00:00

  • Predicting psychosocial risk in patients with breast cancer.

    abstract::Breast cancer is the most common neoplasm in North American women. The psychosocial impact of breast cancer has been extensively studied, and a number of investigators have attempted to characterize women who are at high risk for increased psychosocial morbidity. Although a detailed interview performed by a profession...

    journal_title:Medical care

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1097/00005650-199305000-00004

    authors: Ganz PA,Hirji K,Sim MS,Schag CA,Fred C,Polinsky ML

    更新日期:1993-05-01 00:00:00

  • Satisfaction With Quality of Health Care Among Medicare Beneficiaries With Functional Hearing Loss.

    abstract:BACKGROUND/OBJECTIVES:Nearly 38 million Americans have hearing loss. Understanding how sensory deficits such as hearing loss, which limit communication, impact satisfaction has implications for Medicare value-based reimbursement mechanisms. The aim of this study was to characterize the association of functional hearing...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/MLR.0000000000001419

    authors: Reed NS,Boss EF,Lin FR,Oh ES,Willink A

    更新日期:2021-01-01 00:00:00

  • Pediatric nurse practitioner functions in the outpatient clinics of a tertiary care center.

    abstract::Previous research has neglected to delineate pediatric nurse practitioner (PNP) roles in tertiary care settings (TCS). New PNP roles have developed as TCS seek cost-effective solutions to providing quality patient care and to meeting new demands for outpatient care. The authors evaluated the roles of 11 PNPs in eight ...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/00005650-198604000-00005

    authors: Cruikshank BM,Clow TJ,Seals B

    更新日期:1986-04-01 00:00:00

  • A comparison of in-hospital mortality risk conferred by high hospital occupancy, differences in nurse staffing levels, weekend admission, and seasonal influenza.

    abstract:BACKGROUND:Hospital occupancy, nurse staffing levels, weekend admission, and seasonal influenza have all been shown to be associated with in-hospital mortality. Yet, no study has simultaneously compared the strength of associations of these 4 factors with in-hospital mortality. OBJECTIVE:To compare the risk of in-hosp...

    journal_title:Medical care

    pub_type: 杂志文章,多中心研究

    doi:10.1097/MLR.0b013e3181c162c0

    authors: Schilling PL,Campbell DA Jr,Englesbe MJ,Davis MM

    更新日期:2010-03-01 00:00:00

  • Characterizing patient dysfunction in Alzheimer's-type dementia.

    abstract::Although Alzheimer's-type dementia (ATD) is characterized by global intellectual deterioration, few systematic efforts have been made to characterize overall dysfunction of ATD patients. The Sickness Impact Profile (SIP) was administered to ATD patients and family members to determine the concurrent validity of family...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/00005650-198805000-00002

    authors: Krenz C,Larson EB,Buchner DM,Canfield CG

    更新日期:1988-05-01 00:00:00

  • Practice variation and the risk of low birth weight in a public prenatal care program.

    abstract:OBJECTIVES:Use of antepartum tests of fetal well-being is widespread even though effectiveness in preventing fetal damage or stillbirth has not been established. The study objective was to examine whether aggressive use of these tests might contribute to increased rates of other birth outcomes, including low birth weig...

    journal_title:Medical care

    pub_type: 杂志文章

    doi:10.1097/00005650-199701000-00002

    authors: Helfand M,Zimmer-Gembeck MJ

    更新日期:1997-01-01 00:00:00