Innovations for Evaluation Research: Multiform Protocols, Visual Analog Scaling, and the Retrospective Pretest-Posttest Design.

Abstract:

:In this article, we review three innovative methods: multiform protocols, visual analog scaling, and the retrospective pretest-posttest design that can be used in evaluation research. These three techniques have been proposed for decades, but unfortunately, they are still not utilized readily in evaluation research. Our goal is to familiarize researchers with these underutilized research techniques that could reduce personnel effort and costs for data collection while producing better inferences for a study. We begin by discussing their applications and special unique features. We then discuss each technique's strengths and limitations and offer practical tips on how to better implement these methods in evaluation research. We then showcase two recent empirical studies that implement these methods in real-world evaluation research applications.

journal_name

Eval Health Prof

authors

Chang R,Little TD

doi

10.1177/0163278718759396

subject

Has Abstract

pub_date

2018-06-01 00:00:00

pages

246-269

issue

2

eissn

0163-2787

issn

1552-3918

journal_volume

41

pub_type

杂志文章,评审
  • Surgery resident selection and evaluation. A critical incident study.

    abstract::This article reports a study of the process of selecting and evaluating general surgery residents. In personnel psychology terms, a job analysis of general surgery was conducted using the Critical Incident Technique (CIT). The researchers collected 235 critical incidents through structured interviews with 10 general s...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/016327879301600105

    authors: Edwards JC,Currie ML,Wade TP,Kaminski DL

    更新日期:1993-03-01 00:00:00

  • Telephone survey of hospital staff knowledge of medical device surveillance in a Paris hospital.

    abstract::Reporting of incidents or near incidents because of medical devices in French hospitals relies on procedures following European and national guidelines. The authors intend to evaluate hospital staff knowledge on these surveillance procedures as a marker of appropriate application. A telephone survey is conducted on a ...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278704270012

    authors: Mazeau V,Grenier-Sennelier C,Paturel DX,Mokhtari M,Vidal-Trecan G

    更新日期:2004-12-01 00:00:00

  • A national assessment of the service, support, and housing preferences by persons with chronic fatigue syndrome. Toward a comprehensive rehabilitation program.

    abstract::Persons with Chronic Fatigue Syndrome (PWCs) completed and returned by mail a brief survey of open- and closed-ended items designed to assess their utilization and preferences for a variety of services. A total of 984 middle-aged adults diagnosed with Chronic Fatique Syndrome (CFS) from across North America returned t...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/016327879601900204

    authors: Jason LA,Ferrari JR,Taylor RR,Slavich SP,Stenzel CL

    更新日期:1996-06-01 00:00:00

  • The logic behind a multimethod intervention to improve adherence to clinical practice guidelines in a nationwide network of primary care practices.

    abstract::The gap between evidence-based guidelines for clinical care and their application in medical settings is well established and widely discussed. Effective interventions are needed to help health care providers reduce this gap. Whereas the development of clinical practice guidelines from biomedical and clinical research...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278705284443

    authors: Feifer C,Ornstein SM,Jenkins RG,Wessell A,Corley ST,Nemeth LS,Roylance L,Nietert PJ,Liszka H

    更新日期:2006-03-01 00:00:00

  • Teaching skill improvement for graduate medical trainees. An agenda for research and development.

    abstract::The medical education literature concerned with the teaching role fulfilled by house officers was reviewed by the authors. Articles were presented in three categories: (1) studies of house officer effort, (2) perceptions of the house officer's teaching role, and (3) assessing and improving house officer teaching skill...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章,评审

    doi:10.1177/016327878801100101

    authors: Sheets KJ,Schwenk TL

    更新日期:1988-03-01 00:00:00

  • Comparison of mail and telephone in assessing patient experiences in receiving care from medical group practices.

    abstract::The medical group survey from the CAHPS (formerly Consumer Assessment of Health Plans Study) project, G-CAHPS, focuses on patient experiences in receiving care from their medical group practice. We compared mail and telephone responses to the G-CAHPS survey in a sample of 880 patients from four physician groups. Patie...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章,随机对照试验

    doi:10.1177/0163278705281074

    authors: Hepner KA,Brown JA,Hays RD

    更新日期:2005-12-01 00:00:00

  • When is knowledge ripe for primary care? An exploratory study on the meaning of evidence.

    abstract::The objectives of this study were to explore the meaning of scientific evidence as it is understood by primary care physicians. Individual interviews were conducted with actors chosen for their roles in the production and use of knowledge: 22 family physicians, 13 specialist physicians, and 6 researchers. Two situatio...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278707311870

    authors: Beaulieu MD,Proulx M,Jobin G,Kugler M,Gossard F,Denis JL,Larouche D

    更新日期:2008-03-01 00:00:00

  • Adherence to practice guidelines, clinical outcomes, and costs among Medicaid enrollees with severe mental illnesses.

    abstract::The treatment of Medicaid enrollees diagnosed with depression or schizophrenia was examined to determine whether adherence to treatment guideline was associated with health care financing strategy, clinical outcomes, and cost-effectiveness. Individuals in a fee-for-service condition were significantly more likely to r...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278708328744

    authors: Stiles PG,Boothroyd RA,Dhont K,Beiler PF,Green AE

    更新日期:2009-03-01 00:00:00

  • Measuring physicians' and medical students' attitudes toward caring for immigrant patients.

    abstract::It is generally believed that culturally competent clinical practice depends in part on the development of positive attitudes toward the care of immigrant patients. However, few tools exist to measure such attitudes in physicians. The authors operationalized ''culturally competent attitudes'' to include a high level o...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278710370157

    authors: Hudelson P,Perron NJ,Perneger TV

    更新日期:2010-12-01 00:00:00

  • Health care workers in the Dominican Republic: self-perceived role in smoking cessation.

    abstract::A Dominican Republic (DR)-based multi-community trial of smoking cessation viewed health care workers (HCWs) as potential interventionists. Effectively engaging them requires a clear understanding of their attitudes and practices regarding smoking. A Rapid Assessment Procedure, conducted among HCWs in six economically...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278709333152

    authors: Dozier AM,Ossip DJ,Diaz S,Sierra-Torres E,Quiñones de Monegro Z,Armstrong L,Chin NP,McIntosh S

    更新日期:2009-06-01 00:00:00

  • A measure of perceived burden among caregivers.

    abstract::This report describes an easily administered scale for measuring perceived burden among caregivers of family members with dementia. During home interviews conducted in 1991, 82 caregivers rated their family member with dementia on several items related to functional ability, the type of care provided, and associated s...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章,评审

    doi:

    authors: Macera CA,Eaker ED,Jannarone RJ,Davis DR,Stoskopf CH

    更新日期:1993-06-01 00:00:00

  • Data sources for health care quality evaluation.

    abstract::The central purpose of this article is to review the major approaches to evaluation of health care quality in terms of its use of different data sources. The areas of application, advantages, and disadvantages of seven data sources are presented, including direct observation, clinical records, record abstracts, clinic...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/016327878300600302

    authors: Baker F

    更新日期:1983-09-01 00:00:00

  • Involving people with severe mental illness in evaluation and performance improvement.

    abstract::This article argues for the increased involvement of people with severe mental illness and consumers of other health and mental health services in evaluation and performance improvement in the organizations from which they receive services. Among other reasons, consumers can bring a different perspective to the select...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278702025003003

    authors: Linhorst DM,Eckert A

    更新日期:2002-09-01 00:00:00

  • Development of 7-Item Perceived Meaning of Activity in Housing (PMA-H-7) to Assess Opportunities for Meaningful Activities in the Supported Housing Context for People With Psychiatric Disabilities.

    abstract::People with psychiatric disabilities need to be able to express their views about their support, for example, the provision of meaningful activity in supported accommodation. Brief scales may be necessary to avoid strain and discomfort for this group. The aim was to develop a brief version of Perceived Meaning in Acti...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278719845036

    authors: Eklund M,Brunt D

    更新日期:2020-12-01 00:00:00

  • The nature of explanation in qualitative evaluation.

    abstract::In recent years evaluation has mushroomed dramatically as a discipline. A number of evaluation "models" or approaches have been conceived, and varieties of social science methods have been employed serving several evaluative purposes. Missing from the health profession's literature on evaluation is a discussion of the...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/016327878500800202

    authors: Pearsol JA

    更新日期:1985-06-01 00:00:00

  • The reliability of peer assessments. A meta-analysis.

    abstract::A meta-analysis of studies examining the interrater reliability of the standard practice of peer assessments of quality of care was conducted. Using the Medline, Health Planning and Administration, and SCISEARCH databases, the English-language literature from 1966 through 1991 was searched for studies of chance correc...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章,meta分析

    doi:10.1177/016327879401700101

    authors: Goldman RL

    更新日期:1994-03-01 00:00:00

  • The Association Between Hospital Characteristics and Nonresponse in Organization Survey: An Analysis of the National Healthcare Establishment and Workforce Survey in Malaysia.

    abstract::In any survey where some of the invited participants fail to respond estimates may be biased. The literature on survey nonresponse is substantial, and the intellectual focus has typically been on the nonresponse of individuals. An important yet less scrutinized area in the analysis of nonresponse is in organizational ...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278717713569

    authors: Foo CY,Reidpath DD,Sivasampu S

    更新日期:2017-01-01 00:00:00

  • Hidden bias in the use of archival data.

    abstract::Nonresponses in archival data may violate the missing-at-random assumption in ways difficult to detect. Standard methods of comparing sociodemographics of respondents and nonrespondents are inappropriate when the units of analysis are not also the individuals who maintain the archival record. Under these circumstances...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/016327878701000202

    authors: Dworkin RJ

    更新日期:1987-06-01 00:00:00

  • Longitudinal outcomes of a comprehensive, incentivized worksite wellness program.

    abstract::This study evaluated health benefits of long-term participation in an employer-based wellness program, focusing on selected chronic disease risk factors. A repeated measures longitudinal time-series study was conducted of 8 years of existing prospectively collected annual data, including clinical measures of weight, b...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278710379222

    authors: Neville BH,Merrill RM,Kumpfer KL

    更新日期:2011-03-01 00:00:00

  • Universal Design for Measurement: Centering the Experiences of Individuals With Disabilities Within Health Measurement Research.

    abstract::People with disabilities comprise roughly 25% of the U.S. adult population yet remain underrepresented in mainstream public health and evaluation research. The lack of measures of common constructs that are validated in but not specific to this population may impede their inclusion. This article describes the use of U...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278719900530

    authors: Thomas EV,Warren-Findlow J,Reeve CL,Webb JB,Laditka SB,Quinlan MM

    更新日期:2020-01-20 00:00:00

  • An example of maximizing survey return rates. Methodological issues for health professionals.

    abstract::Obtaining a high response rate in survey research can bolster statistical power, reduce sampling error, and enhance the generalizability of the results to the population surveyed. We describe a mail survey designed to achieve a high return rate of completed questionnaires from members of the American Psychological Ass...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/01678702025002002

    authors: Gore-Felton C,Koopman C,Bridges E,Thoresen C,Spiegel D

    更新日期:2002-06-01 00:00:00

  • Are positive alternative medical therapy trials credible?: Evidence from four high-impact medical journals.

    abstract::Forty-five complementary and alternative medicine (CAM) efficacy randomized controlled trials (RCTs) from high-impact medical journals (NEJM, JAMA, Annals of Internal Medicine, and Archives of Internal Medicine) were reviewed based on their meeting three validity criteria (the existence of a placebo control, moderate ...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278709346810

    authors: Barker Bausell R

    更新日期:2009-12-01 00:00:00

  • A foreign medical school transfer program: student performance and career choices.

    abstract::U.S. medical students who have been unable to gain acceptance into medical schools have long sought alternative pathways into American medical practice. The Medical College of Georgia (MCG) has had a transfer program since 1977 to facilitate entry of Georgia Transfer students into the third-year clinical rotations. Af...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/016327878500800307

    authors: Lewis LA,Kuske TT

    更新日期:1985-09-01 00:00:00

  • A comparison of empirical ranking methods of frequency and severity ratings of clinical presentations.

    abstract::This study compares five methods of ranking Likert ratings on frequency and severity scales. Data were drawn from an international online survey conducted as part of a practice analysis with 91 diplomates of the American Chiropractic Board of Radiology. A total of 129 clinical presentations had been rated on two scale...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278711425041

    authors: Smith SD,Beran TN

    更新日期:2012-12-01 00:00:00

  • Translation and Psychometric Evaluation of the Mahoney Pain Scale Among Iranian Elderly With Dementia: A Methodological Study.

    abstract::Valid and reliable measurement tools are necessary for pain assessment among the elderly with dementia. This study aimed to translate the Mahoney Pain Scale (MPS) into Persian and evaluate its psychometric properties among Iranian elderly with dementia. In this methodological study, after translating and assessing the...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278720961818

    authors: Zare M,Tagharrobi Z,Sharifi K,Sooki Z,Abolhasani J

    更新日期:2020-09-29 00:00:00

  • Investigating the psychometric properties of the Rosenberg Self-Esteem scale for South African residents of Greater Pretoria.

    abstract::Interviewers administered the Rosenberg Self-Esteem scale (RSES) to five groups of Black (formal township and informal settlement), White, Indian, and mixed race adult residents of Greater Pretoria. The results demonstrated that the RSES was psychometrically sound for the five groups. The minimal effects of sociodemog...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278713504214

    authors: Westaway MS,Jordaan ER,Tsai J

    更新日期:2015-06-01 00:00:00

  • Translation of evidence-based tobacco use prevention programming in Croatia.

    abstract::Croatia faces a major threat of smoking-related health burdens given the monumental changes this newly formed country has undergone in the past 15 years because of its postcommunist democratic and economic transitions and the destructive 1991-1995 war with Serbia. This article provides information on Croatia's general...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278708320151

    authors: Skara S,Kovacic L,Civljak M,Voncina L

    更新日期:2008-09-01 00:00:00

  • Using focus groups to assess primary care patients' satisfaction.

    abstract::The present report describes the use of patient focus groups by a primary health care facility. We review our rationale for using focus groups and the process we used to prepare for and conduct them. We then highlight the results and lessons learned through this experience. Focus groups can be an excellent method for ...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/01632780022034480

    authors: Schwarz M,Landis SE,Rowe JE,Janes CL,Pullman N

    更新日期:2000-03-01 00:00:00

  • Evaluating the Healthy Start program. Design development to evaluative assessment.

    abstract::The national evaluation of the federally funded Healthy Start program involved translating a design for a process and outcomes evaluation and standard maternal and infant data set, both developed prior to the national evaluation contract award, into an evaluation design and client data collection protocol that could b...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/016327879601900307

    authors: Raykovich KS,McCormick MC,Howell EM,Devaney BL

    更新日期:1996-09-01 00:00:00

  • Utilization of behavioral knowledge from short-term workshops.

    abstract::Workshops on new methods in the health professions have often been evaluated for participant reaction and understanding of the material. But behavior change on the job following workshops has seldom been assessed. Rehabilitation professionals in seven states were surveyed to determine use of behavior management proced...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/016327877900200404

    authors: Marr JN,Greenwood R

    更新日期:1979-12-01 00:00:00