The assessment of professional competence.

Abstract:

:Valid assessment of professional competence has proven to be an elusive goal. Objective tests, direct observation of performance, overall ratings of competence, and simulations have been tried and found wanting in one way or another. Objective test items are criticized as being unrealistic and therefore invalid. Direct observation tends to be very unreliable and therefore invalid. Simulations and overall ratings of competence share both of these flaws to some extent. Basically, you can't win. This article outlines some of the many ways to lose and some ways to cut these losses. In doing so, it proposes a general framework for evaluating the validity of measures of competence, and it uses this framework to examine the strengths and weaknesses of three approaches to the assessment of professional competence: direct observation, simulation, and objective testing.

journal_name

Eval Health Prof

authors

Kane MT

doi

10.1177/016327879201500203

subject

Has Abstract

pub_date

1992-06-01 00:00:00

pages

163-82

issue

2

eissn

0163-2787

issn

1552-3918

journal_volume

15

pub_type

杂志文章,评审
  • Linking Existing Instruments to Develop an Activity of Daily Living Item Bank.

    abstract::This study examined dimensionality and item-level psychometric properties of an item bank measuring activities of daily living (ADL) across inpatient rehabilitation facilities and community living centers. Common person equating method was used in the retrospective veterans data set. This study examined dimensionality...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278716676873

    authors: Li CY,Romero S,Bonilha HS,Simpson KN,Simpson AN,Hong I,Velozo CA

    更新日期:2018-03-01 00:00:00

  • Comparison of mail and telephone in assessing patient experiences in receiving care from medical group practices.

    abstract::The medical group survey from the CAHPS (formerly Consumer Assessment of Health Plans Study) project, G-CAHPS, focuses on patient experiences in receiving care from their medical group practice. We compared mail and telephone responses to the G-CAHPS survey in a sample of 880 patients from four physician groups. Patie...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章,随机对照试验

    doi:10.1177/0163278705281074

    authors: Hepner KA,Brown JA,Hays RD

    更新日期:2005-12-01 00:00:00

  • Is evaluating complementary and alternative medicine equivalent to evaluating the absurd?

    abstract::Complementary and alternative therapies such as reflexology and acupuncture have been the subject of numerous evaluations, clinical trials, and systematic reviews, yet the empirical evidence in support of their efficacy remains equivocal. The empirical evaluation of a therapy would normally assume a plausible rational...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278710361923

    authors: Greasley P

    更新日期:2010-06-01 00:00:00

  • Outpatient utilization patterns and quality outcomes after first acute episode of mental health hospitalization. Is some better than none, and is more service associated with better outcomes?

    abstract::Access to outpatient services within the first 30 days after an inpatient mental health episode may influence relapse risk. A retrospective cohort of 3,755 adult Medicaid mental health inpatients discharged from their first managed care acute episode of care from July 1, 1996, through May 20, 1998, were studied. Resul...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/01632780022034714

    authors: Huff ED

    更新日期:2000-12-01 00:00:00

  • Utilization and impact of cigarette pack covers illustrated with antismoking messages.

    abstract::The authors tested whether smokers would use cigarette pack covers illustrated with antismoking messages. In 2001, visitors to a smoking cessation Web site ordered cigarette pack covers and answered a follow-up questionnaire 52 days later. Participants received by mail cardboard boxes designed to contain cigarette pac...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278704264050

    authors: Christie D,Etter JF

    更新日期:2004-06-01 00:00:00

  • Organizational effects on mentally retarded adults: a longitudinal analysis.

    abstract::Normalization has gained wide acceptance as a goal that residential institutations for the mentally retarded should strive to achieve, but many organizations have been shown to have difficulty achieving the goal. Theories developed from the organizational contingency perspective suggest that organizations with bureauc...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/016327878000300105

    authors: King RD,Hougland JG Jr,Shepard JM,Gallagher EB

    更新日期:1980-03-01 00:00:00

  • Misunderstanding meta-analysis.

    abstract::Although it is increasingly common, meta-analysis is still a relatively new addition to the toolbox of research strategies. Partially because of its newness and partially because its early enthusiasts may have overstated its presumed contributions, a number of common misunderstandings have developed about the meta-ana...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/016327879501800305

    authors: Bangert-Drowns RL

    更新日期:1995-09-01 00:00:00

  • A comparison of empirical ranking methods of frequency and severity ratings of clinical presentations.

    abstract::This study compares five methods of ranking Likert ratings on frequency and severity scales. Data were drawn from an international online survey conducted as part of a practice analysis with 91 diplomates of the American Chiropractic Board of Radiology. A total of 129 clinical presentations had been rated on two scale...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278711425041

    authors: Smith SD,Beran TN

    更新日期:2012-12-01 00:00:00

  • Assessment of communication barriers in community pharmacies.

    abstract::This study identified previously reported facilitators and barriers to pharmacist-client communication and then evaluated their impact on the observed communication behaviors of pharmacists. Pharmacists (n = 100) completed a seven-page questionnaire collecting information on 11 variables that had been organized accord...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278703258104

    authors: Paluck EC,Green LW,Frankish CJ,Fielding DW,Haverkamp B

    更新日期:2003-12-01 00:00:00

  • Content validity of the National Board Dental Hygiene Examination.

    abstract::This article describes a protocol that was employed to validate the content of the National Board Dental Hygiene Examination (NBDHE) using two separate practice analyses. The protocol consisted of the following phases: (1) the careful definition of the domain of knowledge and skills required for successful entry-level...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278713501073

    authors: Tsai TH,Kramer GA

    更新日期:2014-12-01 00:00:00

  • Impact of differential response rates on the quality of data collected in the CTS physician survey.

    abstract::Survey administrators face trade-offs between expending additional survey resources to maximize response rates versus using fewer resources and accepting lower response rates. Using data from the Community Tracking Study's Physician Survey, we examined how survey estimates and data quality changed as additional respon...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278702250077

    authors: Schoenman JA,Berk ML,Feldman JJ,Singer A

    更新日期:2003-03-01 00:00:00

  • Common metrics to assess the efficiency of clinical research.

    abstract::The Clinical and Translational Science Award (CTSA) program was designed by the National Institutes of Health (NIH) to develop processes and infrastructure for clinical and translational research throughout the United States. The CTSA initiative now funds 61 institutions. In 2012, the National Center for Advancing Tra...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278713499586

    authors: Rubio DM

    更新日期:2013-12-01 00:00:00

  • A national assessment of the service, support, and housing preferences by persons with chronic fatigue syndrome. Toward a comprehensive rehabilitation program.

    abstract::Persons with Chronic Fatigue Syndrome (PWCs) completed and returned by mail a brief survey of open- and closed-ended items designed to assess their utilization and preferences for a variety of services. A total of 984 middle-aged adults diagnosed with Chronic Fatique Syndrome (CFS) from across North America returned t...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/016327879601900204

    authors: Jason LA,Ferrari JR,Taylor RR,Slavich SP,Stenzel CL

    更新日期:1996-06-01 00:00:00

  • Medical care in developing countries. Assessment and assurance of quality.

    abstract::In recent years attention in developing countries has concentrated upon strategies to improve the equitable provision of essential health care--the primary health care approach. Very little work has been reported in connection with the quality of medical care, and yet for the successful outcome of care it is necessary...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/016327878300600405

    authors: Walker GJ

    更新日期:1983-12-01 00:00:00

  • Factors that influence health risk behaviors among tanning salon patrons.

    abstract::A principal components analysis identified the immediate convenience of indoor tanning (i.e., relaxation, perceived attractiveness of tans) as a major factor that motivates people to visit commercial tanning salons frequently and continually. Long-term considerations, such as price, socializing, and perceived health, ...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/016327879702000401

    authors: Beasley TM,Kittel BS

    更新日期:1997-12-01 00:00:00

  • Student Perceptions of Collaboration Skills in an Interprofessional Context: Development and Initial Validation of the Self-Assessed Collaboration Skills Instrument.

    abstract::An integral component of interprofessional education (IPE) is the development of a collaboration-ready health-care workforce. While collaboration is a fundamental element of IPE, there is no existing measure of collaboration skills that is not context specific. This article describes the development and initial valida...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278717752438

    authors: Hinyard L,Toomey E,Eliot K,Breitbach A

    更新日期:2019-12-01 00:00:00

  • Reflections on international translation of evidence-based health behavior programs.

    abstract::In this concluding article, the authors describe factors that influence the international translation of programs. These include language, control over the translation process, local normative challenges to translation, program adaptation, and globalization. The authors suggest that systematic efforts at language tran...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278708320168

    authors: Sussman S,Palinkas LA

    更新日期:2008-09-01 00:00:00

  • Factors shaping physicians' willingness to accommodate medication requests.

    abstract::Medical decisions, including physicians' prescribing behaviors, are shaped by a complex interplay of clinical and nonclinical factors. We aim to determine how physician, patient, and relationship characteristics influence physicians' decisions to accommodate brand-name prescription drug requests. We applied multivaria...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278712468756

    authors: Arney J,Street RL Jr,Naik AD

    更新日期:2014-09-01 00:00:00

  • Follow-up for medical care among drug users with hepatitis C.

    abstract::Prevalence of hepatitis C (HCV) in injection drug users (IDUs) is high and once HCV has been detected, follow-up medical care is essential. Six hundred and one current and former IDUs who tested positive for HCV antibodies received referrals for medical care. Twenty-four percent (147) of participants returned to be in...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278706296003

    authors: Reynolds GL,Fisher DG,Jaffe A,Edwards J

    更新日期:2006-12-01 00:00:00

  • Evaluating the Healthy Start program. Design development to evaluative assessment.

    abstract::The national evaluation of the federally funded Healthy Start program involved translating a design for a process and outcomes evaluation and standard maternal and infant data set, both developed prior to the national evaluation contract award, into an evaluation design and client data collection protocol that could b...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/016327879601900307

    authors: Raykovich KS,McCormick MC,Howell EM,Devaney BL

    更新日期:1996-09-01 00:00:00

  • Translation and Psychometric Evaluation of the Mahoney Pain Scale Among Iranian Elderly With Dementia: A Methodological Study.

    abstract::Valid and reliable measurement tools are necessary for pain assessment among the elderly with dementia. This study aimed to translate the Mahoney Pain Scale (MPS) into Persian and evaluate its psychometric properties among Iranian elderly with dementia. In this methodological study, after translating and assessing the...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278720961818

    authors: Zare M,Tagharrobi Z,Sharifi K,Sooki Z,Abolhasani J

    更新日期:2020-09-29 00:00:00

  • Scope, Influence, and Interdisciplinary Collaboration: The Publication Portfolio of the NIH Clinical and Translational Science Awards (CTSA) Program From 2006 Through 2017.

    abstract::The Clinical and Translational Science Awards (CTSA) program sponsors an array of innovative, collaborative research. This study uses complementary bibliometric approaches to assess the scope, influence, and interdisciplinary collaboration of publications supported by single CTSA hubs and those supported by multiple h...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278719839435

    authors: Llewellyn N,Carter DR,DiazGranados D,Pelfrey C,Rollins L,Nehl EJ

    更新日期:2020-09-01 00:00:00

  • Hidden bias in the use of archival data.

    abstract::Nonresponses in archival data may violate the missing-at-random assumption in ways difficult to detect. Standard methods of comparing sociodemographics of respondents and nonrespondents are inappropriate when the units of analysis are not also the individuals who maintain the archival record. Under these circumstances...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/016327878701000202

    authors: Dworkin RJ

    更新日期:1987-06-01 00:00:00

  • Experiencing satisfaction and stress as an AIDS care provider. The AIDS caregiver scale.

    abstract::Health care workers (n = 342) completed items examining their emotional experiences working with HIV-positive patients. Factor analysis produced two subscales: Personal Satisfaction and Emotional Stress. A subset of these care workers (n = 251) claimed increased stress and depression after 6 months. In a second study,...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/016327879301600303

    authors: Ferrari JR,McCown W,Pantano J

    更新日期:1993-09-01 00:00:00

  • Measuring patient perceptions of the patient-doctor interaction. Development of the PDIS.

    abstract::Patient satisfaction has been related to patient compliance, doctor-patient information exchange, and continuity of care. However, the construct of patient satisfaction is not well defined; its measurement has typically consisted of the anecdotal generation of questions that may not tap issues of concern to patients. ...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/016327878400700106

    authors: Smith JK,Falvo D,McKillip J,Pitz G

    更新日期:1984-03-01 00:00:00

  • Medical schools in crisis.

    abstract::The medical schools of the United States are in crisis because of poor teaching methods, misdirected training of medical students, and failure to respond to the needs of the population. Much of the increased cost of medical care can be blamed on high technology and the type of training provided in the medical school. ...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章,评审

    doi:10.1177/016327878801100201

    authors: Brown JH

    更新日期:1988-06-01 00:00:00

  • Development of 7-Item Perceived Meaning of Activity in Housing (PMA-H-7) to Assess Opportunities for Meaningful Activities in the Supported Housing Context for People With Psychiatric Disabilities.

    abstract::People with psychiatric disabilities need to be able to express their views about their support, for example, the provision of meaningful activity in supported accommodation. Brief scales may be necessary to avoid strain and discomfort for this group. The aim was to develop a brief version of Perceived Meaning in Acti...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278719845036

    authors: Eklund M,Brunt D

    更新日期:2020-12-01 00:00:00

  • Adherence to practice guidelines, clinical outcomes, and costs among Medicaid enrollees with severe mental illnesses.

    abstract::The treatment of Medicaid enrollees diagnosed with depression or schizophrenia was examined to determine whether adherence to treatment guideline was associated with health care financing strategy, clinical outcomes, and cost-effectiveness. Individuals in a fee-for-service condition were significantly more likely to r...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278708328744

    authors: Stiles PG,Boothroyd RA,Dhont K,Beiler PF,Green AE

    更新日期:2009-03-01 00:00:00

  • The precision of practice analysis results in the professions.

    abstract::A practice analysis, in which an appropriate sample of professionals is asked to describe what they do in their practices, is considered an essential part of the content-related validity evidence for licensure and certification tests. This article examines the precision of estimates of the mean frequencies for categor...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/016327879501800103

    authors: Kane MT,Miller T,Trine M,Becker C,Carson K

    更新日期:1995-03-01 00:00:00

  • Are positive alternative medical therapy trials credible?: Evidence from four high-impact medical journals.

    abstract::Forty-five complementary and alternative medicine (CAM) efficacy randomized controlled trials (RCTs) from high-impact medical journals (NEJM, JAMA, Annals of Internal Medicine, and Archives of Internal Medicine) were reviewed based on their meeting three validity criteria (the existence of a placebo control, moderate ...

    journal_title:Evaluation & the health professions

    pub_type: 杂志文章

    doi:10.1177/0163278709346810

    authors: Barker Bausell R

    更新日期:2009-12-01 00:00:00