Abstract:
:Valid assessment of professional competence has proven to be an elusive goal. Objective tests, direct observation of performance, overall ratings of competence, and simulations have been tried and found wanting in one way or another. Objective test items are criticized as being unrealistic and therefore invalid. Direct observation tends to be very unreliable and therefore invalid. Simulations and overall ratings of competence share both of these flaws to some extent. Basically, you can't win. This article outlines some of the many ways to lose and some ways to cut these losses. In doing so, it proposes a general framework for evaluating the validity of measures of competence, and it uses this framework to examine the strengths and weaknesses of three approaches to the assessment of professional competence: direct observation, simulation, and objective testing.
journal_name
Eval Health Profjournal_title
Evaluation & the health professionsauthors
Kane MTdoi
10.1177/016327879201500203subject
Has Abstractpub_date
1992-06-01 00:00:00pages
163-82issue
2eissn
0163-2787issn
1552-3918journal_volume
15pub_type
杂志文章,评审abstract::This study examined dimensionality and item-level psychometric properties of an item bank measuring activities of daily living (ADL) across inpatient rehabilitation facilities and community living centers. Common person equating method was used in the retrospective veterans data set. This study examined dimensionality...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/0163278716676873
更新日期:2018-03-01 00:00:00
abstract::The medical group survey from the CAHPS (formerly Consumer Assessment of Health Plans Study) project, G-CAHPS, focuses on patient experiences in receiving care from their medical group practice. We compared mail and telephone responses to the G-CAHPS survey in a sample of 880 patients from four physician groups. Patie...
journal_title:Evaluation & the health professions
pub_type: 杂志文章,随机对照试验
doi:10.1177/0163278705281074
更新日期:2005-12-01 00:00:00
abstract::Complementary and alternative therapies such as reflexology and acupuncture have been the subject of numerous evaluations, clinical trials, and systematic reviews, yet the empirical evidence in support of their efficacy remains equivocal. The empirical evaluation of a therapy would normally assume a plausible rational...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/0163278710361923
更新日期:2010-06-01 00:00:00
abstract::Access to outpatient services within the first 30 days after an inpatient mental health episode may influence relapse risk. A retrospective cohort of 3,755 adult Medicaid mental health inpatients discharged from their first managed care acute episode of care from July 1, 1996, through May 20, 1998, were studied. Resul...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/01632780022034714
更新日期:2000-12-01 00:00:00
abstract::The authors tested whether smokers would use cigarette pack covers illustrated with antismoking messages. In 2001, visitors to a smoking cessation Web site ordered cigarette pack covers and answered a follow-up questionnaire 52 days later. Participants received by mail cardboard boxes designed to contain cigarette pac...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/0163278704264050
更新日期:2004-06-01 00:00:00
abstract::Normalization has gained wide acceptance as a goal that residential institutations for the mentally retarded should strive to achieve, but many organizations have been shown to have difficulty achieving the goal. Theories developed from the organizational contingency perspective suggest that organizations with bureauc...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/016327878000300105
更新日期:1980-03-01 00:00:00
abstract::Although it is increasingly common, meta-analysis is still a relatively new addition to the toolbox of research strategies. Partially because of its newness and partially because its early enthusiasts may have overstated its presumed contributions, a number of common misunderstandings have developed about the meta-ana...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/016327879501800305
更新日期:1995-09-01 00:00:00
abstract::This study compares five methods of ranking Likert ratings on frequency and severity scales. Data were drawn from an international online survey conducted as part of a practice analysis with 91 diplomates of the American Chiropractic Board of Radiology. A total of 129 clinical presentations had been rated on two scale...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/0163278711425041
更新日期:2012-12-01 00:00:00
abstract::This study identified previously reported facilitators and barriers to pharmacist-client communication and then evaluated their impact on the observed communication behaviors of pharmacists. Pharmacists (n = 100) completed a seven-page questionnaire collecting information on 11 variables that had been organized accord...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/0163278703258104
更新日期:2003-12-01 00:00:00
abstract::This article describes a protocol that was employed to validate the content of the National Board Dental Hygiene Examination (NBDHE) using two separate practice analyses. The protocol consisted of the following phases: (1) the careful definition of the domain of knowledge and skills required for successful entry-level...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/0163278713501073
更新日期:2014-12-01 00:00:00
abstract::Survey administrators face trade-offs between expending additional survey resources to maximize response rates versus using fewer resources and accepting lower response rates. Using data from the Community Tracking Study's Physician Survey, we examined how survey estimates and data quality changed as additional respon...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/0163278702250077
更新日期:2003-03-01 00:00:00
abstract::The Clinical and Translational Science Award (CTSA) program was designed by the National Institutes of Health (NIH) to develop processes and infrastructure for clinical and translational research throughout the United States. The CTSA initiative now funds 61 institutions. In 2012, the National Center for Advancing Tra...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/0163278713499586
更新日期:2013-12-01 00:00:00
abstract::Persons with Chronic Fatigue Syndrome (PWCs) completed and returned by mail a brief survey of open- and closed-ended items designed to assess their utilization and preferences for a variety of services. A total of 984 middle-aged adults diagnosed with Chronic Fatique Syndrome (CFS) from across North America returned t...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/016327879601900204
更新日期:1996-06-01 00:00:00
abstract::In recent years attention in developing countries has concentrated upon strategies to improve the equitable provision of essential health care--the primary health care approach. Very little work has been reported in connection with the quality of medical care, and yet for the successful outcome of care it is necessary...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/016327878300600405
更新日期:1983-12-01 00:00:00
abstract::A principal components analysis identified the immediate convenience of indoor tanning (i.e., relaxation, perceived attractiveness of tans) as a major factor that motivates people to visit commercial tanning salons frequently and continually. Long-term considerations, such as price, socializing, and perceived health, ...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/016327879702000401
更新日期:1997-12-01 00:00:00
abstract::An integral component of interprofessional education (IPE) is the development of a collaboration-ready health-care workforce. While collaboration is a fundamental element of IPE, there is no existing measure of collaboration skills that is not context specific. This article describes the development and initial valida...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/0163278717752438
更新日期:2019-12-01 00:00:00
abstract::In this concluding article, the authors describe factors that influence the international translation of programs. These include language, control over the translation process, local normative challenges to translation, program adaptation, and globalization. The authors suggest that systematic efforts at language tran...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/0163278708320168
更新日期:2008-09-01 00:00:00
abstract::Medical decisions, including physicians' prescribing behaviors, are shaped by a complex interplay of clinical and nonclinical factors. We aim to determine how physician, patient, and relationship characteristics influence physicians' decisions to accommodate brand-name prescription drug requests. We applied multivaria...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/0163278712468756
更新日期:2014-09-01 00:00:00
abstract::Prevalence of hepatitis C (HCV) in injection drug users (IDUs) is high and once HCV has been detected, follow-up medical care is essential. Six hundred and one current and former IDUs who tested positive for HCV antibodies received referrals for medical care. Twenty-four percent (147) of participants returned to be in...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/0163278706296003
更新日期:2006-12-01 00:00:00
abstract::The national evaluation of the federally funded Healthy Start program involved translating a design for a process and outcomes evaluation and standard maternal and infant data set, both developed prior to the national evaluation contract award, into an evaluation design and client data collection protocol that could b...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/016327879601900307
更新日期:1996-09-01 00:00:00
abstract::Valid and reliable measurement tools are necessary for pain assessment among the elderly with dementia. This study aimed to translate the Mahoney Pain Scale (MPS) into Persian and evaluate its psychometric properties among Iranian elderly with dementia. In this methodological study, after translating and assessing the...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/0163278720961818
更新日期:2020-09-29 00:00:00
abstract::The Clinical and Translational Science Awards (CTSA) program sponsors an array of innovative, collaborative research. This study uses complementary bibliometric approaches to assess the scope, influence, and interdisciplinary collaboration of publications supported by single CTSA hubs and those supported by multiple h...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/0163278719839435
更新日期:2020-09-01 00:00:00
abstract::Nonresponses in archival data may violate the missing-at-random assumption in ways difficult to detect. Standard methods of comparing sociodemographics of respondents and nonrespondents are inappropriate when the units of analysis are not also the individuals who maintain the archival record. Under these circumstances...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/016327878701000202
更新日期:1987-06-01 00:00:00
abstract::Health care workers (n = 342) completed items examining their emotional experiences working with HIV-positive patients. Factor analysis produced two subscales: Personal Satisfaction and Emotional Stress. A subset of these care workers (n = 251) claimed increased stress and depression after 6 months. In a second study,...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/016327879301600303
更新日期:1993-09-01 00:00:00
abstract::Patient satisfaction has been related to patient compliance, doctor-patient information exchange, and continuity of care. However, the construct of patient satisfaction is not well defined; its measurement has typically consisted of the anecdotal generation of questions that may not tap issues of concern to patients. ...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/016327878400700106
更新日期:1984-03-01 00:00:00
abstract::The medical schools of the United States are in crisis because of poor teaching methods, misdirected training of medical students, and failure to respond to the needs of the population. Much of the increased cost of medical care can be blamed on high technology and the type of training provided in the medical school. ...
journal_title:Evaluation & the health professions
pub_type: 杂志文章,评审
doi:10.1177/016327878801100201
更新日期:1988-06-01 00:00:00
abstract::People with psychiatric disabilities need to be able to express their views about their support, for example, the provision of meaningful activity in supported accommodation. Brief scales may be necessary to avoid strain and discomfort for this group. The aim was to develop a brief version of Perceived Meaning in Acti...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/0163278719845036
更新日期:2020-12-01 00:00:00
abstract::The treatment of Medicaid enrollees diagnosed with depression or schizophrenia was examined to determine whether adherence to treatment guideline was associated with health care financing strategy, clinical outcomes, and cost-effectiveness. Individuals in a fee-for-service condition were significantly more likely to r...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/0163278708328744
更新日期:2009-03-01 00:00:00
abstract::A practice analysis, in which an appropriate sample of professionals is asked to describe what they do in their practices, is considered an essential part of the content-related validity evidence for licensure and certification tests. This article examines the precision of estimates of the mean frequencies for categor...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/016327879501800103
更新日期:1995-03-01 00:00:00
abstract::Forty-five complementary and alternative medicine (CAM) efficacy randomized controlled trials (RCTs) from high-impact medical journals (NEJM, JAMA, Annals of Internal Medicine, and Archives of Internal Medicine) were reviewed based on their meeting three validity criteria (the existence of a placebo control, moderate ...
journal_title:Evaluation & the health professions
pub_type: 杂志文章
doi:10.1177/0163278709346810
更新日期:2009-12-01 00:00:00