Creating a test blueprint for a progress testing program: A paired-comparisons approach.

Abstract:

CONTEXT:Creating a new testing program requires the development of a test blueprint that will determine how the items on each test form are distributed across possible content areas and practice domains. To achieve validity, categories of a blueprint are typically based on the judgments of content experts. How experts judgments are elicited and combined is important to the quality of resulting test blueprints. METHODS:Content experts in dentistry participated in a day-long faculty-wide workshop to discuss, refine, and confirm the categories and their relative weights. After reaching agreement on categories and their definitions, experts judged the relative importance between category pairs, registering their judgments anonymously using iClicker, an audience response system. Judgments were combined in two ways: a simple calculation that could be performed during the workshop and a multidimensional scaling of the judgments performed later. RESULTS:Content experts were able to produce a set of relative weights using this approach. The multidimensional scaling yielded a three-dimensional model with the potential to provide deeper insights into the basis of the experts' judgments. CONCLUSION:The approach developed and demonstrated in this study can be applied across academic disciplines to elicit and combine content experts judgments for the development of test blueprints.

journal_name

Med Teach

journal_title

Medical teacher

authors

von Bergmann H,Childs RA

doi

10.1080/0142159X.2017.1403015

subject

Has Abstract

pub_date

2018-03-01 00:00:00

pages

267-274

issue

3

eissn

0142-159X

issn

1466-187X

journal_volume

40

pub_type

杂志文章
  • Exploring the feasibility and acceptability of using tactical decision games to develop final year medical students' non-technical skills.

    abstract:INTRODUCTION:Clinical decision-making, situation awareness, task management, and teamwork are key non-technical skills (NTS) required by junior doctors. Tactical decision games (TDGs) are low-fidelity classroom-based activities designed to develop proficiency in NTS. This study aimed to explore the feasibility and acce...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2016.1150979

    authors: Drummond I,Sheikh G,Skinner J,Wood M

    更新日期:2016-05-01 00:00:00

  • Mentoring up: Twelve tips for successfully employing a mentee-driven approach to mentoring relationships.

    abstract::Effective mentorship is critical for achieving professional success, influencing outcomes such as career selection and advancement, self-confidence and performance, and sense of community and fulfillment. Despite the established importance of mentorship, however, mentoring relationships can be challenging to develop a...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2020.1795098

    authors: Manuel SP,Poorsattar SP

    更新日期:2020-07-27 00:00:00

  • An evaluation of the cost of designing, delivering and assessing an undergraduate communication skills module.

    abstract::Communication skills courses are considered expensive to run in terms of time, human resource and finance. This paper reports on the financial cost of designing, delivering and assessing a communication skills module delivered to fifth-year medical students. Costs are classified into three categories: personnel, stand...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590400005475

    authors: Kelly M,Murphy A

    更新日期:2004-11-01 00:00:00

  • Computer-based testing of the modified essay question: the Singapore experience.

    abstract:BACKGROUND:The modified essay question (MEQ), featuring an evolving case scenario, tests a candidate's problem-solving and reasoning ability, rather than mere factual recall. Although it is traditionally conducted as a pen-and-paper examination, our university has run the MEQ using computer-based testing (CBT) since 20...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590701691403

    authors: Lim EC,Seet RC,Oh VM,Chia BL,Aw M,Quak SH,Ong BK

    更新日期:2007-11-01 00:00:00

  • How physicians teach in the clinical setting: The embedded roles of teaching and clinical care.

    abstract:BACKGROUND:Clinical teaching lies at the heart of medical education. However, few studies have explored the embedded nature of teaching and clinical care. The goal of this study was to examine the process of clinical teaching as it naturally, and spontaneously, unfolds in a broad range of authentic contexts with medica...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2017.1360473

    authors: Steinert Y,Basi M,Nugus P

    更新日期:2017-12-01 00:00:00

  • Nursing-using the nursing process.

    abstract::It has often been pointed out that the real problem of nurse numbers is not the failure to recruit or to recruit appropriately, but to retain nurses once they have started. The indications are that where the nursing process approach is used in practice as well as taught, nurses (both learners and trained staff) derive...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421598109064461

    authors: Ashworth PM,Castledine G

    更新日期:1981-01-01 00:00:00

  • Reform of a traditional clinical curriculum in Japan: experiences at Tokyo Medical and Dental University.

    abstract:BACKGROUND:Until recently, Japanese legislative guidelines dictated that undergraduate clinical training consisted of students' observations of clinicians' work. In 2006, Tokyo Medical and Dental University initiated a reform of their traditional undergraduate clinical curriculum. The reform integrated students into pa...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421590902799302

    authors: Farrell SE,Takada K,Armstrong EG,Tanaka Y,Aretz HT

    更新日期:2009-10-01 00:00:00

  • Motivating medical students to learn teamwork skills.

    abstract:BACKGROUND:This study examined teaching teamwork skills to first-year medical students. Teamwork skills focused on verbal communication in PBL-tutorial sessions and in healthcare teams. AIMS:The aim was to find out how to teach teamwork skills to first-year medical students and how to motivate them to learn these skil...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421591003657469

    authors: Aarnio M,Nieminen J,Pyörälä E,Lindblom-Ylänne S

    更新日期:2010-01-01 00:00:00

  • Use an overhead projector.

    abstract::The overhead projector is a very useful adjunct to other teaching aids. It is easy to operate, flexible, and the lecturer can work it himself while facing the audience. Transparencies can be produced quickly and simply, and since they are large enough to be studied without viewing equipment, sets of transparencies can...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421597909010575

    authors: Essex-Lopresti M

    更新日期:1979-01-01 00:00:00

  • A reappraisal of the use of multiple choice questions.

    abstract::The terms Multiple True/False and Best Answer deserve wider applicability than at present when discussing multiple choice questions (MCQs). They describe the truthfulness of the choices and distinguish between the question types. The choice which matches the key in a MCQ is best called the correct answer. Multiple Tru...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:

    authors: Premadasa IG

    更新日期:1993-01-01 00:00:00

  • Script-theory virtual case: A novel tool for education and research.

    abstract::Context/Setting: The script theory of diagnostic reasoning proposes that clinicians evaluate cases in the context of an "illness script," iteratively testing internal hypotheses against new information eventually reaching a diagnosis. We present a novel tool for teaching diagnostic reasoning to undergraduate medical s...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2016.1170776

    authors: Hayward J,Cheung A,Velji A,Altarejos J,Gill P,Scarfe A,Lewis M

    更新日期:2016-11-01 00:00:00

  • Peer assisted learning in surgical skills laboratory training: a pilot study.

    abstract:BACKGROUND:Peer assisted learning (PAL) has been rarely investigated in surgical skills training. AIMS:Describe feedback residents give peers on surgical skills with and without guidelines, determine the association between feedback and actual performance, evaluate resident satisfaction with PAL. METHOD:Participants ...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2012.706340

    authors: Beard JH,O'sullivan P,Palmer BJ,Qiu M,Kim EH

    更新日期:2012-01-01 00:00:00

  • Medical interns' view of their undergraduate medical education in Uppsala: an alumnus study with clear attitude differences between women and men.

    abstract:BACKGROUND:An alumni study of graduates from the medical school in Uppsala, was performed to give input into an ongoing reform process. AIMS:This study aimed to investigate how medical interns view their undergraduate medical education and the extent to which they felt that the curriculum prepared them for their curre...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590802216266

    authors: Hoppe A,Persson E,Birgegård G

    更新日期:2009-05-01 00:00:00

  • Clinical reasoning: the relative contribution of identification, interpretation and hypothesis errors to misdiagnosis.

    abstract::The aim of this study was to identify and describe the types of errors in clinical reasoning that contribute to poor diagnostic performance at different levels of medical training and experience. Three cohorts of subjects, second- and fourth- (final) year medical students and a group of general practitioners, complete...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590310001605688

    authors: Groves M,O'Rourke P,Alexander H

    更新日期:2003-11-01 00:00:00

  • Study guides: a study of different formats.

    abstract::More emphasis is being placed on students as independent learners with teachers acting as facilitators. It has been argued that student-centred learning can be supported usefully by study guides. This paper supports previous claims as to the value of study guides as perceived by students. But what should study guides ...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590600799059

    authors: Khogali SE,Laidlaw JM,Harden RM

    更新日期:2006-06-01 00:00:00

  • Psychometrics of the scale of attitudes toward physician-pharmacist collaboration: a study with medical students.

    abstract:BACKGROUND:Despite the emphasis placed on interdisciplinary education and interprofessional collaboration between physicians and pharmacologists, no psychometrically sound instrument is available to measure attitudes toward collaborative relationships. AIM:This study was designed to examine psychometrics of an instrum...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2012.714877

    authors: Hojat M,Spandorfer J,Isenberg GA,Vergare MJ,Fassihi R,Gonnella JS

    更新日期:2012-01-01 00:00:00

  • A study of student performance on self-scheduled, computer-based examinations in a medical histology course: is later better?

    abstract:BACKGROUND:Student self-scheduling of computer-based examinations during a defined window of opportunity is a protocol used by some medical school courses and licensing bodies. Students scheduling late have more time to prepare, which may provide them with an unfair advantage. METHODS:ANOVA was used to compare the ave...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590701477365

    authors: Burns ER,Garrett JE,Childs GV

    更新日期:2007-11-01 00:00:00

  • Twelve tips for effective short course design.

    abstract::Short courses are commonly used by physicians to stay up-to-date and acquire new skills for practice. Unfortunately, many short courses are not designed to maximize their impact on practice as they fail to acknowledge how people learn and change. Designers of effective short course planning should pay attention to wri...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590500086888

    authors: Lockyer J,Ward R,Toews J

    更新日期:2005-08-01 00:00:00

  • A cardiological web as an adjunct to medical teaching: prospective analysis.

    abstract::The aim of the study was to deliver and evaluate an educational web for medical students. A web of the complete cardiovascular course was prepared as an adjunct educational material for the classes. The use and utility of the web was assessed through a questionnaire (frequency of use, impact on in-class attendance and...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590310001653991

    authors: Gómez-Arbonés X,Ferreira A,Piqué M,Roca J,Tomás J,Frutos JL,Vinyas J,Prat J,Ballester M

    更新日期:2004-03-01 00:00:00

  • Research methodology workshops evaluation using the Kirkpatrick's model: translating theory into practice.

    abstract:BACKGROUND:Qualitative and quantitative evaluation of academic programs can enhance the development, effectiveness, and dissemination of comparative quality reports as well as quality improvement efforts. OBJECTIVES:To evaluate the five research methodology workshops through assessing participants' satisfaction, knowl...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2014.886012

    authors: Abdulghani HM,Shaik SA,Khamis N,Al-Drees AA,Irshad M,Khalil MS,Alhaqwi AI,Isnani A

    更新日期:2014-04-01 00:00:00

  • Development of cognitive processing and judgments of knowledge in medical students: Analysis of progress test results.

    abstract:BACKGROUND:Beside acquiring knowledge, medical students should also develop the ability to apply and reflect on it, requiring higher-order cognitive processing. Ideally, students should have reached higher-order cognitive processing when they enter the clinical program. Whether this is the case, is unknown. We investig...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2016.1170781

    authors: Cecilio-Fernandes D,Kerdijk W,Jaarsma AD,Tio RA

    更新日期:2016-11-01 00:00:00

  • Clinical teaching performance improvement of faculty in residency training: A prospective cohort study.

    abstract:PURPOSE:The purpose of this study is to investigate how aspects of a teaching performance evaluation system may affect faculty's teaching performance improvement as perceived by residents over time. METHODS:Prospective multicenter cohort study conducted in The Netherlands between 1 September 2008 and 1 February 2013. ...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2015.1060302

    authors: Van Der Leeuw RM,Boerebach BC,Lombarts KM,Heineman MJ,Arah OA

    更新日期:2016-05-01 00:00:00

  • Using medical knowledge sources on handheld computers--a qualitative study among junior doctors.

    abstract:BACKGROUND:The emergence of mobile computing could have an impact on how junior doctors learn. To exploit this opportunity it is essential to understand their information seeking process. AIM:To explore junior doctors' experiences of using medical knowledge sources on handheld computers. METHOD:Interviews with five S...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590701507294

    authors: Axelson C,Wårdh I,Strender LE,Nilsson G

    更新日期:2007-09-01 00:00:00

  • Later is too late: Exploring student experiences of diversity and inclusion in medical school orientation.

    abstract:BACKGROUND:While there is increasing effort among medical schools to recruit diverse students, there is a paucity of research into the unique experiences of these students during their transition to medicine. This study explored how experiences during medical school orientation influence students' transition into the m...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2021.1874326

    authors: van Buuren A,Yaseen W,Veinot P,Mylopoulos M,Law M

    更新日期:2021-02-02 00:00:00

  • Interactive large-group teaching in a dermatology course.

    abstract::This is a prospective study to find out whether an interactive large-group case-based teaching approach combined with small-group bedside teaching improves student satisfaction and learning outcome in a practical dermatology course. During two consecutive terms a rotating system of large-group interactive case-study-m...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590601034241

    authors: Ochsendorf FR,Boehncke WH,Sommerlad M,Kaufmann R

    更新日期:2006-12-01 00:00:00

  • Communities of teaching practice in the workplace: Evaluation of a faculty development programme.

    abstract:BACKGROUND:The focus of faculty development (FD) has recently shifted from individual and formal learning to formal and informal learning by a team of teachers in the workplace where the teaching is actually effected. This study aimed to evaluate the impact of a faculty development programme on teachers' educational wo...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2015.1112892

    authors: Schreurs ML,Huveneers W,Dolmans D

    更新日期:2016-08-01 00:00:00

  • Promoting self-awareness and reflection through an experiential mind-body skills course for first year medical students.

    abstract:BACKGROUND:This research examines student evaluations of their experience and attitudes in an 11 week mind-body skills course for first year medical students. AIMS:The aim is to understand the impact of this course on students' self-awareness, self-reflection, and self-care as part of their medical education experienc...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590701509647

    authors: Saunders PA,Tractenberg RE,Chaterji R,Amri H,Harazduk N,Gordon JS,Lumpkin M,Haramati A

    更新日期:2007-10-01 00:00:00

  • Teaching in practice: a survey of a general practice teaching network.

    abstract::The need for high-quality teaching practices and general practitioners (GPs) skilled in teaching is ever increasing. The authors determined the quality of teaching in the Göttingen general practice teaching network with regard to equipment, student participation and GPs' motivation for teaching. A questionnaire was ma...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590600703283

    authors: Heidenreich R,Chenot JF,Kochen MM,Himmel W

    更新日期:2006-05-01 00:00:00

  • Chronically diseased patients and their doctors.

    abstract::The doctor-patient relationship reflects the role of the physician in society and has thus experienced substantial changes over time. Medical authority can be dissected into three elements, all of which appear essential for any doctor-patient relationship: sapiental authority, i.e. professional competence as called fo...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159021000063989

    authors: Berger M

    更新日期:2002-11-01 00:00:00

  • Medical education and the GCSE generation--a transferable activity-skills programme in medical sociology.

    abstract::The first major intake of medical students who studied the new GCSE occurred in Autumn 1990. These students have experienced a range of student-centred educational approaches to learning, but medical education in the UK remains committed to teacher-centred approaches. This mismatch of expectations is discussed. An inn...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421599109029029

    authors: Fox NJ,Dryden C

    更新日期:1991-01-01 00:00:00