Establishing Measurement Equivalence Across Computer- and Paper-Based Tests of Spatial Cognition.

Abstract:

:Objective The purpose of the present research is to establish measurement equivalence and test differences in reliability between computerized and pencil-and-paper-based tests of spatial cognition. Background Researchers have increasingly adopted computerized test formats, but few attempt to establish equivalence for computer-based and paper-based tests. The mixed results in the literature on the test mode effect, which occurs when performance differs as a function of test medium, highlight the need to test for, instead of assume, measurement equivalence. One domain that has been increasingly computerized and is thus in need of tests of measurement equivalence across test mode is spatial cognition. Method In the present study, 244 undergraduate students completed two measures of spatial ability (i.e., spatial visualization and cross-sectioning) in either computer- or paper-and-pencil-based format. Results Measurement equivalence was not supported across computer-based and paper-based formats for either spatial test. The results also indicated that test administration type affected the types of errors made on the spatial visualization task, which further highlights the conceptual differences between test mediums. Paper-based tests also demonstrated increased reliability when compared with computerized versions of the tests. Conclusion The results of the measurement equivalence tests caution against treating computer- and paper-based versions of spatial measures as equivalent. We encourage subsequent work to demonstrate test mode equivalence prior to the utilization of spatial measures because current evidence suggests they may not reliably capture the same construct. Application The assessment of test type differences may influence the medium in which spatial cognition tests are administered.

journal_name

Hum Factors

journal_title

Human factors

authors

Bailey SKT,Neigel AR,Dhanani LY,Sims VK

doi

10.1177/0018720817747731

subject

Has Abstract

pub_date

2018-05-01 00:00:00

pages

340-350

issue

3

eissn

0018-7208

issn

1547-8181

journal_volume

60

pub_type

杂志文章
  • Using noninvasive brain stimulation to accelerate learning and enhance human performance.

    abstract:OBJECTIVE:The authors evaluate the effectiveness of noninvasive brain stimulation, in particular, transcranial direct current stimulation (tDCS), for accelerating learning and enhancing human performance on complex tasks. BACKGROUND:Developing expertise in complex tasks typically requires extended training and practic...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/0018720814538815

    authors: Parasuraman R,McKinley RA

    更新日期:2014-08-01 00:00:00

  • Workload and Performance: Associations, Insensitivities, and Dissociations.

    abstract:OBJECTIVE:The aim of this study was to distill and define those influences under which change in objective performance level and the linked cognitive workload reflections of subjective experience and physiological variation either associate, dissociate, or are insensitive, one to another. BACKGROUND:Human factors/ergo...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/0018720818809590

    authors: Hancock PA,Matthews G

    更新日期:2019-05-01 00:00:00

  • Trunk muscle use during pulling tasks: effects of a lifting belt and footing conditions.

    abstract::Pulling tasks require the torso to act as a rigid link in order to facilitate the force transmission between the ground and the hands. In this study, we tested the hypothesis that a lifting belt increases the rigidity of the torso, thereby increasing pulling strength or reducing trunk muscle forces, or both, as pullin...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1518/001872098779480631

    authors: Lavender SA,Chen SH,Li YC,Andersson GB

    更新日期:1998-03-01 00:00:00

  • Ergonomic Benefits From a Laparoscopic Instrument With Rotatable Handle Piece Depend on the Area of the Operating Field and Working Height.

    abstract::Objective To evaluate the effect of a laparoscopic instrument with a 360° rotatable handle piece (rot-HP) on biomechanical stress and precision in different areas of a simulated operating field at two working heights. Background Surgeons performing laparoscopic procedures are exposed to biomechanical stress and have a...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/0018720817712597

    authors: Steinhilber B,Reiff F,Seibt R,Rieger MA,Martus P,Kraemer B,Rothmund R

    更新日期:2017-11-01 00:00:00

  • Variable Lifting Index (VLI): A New Method for Evaluating Variable Lifting Tasks.

    abstract:OBJECTIVE:We seek to develop a new approach for analyzing the physical demands of highly variable lifting tasks through an adaptation of the Revised NIOSH (National Institute for Occupational Safety and Health) Lifting Equation (RNLE) into a Variable Lifting Index (VLI). BACKGROUND:There are many jobs that contain ind...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/0018720815612256

    authors: Waters T,Occhipinti E,Colombini D,Alvarez-Casado E,Fox R

    更新日期:2016-08-01 00:00:00

  • The twilight envelope: a user-centered approach to describing roadway illumination at night.

    abstract::Visual recognition functions, such as acuity and contrast sensitivity, deteriorate rapidly over the declining luminances found during civil twilight. Thus civil twilight, a critical part of the transition between daylight and darkness, represents lighting conditions that may be useful to describe artificial illuminati...

    journal_title:Human factors

    pub_type: 杂志文章,评审

    doi:10.1518/001872001775870331

    authors: Andre J,Owens DA

    更新日期:2001-01-01 00:00:00

  • The effect of keyboard key spacing on typing speed, error, usability, and biomechanics: Part 1.

    abstract:OBJECTIVE:In this study, we evaluated the effects of key spacing on a conventional computer keyboard on typing speed, percentage error, usability, and forearm muscle activity and wrist posture. BACKGROUND:International standards that specify the spacing between keys on a keyboard have been guided primarily by design c...

    journal_title:Human factors

    pub_type: 杂志文章,随机对照试验

    doi:10.1177/0018720812465005

    authors: Pereira A,Lee DL,Sadeeshkumar H,Laroche C,Odell D,Rempel D

    更新日期:2013-06-01 00:00:00

  • Impact of Frequent Interruption on Nurses' Patient-Controlled Analgesia Programming Performance.

    abstract:OBJECTIVE:The purpose was to add to the body of knowledge regarding the impact of interruption on acute care nurses' cognitive workload, total task completion times, nurse frustration, and medication administration error while programming a patient-controlled analgesia (PCA) pump. BACKGROUND:Data support that the seve...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/0018720817732605

    authors: Campoe KR,Giuliano KK

    更新日期:2017-12-01 00:00:00

  • Effect of descriptive information and experience on automation reliance.

    abstract:OBJECTIVE:The present research addresses the issue of reliance on decision support systems for the long-term (DSSLT), which help users develop decision-making strategies and long-term planning. It is argued that providing information about a system's future performance in an experiential manner, as compared with a desc...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/0018720811406725

    authors: Yuviler-Gavish N,Gopher D

    更新日期:2011-06-01 00:00:00

  • The NIOSH lifting equation and low-back pain, Part 1: Association with low-back pain in the backworks prospective cohort study.

    abstract:OBJECTIVE:The aim of this study was to evaluate relationships between the revised NIOSH lifting equation (RNLE) and risk of low-back pain (LBP). BACKGROUND:The RNLE is commonly used to quantify job physical stressors to the low back from lifting and/or lowering of loads. There is no prospective study on the relationsh...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/0018720813486669

    authors: Garg A,Boda S,Hegmann KT,Moore JS,Kapellusch JM,Bhoyar P,Thiese MS,Merryweather A,Deckow-Schaefer G,Bloswick D,Malloy EJ

    更新日期:2014-02-01 00:00:00

  • Performance enhancement in an uninhabited air vehicle task using psychophysiologically determined adaptive aiding.

    abstract:OBJECTIVE:We show that psychophysiologically driven real-time adaptive aiding significantly enhances performance in a complex aviation task. A further goal was to assess the importance of individual operator capabilities when providing adaptive aiding. BACKGROUND:Psychophysiological measures are useful for monitoring ...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1518/001872007X249875

    authors: Wilson GF,Russell CA

    更新日期:2007-12-01 00:00:00

  • The Impact of Head-Worn Displays on Strategic Alarm Management and Situation Awareness.

    abstract:OBJECTIVE:To investigate whether head-worn displays (HWDs) help mobile participants make better alarm management decisions and achieve better situation awareness than alarms alone. BACKGROUND:Patient alarms occur frequently in hospitals but often do not require clinical intervention. Clinicians may become desensitized...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/0018720818814969

    authors: Pascale MT,Sanderson P,Liu D,Mohamed I,Brecknell B,Loeb RG

    更新日期:2019-06-01 00:00:00

  • Harness sizing and strap length configurations.

    abstract:OBJECTIVE:This article describes the derivation of strap lengths and adjustments to fall-arrest harnesses and the development of harness size configurations. BACKGROUND:Updated harness sizing configurations are needed to accommodate diverse populations in the current workforce. METHOD:Three-dimensional torso anthropo...

    journal_title:Human factors

    pub_type: 杂志文章,评审

    doi:10.1177/0018720809346320

    authors: Hsiao H,Whitestone J,Taylor S,Godby M,Guan J

    更新日期:2009-08-01 00:00:00

  • Assessment of structural knowledge as a training outcome in process control environments.

    abstract:OBJECTIVE:The objective of the present studies was to apply a novel method for structural knowledge assessment to process control to assess the potential of its measures as a training outcome. BACKGROUND:Traditionally, knowledge is assessed by verbal achievement tests on the subject matter. However, traditional method...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/0018720810367646

    authors: Burkolter D,Meyer B,Kluge A,Sauer J

    更新日期:2010-02-01 00:00:00

  • A Fundamental Cognitive Taxonomy for Cognition Aids.

    abstract:OBJECTIVE:This study aimed to organize the literature on cognitive aids to allow comparison of findings across studies and link the applied work of aid development to psychological constructs and theories of cognition. BACKGROUND:Numerous taxonomies have been developed, all of which label cognitive aids via their surf...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/0018720820920099

    authors: McLaughlin AC,Byrne VE

    更新日期:2020-09-01 00:00:00

  • Effects of three types of flight simulator visual scene detail on detection of altitude change.

    abstract::The effects of three types of flight simulator visual scene detail on detection of altitude change were evaluated in three experiments. Across all experiments and with a variety of tasks and display conditions, speed and accuracy of detecting altitude change improved with increases in the density of vertical objects i...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/001872089303500406

    authors: Kleiss JA,Hubbard DC

    更新日期:1993-12-01 00:00:00

  • Control task substitution in semiautomated driving: does it matter what aspects are automated?

    abstract:OBJECTIVE:The study was designed to show how driver attention to the road scene and engagement of a choice of secondary tasks are affected by the level of automation provided to assist or take over the basic task of vehicle control. It was also designed to investigate the difference between support in longitudinal cont...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/0018720812460246

    authors: Carsten O,Lai FC,Barnard Y,Jamson AH,Merat N

    更新日期:2012-10-01 00:00:00

  • Vibrotactile "on-thigh" alerting system in the cockpit.

    abstract:BACKGROUND:Alerts in the cockpit must be robust, difficult to ignore, and easily recognized. Tactile alerts can provide means to direct the pilot's attention in the already visual-auditory overloaded cockpit environment. OBJECTIVE:This research examined the thigh as a placement for vibrotactile display in the cockpit....

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/0018720811403139

    authors: Salzer Y,Oron-Gilad T,Ronen A,Parmet Y

    更新日期:2011-04-01 00:00:00

  • Narcosis has additive rather than interactive effects on discrimination reaction time.

    abstract::A central feature of the impairment in performance produced by inert gas narcosis, which poses a threat to divers breathing compressed air, is a slowing of reaction time (RT). To investigate the locus of this slowing, the effects of 35% nitrous oxide on Crossman's confusion function were determined using line-length a...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/001872088903100506

    authors: Fowler B,Mitchell I,Bhatia M,Porlier G

    更新日期:1989-10-01 00:00:00

  • Identification of the human factors contributing to maintenance failures in a petroleum operation.

    abstract:OBJECTIVE:This research aimed to identify the most frequently occurring human factors contributing to maintenance-related failures within a petroleum industry organization. Commonality between failures will assist in understanding reliability in maintenance processes, thereby preventing accidents in high-hazard domains...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/0018720813491424

    authors: Antonovsky A,Pollock C,Straker L

    更新日期:2014-03-01 00:00:00

  • A ten-year follow-up of driving patterns among community-dwelling elderly.

    abstract::Massachusetts Health Care Panel Study data were used to examine age-related changes in driving patterns over 10 years in a community-dwelling cohort of elders. In 1974, 86% of the men and 76% of the women reported that the automobile was their chief mode of transportation. At each follow-up, 87% or more of those who h...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/001872089203400104

    authors: Jette AM,Branch LG

    更新日期:1992-02-01 00:00:00

  • The effect of handle angle on MAWL, wrist posture, RPE, and heart rate.

    abstract::In manual material handling tasks, the handle serves as the interface between the human operator and the box (the materials). Handle angle design can affect both wrist posture and lifting ability. This study was designed to evaluate the effect of handle angle on maximal acceptable weight of lifting (MAWL), perceived w...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1518/001872000779698079

    authors: Wang MJ,Chung HC,Chen HC

    更新日期:2000-01-01 00:00:00

  • Failure to detect critical auditory alerts in the cockpit: evidence for inattentional deafness.

    abstract:OBJECTIVE:The aim of this study was to test whether inattentional deafness to critical alarms would be observed in a simulated cockpit. BACKGROUND:The inability of pilots to detect unexpected changes in their auditory environment (e.g., alarms) is a major safety problem in aeronautics. In aviation, the lack of respons...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/0018720813510735

    authors: Dehais F,Causse M,Vachon F,Régis N,Menant E,Tremblay S

    更新日期:2014-06-01 00:00:00

  • Inward torque and high-friction handles can reduce required muscle efforts for torque generation.

    abstract:OBJECTIVE:The effects of handle friction and torque direction on muscle activity and torque are empirically investigated using cylindrical handles. BACKGROUND:A torque biomechanical model that considers contact force, friction, and torque direction was evaluated using different friction handles. METHODS:Twelve adults...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1518/001872008X250610

    authors: Seo NJ,Armstrong TJ,Chaffin DB,Ashton-Miller JA

    更新日期:2008-02-01 00:00:00

  • Toward more usable electronic voting: testing the usability of a smartphone voting system.

    abstract:OBJECTIVE:The goal of this research was to assess the usability of a voting system designed for smart-phones. BACKGROUND:Smartphones offer remote participation in elections through the use of pervasive technology. Voting on these devices could, among other benefits, increase voter participation while allowing voters t...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/0018720813519266

    authors: Campbell BA,Tossell CC,Byrne MD,Kortum P

    更新日期:2014-08-01 00:00:00

  • Maximum isometric lifting strengths of men in teamwork.

    abstract::This study reexamined the additivity of maximum isometric teamwork lifting strength using experienced and height-matched young male participants. The maximum isometric lifting strength was measured for four exertion heights (45, 75, 105, and 140 cm) and four lifting styles (one-, two, three-, and four-person exertions...

    journal_title:Human factors

    pub_type: 临床试验,杂志文章

    doi:10.1518/hfes.46.4.686.56812

    authors: Lee TH

    更新日期:2004-01-01 00:00:00

  • Foot flare and foot axis.

    abstract::Most commercial footwear is designed and manufactured on a curved last, although the amount of curvature of the last and the turning point of the last centerline have not been formally determined. In this study, we used principal component analysis to determine the foot axis so that lasts that match feet can be produc...

    journal_title:Human factors

    pub_type: 临床试验,杂志文章

    doi:10.1518/001872099779656761

    authors: Goonetilleke RS,Luximon A

    更新日期:1999-12-01 00:00:00

  • Differentiating Experience From Cue Utilization in Radiological Assessments.

    abstract:OBJECTIVE:This research was designed to examine the contribution of self-reported experience and cue utilization to diagnostic accuracy in the context of radiology. BACKGROUND:Within radiology, it is unclear how task-related experience contributes to the acquisition of associations between features with events in memo...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/0018720820902576

    authors: Carrigan AJ,Magnussen J,Georgiou A,Curby KM,Palmeri TJ,Wiggins MW

    更新日期:2020-03-09 00:00:00

  • Operation of controls on consumer products by physically impaired users.

    abstract::The self-reliance of the physically impaired can be seriously jeopardized by their inability to operate everyday products, especially if both upper extremities are impaired. To determine the difficulties impaired users encounter in operating consumer product controls, on-site video recordings were made of subjects suf...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/001872089303500207

    authors: Kanis H

    更新日期:1993-06-01 00:00:00

  • Odor identification by name and by edibility: life-span development and safety.

    abstract::The study explored how subjects from childhood (8-14 years old) to elderly adulthood could identify the odors of 17 everyday products. Performance at naming followed an inverted U-shaped course over age, best in young adults and poorest in children and elderly. A discrimination task given to the adults revealed parall...

    journal_title:Human factors

    pub_type: 杂志文章

    doi:10.1177/001872089403600112

    authors: De Wijk RA,Cain WS

    更新日期:1994-03-01 00:00:00