Tests of measurement invariance failed to support the application of the "then-test".

Abstract:

OBJECTIVE:The use of then-test (retrospective pre-test) scores has frequently been proposed as a solution to potential confounding of change scores because of response shift, as it is assumed that then-test and post-test responses are provided from the same perspective. However, this assumption has not been formally tested using robust quantitative methods. The aim of this study was to compare the psychometric performance of then-test/post-test with traditional pre-test/post-test data and assessing whether the resulting data structures support the application of the then-test for evaluations of chronic disease self-management interventions. STUDY DESIGN AND SETTING:Pre-test, post-test, and then-test data were collected from 314 participants of self-management courses using the Health Education Impact Questionnaire (heiQ). The derived change scores (pre-test/post-test; then-test/post-test) were examined for their psychometric performance using tests of measurement invariance. RESULTS:Few questionnaire items were noninvariant across pre-test/post-test, with four items identified and requiring removal to enable an unbiased comparison of factor means. In contrast, 12 items were identified and required removal in then-test/post-test data to avoid biased change score estimates. CONCLUSION:Traditional pre-test/post-test data appear to be robust with little indication of response shift. In contrast, the weaker psychometric performance of then-test/post-test data suggests psychometric flaws that may be the result of implicit theory of change, social desirability, and recall bias.

journal_name

J Clin Epidemiol

authors

Nolte S,Elsworth GR,Sinclair AJ,Osborne RH

doi

10.1016/j.jclinepi.2009.01.021

subject

Has Abstract

pub_date

2009-11-01 00:00:00

pages

1173-80

issue

11

eissn

0895-4356

issn

1878-5921

pii

S0895-4356(09)00097-3

journal_volume

62

pub_type

杂志文章,多中心研究
  • CARDIA: study design, recruitment, and some characteristics of the examined subjects.

    abstract::In 1984, a prospective cohort study, Coronary Artery Risk Development in Young Adults (CARDIA) was initiated to investigate life-style and other factors that influence, favorably and unfavorably, the evolution of coronary heart disease risk factors during young adulthood. After a year of planning and protocol developm...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(88)90080-7

    authors: Friedman GD,Cutter GR,Donahue RP,Hughes GH,Hulley SB,Jacobs DR Jr,Liu K,Savage PJ

    更新日期:1988-01-01 00:00:00

  • Indices of abdominal obesity are better discriminators of cardiovascular risk factors than BMI: a meta-analysis.

    abstract:OBJECTIVE:To determine which simple index of overweight and obesity is the best discriminator of cardiovascular risk factors. STUDY DESIGN AND SETTING:This is a meta-analysis of published literature. MEDLINE was searched. Studies that used receiver-operating characteristics (ROC) curve analysis and published area unde...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,meta分析,评审

    doi:10.1016/j.jclinepi.2007.08.012

    authors: Lee CM,Huxley RR,Wildman RP,Woodward M

    更新日期:2008-07-01 00:00:00

  • Test-retest of self-reported exposure to artificial tanning devices, self-tanning creams, and sun sensitivity showed consistency.

    abstract:OBJECTIVE:Exposure to ultraviolet radiation has consistently been linked to an increased risk of melanoma. Epidemiologic studies are susceptible to measurement error, which can distort the magnitude of observed effects. Although the reliability of self-report of many sun exposure factors has been previously described i...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2004.09.004

    authors: Beane Freeman LE,Dennis LK,Lynch CF,Lowe JB,Clarke WR

    更新日期:2005-04-01 00:00:00

  • Tradeoffs between accuracy measures for electronic health care data algorithms.

    abstract:OBJECTIVE:We review the uses of electronic health care data algorithms, measures of their accuracy, and reasons for prioritizing one measure of accuracy over another. STUDY DESIGN AND SETTING:We use real studies to illustrate the variety of uses of automated health care data in epidemiologic and health services resear...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2011.09.002

    authors: Chubak J,Pocobelli G,Weiss NS

    更新日期:2012-03-01 00:00:00

  • Reliability of Bayesian probability analysis for predicting coronary artery disease in a veterans hospital.

    abstract::To assess the accuracy of Bayesian probability analysis for the prediction of coronary artery disease, post-test probabilities were generated by the application of three Bayesian algorithms to the clinical and noninvasive test results of 199 patients undergoing angiography in a veterans' hospital. All assumed conditio...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(88)90065-0

    authors: Detrano R,Guppy KH,Abbassi N,Janosi A,Sandhu S,Froelicher V

    更新日期:1988-01-01 00:00:00

  • Methods for detecting, quantifying, and adjusting for dissemination bias in meta-analysis are described.

    abstract:OBJECTIVE:To systematically review methodological articles which focus on nonpublication of studies and to describe methods of detecting and/or quantifying and/or adjusting for dissemination in meta-analyses. To evaluate whether the methods have been applied to an empirical data set for which one can be reasonably conf...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2016.04.015

    authors: Mueller KF,Meerpohl JJ,Briel M,Antes G,von Elm E,Lang B,Motschall E,Schwarzer G,Bassler D

    更新日期:2016-12-01 00:00:00

  • Good agreement between parental and self-completed questionnaires about allergic diseases and environmental factors in teenagers.

    abstract:OBJECTIVES:To study whether the methodological change from parent to index subject as questionnaire respondent affected the prevalence estimates and risk factor patterns for allergic diseases in a longitudinal study. STUDY DESIGN AND SETTING:A prospective study of asthma and allergic diseases among children was begun ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2009.08.017

    authors: Hedman L,Bjerg A,Perzanowski M,Rönmark E

    更新日期:2010-07-01 00:00:00

  • Diabetes and disability among Mexican Americans: the effect of different measures of diabetes on its association with disability.

    abstract::The association of non-insulin-dependent diabetes mellitus and disability was evaluated in a population of Mexican Americans from the southwest U.S. using data from the Hispanic Health and Nutrition Examination Survey. Among the total sample of persons who completed a clinical examination, 14.6% reported a limitation ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(92)90101-r

    authors: Macheledt JE,Vernon SW

    更新日期:1992-05-01 00:00:00

  • Relative responsiveness of condition-specific and generic health status measures in degenerative lumbar spinal stenosis.

    abstract::The objective of this study was to compare the relative responsiveness of a condition-specific spinal stenosis measure and two generic health status measures for outcome assessment of surgery for degenerative lumbar spinal stenosis, and to examine whether responsiveness statistics and measures of the ability to distin...

    journal_title:Journal of clinical epidemiology

    pub_type: 临床试验,杂志文章,多中心研究

    doi:10.1016/0895-4356(95)00054-2

    authors: Stucki G,Liang MH,Fossel AH,Katz JN

    更新日期:1995-11-01 00:00:00

  • The statistical significance of meta-analyses is frequently fragile: definition of a fragility index for meta-analyses.

    abstract:OBJECTIVES:Meta-analyses inform clinical practice by summarizing treatment effect estimates based on results from several trials. However, the statistical significance of a meta-analysis (i.e., whether the pooled treatment effect is statistically significant or not) may rely on the outcome of only a few patients from s...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2019.03.012

    authors: Atal I,Porcher R,Boutron I,Ravaud P

    更新日期:2019-07-01 00:00:00

  • Frailty bias in comorbidity risk adjustments of community-dwelling elderly populations.

    abstract::Our objective was to describe distortion in outcome studies due to "frailty bias" or differential susceptibility to adverse health outcomes due to frailties but attributed to other factors. We linked an administrative database to survey data (n = 5934) containing functional, condition, and outcome measures. The diseas...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(99)00056-6

    authors: Pressley JC,Patrick CH

    更新日期:1999-08-01 00:00:00

  • Validation of the Danish Birth Registration.

    abstract::We assessed validity and reliability of data on four serious pregnancy complications and gestational age in two national registers, the Medical Birth Register (MBR) and the National Register of Hospital Discharges (NRHD). From a cohort of all women in Denmark who gave birth to their first and second singleton infant i...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(96)00018-2

    authors: Kristensen J,Langhoff-Roos J,Skovgaard LT,Kristensen FB

    更新日期:1996-08-01 00:00:00

  • Deficiencies in addressing effect modification in network meta-analyses: a meta-epidemiological survey.

    abstract:OBJECTIVE:The objectives of this study were to evaluate the current state of reporting and handling of effect modification in network meta-analyses (NMAs) and perform exploratory analyses to identify variables that are potentially associated with incomplete reporting of effect modifiers in NMAs. STUDY DESIGN AND SETTI...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,meta分析

    doi:10.1016/j.jclinepi.2017.06.004

    authors: Kovic B,Zoratti MJ,Michalopoulos S,Silvestre C,Thorlund K,Thabane L

    更新日期:2017-08-01 00:00:00

  • Testing the equivalence of translations of widely used response choice labels: results from the IQOLA Project. International Quality of Life Assessment.

    abstract::The similarity in meaning assigned to response choice labels from the SF-36 Health Survey (SF-36) was evaluated across countries. Convenience samples of judges (range, 10 to 117; median = 48) from 13 countries rated translations of response choice labels, using a variation of the Thurstone method of equal appearing in...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(98)00084-5

    authors: Keller SD,Ware JE Jr,Gandek B,Aaronson NK,Alonso J,Apolone G,Bjorner JB,Brazier J,Bullinger M,Fukuhara S,Kaasa S,Leplège A,Sanson-Fisher RW,Sullivan M,Wood-Dauphinee S

    更新日期:1998-11-01 00:00:00

  • Parity derived for pregnant women using historical administrative hospital data: accuracy varied among patient groups.

    abstract:OBJECTIVES:Understanding patterns of maternity care requires knowing which women have given birth previously, but this information is typically unavailable in administrative hospital data sets. We assessed how well parity can be derived using linked historical records. STUDY DESIGN AND SETTING:Using Hospital Episode S...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2013.10.011

    authors: Cromwell DA,Knight HE,Gurol-Urganci I

    更新日期:2014-05-01 00:00:00

  • International classification of diseases codes showed modest sensitivity for detecting community-acquired pneumonia.

    abstract:OBJECTIVE:To estimate the sensitivity of International Classification of Diseases (ICD-9-CM) coding for detecting hospitalized community-acquired pneumonia and to assess possible determinants for misclassification. STUDY DESIGN AND SETTING:Based on microbiological analysis data, 293 patients with a principal diagnosis...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2006.10.018

    authors: van de Garde EM,Oosterheert JJ,Bonten M,Kaplan RC,Leufkens HG

    更新日期:2007-08-01 00:00:00

  • Measuring importance of outcomes to patients: a cross-sectional survey for the German anal cancer guideline.

    abstract:OBJECTIVE:We aimed to generate evidence on patients' values and preferences to inform the development of the German national Evidence-based Anal Cancer Guideline. STUDY DESIGN AND SETTING:We developed a list of health outcomes based on a systematic search. We then asked anal cancer patients and experts of the guidelin...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2020.09.026

    authors: Werner RN,Gaskins M,Dressler C,Nast A,Schaefer C,Aigner F,Siegel R

    更新日期:2021-01-01 00:00:00

  • Relationship between hepatitis B surface antigen prevalence, per capita alcohol consumption and primary liver cancer death rate in 30 countries.

    abstract::The relationships between the prevalence of hepatitis B surface antigen (HBsAg), mean annual per capita alcohol consumption and primary liver cancer (PLC) death rates were explored in 30 countries. HBsAg prevalence was associated, significantly, with the logarithm of the primary liver cancer death rate (simple correla...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(88)90165-5

    authors: Qiao ZK,Halliday ML,Rankin JG,Coates RA

    更新日期:1988-01-01 00:00:00

  • Correlation between serial tests made disease probability estimates erroneous.

    abstract:BACKGROUND:The probability of a disease, given the result of two diagnostic tests, can be calculated by multiplying the odds of disease after the first test by the likelihood ratio of the second test. OBJECTIVE:To illustrate the error that occurs when calculating disease probability by combining the results of tests t...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2009.04.010

    authors: van Walraven C,Austin PC,Jennings A,Forster AJ

    更新日期:2009-12-01 00:00:00

  • Responsiveness was similar between direct and mapped SF-6D in colorectal cancer patients who declined.

    abstract:OBJECTIVES:To evaluate the responsiveness of generic and mapped preference-based measures based on the anchor of global change in health condition of colorectal cancer (CRC) patients. STUDY DESIGN AND SETTING:A baseline sample of 333 Chinese CRC patients was recruited between September 2009 and July 2010 and was surve...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2013.08.011

    authors: Wong CK,Mulhern B,Wan YF,Lam CL

    更新日期:2014-02-01 00:00:00

  • Parents were accurate proxy reporters of urgent pediatric asthma health services: a retrospective agreement analysis.

    abstract:OBJECTIVE:To assess agreement between parents' proxy reports of children's respiratory-related health service use and administrative data. STUDY DESIGN AND SETTING:A retrospective analysis of statistical agreement between clinical and claims data for reports of physician visits, emergency department (ED) visits, and h...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2007.02.002

    authors: Ungar WJ,Davidson-Grimwood SR,Cousins M

    更新日期:2007-11-01 00:00:00

  • The Kaiser Permanente inpatient risk adjustment methodology was valid in an external patient population.

    abstract:OBJECTIVES:Accurately predicting hospital mortality is necessary to measure and compare patient care. External validation of predictive models is required to truly prove their utility. This study assessed the Kaiser Permanente inpatient risk adjustment methodology for hospital mortality in a patient population distinct...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.jclinepi.2009.08.020

    authors: van Walraven C,Escobar GJ,Greene JD,Forster AJ

    更新日期:2010-07-01 00:00:00

  • Efficiency optimization of the selection period in therapeutic trials.

    abstract::To determine eligibility for a (randomized) clinical trial, measuring the inclusion and exclusion criteria can be extended over a period of time. During this period, known as the selection period, a patient is repeatedly examined at certain time intervals. This study describes an approach for optimizing the efficiency...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(97)00069-3

    authors: Moons CK,van Es GA,Stijnen T,Bak AA,Hofman A,Jonker JJ,Habbema JD,Grobbee DE

    更新日期:1997-07-01 00:00:00

  • Statistical analysis of failure times in total joint replacement.

    abstract::Time to revision is an important criterion describing the quality of implants in total joint surgery. Estimates of failure probabilities are required to inform a patient about the risk of suffering a reoperation. Also, regression models are used for comparing different prosthesis designs. Typically, patients dying bef...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(01)00371-7

    authors: Schwarzer G,Schumacher M,Maurer TB,Ochsner PE

    更新日期:2001-10-01 00:00:00

  • The Burden of Stroke Scale (BOSS) provides valid and reliable score estimates of functioning and well-being in stroke survivors with and without communication disorders.

    abstract:BACKGROUND AND OBJECTIVE:This study describes the conceptual foundation and psychometric properties of the Burden of Stroke Scale (BOSS), a patient-reported health status assessment designed to quantify the physical, cognitive, and psychological burden of stroke. METHODS:Qualitative research methods were used to devel...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2003.11.016

    authors: Doyle PJ,McNeil MR,Mikolic JM,Prieto L,Hula WD,Lustig AP,Ross K,Wambaugh JL,Gonzalez-Rothi LJ,Elman RJ

    更新日期:2004-10-01 00:00:00

  • Methods to evaluate risks for composite end points and their individual components.

    abstract:OBJECTIVE:Both randomized and observational studies commonly examine composite end points, but the literature on model development and criticism in this setting is limited. STUDY DESIGN AND SETTING:We examined approaches for evaluating heterogeneity in the effects of risk factors for different components of the end po...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2003.02.001

    authors: Glynn RJ,Rosner B

    更新日期:2004-02-01 00:00:00

  • Nutrition guidelines vary widely in methodological quality: an overview of reviews.

    abstract:OBJECTIVES:To identify, describe, and map contemporary nutrition guidelines (NGs) from reviews that used the Appraisal of Guidelines, Research and Evaluation (AGREE) tool. STUDY DESIGN AND SETTING:We performed an overview of reviews that systematically assessed the quality of NGs using the AGREE tool. We searched MEDL...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2018.08.018

    authors: Rabassa M,Garcia-Ribera Ruiz S,Solà I,Pardo-Hernandez H,Alonso-Coello P,Martínez García L

    更新日期:2018-12-01 00:00:00

  • Optimism bias leads to inconclusive results-an empirical study.

    abstract:OBJECTIVE:Optimism bias refers to unwarranted belief in the efficacy of new therapies. We assessed the impact of optimism bias on a proportion of trials that did not answer their research question successfully and explored whether poor accrual or optimism bias is responsible for inconclusive results. STUDY DESIGN:Syst...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2010.09.007

    authors: Djulbegovic B,Kumar A,Magazin A,Schroen AT,Soares H,Hozo I,Clarke M,Sargent D,Schell MJ

    更新日期:2011-06-01 00:00:00

  • Toxic oil syndrome: survival in the whole cohort between 1981 and 1995.

    abstract:BACKGROUND AND OBJECTIVE:In 1981, toxic oil syndrome (TOS) appeared in Spain, affecting more than 20,000 persons and causing over 2500 deaths to date. Previous studies have addressed mortality only by gender and age. We analyzed possible prognostic factors in the survival of the cohort. METHODS:The study period was 1 ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(03)00119-7

    authors: Sánchez-Porro Valadés P,Posada de la Paz M,de Andrés Copa P,Gimenez Ribota O,Abaitua Borda I

    更新日期:2003-07-01 00:00:00

  • Minimal important change (MIC) based on a predictive modeling approach was more precise than MIC based on ROC analysis.

    abstract:OBJECTIVES:To present a new method to estimate a "minimal important change" (MIC) of health-related quality of life (HRQOL) scales, based on predictive modeling, and to compare its performance with the MIC based on receiver operating characteristic (ROC) analysis. To illustrate how the new method deals with variables t...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2015.03.015

    authors: Terluin B,Eekhout I,Terwee CB,de Vet HC

    更新日期:2015-12-01 00:00:00