Automated inter-rater reliability assessment and electronic data collection in a multi-center breast cancer study.

Abstract:

BACKGROUND:The choice between paper data collection methods and electronic data collection (EDC) methods has become a key question for clinical researchers. There remains a need to examine potential benefits, efficiencies, and innovations associated with an EDC system in a multi-center medical record review study. METHODS:A computer-based automated menu-driven system with 658 data fields was developed for a cohort study of women aged 65 years or older, diagnosed with invasive histologically confirmed primary breast cancer (N = 1859), at 6 Cancer Research Network sites. Medical record review with direct data entry into the EDC system was implemented. An inter-rater and intra-rater reliability (IRR) system was developed using a modified version of the EDC. RESULTS:Automation of EDC accelerated the flow of study information and resulted in an efficient data collection process. Data collection time was reduced by approximately four months compared to the project schedule and funded time available for manuscript preparation increased by 12 months. In addition, an innovative modified version of the EDC permitted an automated evaluation of inter-rater and intra-rater reliability across six data collection sites. CONCLUSION:Automated EDC is a powerful tool for research efficiency and innovation, especially when multiple data collection sites are involved.

journal_name

BMC Med Res Methodol

authors

Thwin SS,Clough-Gorr KM,McCarty MC,Lash TL,Alford SH,Buist DS,Enger SM,Field TS,Frost F,Wei F,Silliman RA

doi

10.1186/1471-2288-7-23

subject

Has Abstract

pub_date

2007-06-18 00:00:00

pages

23

issn

1471-2288

pii

1471-2288-7-23

journal_volume

7

pub_type

杂志文章,多中心研究
  • Norm values and psychometric properties for the German health regulatory focus scale - results of a representative survey.

    abstract:BACKGROUND:The health regulatory focus is an application of Higgins' regulatory focus theory to a health-specific context. It explains individual differences in health motivation, strategies, and behavior. Previous research found the Health Regulatory Focus Scale (HRFS) to be a reliable and valid measure for the constr...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-00927-x

    authors: Schmalbach B,Zenger M,Brähler E,Petrowski K

    更新日期:2020-03-02 00:00:00

  • An international survey of physicians regarding clinical trials: a comparison between Kyoto University Hospital and Seoul National University Hospital.

    abstract:BACKGROUND:International clinical trials are now rapidly expanding into Asia. However, the proportion of global trials is higher in South Korea compared to Japan despite implementation of similar governmental support in both countries. The difference in clinical trial environment might influence the respective physicia...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-130

    authors: Ito-Ihara T,Hong JH,Kim OJ,Sumi E,Kim SY,Tanaka S,Narita K,Hatta T,Choi EK,Choi KJ,Miyagawa T,Minami M,Murayama T,Yokode M

    更新日期:2013-10-25 00:00:00

  • Positive predictive value of a case definition for diabetes mellitus using automated administrative health data in children and youth exposed to antipsychotic drugs or control medications: a Tennessee Medicaid study.

    abstract:BACKGROUND:We developed and validated an automated database case definition for diabetes in children and youth to facilitate pharmacoepidemiologic investigations of medications and the risk of diabetes. METHODS:The present study was part of an in-progress retrospective cohort study of antipsychotics and diabetes in Te...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-128

    authors: Bobo WV,Cooper WO,Stein CM,Olfson M,Mounsey J,Daugherty J,Ray WA

    更新日期:2012-08-24 00:00:00

  • Handling coarsened age information in the analysis of emergency department presentations.

    abstract:BACKGROUND:Administrative databases offer vast amounts of data that provide opportunities for cost-effective insights. They simultaneously pose significant challenges to statistical analysis such as the redaction of data because of privacy policies and the provision of data that may not be at the level of detail requir...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01181-x

    authors: Rosychuk RJ,Bachman JWN,Chen A,Hu XJ

    更新日期:2020-12-07 00:00:00

  • Can electronic search engines optimize screening of search results in systematic reviews: an empirical study.

    abstract:BACKGROUND:Most electronic search efforts directed at identifying primary studies for inclusion in systematic reviews rely on the optimal Boolean search features of search interfaces such as DIALOG and Ovid. Our objective is to test the ability of an Ultraseek search engine to rank MEDLINE records of the included studi...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-6-7

    authors: Sampson M,Barrowman NJ,Moher D,Clifford TJ,Platt RW,Morrison A,Klassen TP,Zhang L

    更新日期:2006-02-24 00:00:00

  • New journal selection for quantitative survey of infectious disease research: application for Asian trend analysis.

    abstract:BACKGROUND:Quantitative survey of research articles, as an application of bibliometrics, is an effective tool for grasping overall trends in various medical research fields. This type of survey has been also applied to infectious disease research; however, previous studies were insufficient as they underestimated artic...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-9-67

    authors: Takahashi-Omoe H,Omoe K,Okabe N

    更新日期:2009-10-06 00:00:00

  • Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity.

    abstract:BACKGROUND:Controlled clinical trials of health care interventions are either explanatory or pragmatic. Explanatory trials test whether an intervention is efficacious; that is, whether it can have a beneficial effect in an ideal situation. Pragmatic trials measure effectiveness; they measure the degree of beneficial ef...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-3-28

    authors: Godwin M,Ruhland L,Casson I,MacDonald S,Delva D,Birtwhistle R,Lam M,Seguin R

    更新日期:2003-12-22 00:00:00

  • Effectiveness of motivational interviewing, health education and brief advice in a population of smokers who are not ready to quit.

    abstract:BACKGROUND:Motivational Interviewing (MI), Brief Advice (BA) and Health Education (HE) are established smoking cessation induction methods for smokers with low desire to quit. Although randomized controlled trials (RCT's) have been frequently used to assess these interventions the temporal efficacy and effectiveness of...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/s12874-018-0511-0

    authors: Bani-Yaghoub M,Elhomani A,Catley D

    更新日期:2018-06-13 00:00:00

  • Psychometric analysis of the brief symptom inventory 18 (BSI-18) in a representative German sample.

    abstract:BACKGROUND:The BSI-18 contains the three six-item scales somatization, depression, and anxiety as well as the Global Severity Index (GSI), including all 18 items. The BSI-18 is the latest and shortest of the multidimensional versions of the Symptom-Checklist 90-R, but its psychometric properties have not been sufficien...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0283-3

    authors: Franke GH,Jaeger S,Glaesmer H,Barkmann C,Petrowski K,Braehler E

    更新日期:2017-01-26 00:00:00

  • Validity of information on atopic disease and other illness in young children reported by parents in a prospective birth cohort study.

    abstract:BACKGROUND:The longitudinal birth cohort study is the preferred design for studies of childhood health, particularly atopic disease. Still, prospective data collection depends on recollection of the medical history since the previous visit representing a potential recall-bias. We aimed to ascertain the quality of infor...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-160

    authors: Vissing NH,Jensen SM,Bisgaard H

    更新日期:2012-10-22 00:00:00

  • A comparison of the statistical performance of different meta-analysis models for the synthesis of subgroup effects from randomized clinical trials.

    abstract:BACKGROUND:When investigating subgroup effects in meta-analysis, it is unclear whether accounting in meta-regression for between-trial variation in treatment effects, but not between-trial variation in treatment interaction effects when such effects are present, leads to biased estimates, coverage problems, or wrong st...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0831-8

    authors: da Costa BR,Sutton AJ

    更新日期:2019-10-26 00:00:00

  • Reported frequency of physical activity in a large epidemiological study: relationship to specific activities and repeatability over time.

    abstract:BACKGROUND:How overall physical activity relates to specific activities and how reported activity changes over time may influence interpretation of observed associations between physical activity and health. We examine the relationships between various physical activities self-reported at different times in a large coh...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-97

    authors: Armstrong ME,Cairns BJ,Green J,Reeves GK,Beral V,Million Women Study Collaborators.

    更新日期:2011-06-22 00:00:00

  • Eliciting parental support for the use of newborn blood spots for pediatric research.

    abstract:BACKGROUND:Biomarkers of exposures such as infection or environmental chemicals can be measured in small volumes of blood extracted from newborn dried blood spots (DBS) underscoring their potential utility for population-based research. However, few studies have evaluated the feasibility and utility of this resource; p...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0120-8

    authors: Yeung EH,Louis GB,Lawrence D,Kannan K,McLain AC,Caggana M,Druschel C,Bell E

    更新日期:2016-02-04 00:00:00

  • Tools used to assess the quality of peer review reports: a methodological systematic review.

    abstract:BACKGROUND:A strong need exists for a validated tool that clearly defines peer review report quality in biomedical research, as it will allow evaluating interventions aimed at improving the peer review process in well-performed trials. We aim to identify and describe existing tools for assessing the quality of peer rev...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0688-x

    authors: Superchi C,González JA,Solà I,Cobo E,Hren D,Boutron I

    更新日期:2019-03-06 00:00:00

  • Does it matter whether the recipient of patient questionnaires in general practice is the general practitioner or an independent researcher? The REPLY randomised trial.

    abstract:BACKGROUND:Self-administered questionnaires are becoming increasingly common in general practice. Much research has explored methods to increase response rates but comparatively few studies have explored the effect of questionnaire administration on reported answers. METHODS:The aim of this study was to determine the ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/1471-2288-8-42

    authors: Desborough JA,Butters P,Bhattacharya D,Holland RC,Wright DJ

    更新日期:2008-06-27 00:00:00

  • Consensus workshops on the development of an ADHD medication management protocol using QbTest: developing a clinical trial protocol with multidisciplinary stakeholders.

    abstract:BACKGROUND:The study design and protocol that underpin a randomised controlled trial (RCT) are critical for the ultimate success of the trial. Although RCTs are considered the gold standard for research, there are multiple threats to their validity such as participant recruitment and retention, identifying a meaningful...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0772-2

    authors: Hall CL,Brown S,James M,Martin JL,Brown N,Selby K,Clarke J,Williams L,Sayal K,Hollis C,Groom MJ

    更新日期:2019-06-18 00:00:00

  • A methodological systematic review of what's wrong with meta-ethnography reporting.

    abstract:BACKGROUND:Syntheses of qualitative studies can inform health policy, services and our understanding of patient experience. Meta-ethnography is a systematic seven-phase interpretive qualitative synthesis approach well-suited to producing new theories and conceptual models. However, there are concerns about the quality ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/1471-2288-14-119

    authors: France EF,Ring N,Thomas R,Noyes J,Maxwell M,Jepson R

    更新日期:2014-11-19 00:00:00

  • Variance constraints strongly influenced model performance in growth mixture modeling: a simulation and empirical study.

    abstract:BACKGROUND:Growth Mixture Modeling (GMM) is commonly used to group individuals on their development over time, but convergence issues and impossible values are common. This can result in unreliable model estimates. Constraining variance parameters across classes or over time can solve these issues, but can also serious...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01154-0

    authors: Sijbrandij JJ,Hoekstra T,Almansa J,Peeters M,Bültmann U,Reijneveld SA

    更新日期:2020-11-12 00:00:00

  • Interpreter proxy versus healthcare interpreter for administration of patient surveys following arthroplasty: a pilot study.

    abstract:BACKGROUND:Clinical quality registries and other systems that conduct routine post-discharge surveillance of patient outcomes following surgery may have difficulty surveying patients who have limited proficiency in the language of the healthcare provider. Interpreter proxies (family and carers) are often used due to li...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0854-1

    authors: Xue D,Churches T,Armstrong E,Mittal R,Naylor JM,Harris IA

    更新日期:2019-11-14 00:00:00

  • Recruiting and motivating black subjects to complete a lengthy survey in a large cohort study: an exploration of different strategies.

    abstract:BACKGROUND:The effectiveness of multiple innovative recruitment strategies for enrolling Black/African American participants to the Adventist Health Study-2 (AHS-2) is described. The study's focus is diet and breast, prostate and colon cancer. METHODS:Promotions centered on trust, relationship building and incentives ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-14-46

    authors: Herring P,Butler T,Hall S,Bennett H,Montgomery SB,Fraser G

    更新日期:2014-04-03 00:00:00

  • Recruitment strategies and yields for the Pathobiology of Prediabetes in a Biracial Cohort: a prospective natural history study of incident dysglycemia.

    abstract:BACKGROUND:The Pathobiology of Prediabetes in A Biracial Cohort study is a prospective evaluation of the transition from normal to impaired glucose regulation among African American and Caucasian adults with parental type 2 diabetes. This report describes recruitment strategies and relative yields for the 376 enrolled ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-64

    authors: Ebenibo S,Edeoga C,Ammons A,Egbuonu N,Dagogo-Jack S,Pathobiology of Prediabetes in a Biracial Cohort (POP-ABC) Research Group.

    更新日期:2013-05-10 00:00:00

  • Estimating the loss of lifetime function using flexible parametric relative survival models.

    abstract:BACKGROUND:Within cancer care, dynamic evaluations of the loss in expectation of life provides useful information to patients as well as physicians. The loss of lifetime function yields the conditional loss in expectation of life given survival up to a specific time point. Due to the inevitable censoring in time-to-eve...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0661-8

    authors: Jakobsen LH,Andersson TM,Biccler JL,El-Galaly TC,Bøgsted M

    更新日期:2019-01-28 00:00:00

  • Parental compliance--an emerging problem in Liverpool community child health surveys 1991-2006.

    abstract:BACKGROUND:Compliance is a critical issue for parental questionnaires in school based epidemiological surveys and high compliance is difficult to achieve. The objective of this study was to determine trends and factors associated with parental questionnaire compliance during respiratory health surveys of school childre...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-53

    authors: Koshy G,Brabin BJ

    更新日期:2012-04-20 00:00:00

  • A system for rating the stability and strength of medical evidence.

    abstract:BACKGROUND:Methods for describing one's confidence in the available evidence are useful for end-users of evidence reviews. Analysts inevitably make judgments about the quality, quantity consistency, robustness, and magnitude of effects observed in the studies identified. The subjectivity of these judgments in several a...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-6-52

    authors: Treadwell JR,Tregear SJ,Reston JT,Turkelson CM

    更新日期:2006-10-19 00:00:00

  • Academic pediatric clinical research: factors associated with study implementation duration.

    abstract:BACKGROUND:The ethical, methodological, and technical aspects of pediatric research, often results in complications and delays in implementation. Our objective was to identify factors associated with the implementation duration of hospital-based pediatric studies. METHODS:All hospital-based pediatric studies sponsored...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0138-y

    authors: Meier-Girard D,Tibi A,Abdoul H,Prot-Labarthe S,Brion F,Bourdon O,Alberti C

    更新日期:2016-03-29 00:00:00

  • Generating evidence on a risk-based monitoring approach in the academic setting - lessons learned.

    abstract:BACKGROUND:In spite of efforts to employ risk-based strategies to increase monitoring efficiency in the academic setting, empirical evidence on their effectiveness remains sparse. This mixed-methods study aimed to evaluate the risk-based on-site monitoring approach currently followed at our academic institution. METHO...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0308-6

    authors: von Niederhäusern B,Orleth A,Schädelin S,Rawi N,Velkopolszky M,Becherer C,Benkert P,Satalkar P,Briel M,Pauli-Magnus C

    更新日期:2017-02-14 00:00:00

  • Does the association between adherence to statin medications and mortality depend on measurement approach? A retrospective cohort study.

    abstract:BACKGROUND:The aim of this study was to examine the relationship between mortality and statin adherence using two different approaches to adherence measurement (summary versus repeated-measures). METHODS:A retrospective cohort study was conducted using administrative data from Saskatchewan, Canada between 1994 and 200...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0339-z

    authors: Alsabbagh MW,Eurich D,Lix LM,Wilson TW,Blackburn DF

    更新日期:2017-04-20 00:00:00

  • Comparison of confidence interval methods for an intra-class correlation coefficient (ICC).

    abstract:BACKGROUND:The intraclass correlation coefficient (ICC) is widely used in biomedical research to assess the reproducibility of measurements between raters, labs, technicians, or devices. For example, in an inter-rater reliability study, a high ICC value means that noise variability (between-raters and within-raters) is...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-14-121

    authors: Ionan AC,Polley MY,McShane LM,Dobbin KK

    更新日期:2014-11-22 00:00:00

  • Obstacles to recruitment in paediatric studies focusing on mental health in a physical health context: the experiences of clinical gatekeepers in an observational cohort study.

    abstract:BACKGROUND:Studies in both paediatric and psychiatric settings often experience problems in recruitment. This can compromise the ability of the study to recruit to target, meaning studies are potentially underpowered. It can also result in a biased sample if a non-representative group are selectively recruited. Recruit...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0730-z

    authors: Loades ME,Smith L,Higson-Sweeney N,Beasant L,Stallard P,Kessler D,Crawley E

    更新日期:2019-04-27 00:00:00

  • High-performing physicians are more likely to participate in a research study: findings from a quality improvement study.

    abstract:BACKGROUND:Participants in voluntary research present a different demographic profile than those who choose not to participate, affecting the generalizability of many studies. Efforts to evaluate these differences have faced challenges, as little information is available from non-participants. Leveraging data from a re...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0809-6

    authors: Dahrouge S,Armstrong CD,Hogg W,Singh J,Liddy C

    更新日期:2019-08-07 00:00:00