Tools used to assess the quality of peer review reports: a methodological systematic review.

Abstract:

BACKGROUND:A strong need exists for a validated tool that clearly defines peer review report quality in biomedical research, as it will allow evaluating interventions aimed at improving the peer review process in well-performed trials. We aim to identify and describe existing tools for assessing the quality of peer review reports in biomedical research. METHODS:We conducted a methodological systematic review by searching PubMed, EMBASE (via Ovid) and The Cochrane Methodology Register (via The Cochrane Library) as well as Google® for all reports in English describing a tool for assessing the quality of a peer review report in biomedical research. Data extraction was performed in duplicate using a standardized data extraction form. We extracted information on the structure, development and validation of each tool. We also identified quality components across tools using a systematic multi-step approach and we investigated quality domain similarities among tools by performing hierarchical, complete-linkage clustering analysis. RESULTS:We identified a total number of 24 tools: 23 scales and 1 checklist. Six tools consisted of a single item and 18 had several items ranging from 4 to 26. None of the tools reported a definition of 'quality'. Only 1 tool described the scale development and 10 provided measures of validity and reliability. Five tools were used as an outcome in a randomized controlled trial (RCT). Moreover, we classified the quality components of the 18 tools with more than one item into 9 main quality domains and 11 subdomains. The tools contained from two to seven quality domains. Some domains and subdomains were considered in most tools such as the detailed/thorough (11/18) nature of reviewer's comments. Others were rarely considered, such as whether or not the reviewer made comments on the statistical methods (1/18). CONCLUSION:Several tools are available to assess the quality of peer review reports; however, the development and validation process is questionable and the concepts evaluated by these tools vary widely. The results from this study and from further investigations will inform the development of a new tool for assessing the quality of peer review reports in biomedical research.

journal_name

BMC Med Res Methodol

authors

Superchi C,González JA,Solà I,Cobo E,Hren D,Boutron I

doi

10.1186/s12874-019-0688-x

subject

Has Abstract

pub_date

2019-03-06 00:00:00

pages

48

issue

1

issn

1471-2288

pii

10.1186/s12874-019-0688-x

journal_volume

19

pub_type

杂志文章
  • Measurement and control of bias in patient reported outcomes using multidimensional item response theory.

    abstract:BACKGROUND:Patient-reported outcome (PRO) measures play a key role in the advancement of patient-centered care research. The accuracy of inferences, relevance of predictions, and the true nature of the associations made with PRO data depend on the validity of these measures. Errors inherent to self-report measures can ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0161-z

    authors: Dowling NM,Bolt DM,Deng S,Li C

    更新日期:2016-05-26 00:00:00

  • Combining estimates of interest in prognostic modelling studies after multiple imputation: current practice and guidelines.

    abstract:BACKGROUND:Multiple imputation (MI) provides an effective approach to handle missing covariate data within prognostic modelling studies, as it can properly account for the missing data uncertainty. The multiply imputed datasets are each analysed using standard prognostic modelling techniques to obtain the estimates of ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,实务指引

    doi:10.1186/1471-2288-9-57

    authors: Marshall A,Altman DG,Holder RL,Royston P

    更新日期:2009-07-28 00:00:00

  • Awareness of wearing an accelerometer does not affect physical activity in youth.

    abstract:BACKGROUND:This study aimed to investigate whether awareness of being monitored by an accelerometer has an effect on physical activity in young people. METHODS:Eighty healthy participants aged 10-18 years were randomized between blinded and nonblinded groups. The blinded participants were informed that we were testing...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/s12874-017-0378-5

    authors: Vanhelst J,Béghin L,Drumez E,Coopman S,Gottrand F

    更新日期:2017-07-11 00:00:00

  • Sample size calculations for cluster randomised controlled trials with a fixed number of clusters.

    abstract:BACKGROUND:Cluster randomised controlled trials (CRCTs) are frequently used in health service evaluation. Assuming an average cluster size, required sample sizes are readily computed for both binary and continuous outcomes, by estimating a design effect or inflation factor. However, where the number of clusters are fix...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-102

    authors: Hemming K,Girling AJ,Sitch AJ,Marsh J,Lilford RJ

    更新日期:2011-06-30 00:00:00

  • Assembling and validating a heart failure-free cohort from the Reasons for Geographic and Racial Differences in Stroke (REGARDS) study.

    abstract:BACKGROUND:Studies examining incident heart failure (HF) have been limited to select populations. To examine incident HF with broader generalizability, there is need to assemble a HF-free cohort using a geographically-diverse sample. We aimed to develop and validate a simple medication-based strategy for assembling a H...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0890-x

    authors: Goyal P,Mefford MT,Chen L,Sterling MR,Durant RW,Safford MM,Levitan EB

    更新日期:2020-03-04 00:00:00

  • Does the association between adherence to statin medications and mortality depend on measurement approach? A retrospective cohort study.

    abstract:BACKGROUND:The aim of this study was to examine the relationship between mortality and statin adherence using two different approaches to adherence measurement (summary versus repeated-measures). METHODS:A retrospective cohort study was conducted using administrative data from Saskatchewan, Canada between 1994 and 200...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0339-z

    authors: Alsabbagh MW,Eurich D,Lix LM,Wilson TW,Blackburn DF

    更新日期:2017-04-20 00:00:00

  • Bivariate random-effects meta-analysis and the estimation of between-study correlation.

    abstract:BACKGROUND:When multiple endpoints are of interest in evidence synthesis, a multivariate meta-analysis can jointly synthesise those endpoints and utilise their correlation. A multivariate random-effects meta-analysis must incorporate and estimate the between-study correlation (rhoB). METHODS:In this paper we assess ma...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-7-3

    authors: Riley RD,Abrams KR,Sutton AJ,Lambert PC,Thompson JR

    更新日期:2007-01-12 00:00:00

  • Pan-Canadian assessment of pandemic immunization data collection: study methodology.

    abstract:BACKGROUND:The collection of individual-level pandemic (H1N1) 2009 influenza immunization data was considered important to facilitate optimal vaccine delivery and accurate assessment of vaccine coverage. These data are also critical for research aimed at evaluating the new vaccine's safety and effectiveness. Systems us...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-10-51

    authors: Pereira JA,Quach S,Heidebrecht C,Foisy J,Quan S,Finkelstein M,Sikora CA,Bettinger JA,Buckeridge DL,McCarthy A,Deeks S,Kwong JC,Public Health Agency of Canada\/Canadian Institutes of Health Research Influenza Research Network Vacc

    更新日期:2010-06-08 00:00:00

  • Positive predictive value of a case definition for diabetes mellitus using automated administrative health data in children and youth exposed to antipsychotic drugs or control medications: a Tennessee Medicaid study.

    abstract:BACKGROUND:We developed and validated an automated database case definition for diabetes in children and youth to facilitate pharmacoepidemiologic investigations of medications and the risk of diabetes. METHODS:The present study was part of an in-progress retrospective cohort study of antipsychotics and diabetes in Te...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-128

    authors: Bobo WV,Cooper WO,Stein CM,Olfson M,Mounsey J,Daugherty J,Ray WA

    更新日期:2012-08-24 00:00:00

  • Structural issues affecting mixed methods studies in health research: a qualitative study.

    abstract:BACKGROUND:Health researchers undertake studies which combine qualitative and quantitative methods. Little attention has been paid to the structural issues affecting this mixed methods approach. We explored the facilitators and barriers to undertaking mixed methods studies in health research. METHODS:Face-to-face semi...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-9-82

    authors: O'Cathain A,Nicholl J,Murphy E

    更新日期:2009-12-09 00:00:00

  • Comparison of retention in observational cohorts and nested simulated HIV vaccine efficacy trials in the key populations in Uganda.

    abstract:BACKGROUND:Outcomes in observational studies may not best estimate those expected in the HIV vaccine efficacy trials. We compared retention in Simulated HIV Vaccine Efficacy Trials (SiVETs) and observational cohorts drawn from two key populations in Uganda. METHODS:Two SiVETs were nested within two observational cohor...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-00920-4

    authors: Abaasa A,Todd J,Nash S,Mayanja Y,Kaleebu P,Fast PE,Price M

    更新日期:2020-02-12 00:00:00

  • Forecasts of COPD mortality in Australia: 2006-2025.

    abstract:BACKGROUND:Chronic Obstructive Pulmonary Disease (COPD) is currently the fifth leading cause of death in Australia, and there are marked differences in mortality trends between men and women. In this study, we have sought to model and forecast age related changes in COPD mortality over time for men and women separately...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-17

    authors: Erbas B,Ullah S,Hyndman RJ,Scollo M,Abramson M

    更新日期:2012-02-21 00:00:00

  • Integrating and extending cohort studies: lessons from the eXtending Treatments, Education and Networks in Depression (xTEND) study.

    abstract:BACKGROUND:Epidemiologic studies often struggle to adequately represent populations and outcomes of interest. Differences in methodology, data analysis and research questions often mean that reviews and synthesis of the existing literature have significant limitations. The current paper details our experiences in combi...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-122

    authors: Allen J,Inder KJ,Lewin TJ,Attia JR,Kay-Lambkin FJ,Baker AL,Hazell T,Kelly BJ

    更新日期:2013-10-05 00:00:00

  • High-performing physicians are more likely to participate in a research study: findings from a quality improvement study.

    abstract:BACKGROUND:Participants in voluntary research present a different demographic profile than those who choose not to participate, affecting the generalizability of many studies. Efforts to evaluate these differences have faced challenges, as little information is available from non-participants. Leveraging data from a re...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0809-6

    authors: Dahrouge S,Armstrong CD,Hogg W,Singh J,Liddy C

    更新日期:2019-08-07 00:00:00

  • A system for rating the stability and strength of medical evidence.

    abstract:BACKGROUND:Methods for describing one's confidence in the available evidence are useful for end-users of evidence reviews. Analysts inevitably make judgments about the quality, quantity consistency, robustness, and magnitude of effects observed in the studies identified. The subjectivity of these judgments in several a...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-6-52

    authors: Treadwell JR,Tregear SJ,Reston JT,Turkelson CM

    更新日期:2006-10-19 00:00:00

  • Health Equity Assessment Toolkit (HEAT): software for exploring and comparing health inequalities in countries.

    abstract:BACKGROUND:It is widely recognised that the pursuit of sustainable development cannot be accomplished without addressing inequality, or observed differences between subgroups of a population. Monitoring health inequalities allows for the identification of health topics where major group differences exist, dimensions of...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0229-9

    authors: Hosseinpoor AR,Nambiar D,Schlotheuber A,Reidpath D,Ross Z

    更新日期:2016-10-19 00:00:00

  • Does it matter whether the recipient of patient questionnaires in general practice is the general practitioner or an independent researcher? The REPLY randomised trial.

    abstract:BACKGROUND:Self-administered questionnaires are becoming increasingly common in general practice. Much research has explored methods to increase response rates but comparatively few studies have explored the effect of questionnaire administration on reported answers. METHODS:The aim of this study was to determine the ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/1471-2288-8-42

    authors: Desborough JA,Butters P,Bhattacharya D,Holland RC,Wright DJ

    更新日期:2008-06-27 00:00:00

  • Practical considerations for sensitivity analysis after multiple imputation applied to epidemiological studies with incomplete data.

    abstract:BACKGROUND:Multiple Imputation as usually implemented assumes that data are Missing At Random (MAR), meaning that the underlying missing data mechanism, given the observed data, is independent of the unobserved data. To explore the sensitivity of the inferences to departures from the MAR assumption, we applied the meth...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-73

    authors: Héraud-Bousquet V,Larsen C,Carpenter J,Desenclos JC,Le Strat Y

    更新日期:2012-06-08 00:00:00

  • Evaluation of a modified version of the Posttraumatic Growth Inventory-Short Form.

    abstract:BACKGROUND:Posttraumatic growth is the positive change resulting from traumatic experiences and is typically assessed with retrospective measures like the Posttraumatic Growth Inventory (PTGI). The PTGI was designed to include reference to a specific traumatic event, making it difficult to implement, without change, in...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0344-2

    authors: Kaur N,Porter B,LeardMann CA,Tobin LE,Lemus H,Luxton DD,Millennium Cohort Study Team.

    更新日期:2017-04-20 00:00:00

  • The use of relative incidence ratios in self-controlled case series studies: an overview.

    abstract:BACKGROUND:The self-controlled case series (SCCS) is a useful design for investigating associations between outcomes and transient exposures. The SCCS design controls for all fixed covariates, but effect modification can still occur. This can be evaluated by including interaction terms in the model which, when exponent...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0225-0

    authors: Hawken S,Potter BK,Little J,Benchimol EI,Mahmud S,Ducharme R,Wilson K

    更新日期:2016-09-23 00:00:00

  • Modern modelling techniques are data hungry: a simulation study for predicting dichotomous endpoints.

    abstract:BACKGROUND:Modern modelling techniques may potentially provide more accurate predictions of binary outcomes than classical techniques. We aimed to study the predictive performance of different modelling techniques in relation to the effective sample size ("data hungriness"). METHODS:We performed simulation studies bas...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-14-137

    authors: van der Ploeg T,Austin PC,Steyerberg EW

    更新日期:2014-12-22 00:00:00

  • Can a 'consent to contact' community help research teams overcome barriers to recruitment? The development and impact of the 'Research for the Future' community.

    abstract:BACKGROUND:Recruitment to health research remains a major challenge. Innovation is required to meet policy commitments to help patients take part in health research. One innovation that may help meet those policy goals is the development of 'consent to contact' systems, where people give generic consent to be contacted...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0843-4

    authors: Grady K,Gibson M,Bower P

    更新日期:2019-10-22 00:00:00

  • Understanding the predictive value of continuous markers for censored survival data using a likelihood ratio approach.

    abstract:BACKGROUND:The likelihood ratio function (LR), the ratio of conditional probabilities of obtaining a specific marker value among those with the event of interest over those without, provides an easily interpretable way to quantify the update of the risk prediction due to the knowledge of the marker value. The LR has be...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0721-0

    authors: Smith AM,Christodouleas JP,Hwang WT

    更新日期:2019-05-22 00:00:00

  • The challenges of recruiting cancer patient/caregiver dyads: informing randomized controlled trials.

    abstract:BACKGROUND:Family members are increasingly involved in the care of cancer patients, however many are not prepared for this challenging role. Intervention-based studies are valuable to inform the most appropriate and effective support for caregivers. Barriers in the recruitment of patient/caregiver dyads exist but the r...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,多中心研究,随机对照试验

    doi:10.1186/s12874-018-0614-7

    authors: Heckel L,Gunn KM,Livingston PM

    更新日期:2018-11-21 00:00:00

  • Methods to increase response rates to a population-based maternity survey: a comparison of two pilot studies.

    abstract:BACKGROUND:Surveys are established methods for collecting population data that are unavailable from other sources; however, response rates to surveys are declining. A number of methods have been identified to increase survey returns yet response rates remain low. This paper evaluates the impact of five selected methods...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0702-3

    authors: Harrison S,Henderson J,Alderdice F,Quigley MA

    更新日期:2019-03-20 00:00:00

  • Design and development of the Australian and New Zealand (ANZ) myeloma and related diseases registry.

    abstract:BACKGROUND:Plasma cell dyscrasias (PCD) are a spectrum of disorders resulting from the clonal expansion of plasma cells, ranging from the pre-malignant condition monoclonal gammopathy of undetermined significance (MGUS) to multiple myeloma (MM). MM generates a significant burden of disease on the community and it is pr...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0250-z

    authors: Bergin K,Moore E,McQuilten Z,Wood E,Augustson B,Blacklock H,Ho J,Horvath N,King T,McNeil J,Mollee P,Quach H,Reid CM,Rosengarten B,Walker P,Spencer A

    更新日期:2016-11-09 00:00:00

  • Getting messier with TIDieR: embracing context and complexity in intervention reporting.

    abstract:BACKGROUND:The Template for Intervention Description and Replication (TIDieR) checklist and guide was developed by an international team of experts to promote full and accurate description of trial interventions. It is now widely used in health research. The aim of this paper is to describe the experience of using TIDi...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0461-y

    authors: Cotterill S,Knowles S,Martindale AM,Elvey R,Howard S,Coupe N,Wilson P,Spence M

    更新日期:2018-01-18 00:00:00

  • Imputation of a true endpoint from a surrogate: application to a cluster randomized controlled trial with partial information on the true endpoint.

    abstract:BACKGROUND:The Anglia Menorrhagia Education Study (AMES) is a randomized controlled trial testing the effectiveness of an education package applied to general practices. Binary data are available from two sources; general practitioner reported referrals to hospital, and referrals to hospital determined by independent a...

    journal_title:BMC medical research methodology

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1186/1471-2288-3-17

    authors: Nixon RM,Duffy SW,Fender GR

    更新日期:2003-09-24 00:00:00

  • Sample size calculation in multi-centre clinical trials.

    abstract:BACKGROUND:Multi-centre randomized controlled clinical trials play an important role in modern evidence-based medicine. Advantages of collecting data from more than one site are numerous, including accelerated recruitment and increased generalisability of results. Mixed models can be applied to account for potential cl...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-018-0602-y

    authors: Harden M,Friede T

    更新日期:2018-11-29 00:00:00

  • A statistical model to assess the risk of communicable diseases associated with multiple exposures in healthcare settings.

    abstract:BACKGROUND:The occurrence of communicable diseases (CD) depends on exposure to contagious persons. The effects of exposure to CD are delayed in time and contagious persons remain contagious for several days during which their contagiousness varies. Moreover when multiple exposures occur, it is difficult to know which e...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-26

    authors: Payet C,Voirin N,Vanhems P,Ecochard R

    更新日期:2013-02-20 00:00:00