Resuming the discussion of AMSTAR: What can (should) be made better?

Abstract:

BACKGROUND:Evidence syntheses, and in particular systematic reviews (SRs), have become one of the cornerstones of evidence-based health care. The Assessment of Multiple Systematic Reviews (AMSTAR) tool has become the most widely used tool for investigating the methodological quality of SRs and is currently undergoing revision. The objective of this paper is to present insights, challenges and potential solutions from the point of view of a group of assessors, while referring to earlier methodological discussions and debates with respect to AMSTAR. DISCUSSION:One major drawback of AMSTAR is that it relies heavily on reporting quality rather than on methodological quality. This can be found in several items. Furthermore, it should be acknowledged that there are now new methods and procedures that did not exist when AMSTAR was developed. For example, the note to item 1 should now refer to the International Prospective Register of Ongoing Systematic Reviews (PROSPERO). Furthermore, item 3 should consider the definition of hand-searching, as the process of reviewing conference proceedings using the search function (e.g. in Microsoft Word or in a PDF file) does not meet the definition set out by the Cochrane Collaboration. Moreover, methods for assessing the quality of the body of evidence have evolved since AMSTAR was developed and should be incorporated into a revised AMSTAR tool. Potential solutions are presented for each AMSTAR item with the aim of allowing a more thorough assessment of SRs. As the AMSTAR tool is currently undergoing further development, our paper hopes to add to preceding discussions and papers regarding this tool and stimulate further discussion.

journal_name

BMC Med Res Methodol

authors

Wegewitz U,Weikert B,Fishta A,Jacobs A,Pieper D

doi

10.1186/s12874-016-0183-6

subject

Has Abstract

pub_date

2016-08-26 00:00:00

pages

111

issue

1

issn

1471-2288

pii

10.1186/s12874-016-0183-6

journal_volume

16

pub_type

杂志文章
  • Validity of the International Physical Activity Questionnaire (IPAQ) for assessing moderate-to-vigorous physical activity and sedentary behaviour of older adults in the United Kingdom.

    abstract:BACKGROUND:In order to accurately measure and monitor levels of moderate-to-vigorous physical activity (MVPA) and sedentary behaviour (SB) in older adults, cost efficient and valid instruments are required. To date, the International Physical Activity Questionnaire (IPAQ) has not been validated with older adults (aged ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,多中心研究

    doi:10.1186/s12874-018-0642-3

    authors: Cleland C,Ferguson S,Ellis G,Hunter RF

    更新日期:2018-12-22 00:00:00

  • Misclassification of incident conditions using claims data: impact of varying the period used to exclude pre-existing disease.

    abstract:BACKGROUND:Estimating the incidence of medical conditions using claims data often requires constructing a prevalence period that predates an event of interest, for instance the diagnosis of cancer, to exclude those with pre-existing conditions from the incidence risk set. Those conditions missed during the prevalence p...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-32

    authors: Griffiths RI,O'Malley CD,Herbert RJ,Danese MD

    更新日期:2013-03-06 00:00:00

  • A factorial cluster-randomised controlled trial combining home-environmental and early child development interventions to improve child health and development: rationale, trial design and baseline findings.

    abstract:BACKGROUND:Exposure to unhealthy environments and inadequate child stimulation are main risk factors that affect children's health and wellbeing in low- and middle-income countries. Interventions that simultaneously address several risk factors at the household level have great potential to reduce these negative effect...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-00950-y

    authors: Hartinger SM,Nuño N,Hattendorf J,Verastegui H,Karlen W,Ortiz M,Mäusezahl D

    更新日期:2020-04-02 00:00:00

  • Obstacles to recruitment in paediatric studies focusing on mental health in a physical health context: the experiences of clinical gatekeepers in an observational cohort study.

    abstract:BACKGROUND:Studies in both paediatric and psychiatric settings often experience problems in recruitment. This can compromise the ability of the study to recruit to target, meaning studies are potentially underpowered. It can also result in a biased sample if a non-representative group are selectively recruited. Recruit...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0730-z

    authors: Loades ME,Smith L,Higson-Sweeney N,Beasant L,Stallard P,Kessler D,Crawley E

    更新日期:2019-04-27 00:00:00

  • Strengthening policy coding methodologies to improve COVID-19 disease modeling and policy responses: a proposed coding framework and recommendations.

    abstract:BACKGROUND:In recent months, multiple efforts have sought to characterize COVID-19 social distancing policy responses. These efforts have used various coding frameworks, but many have relied on coding methodologies that may not adequately describe the gradient in social distancing policies as states "re-open." METHODS...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01174-w

    authors: Lane J,Garrison MM,Kelley J,Sarma P,Katz A

    更新日期:2020-12-08 00:00:00

  • Recruiting former melanoma patients via hospitals in comparison to office-based dermatologists in a register-based cohort study that required indirect contact.

    abstract:BACKGROUND:There are detailed reviews about different recruitment strategies, but not with regard to differences between recruitment of hospital-based versus office-based physicians. Within this study, the two different recruitment schemes are compared. Advantages and disadvantages of different ways of recruitment in r...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0425-2

    authors: Zeissig SR,Weyer-Elberich V,Emrich K,Binder H,Fischbeck S,Imruck BH,Friedrich-Mai P,Beutel ME,Blettner M

    更新日期:2017-11-22 00:00:00

  • Power and sample size determination for the group comparison of patient-reported outcomes using the Rasch model: impact of a misspecification of the parameters.

    abstract:BACKGROUND:Patient-reported outcomes (PRO) are important as endpoints in clinical trials and epidemiological studies. Guidelines for the development of PRO instruments and analysis of PRO data have emphasized the need to report methods used for sample size planning. The Raschpower procedure has been proposed for sample...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-015-0011-4

    authors: Blanchin M,Guilleux A,Perrot B,Bonnaud-Antignac A,Hardouin JB,Sébille V

    更新日期:2015-03-15 00:00:00

  • Optimising the use of electronic health records to estimate the incidence of rheumatoid arthritis in primary care: what information is hidden in free text?

    abstract:BACKGROUND:Primary care databases are a major source of data for epidemiological and health services research. However, most studies are based on coded information, ignoring information stored in free text. Using the early presentation of rheumatoid arthritis (RA) as an exemplar, our objective was to estimate the exten...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-105

    authors: Ford E,Nicholson A,Koeling R,Tate A,Carroll J,Axelrod L,Smith HE,Rait G,Davies KA,Petersen I,Williams T,Cassell JA

    更新日期:2013-08-21 00:00:00

  • Eliciting parental support for the use of newborn blood spots for pediatric research.

    abstract:BACKGROUND:Biomarkers of exposures such as infection or environmental chemicals can be measured in small volumes of blood extracted from newborn dried blood spots (DBS) underscoring their potential utility for population-based research. However, few studies have evaluated the feasibility and utility of this resource; p...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0120-8

    authors: Yeung EH,Louis GB,Lawrence D,Kannan K,McLain AC,Caggana M,Druschel C,Bell E

    更新日期:2016-02-04 00:00:00

  • National weighting of data from the Behavioral Risk Factor Surveillance System (BRFSS).

    abstract:BACKGROUND:The Behavioral Risk Factor Surveillance System (BRFSS) is a network of health-related telephone surveys--conducted by all 50 states, the District of Columbia, and participating US territories-that receive technical assistance from CDC. Data users often aggregate BRFSS state samples for national estimates wit...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0255-7

    authors: Iachan R,Pierannunzi C,Healey K,Greenlund KJ,Town M

    更新日期:2016-11-15 00:00:00

  • Bias due to censoring of deaths when calculating extra length of stay for patients acquiring a hospital infection.

    abstract:BACKGROUND:In many studies the information of patients who are dying in the hospital is censored when examining the change in length of hospital stay (cLOS) due to hospital-acquired infections (HIs). While appropriate estimators of cLOS are available in literature, the existence of the bias due to censoring of deaths w...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-018-0500-3

    authors: Rahman S,von Cube M,Schumacher M,Wolkewitz M

    更新日期:2018-05-30 00:00:00

  • Reliability of the modified child and adolescent physical activity and nutrition survey, physical activity (CAPANS-PA) questionnaire among Chinese-Australian youth.

    abstract:BACKGROUND:Evidence suggests that differences exist in physical activity (PA) participation among Culturally and Linguistically Diverse (CALD) children and adolescents. It is possible that these differences could be influenced by variations in measurement technique and instrument reliability. However, culturally sensit...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-122

    authors: Strugnell C,Renzaho A,Ridley K,Burns C

    更新日期:2011-08-25 00:00:00

  • Measurement and control of bias in patient reported outcomes using multidimensional item response theory.

    abstract:BACKGROUND:Patient-reported outcome (PRO) measures play a key role in the advancement of patient-centered care research. The accuracy of inferences, relevance of predictions, and the true nature of the associations made with PRO data depend on the validity of these measures. Errors inherent to self-report measures can ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0161-z

    authors: Dowling NM,Bolt DM,Deng S,Li C

    更新日期:2016-05-26 00:00:00

  • Does the association between adherence to statin medications and mortality depend on measurement approach? A retrospective cohort study.

    abstract:BACKGROUND:The aim of this study was to examine the relationship between mortality and statin adherence using two different approaches to adherence measurement (summary versus repeated-measures). METHODS:A retrospective cohort study was conducted using administrative data from Saskatchewan, Canada between 1994 and 200...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0339-z

    authors: Alsabbagh MW,Eurich D,Lix LM,Wilson TW,Blackburn DF

    更新日期:2017-04-20 00:00:00

  • Comparison of sample characteristics in two pregnancy cohorts: community-based versus population-based recruitment methods.

    abstract:BACKGROUND:One of the biggest challenges for population health studies is the recruitment of participants. Questions that investigators have asked are "who volunteers for studies?" and "does recruitment method influence characteristics of the samples?" The purpose of this paper was to compare sample characteristics of ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-149

    authors: Leung BM,McDonald SW,Kaplan BJ,Giesbrecht GF,Tough SC

    更新日期:2013-12-06 00:00:00

  • A systematic survey shows that reporting and handling of missing outcome data in networks of interventions is poor.

    abstract:BACKGROUND:To provide empirical evidence about prevalence, reporting and handling of missing outcome data in systematic reviews with network meta-analysis and acknowledgement of their impact on the conclusions. METHODS:We conducted a systematic survey including all published systematic reviews of randomized controlled...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-018-0576-9

    authors: Spineli LM,Yepes-Nuñez JJ,Schünemann HJ

    更新日期:2018-10-24 00:00:00

  • The efficiency and effectiveness of utilizing diagrams in interviews: an assessment of participatory diagramming and graphic elicitation.

    abstract:BACKGROUND:This paper focuses on measuring the efficiency and effectiveness of two diagramming methods employed in key informant interviews with clinicians and health care administrators. The two methods are 'participatory diagramming', where the respondent creates a diagram that assists in their communication of answe...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-8-53

    authors: Umoquit MJ,Dobrow MJ,Lemieux-Charles L,Ritvo PG,Urbach DR,Wodchis WP

    更新日期:2008-08-08 00:00:00

  • Use of re-randomized data in meta-analysis.

    abstract:BACKGROUND:Outcomes collected in randomized clinical trials are observations of random variables that should be independent and identically distributed. However, in some trials, the patients are randomized more than once thus violating both of these assumptions. The probability of an event is not always the same when a...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-5-17

    authors: Hozo I,Djulbegovic B,Clark O,Lyman GH

    更新日期:2005-05-10 00:00:00

  • Positive predictive value of a case definition for diabetes mellitus using automated administrative health data in children and youth exposed to antipsychotic drugs or control medications: a Tennessee Medicaid study.

    abstract:BACKGROUND:We developed and validated an automated database case definition for diabetes in children and youth to facilitate pharmacoepidemiologic investigations of medications and the risk of diabetes. METHODS:The present study was part of an in-progress retrospective cohort study of antipsychotics and diabetes in Te...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-128

    authors: Bobo WV,Cooper WO,Stein CM,Olfson M,Mounsey J,Daugherty J,Ray WA

    更新日期:2012-08-24 00:00:00

  • Comparison of confidence interval methods for an intra-class correlation coefficient (ICC).

    abstract:BACKGROUND:The intraclass correlation coefficient (ICC) is widely used in biomedical research to assess the reproducibility of measurements between raters, labs, technicians, or devices. For example, in an inter-rater reliability study, a high ICC value means that noise variability (between-raters and within-raters) is...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-14-121

    authors: Ionan AC,Polley MY,McShane LM,Dobbin KK

    更新日期:2014-11-22 00:00:00

  • Impact of preconception enrollment on birth enrollment and timing of exposure assessment in the initial vanguard cohort of the U.S. National Children's Study.

    abstract:BACKGROUND:The initial vanguard cohort of the U.S. National Children's Study was a pregnancy and birth cohort study that sought to enroll some women prior to pregnancy, and to assess exposures early in pregnancy. METHODS:During the recruitment phase (2009-2010), geographically based sampling was used to recruit women ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-015-0067-1

    authors: Stanford JB,Brenner R,Fetterer D,Palmer L,Schoendorf KC,U.S. National Children’s Study.

    更新日期:2015-09-24 00:00:00

  • Interpreter proxy versus healthcare interpreter for administration of patient surveys following arthroplasty: a pilot study.

    abstract:BACKGROUND:Clinical quality registries and other systems that conduct routine post-discharge surveillance of patient outcomes following surgery may have difficulty surveying patients who have limited proficiency in the language of the healthcare provider. Interpreter proxies (family and carers) are often used due to li...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0854-1

    authors: Xue D,Churches T,Armstrong E,Mittal R,Naylor JM,Harris IA

    更新日期:2019-11-14 00:00:00

  • Integrating and extending cohort studies: lessons from the eXtending Treatments, Education and Networks in Depression (xTEND) study.

    abstract:BACKGROUND:Epidemiologic studies often struggle to adequately represent populations and outcomes of interest. Differences in methodology, data analysis and research questions often mean that reviews and synthesis of the existing literature have significant limitations. The current paper details our experiences in combi...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-122

    authors: Allen J,Inder KJ,Lewin TJ,Attia JR,Kay-Lambkin FJ,Baker AL,Hazell T,Kelly BJ

    更新日期:2013-10-05 00:00:00

  • A methodological systematic review of what's wrong with meta-ethnography reporting.

    abstract:BACKGROUND:Syntheses of qualitative studies can inform health policy, services and our understanding of patient experience. Meta-ethnography is a systematic seven-phase interpretive qualitative synthesis approach well-suited to producing new theories and conceptual models. However, there are concerns about the quality ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/1471-2288-14-119

    authors: France EF,Ring N,Thomas R,Noyes J,Maxwell M,Jepson R

    更新日期:2014-11-19 00:00:00

  • Random allocation software for parallel group randomized trials.

    abstract:BACKGROUND:Typically, randomization software should allow users to exert control over the different aspects of randomization including block design, provision of unique identifiers and control over the format and type of program output. While some of these characteristics have been addressed by available software, none...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-4-26

    authors: Saghaei M

    更新日期:2004-11-09 00:00:00

  • Modern modelling techniques are data hungry: a simulation study for predicting dichotomous endpoints.

    abstract:BACKGROUND:Modern modelling techniques may potentially provide more accurate predictions of binary outcomes than classical techniques. We aimed to study the predictive performance of different modelling techniques in relation to the effective sample size ("data hungriness"). METHODS:We performed simulation studies bas...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-14-137

    authors: van der Ploeg T,Austin PC,Steyerberg EW

    更新日期:2014-12-22 00:00:00

  • Validation of death prediction after breast cancer relapses using joint models.

    abstract:BACKGROUND:Cancer relapses may be useful to predict the risk of death. To take into account relapse information, the Landmark approach is popular. As an alternative, we propose the joint frailty model for a recurrent event and a terminal event to derive dynamic predictions of the risk of death. METHODS:The proposed pr...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-015-0018-x

    authors: Mauguen A,Rachet B,Mathoulin-Pélissier S,Lawrence GM,Siesling S,MacGrogan G,Laurent A,Rondeau V

    更新日期:2015-04-01 00:00:00

  • The impact of varying cluster size in cross-sectional stepped-wedge cluster randomised trials.

    abstract:BACKGROUND:Cluster randomised trials with unequal sized clusters often have lower precision than with clusters of equal size. To allow for this, sample sizes are inflated by a modified version of the design effect for clustering. These inflation factors are valid under the assumption that randomisation is stratified by...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0760-6

    authors: Martin JT,Hemming K,Girling A

    更新日期:2019-06-14 00:00:00

  • Dealing with missing data in a multi-question depression scale: a comparison of imputation methods.

    abstract:BACKGROUND:Missing data present a challenge to many research projects. The problem is often pronounced in studies utilizing self-report scales, and literature addressing different strategies for dealing with missing data in such circumstances is scarce. The objective of this study was to compare six different imputatio...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-6-57

    authors: Shrive FM,Stuart H,Quan H,Ghali WA

    更新日期:2006-12-13 00:00:00

  • Sample size calculations for cluster randomised controlled trials with a fixed number of clusters.

    abstract:BACKGROUND:Cluster randomised controlled trials (CRCTs) are frequently used in health service evaluation. Assuming an average cluster size, required sample sizes are readily computed for both binary and continuous outcomes, by estimating a design effect or inflation factor. However, where the number of clusters are fix...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-102

    authors: Hemming K,Girling AJ,Sitch AJ,Marsh J,Lilford RJ

    更新日期:2011-06-30 00:00:00