Abstract:
BACKGROUND:Methods for describing one's confidence in the available evidence are useful for end-users of evidence reviews. Analysts inevitably make judgments about the quality, quantity consistency, robustness, and magnitude of effects observed in the studies identified. The subjectivity of these judgments in several areas underscores the need for transparency in judgments. DISCUSSION:This paper introduces a new system for rating medical evidence. The system requires explicit judgments and provides explicit rules for balancing these judgments. Unlike other systems for rating the strength of evidence, our system draws a distinction between two types of conclusions: quantitative and qualitative. A quantitative conclusion addresses the question, "How well does it work?", whereas a qualitative conclusion addresses the question, "Does it work?" In our system, quantitative conclusions are tied to stability ratings, and qualitative conclusions are tied to strength ratings. Our system emphasizes extensive a priori criteria for judgments to reduce the potential for bias. Further, the system makes explicit the impact of heterogeneity testing, meta-analysis, and sensitivity analyses on evidence ratings. This article provides details of our system, including graphical depictions of how the numerous judgments that an analyst makes can be combined. We also describe two worked examples of how the system can be applied to both interventional and diagnostic technologies. SUMMARY:Although explicit judgments and formal combination rules are two important steps on the path to a comprehensive system for rating medical evidence, many additional steps must also be taken. Foremost among these are the distinction between quantitative and qualitative conclusions, an extensive set of a priori criteria for making judgments, and the direct impact of analytic results on evidence ratings. These attributes form the basis for a logically consistent system that can improve the usefulness of evidence reviews.
journal_name
BMC Med Res Methodoljournal_title
BMC medical research methodologyauthors
Treadwell JR,Tregear SJ,Reston JT,Turkelson CMdoi
10.1186/1471-2288-6-52subject
Has Abstractpub_date
2006-10-19 00:00:00pages
52issn
1471-2288pii
1471-2288-6-52journal_volume
6pub_type
杂志文章abstract:BACKGROUND:Few studies have compared methods to correct for retest effects or practice effects in settings where an acute event could influence test performance, such as major surgery. Our goal in this study was to evaluate the use of different methods to correct for the effects of practice or retest on repeated test a...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-018-0530-x
更新日期:2018-07-03 00:00:00
abstract:BACKGROUND:Randomised controlled trials (RCTs) are the gold standard for evidence-based practice. However, RCTs can have limitations. For example, translation of findings into practice can be limited by design features, such as inclusion criteria, not accurately reflecting clinical populations. In addition, it is expen...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-020-01078-9
更新日期:2020-07-25 00:00:00
abstract:BACKGROUND:The BSI-18 contains the three six-item scales somatization, depression, and anxiety as well as the Global Severity Index (GSI), including all 18 items. The BSI-18 is the latest and shortest of the multidimensional versions of the Symptom-Checklist 90-R, but its psychometric properties have not been sufficien...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-016-0283-3
更新日期:2017-01-26 00:00:00
abstract:BACKGROUND:Statistical time series derived from administrative data sets form key indicators in measuring progress in addressing disadvantage in Aboriginal and Torres Strait Islander populations in Australia. However, inconsistencies in the reporting of Indigenous status can cause difficulties in producing reliable ind...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/1471-2288-12-90
更新日期:2012-07-02 00:00:00
abstract:BACKGROUND:When discussing results medical research articles often tear substantive and statistical (methodical) contributions apart, just as if both were independent. Consequently, reasoning on bias tends to be vague, unclear and superficial. This can lead to over-generalized, too narrow and misleading conclusions, es...
journal_title:BMC medical research methodology
pub_type: 杂志文章,评审
doi:10.1186/s12874-018-0490-1
更新日期:2018-04-17 00:00:00
abstract:BACKGROUND:Posttraumatic growth is the positive change resulting from traumatic experiences and is typically assessed with retrospective measures like the Posttraumatic Growth Inventory (PTGI). The PTGI was designed to include reference to a specific traumatic event, making it difficult to implement, without change, in...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-017-0344-2
更新日期:2017-04-20 00:00:00
abstract:BACKGROUND:E1684 was the pivotal adjuvant melanoma trial for establishment of high-dose interferon (IFN) as effective therapy of high-risk melanoma patients. E1690 was an intriguing effort to corroborate E1684, and the differences between the outcomes of these trials have embroiled the field in controversy over the pas...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/1471-2288-12-183
更新日期:2012-11-29 00:00:00
abstract:BACKGROUND:Controlled clinical trials of health care interventions are either explanatory or pragmatic. Explanatory trials test whether an intervention is efficacious; that is, whether it can have a beneficial effect in an ideal situation. Pragmatic trials measure effectiveness; they measure the degree of beneficial ef...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/1471-2288-3-28
更新日期:2003-12-22 00:00:00
abstract:BACKGROUND:Identifying and assessing degree and type of frailty among older persons is a major challenge when targeting high risk populations to identify preventive interventions. The Vulnerable Elders Survey-(VES-13) is a simple instrument to identify frailty defined as risk for death, functional decline or institutio...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-020-0910-x
更新日期:2020-02-05 00:00:00
abstract:BACKGROUND:Defeat and entrapment have been shown to be of central relevance to the development of different disorders. However, it remains unclear whether they represent two distinct constructs or one overall latent variable. One reason for the unclarity is that traditional factor analytic techniques have trouble estim...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-018-0470-5
更新日期:2018-01-25 00:00:00
abstract:BACKGROUND:Data on lifetime exposures are often self-reported in epidemiologic studies, sometimes many years after the relevant age. Validity of self-reported data is usually inferred from their agreement with measured values, but few studies directly quantify the likely effects of reporting errors in body size and rep...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/1471-2288-11-7
更新日期:2011-01-17 00:00:00
abstract:BACKGROUND:The Computer Adaptive Test version of the Community Reintegration of Injured Service Members measure (CRIS-CAT) consists of three scales measuring Extent of, Perceived Limitations in, and Satisfaction with community integration. The CRIS-CAT was developed using item response theory methods. The purposes of t...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/1471-2288-12-145
更新日期:2012-09-17 00:00:00
abstract:BACKGROUND:Patient-reported outcomes (PRO) are important as endpoints in clinical trials and epidemiological studies. Guidelines for the development of PRO instruments and analysis of PRO data have emphasized the need to report methods used for sample size planning. The Raschpower procedure has been proposed for sample...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-015-0011-4
更新日期:2015-03-15 00:00:00
abstract:BACKGROUND:Diabetes-related lower limb amputations are associated with considerable morbidity and mortality and are usually preceded by foot ulceration. The available systematic reviews of aggregate data are compromised because the primary studies report both adjusted and unadjusted estimates. As adjusted meta-analyses...
journal_title:BMC medical research methodology
pub_type: 杂志文章,meta分析
doi:10.1186/1471-2288-13-22
更新日期:2013-02-15 00:00:00
abstract:BACKGROUND:With the increasing implementation of web-based, mobile health interventions in clinical trials, it is crucial for researchers to address the security and privacy concerns of patient information according to high ethical standards. The full process of meeting these standards is often made more complicated du...
journal_title:BMC medical research methodology
pub_type: 社论
doi:10.1186/s12874-017-0324-6
更新日期:2017-03-17 00:00:00
abstract:BACKGROUND:While randomised controlled trials (RCTs) provide high-quality evidence to guide practice, much routine care is not based upon available RCTs. This disconnect between evidence and practice is not sufficiently well understood. This case study explores this relationship using a novel approach. Better understan...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-020-01009-8
更新日期:2020-05-12 00:00:00
abstract:BACKGROUND:Many medicines are dosed to achieve a particular therapeutic range, and monitored using therapeutic drug monitoring (TDM). The evidence base for a therapeutic range can be evaluated using systematic reviews, to ensure it continues to reflect current indications, doses, routes and formulations, as well as upd...
journal_title:BMC medical research methodology
pub_type: 杂志文章,评审
doi:10.1186/s12874-017-0363-z
更新日期:2017-06-02 00:00:00
abstract:BACKGROUND:Clinical study reports (CSRs) have been increasingly utilised within academic research in recent years. European Medicines Agency (EMA) Policy 0070 'Phase 1,' which came into effect in January 2015, requires the publication of regulatory documents such as CSRs from central applications in an anonymised forma...
journal_title:BMC medical research methodology
pub_type: 杂志文章,评审
doi:10.1186/s12874-019-0836-3
更新日期:2019-11-05 00:00:00
abstract:BACKGROUND:Discrete Choice Experiments (DCEs) are increasingly used in studies in healthcare research but there is still little empirical evidence for the predictive value of these hypothetical situations in similar real life circumstances. The aim of this paper is to compare the stated preferences in a DCE and the acc...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-015-0010-5
更新日期:2015-03-12 00:00:00
abstract:BACKGROUND:The health regulatory focus is an application of Higgins' regulatory focus theory to a health-specific context. It explains individual differences in health motivation, strategies, and behavior. Previous research found the Health Regulatory Focus Scale (HRFS) to be a reliable and valid measure for the constr...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-020-00927-x
更新日期:2020-03-02 00:00:00
abstract:BACKGROUND:Studies examining incident heart failure (HF) have been limited to select populations. To examine incident HF with broader generalizability, there is need to assemble a HF-free cohort using a geographically-diverse sample. We aimed to develop and validate a simple medication-based strategy for assembling a H...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-019-0890-x
更新日期:2020-03-04 00:00:00
abstract:BACKGROUND:The construction of prediction intervals (PIs) for future body mass index (BMI) values of individual children based on a recent German birth cohort study with n = 2007 children is problematic for standard parametric approaches, as the BMI distribution in childhood is typically skewed depending on age. METHO...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/1471-2288-12-6
更新日期:2012-01-25 00:00:00
abstract:BACKGROUND:Health researchers undertake studies which combine qualitative and quantitative methods. Little attention has been paid to the structural issues affecting this mixed methods approach. We explored the facilitators and barriers to undertaking mixed methods studies in health research. METHODS:Face-to-face semi...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/1471-2288-9-82
更新日期:2009-12-09 00:00:00
abstract:BACKGROUND:The collection of individual-level pandemic (H1N1) 2009 influenza immunization data was considered important to facilitate optimal vaccine delivery and accurate assessment of vaccine coverage. These data are also critical for research aimed at evaluating the new vaccine's safety and effectiveness. Systems us...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/1471-2288-10-51
更新日期:2010-06-08 00:00:00
abstract:BACKGROUND:In recent months, multiple efforts have sought to characterize COVID-19 social distancing policy responses. These efforts have used various coding frameworks, but many have relied on coding methodologies that may not adequately describe the gradient in social distancing policies as states "re-open." METHODS...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-020-01174-w
更新日期:2020-12-08 00:00:00
abstract:BACKGROUND:International clinical trials are now rapidly expanding into Asia. However, the proportion of global trials is higher in South Korea compared to Japan despite implementation of similar governmental support in both countries. The difference in clinical trial environment might influence the respective physicia...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/1471-2288-13-130
更新日期:2013-10-25 00:00:00
abstract:BACKGROUND:Sleeping under a long-lasting insecticidal net (LLIN) is recommended for all pregnant women in sub-Saharan Africa, due to the high prevalence of malaria infection and its associated complications in the region. Despite this, LLIN use has still remained sub-optimal among pregnant women in Maiduguri, Nigeria. ...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-019-0803-z
更新日期:2019-07-18 00:00:00
abstract:BACKGROUND:Diagnostic tests are performed in a subset of the population who are at higher risk, resulting in undiagnosed cases among those who do not receive the test. This poses a challenge for estimating the prevalence of the disease in the study population, and also for studying the risk factors for the disease. ME...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-017-0447-9
更新日期:2017-12-12 00:00:00
abstract:BACKGROUND:The mechanisms and pathways to impacts from public health research in the UK have not been widely studied. Through the lens of one funder (NIHR), our aims are to map the diversity of public health research, in terms of funding mechanisms, disciplinary contributions, and public health impacts, identify exampl...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/s12874-020-0905-7
更新日期:2020-02-19 00:00:00
abstract:BACKGROUND:Systematic reviews (SRs) must be of high quality. The purpose of our research was to compare the methodological and reporting quality of original versus updated Cochrane SRs to determine whether updating had improved these two quality dimensions. METHODS:We identified updated Cochrane SRs published in issue...
journal_title:BMC medical research methodology
pub_type: 杂志文章
doi:10.1186/1471-2288-6-27
更新日期:2006-06-13 00:00:00