An exploration of how developers use qualitative evidence: content analysis and critical appraisal of guidelines.

Abstract:

BACKGROUND:Clinical practice guidelines have become increasingly widely used to guide quality improvement of clinical practice. Qualitative research may be a useful way to improve the quality and implementation of guidelines. The methodology for qualitative evidence used in guidelines development is worthy of further research. METHODS:A comprehensive search was made of WHO, NICE, SIGN, NGC, RNAO, PubMed, Embase, Web of Science, CNKI, Wanfang, CBM, and VIP from January 1, 2011 to February 25, 2020. Guidelines which met IOM criteria and were focused on clinical questions using qualitative research or qualitative evidence, were included. Four authors extracted significant information and entered this onto data extraction forms. The Appraisal of Guidelines for Research and Evaluation (AGREE II) tool was used to evaluate the guidelines' quality. The data were analyzed using SPSS version 17.0 and R version 3.3.2. RESULTS:Sixty four guidelines were identified. The overall quality of the guidelines was high (almost over 60%). Domain 1 (Scope and Purpose) was ranked the highest with a median score of 83% (IQ 78-83). Domain 2 (Stakeholder involvement) and Domain 5 (Applicability) were ranked the lowest with median scores of 67% (IQ 67-78) and 67% (IQ 63-73) respectively. 20% guidelines used qualitative research to identify clinical questions. 86% guidelines used qualitative evidence to support recommendations (mainly based on primary studies, a few on qualitative evidence synthesis). 19% guidelines applied qualitative evidence when considering facilitators and barriers to recommendations' implementation. 52% guideline developers evaluated the quality of the primary qualitative research study using the CASP tool or NICE checklist for qualitative studies. No guidelines evaluated the quality of qualitative evidence synthesis to formulate recommendations. 17% guidelines presented the level of qualitative research using the grade criteria of evidence and recommendation in different forms such as I, III, IV, very low. 28% guidelines described the grades of the recommendations supported by qualitative and quantitative evidence. No guidelines described the grade of recommendations only supported by qualitative evidence. CONCLUSIONS:The majority of the included guidelines were high-quality. Qualitative evidence was mainly used to identify clinical questions, support recommendations, and consider facilitators and barriers to implementation of recommendations'. However, more attention needs to be paid to the methodology. For example, no experts proficient in qualitative research were involved in guideline development groups, no assessment of the quality of qualitative evidence synthesis was included and there was lack of details reported on the level of qualitative evidence or grade of recommendations.

journal_name

BMC Med Res Methodol

authors

Wang YY,Liang DD,Lu C,Shi YX,Zhang J,Cao Y,Fang C,Huang D,Jin YH

doi

10.1186/s12874-020-01041-8

subject

Has Abstract

pub_date

2020-06-17 00:00:00

pages

160

issue

1

issn

1471-2288

pii

10.1186/s12874-020-01041-8

journal_volume

20

pub_type

杂志文章
  • Resuming the discussion of AMSTAR: What can (should) be made better?

    abstract:BACKGROUND:Evidence syntheses, and in particular systematic reviews (SRs), have become one of the cornerstones of evidence-based health care. The Assessment of Multiple Systematic Reviews (AMSTAR) tool has become the most widely used tool for investigating the methodological quality of SRs and is currently undergoing r...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0183-6

    authors: Wegewitz U,Weikert B,Fishta A,Jacobs A,Pieper D

    更新日期:2016-08-26 00:00:00

  • Study protocol: the empirical investigation of methods to correct for measurement error in biobanks with dietary assessment.

    abstract:BACKGROUND:The Public Population Project in Genomics (P3G) is an organisation that aims to promote collaboration between researchers in the field of population-based genomics. The main objectives of P3G are to encourage collaboration between researchers and biobankers, optimize study design, promote the harmonization o...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-135

    authors: Bennett DA,Little J,Masson LF,Minelli C

    更新日期:2011-10-05 00:00:00

  • The new COSMIN guidelines confront traditional concepts of responsiveness.

    abstract::The recently published "COSMIN" guidelines aim to rate properties of outcome instruments and state two issues with regard to responsiveness which is the instrument's ability to detect change over time. These issues are comparison of score changes with change of an external criterion using correlations and the judgemen...

    journal_title:BMC medical research methodology

    pub_type: 评论,信件

    doi:10.1186/1471-2288-11-152

    authors: Angst F

    更新日期:2011-11-18 00:00:00

  • The triple variable index combines information generated over time from common monitoring variables to identify patients expressing distinct patterns of intraoperative physiology.

    abstract:BACKGROUND:Mean arterial pressure (MAP), bispectral index (BIS), and minimum alveolar concentration (MAC) represent valuable, yet dynamic intraoperative monitoring variables. They provide information related to poor outcomes when considered together, however their collective behavior across time has not been characteri...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0660-9

    authors: Schnetz MP,Hochheiser HS,Danks DJ,Landsittel DP,Vogt KM,Ibinson JW,Whitehurst SL,McDermott SP,Duque MG,Kaynar AM

    更新日期:2019-01-14 00:00:00

  • Getting under the skin of the primary care consultation using video stimulated recall: a systematic review.

    abstract:BACKGROUND:Video stimulated recall (VSR) is a method of enhancing participants' accounts of the consultation using a video recording of the event to encourage and prompt recall in a post consultation interview. VSR is used in education and education research, and to a lesser extent in medical and nursing research. Litt...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/1471-2288-14-101

    authors: Paskins Z,McHugh G,Hassell AB

    更新日期:2014-08-30 00:00:00

  • Does it matter whether the recipient of patient questionnaires in general practice is the general practitioner or an independent researcher? The REPLY randomised trial.

    abstract:BACKGROUND:Self-administered questionnaires are becoming increasingly common in general practice. Much research has explored methods to increase response rates but comparatively few studies have explored the effect of questionnaire administration on reported answers. METHODS:The aim of this study was to determine the ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/1471-2288-8-42

    authors: Desborough JA,Butters P,Bhattacharya D,Holland RC,Wright DJ

    更新日期:2008-06-27 00:00:00

  • Validating and updating a risk model for pneumonia - a case study.

    abstract:BACKGROUND:The development of risk prediction models is of increasing importance in medical research - their use in practice, however, is rare. Among other reasons this might be due to the fact that thorough validation is often lacking. This study focuses on two Bayesian approaches of how to validate a prediction rule ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-99

    authors: Held U,Bové DS,Steurer J,Held L

    更新日期:2012-07-20 00:00:00

  • Good agreement between questionnaire and administrative databases for health care use and costs in patients with osteoarthritis.

    abstract:BACKGROUND:Estimating costs is essential to the economic analysis of health care programs. Health care costs are often captured from administrative databases or by patient report. Administrative records only provide a partial representation of health care costs and have additional limitations. Patient-completed questio...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-45

    authors: Pinto D,Robertson MC,Hansen P,Abbott JH

    更新日期:2011-04-13 00:00:00

  • Health Equity Assessment Toolkit (HEAT): software for exploring and comparing health inequalities in countries.

    abstract:BACKGROUND:It is widely recognised that the pursuit of sustainable development cannot be accomplished without addressing inequality, or observed differences between subgroups of a population. Monitoring health inequalities allows for the identification of health topics where major group differences exist, dimensions of...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0229-9

    authors: Hosseinpoor AR,Nambiar D,Schlotheuber A,Reidpath D,Ross Z

    更新日期:2016-10-19 00:00:00

  • Psychometric properties of an English short version of the Trier Inventory for chronic Stress.

    abstract:BACKGROUND:Although a variety of instruments are available that capture stress experience, the assessment of chronic stress has been hindered by the lack of economical screening instruments. Recently, an English-language version of the Trier Inventory for Chronic Stress (TICS-EN) consisting of 57 items according to a s...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01156-y

    authors: Petrowski K,Braehler E,Schmalbach B,Hinz A,Bastianon C,Ritz T

    更新日期:2020-12-16 00:00:00

  • Interpreter proxy versus healthcare interpreter for administration of patient surveys following arthroplasty: a pilot study.

    abstract:BACKGROUND:Clinical quality registries and other systems that conduct routine post-discharge surveillance of patient outcomes following surgery may have difficulty surveying patients who have limited proficiency in the language of the healthcare provider. Interpreter proxies (family and carers) are often used due to li...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0854-1

    authors: Xue D,Churches T,Armstrong E,Mittal R,Naylor JM,Harris IA

    更新日期:2019-11-14 00:00:00

  • Incomplete evidence: the inadequacy of databases in tracing published adverse drug reactions in clinical trials.

    abstract:BACKGROUND:We would expect information on adverse drug reactions in randomised clinical trials to be easily retrievable from specific searches of electronic databases. However, complete retrieval of such information may not be straightforward, for two reasons. First, not all clinical drug trials provide data on the fre...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-1-7

    authors: Derry S,Loke YK,Aronson JK

    更新日期:2001-01-01 00:00:00

  • Development of an integrative coding framework for evaluating context within implementation science.

    abstract:BACKGROUND:This research aims to explore an identified gap in implementation science methodology, that is, how to assess context in implementation research. Context is among the strongest influences on implementation success but is a construct that is poorly understood and reported within the literature. Consequently, ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01044-5

    authors: Rogers L,De Brún A,McAuliffe E

    更新日期:2020-06-15 00:00:00

  • Recruiting former melanoma patients via hospitals in comparison to office-based dermatologists in a register-based cohort study that required indirect contact.

    abstract:BACKGROUND:There are detailed reviews about different recruitment strategies, but not with regard to differences between recruitment of hospital-based versus office-based physicians. Within this study, the two different recruitment schemes are compared. Advantages and disadvantages of different ways of recruitment in r...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0425-2

    authors: Zeissig SR,Weyer-Elberich V,Emrich K,Binder H,Fischbeck S,Imruck BH,Friedrich-Mai P,Beutel ME,Blettner M

    更新日期:2017-11-22 00:00:00

  • The rise of multiple imputation: a review of the reporting and implementation of the method in medical research.

    abstract:BACKGROUND:Missing data are common in medical research, which can lead to a loss in statistical power and potentially biased results if not handled appropriately. Multiple imputation (MI) is a statistical method, widely adopted in practice, for dealing with missing data. Many academic journals now emphasise the importa...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/s12874-015-0022-1

    authors: Hayati Rezvan P,Lee KJ,Simpson JA

    更新日期:2015-04-07 00:00:00

  • Protecting patient privacy when sharing patient-level data from clinical trials.

    abstract:BACKGROUND:Greater transparency and, in particular, sharing of patient-level data for further scientific research is an increasingly important topic for the pharmaceutical industry and other organisations who sponsor and conduct clinical trials as well as generally in the interests of patients participating in studies....

    journal_title:BMC medical research methodology

    pub_type: 信件

    doi:10.1186/s12874-016-0169-4

    authors: Tucker K,Branson J,Dilleen M,Hollis S,Loughlin P,Nixon MJ,Williams Z

    更新日期:2016-07-08 00:00:00

  • Imputation of a true endpoint from a surrogate: application to a cluster randomized controlled trial with partial information on the true endpoint.

    abstract:BACKGROUND:The Anglia Menorrhagia Education Study (AMES) is a randomized controlled trial testing the effectiveness of an education package applied to general practices. Binary data are available from two sources; general practitioner reported referrals to hospital, and referrals to hospital determined by independent a...

    journal_title:BMC medical research methodology

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1186/1471-2288-3-17

    authors: Nixon RM,Duffy SW,Fender GR

    更新日期:2003-09-24 00:00:00

  • Bayes factors for superiority, non-inferiority, and equivalence designs.

    abstract:BACKGROUND:In clinical trials, study designs may focus on assessment of superiority, equivalence, or non-inferiority, of a new medicine or treatment as compared to a control. Typically, evidence in each of these paradigms is quantified with a variant of the null hypothesis significance test. A null hypothesis is assume...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0699-7

    authors: van Ravenzwaaij D,Monden R,Tendeiro JN,Ioannidis JPA

    更新日期:2019-03-29 00:00:00

  • Exploratory trials, confirmatory observations: a new reasoning model in the era of patient-centered medicine.

    abstract:BACKGROUND:The prevailing view in therapeutic clinical research today is that observational studies are useful for generating new hypotheses and that controlled experiments (i.e., randomized clinical trials, RCTs) are the most appropriate method for assessing and confirming the efficacy of interventions. DISCUSSION:Th...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-57

    authors: Sacristán JA

    更新日期:2011-04-25 00:00:00

  • Barriers and facilitators to patient recruitment to a cluster randomized controlled trial in primary care: lessons for future trials.

    abstract:BACKGROUND:Primary-care based randomized controlled trials (RCTs) build an important evidence base for general practice but little evidence exists about barriers to recruitment which often hamper such trials. We investigated the issues that impeded and facilitated recruitment to a clinical trial in general practice. M...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-015-0012-3

    authors: Foster JM,Sawyer SM,Smith L,Reddel HK,Usherwood T

    更新日期:2015-03-12 00:00:00

  • Reliability, validity and administrative burden of the community reintegration of injured service members computer adaptive test (CRIS-CAT)".

    abstract:BACKGROUND:The Computer Adaptive Test version of the Community Reintegration of Injured Service Members measure (CRIS-CAT) consists of three scales measuring Extent of, Perceived Limitations in, and Satisfaction with community integration. The CRIS-CAT was developed using item response theory methods. The purposes of t...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-145

    authors: Resnik L,Borgia M,Ni P,Pirraglia PA,Jette A

    更新日期:2012-09-17 00:00:00

  • Regional differences in the validity of self-reported use of health care in Belgium: selection versus reporting bias.

    abstract:BACKGROUND:The Health Care Module of the European Health Interview Survey (EHIS) is aimed to obtain comparable information on the use of inpatient and ambulatory care in all EU member states. In this study we assessed the validity of self-reported information on the use of health care, collected through this instrument...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0198-z

    authors: Van der Heyden J,Charafeddine R,De Bacquer D,Tafforeau J,Van Herck K

    更新日期:2016-08-16 00:00:00

  • A proof of principle for using adaptive testing in Routine Outcome Monitoring: the efficiency of the Mood and Anxiety Symptoms Questionnaire -Anhedonic Depression CAT.

    abstract:BACKGROUND:In Routine Outcome Monitoring (ROM) there is a high demand for short assessments. Computerized Adaptive Testing (CAT) is a promising method for efficient assessment. In this article, the efficiency of a CAT version of the Mood and Anxiety Symptom Questionnaire, - Anhedonic Depression scale (MASQ-AD) for use ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-4

    authors: Smits N,Zitman FG,Cuijpers P,den Hollander-Gijsman ME,Carlier IV

    更新日期:2012-01-10 00:00:00

  • The challenges of recruiting cancer patient/caregiver dyads: informing randomized controlled trials.

    abstract:BACKGROUND:Family members are increasingly involved in the care of cancer patients, however many are not prepared for this challenging role. Intervention-based studies are valuable to inform the most appropriate and effective support for caregivers. Barriers in the recruitment of patient/caregiver dyads exist but the r...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,多中心研究,随机对照试验

    doi:10.1186/s12874-018-0614-7

    authors: Heckel L,Gunn KM,Livingston PM

    更新日期:2018-11-21 00:00:00

  • Investigating hospital heterogeneity with a multi-state frailty model: application to nosocomial pneumonia disease in intensive care units.

    abstract:BACKGROUND:Multistate models have become increasingly useful to study the evolution of a patient's state over time in intensive care units ICU (e.g. admission, infections, alive discharge or death in ICU). In addition, in critically-ill patients, data come from different ICUs, and because observations are clustered int...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-79

    authors: Liquet B,Timsit JF,Rondeau V

    更新日期:2012-06-15 00:00:00

  • Workplace restructurings in intervention studies - a challenge for design, analysis and interpretation.

    abstract:BACKGROUND:Interventions in occupational health often target worksites rather than individuals. The objective of this paper is to describe the (lack of) stability in units of analysis in occupational health and safety intervention projects directed toward worksites. METHODS:A case study approach is used to describe na...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-8-39

    authors: Olsen O,Albertsen K,Nielsen ML,Poulsen KB,Gron SM,Brunnberg HL

    更新日期:2008-06-13 00:00:00

  • Does the association between adherence to statin medications and mortality depend on measurement approach? A retrospective cohort study.

    abstract:BACKGROUND:The aim of this study was to examine the relationship between mortality and statin adherence using two different approaches to adherence measurement (summary versus repeated-measures). METHODS:A retrospective cohort study was conducted using administrative data from Saskatchewan, Canada between 1994 and 200...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0339-z

    authors: Alsabbagh MW,Eurich D,Lix LM,Wilson TW,Blackburn DF

    更新日期:2017-04-20 00:00:00

  • Imputation by the mean score should be avoided when validating a Patient Reported Outcomes questionnaire by a Rasch model in presence of informative missing data.

    abstract:BACKGROUND:Nowadays, more and more clinical scales consisting in responses given by the patients to some items (Patient Reported Outcomes - PRO), are validated with models based on Item Response Theory, and more specifically, with a Rasch model. In the validation sample, presence of missing data is frequent. The aim of...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-105

    authors: Hardouin JB,Conroy R,Sébille V

    更新日期:2011-07-14 00:00:00

  • Methods to increase response rates to a population-based maternity survey: a comparison of two pilot studies.

    abstract:BACKGROUND:Surveys are established methods for collecting population data that are unavailable from other sources; however, response rates to surveys are declining. A number of methods have been identified to increase survey returns yet response rates remain low. This paper evaluates the impact of five selected methods...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0702-3

    authors: Harrison S,Henderson J,Alderdice F,Quigley MA

    更新日期:2019-03-20 00:00:00

  • Comparison of confidence interval methods for an intra-class correlation coefficient (ICC).

    abstract:BACKGROUND:The intraclass correlation coefficient (ICC) is widely used in biomedical research to assess the reproducibility of measurements between raters, labs, technicians, or devices. For example, in an inter-rater reliability study, a high ICC value means that noise variability (between-raters and within-raters) is...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-14-121

    authors: Ionan AC,Polley MY,McShane LM,Dobbin KK

    更新日期:2014-11-22 00:00:00