Comparative clinical trials in psychotherapy: Have large effects been replicated?

Abstract:

AIMS:The purpose of this review is to examine the replication attempts of psychotherapy clinical trials for depression and anxiety. We focus specifically on replications of trials that exhibit large differences between psychotherapies. The replicability of these trials is especially important for meta-analysis, where the inclusion of false-positive trials can lead to erroneous conclusions about treatment efficacy. METHODS:Standard replication criteria were developed to distinguish direct from conceptual replication methodologies. Next, an exhaustive literature search was conducted for published meta-analyses of psychotherapy comparisons. Trials that exhibited large effects (d > 0.8) were culled from these meta-analyses. For each trial, a cited replication was conducted to determine if the trial had been subsequently replicated by either 'direct' or 'conceptual' methods. Finally, a broader search was conducted to examine the extent of replication efforts in the psychotherapy literature overall. RESULTS:In the meta-analytic search, a total of N = 10 meta-analyses met the inclusion criteria. From these meta-analyses, N = 12 distinct trials exhibited large effect sizes. The meta-analyses containing more than two large effect trials reported evidence for treatment superiority. A cited replication search yielded no direct replication attempts (N = 0) for the trials with large effects, and N = 4 conceptual replication attempts of average or above average quality. However, of these four attempts, only two partially corroborated the results from their original trial. CONCLUSION:Meta-analytic reviews are influenced by trials with large effects, and it is not uncommon for these reviews to contain several such trials. Since we find no evidence that trials with such large effects are directly replicable, treatment superiority conclusions from these reviews are highly questionable. To enhance the quality of clinical science, the development of authoritative replication criteria for clinical trials is needed. Moreover, quality benchmarks should be considered before trials are included in a meta-analysis, or replications are attempted.

authors

Frost ND,Baskin TW,Wampold BE

doi

10.1017/S2045796020000402

subject

Has Abstract

pub_date

2020-05-15 00:00:00

pages

e128

eissn

2045-7960

issn

2045-7979

pii

S2045796020000402

journal_volume

29

pub_type

杂志文章,meta分析,评审
  • Trends in the prevalence and disability-adjusted life years of eating disorders from 1990 to 2017: results from the Global Burden of Disease Study 2017.

    abstract:AIM:Eating disorders have increasingly become a public health concern globally. This study aimed to reveal the burden of eating disorders at the global, regional and national levels using the Global Burden of Disease (GBD) Study 2017 data. METHODS:We extracted the age-standardised rates (ASRs) of prevalence and disabi...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796020001055

    authors: Wu J,Liu J,Li S,Ma H,Wang Y

    更新日期:2020-12-07 00:00:00

  • Making mental health an integral part of sustainable development: the contribution of a social determinants framework.

    abstract::There have been repeated calls to include mental health in the sustainable development goals (SDGs), arguing that progress in development will not be made without improvements in mental health. Although these calls are starting to gain political traction, currently only a tiny fraction of international development wor...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796015000049

    authors: De Silva MJ

    更新日期:2015-04-01 00:00:00

  • Persistent and aggressive interactions with the police: potential mental health implications.

    abstract:AIMS:Little is known about the potential health impact of police encounters despite a ubiquitous police presence in many disadvantaged urban environments. In this paper, we assess whether persistent or aggressive interactions with the police are associated with poor mental health outcomes in a sample of primarily low-i...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796019000015

    authors: Hirschtick JL,Homan SM,Rauscher G,Rubin LH,Johnson TP,Peterson CE,Persky VW

    更新日期:2019-02-05 00:00:00

  • Identifying the critical time points for mental health of asylum seekers and refugees in high-income countries.

    abstract:AIMS:High heterogeneity was found in the prevalence rates of mental disorders in adult asylum seekers and refugees in high-income countries. This may be related to different problems. Among them, there is a changing exposure to risk and protective factors for mental health at different phases of these people's life bef...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S204579601900057X

    authors: Giacco D

    更新日期:2019-10-02 00:00:00

  • Understanding the characteristics and mechanisms underlying suicide clusters in Australian youth: a comparison of cluster detection methods.

    abstract:AIMS:There is currently no gold-standard definition or method for identifying suicide clusters, resulting in considerable heterogeneity in the types of suicide clusters that are detected. This study sought to identify the characteristics, mechanisms and parameters of suicide clusters using three cluster detection metho...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796020000645

    authors: Hill NTM,Too LS,Spittal MJ,Robinson J

    更新日期:2020-08-06 00:00:00

  • What does the latest meta-analysis really tell us about antidepressants?

    abstract::A recent meta-analysis of antidepressant trials is the largest conducted to date. Although it claims to prove antidepressant effectiveness beyond dispute, the main outcome is response rates, which are derived from continuous data in a process that can inflate differences between groups. The standardised mean differenc...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796018000240

    authors: Moncrieff J

    更新日期:2018-10-01 00:00:00

  • Do psychiatric units at general hospitals attract less stigmatizing attitudes compared with psychiatric hospitals?

    abstract::Aims. It is often assumed that psychiatric units at general hospitals attract less stigma than do specialized psychiatric hospitals, but so far this has not been examined empirically. Methods. We conducted a representative population survey in Germany (n = 2410) in order to compare attitudes towards psychiatric units ...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796012000510

    authors: Schomerus G,Matschinger H,Angermeyer MC

    更新日期:2013-06-01 00:00:00

  • Transitional care for young adults with ADHD: transforming potential upheaval into smooth progression.

    abstract::Increasing numbers of young adults need continued support for their attention deficit hyperactivity disorder (ADHD) beyond the age-boundary for children's services. The sparse literature on transition in general suggests patchy provision and huge gaps in transitional care, but also that young people with ADHD and othe...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796019000817

    authors: Ford T

    更新日期:2020-01-09 00:00:00

  • Area characteristics and admission rates of people with schizophrenia and affective disorders in a German rural catchment area.

    abstract:BACKGROUND:Studies in urban areas identified environmental risk factors for mental illness, but little research on this topic has been performed in rural areas. METHODS:Hospital admission rates were computed for 174 rural municipalities in the catchment area of the state psychiatric hospital in Günzburg in years 2006 ...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796012000157

    authors: Losert C,Schmauß M,Becker T,Kilian R

    更新日期:2012-12-01 00:00:00

  • Implementing evidence-based guidelines for managing depression in elderly patients: a Norwegian perspective.

    abstract::Depression in the elderly is common and exhibits a distinctive phenomenology, due to neurobiological, physiological, psychological and social changes related to ageing. Most elderly with depression are managed in primary health care. Although the number of scientific publications related to geriatric psychiatry has in...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章,评审

    doi:10.1017/S204579601200025X

    authors: Aakhus E,Flottorp SA,Oxman AD

    更新日期:2012-09-01 00:00:00

  • Person-centred mental health care: the challenge of implementation.

    abstract::Within mental health care, 'person-centredness' has been generally interpreted to convey a holistic approach with an attitude of respect for the individual and his/her unique experience and needs. Although it has been possible to demonstrate that professionals can acquire such skills through training, the impact on cl...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 社论

    doi:10.1017/S2045796012000078

    authors: Gask L,Coventry P

    更新日期:2012-06-01 00:00:00

  • What is a factorial trial?

    abstract::Randomized controlled trials (RCTs), typically, randomize participants to one of two intervention groups. It has been shown, however, that about 25% of RCTs published in the scientific literature randomize participants to three or more treatment groups. These studies are called 'multi-arm' trials: there may be, for in...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796013000231

    authors: Cipriani A,Barbui C

    更新日期:2013-09-01 00:00:00

  • Neuroscience and the future for mental health?

    abstract::Psychiatry is in one of its regular crises. It is a crisis of its diagnostic systems despite - perhaps because - of the recurrent claims about the extent of diagnosable 'brain disorders'. It is a crisis of its explanatory systems despite - perhaps because - of its current wager on the brain as the ultimate locus for e...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796015000621

    authors: Rose N

    更新日期:2016-04-01 00:00:00

  • Employment and educational outcomes in early intervention programmes for early psychosis: a systematic review.

    abstract:AIMS:Young adults with early psychosis want to pursue normal roles - education and employment. This paper summarises the empirical literature on the effectiveness of early intervention programmes for employment and education outcomes. METHODS:We conducted a systematic review of employment/education outcomes for early ...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796014000419

    authors: Bond GR,Drake RE,Luciano A

    更新日期:2015-10-01 00:00:00

  • Mistrust of mental health services: ethnicity, hospital admission and unfair treatment.

    abstract:AIMS:To explore the role of psychiatric admission, diagnosis and reported unfair treatment in the relationship between ethnicity and mistrust of mental health services. METHODS:The Mental Illness-Related Investigations on Discrimination (MIRIAD) study was a cross-sectional study of 202 individuals using secondary ment...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796014000158

    authors: Henderson RC,Williams P,Gabbidon J,Farrelly S,Schauman O,Hatch S,Thornicroft G,Bhugra D,Clement S,MIRIAD study group.

    更新日期:2015-06-01 00:00:00

  • Investigating 'place effects' on mental health: implications for population-based studies in psychiatry.

    abstract::Background. Interest in features of our local environments that may promote better mental health and wellbeing continues to rise among decision makers. Our purpose was to highlight a selection of these challenges and some promising avenues for enhancing the quality of evidence. Method. An analysis of approximately 267...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S204579601400050X

    authors: Astell-Burt T,Feng X

    更新日期:2015-02-01 00:00:00

  • Alzheimer's disease medication and outcomes of hospitalisation among patients with dementia.

    abstract:AIMS:The use of Alzheimer disease medication for the treatment of dementia symptoms has shown significant benefits with regards to functional and cognitive outcomes as well as nursing home placement (NHP) and mortality. Hospitalisations in these patient groups are characterised by extended length of stays (LOS), freque...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796019000702

    authors: Möllers T,Perna L,Stocker H,Ihle P,Schubert I,Schöttker B,Frölich L,Bauer J,Brenner H

    更新日期:2019-11-14 00:00:00

  • Applying neuroimaging to detect neuroanatomical dysconnectivity in psychosis.

    abstract::This editorial discusses the application of a novel brain imaging analysis technique in the assessment of neuroanatomical dysconnectivity in psychotic illnesses. There has long been a clinical interest in psychosis as a disconnection syndrome. In recent years graph theory metrics have been applied to functional and st...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796015000074

    authors: O'Donoghue S,Cannon DM,Perlini C,Brambilla P,McDonald C

    更新日期:2015-08-01 00:00:00

  • Consumers' understanding and expectations of a community-based recovery-oriented mental health rehabilitation unit: a pragmatic grounded theory analysis.

    abstract:AIMS:Incorporating consumer perspectives into mental health services design is important in working to deliver recovery-oriented care. One of the challenges faced in mental health rehabilitation services is limited consumer engagement with the available support. Listening to consumers' expectations of mental health ser...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796017000749

    authors: Parker S,Dark F,Newman E,Hanley D,McKinlay W,Meurk C

    更新日期:2019-08-01 00:00:00

  • 'At-risk' for psychosis research: where are we heading?

    abstract::The 'at-risk' criteria are a useful paradigm for investigating the psychological, neurocognitive, neurobiological and genetic risk factors for psychosis, specifically schizophrenia. To date, the primary outcome of interest in at-risk research has been the development of psychotic disorder, whereby patients are categor...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 社论

    doi:10.1017/S2045796012000388

    authors: Lin A,Nelson B,Yung AR

    更新日期:2012-12-01 00:00:00

  • Aligning the ICD-11 classification of disorders due to substance use with global service needs.

    abstract::The use of psychoactive, potentially dependence-producing substances is highly prevalent around the world, and contributes substantially to global disease burden. There is a major gap between the need for treatment for substance use disorders. Changes proposed for the classification of substance use disorders in the E...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796017000622

    authors: Poznyak V,Reed GM,Medina-Mora ME

    更新日期:2018-06-01 00:00:00

  • The overall and sex- and age-group specific incidence rates of cancer in people with schizophrenia: a population-based cohort study.

    abstract:AIMS:Decades of research show that people with schizophrenia have an increased risk of death from cancer; however, the relationship between schizophrenia and cancer incidence remains less clear. This population-based study investigates the incidence of seven common types of cancer among people with a hospital diagnosis...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S204579602000044X

    authors: Pettersson D,Gissler M,Hällgren J,Ösby U,Westman J,Bobo WV

    更新日期:2020-05-28 00:00:00

  • Disparities in mental health care provision to immigrants with severe mental illness in Italy.

    abstract:AIM:To determine whether disparities exist in mental health care provision to immigrants and Italian citizens with severe mental illness in Bologna, Italy. METHODS:Records of prevalent cases on 31/12/2010 with severe mental illness and ≥1 contact with Community Mental Health Centers in 2011 were extracted from the men...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796014000250

    authors: Rucci P,Piazza A,Perrone E,Tarricone I,Maisto R,Donegani I,Spigonardo V,Berardi D,Fantini MP,Fioritti A

    更新日期:2015-08-01 00:00:00

  • The CBCL 1.5-5 and the identification of preschoolers with autism in Italy.

    abstract:AIMS:To study the potential use of child behaviour checklist (CBCL) 1.5-5 scales for the early identification of preschoolers at risk of autism. METHODS:CBCL scores of three groups of preschoolers were compared: (1) an experimental group of 101 preschoolers with autism spectrum disorder (ASD); (2) a control group of 9...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/s204579601100045x

    authors: Muratori F,Narzisi A,Tancredi R,Cosenza A,Calugi S,Saviozzi I,Santocchi E,Calderoni S

    更新日期:2011-12-01 00:00:00

  • Video modeling for the development of personal hygiene skills in youth with autism spectrum disorder.

    abstract::Autism spectrum disorder (ASD) is a neurodevelopmental disorder mainly characterised by deficits in social communication as well as by narrow patterns of behaviour and interests (American Psychiatric Association, 2013), often accompanied by language, intellectual and sensory impairments. The severity of these impairme...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796017000610

    authors: Piccin S,Crippa A,Nobile M,Hardan AY,Brambilla P

    更新日期:2018-04-01 00:00:00

  • Minimum clinically important differences for the Functioning Assessment Short Test and a battery of neuropsychological tests in bipolar disorders: results from the FACE-BD cohort.

    abstract:AIMS:Establishing the minimum clinically important difference (MCID) in functioning and cognition is essential to the interpretation of the research and clinical work conducted in bipolar disorders (BD). The present study aimed to estimate the MCID for the Functioning Assessment Short Test (FAST) and a battery of neuro...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796020000566

    authors: Roux P,Brunet-Gouet E,Ehrminger M,Aouizerate B,Aubin V,Azorin JM,Bellivier F,Bougerol T,Courtet P,Dubertret C,Kahn JP,Leboyer M,Olié E,FondaMental Advanced Centers of Expertise in Bipolar Disorders (FACE-BD) Collaborators.,Et

    更新日期:2020-07-20 00:00:00

  • A profile of Australian mental health carers, their caring role and service needs: results from the 2012 Survey of Disability, Ageing and Carers.

    abstract:AIMS:Planning mental health carer services requires information about the number of carers, their characteristics, service use and unmet support needs. Available Australian estimates vary widely due to different definitions of mental illness and the types of carers included. This study aimed to provide a detailed profi...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796018000446

    authors: Diminic S,Hielscher E,Harris MG,Lee YY,Kealton J,Whiteford HA

    更新日期:2019-12-01 00:00:00

  • Poverty, inequality and a political economy of mental health.

    abstract::The relationship between poverty and mental health is indisputable. However, to have an influence on the next set of sustainable global development goals, we need to understand the causal relationships between social determinants such as poverty, inequality, lack of education and unemployment; thereby clarifying which...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796015000086

    authors: Burns JK

    更新日期:2015-04-01 00:00:00

  • Poor implementation of the EU clinical trial regulation is a major threat for pragmatic trials in European countries.

    abstract::The principle of pragmatism in clinical trials has been broadly recognised as a way to close the gap between research and practice. In this contribution, we argue that the conduct of pragmatic clinical trials in Europe may be hampered by poor implementation of current European Union's Clinical Trial Regulation No. 536...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/S2045796020000396

    authors: Ostuzzi G,Gastaldon C,Petrini C,Godman B,Barbui C

    更新日期:2020-05-06 00:00:00

  • Functional MRI studies in disruptive behaviour disorders.

    abstract::Aggressive or antisocial behaviours with violations of social rules are the main features of disruptive behaviour disorders (DBDs), which are developmental diseases and include conduct disorder and oppositional defiant disorder. In the last decade, several efforts have been made to shed light on the biological underpi...

    journal_title:Epidemiology and psychiatric sciences

    pub_type: 杂志文章

    doi:10.1017/s2045796011000692

    authors: Bellani M,Garzitto M,Brambilla P

    更新日期:2012-03-01 00:00:00