When meta-analysis misleads: A critical case study of a meta-analysis of client feedback.

Abstract:

:Consumers of psychotherapy outcome literature consider meta-analysis the gold standard for assessing the efficacy of interventions across disparate studies. Many assume that findings are valid, especially when published in journals with research credentials. Uncritical acceptance, however, can result in real-world consequences, including whether interventions attain evidence-based status or become marginalized or are considered for implementation in public service arenas. This article examines one meta-analysis, "The Effect of Using the Partners for Change Outcome Management System as Feedback Tool in Psychotherapy-A Systematic Review and Meta-Analysis" (Østergård, Randa, & Hougaard, 2018). The findings are at odds with both the empirical record of routine outcome management as well as professional taskforce recommendations and thus provide an ideal exemplar of the risks of uncritically accepting the conclusions of a meta-analysis. Using guidelines from the Cochrane Handbook for Systematic Reviews of Interventions (Higgins & Green, 2011) and a qualitative case study methodology, this article examines Østergård et al.'s (2018) study selection, quality of evidence, and appropriateness of interpretation, emphasizing the link between flawed method and the ultimate validity of its conclusions. The method illustrated in this case study can be used to assess the legitimacy of meta-analytic findings to inform practice, funding, and policy decisions as well as how rhetoric minimizes flaws and bolsters believability. Our analysis revealed that half of the selected studies of the meta-analysis contained significant limitations, including inadequate dose of treatment and/or adherence problems, thereby calling into question its conclusions. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

journal_name

Psychol Serv

journal_title

Psychological services

authors

Duncan BL,Sparks JA

doi

10.1037/ser0000398

subject

Has Abstract

pub_date

2020-11-01 00:00:00

pages

487-496

issue

4

eissn

1541-1559

issn

1939-148X

pii

2019-64657-001

journal_volume

17

pub_type

杂志文章
  • Development of the Perceived Access Inventory: A patient-centered measure of access to mental health care.

    abstract::According to recent Congressional testimony by the Secretary for Veterans Affairs (VA), improving the timeliness of services is one of five current priorities for VA. A comprehensive access measure, grounded in veterans' experience, is essential to support VA's efforts to improve access. In this article, the authors d...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/ser0000235

    authors: Pyne JM,Kelly PA,Fischer EP,Miller CJ,Wright P,Zamora K,Koenig CJ,Stanley R,Seal K,Burgess JF,Fortney JC

    更新日期:2020-02-01 00:00:00

  • Presenting concerns in counseling centers: The view from clinicians on the ground.

    abstract::Despite growing evidence that a greater number of students are seeking counseling in college and university counseling centers throughout the United States, there is a dearth of empirical information about (a) the presenting concerns for which students seek treatment and (b) how these concerns differ according to clie...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/ser0000122

    authors: Pérez-Rojas AE,Lockard AJ,Bartholomew TT,Janis RA,Carney DM,Xiao H,Youn SJ,Scofield BE,Locke BD,Castonguay LG,Hayes JA

    更新日期:2017-11-01 00:00:00

  • Temporal discounting and criminal thinking: understanding cognitive processes to align services.

    abstract::Temporal discounting is an indicator of impulsivity that has consistently been found to be associated with risky behaviors such as substance abuse and compulsive gambling. Yet, although criminal acts are clearly risky choice behaviors, no study has examined temporal discounting in the criminal attitudes and behaviors ...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/a0035004

    authors: Varghese FP,Charlton SR,Wood M,Trower E

    更新日期:2014-05-01 00:00:00

  • Effects of eliminating psychiatric rehabilitation from the secure levels of a mental-health service system.

    abstract::Psychiatric rehabilitation (PR) is widely recognized as a treatment approach and an array of evidence-based practices effective for promoting the recovery of people with serious mental illness (SMI). However, its use in institutional settings is not widespread for unclear reasons. Policymakers may sometimes believe th...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/a0030260

    authors: Tarasenko M,Sullivan M,Ritchie AJ,Spaulding WD

    更新日期:2013-11-01 00:00:00

  • Provider, veteran, and family perspectives on family education in Veterans Affairs community-based outpatient facilities.

    abstract::The Veterans Affairs (VA) healthcare system is dedicated to providing high-quality mental health services to all veterans, including the nearly 40% of enrolled veterans living in rural areas. Family education programs regarding mental illness and posttraumatic stress disorder, mandated for delivery in all VA medical c...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/a0027103

    authors: Sherman MD,Fischer EP

    更新日期:2012-02-01 00:00:00

  • Development of an in-home telehealth program for outpatient veterans with substance use disorders.

    abstract::A variety of obstacles (e.g., lack of transportation, less availability of treatment in rural districts) contribute to underutilization of treatment among patients with substance use disorders, warranting the need to develop innovative strategies for enhancing access to treatment for these patients. The telehealth in-...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/a0026511

    authors: Santa Ana EJ,Stallings DL,Rounsaville BJ,Martino S

    更新日期:2013-08-01 00:00:00

  • Effects of social support and resilient coping on violent behavior in military veterans.

    abstract::Violence toward others has been identified as a serious postdeployment adjustment problem in a subset of Iraq- and Afghanistan-era veterans. In the current study, we examined the intricate links between posttraumatic stress disorder (PTSD), commonly cited psychosocial risk and protective factors, and violent behavior ...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/ser0000187

    authors: Van Voorhees EE,Wagner HR,Beckham JC,Bradford DW,Neal LC,Penk WE,Elbogen EB

    更新日期:2018-05-01 00:00:00

  • Steps for implementing measurement-based care: Implementation planning guide development and use in quality improvement.

    abstract::Although the benefits of measurement-based care (MBC) are widely noted, MBC remains underutilized in mental health services. In 2016, the Department of Veterans Affairs, Veterans Health Administration began the MBC in Mental Health Initiative to implement MBC as a standard of care across VHA mental health services. Su...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/ser0000368

    authors: Dollar KM,Kirchner JE,DePhilippis D,Ritchie MJ,McGee-Vincent P,Burden JL,Resnick SG

    更新日期:2020-08-01 00:00:00

  • Telephone-delivered psychotherapy for late-life anxiety.

    abstract::A randomized controlled trial (RCT) of telephone-delivered cognitive-behavioral therapy (CBT) was compared with usual care for late-life anxiety disorders. Client satisfaction, as assessed by the Client Satisfaction Questionnaire, was high (M = 27.4, range 8-32), and attrition rates were low (8.3%). Preliminary result...

    journal_title:Psychological services

    pub_type: 杂志文章,随机对照试验

    doi:10.1037/a0025950

    authors: Brenes GA,Ingram CW,Danhauer SC

    更新日期:2012-05-01 00:00:00

  • Predictors of mental healthcare use among domestic violence survivors in shelters.

    abstract::We examined sociodemographic and illness/need associations with mental health care use and service use intensity (i.e., number of visits) among domestic violence survivors. Data from 252 women recruited from 5 Midwestern domestic violence shelters were analyzed. Univariate analyses indicated a more positive treatment ...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/a0034960

    authors: Klopper JJ,Schweinle W,Ractliffe KC,Elhai JD

    更新日期:2014-05-01 00:00:00

  • Team communication within integrated primary care in the context of suicide prevention: A mixed methods preliminary examination.

    abstract::Direct and indirect communication through the electronic medical record play a vital role in helping medical home primary care teams implement suicide prevention efforts. The purpose of this study is to examine how communication related to suicide prevention occurs among primary care team members working within a grou...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/ser0000287

    authors: Funderburk JS,Levandowski BA,Wittink MN,Pigeon WR

    更新日期:2020-02-01 00:00:00

  • American Akicita: Indigenous American warriors and military service.

    abstract::Indigenous Americans (i.e., Native/American Indians, AK natives, Pacific Islanders) have consistently volunteered for military service at greater rates than any other ethnic group, including the majority culture, since the early days of the country. This article is an introduction to the special section which includes...

    journal_title:Psychological services

    pub_type:

    doi:10.1037/ser0000188

    authors: McDonald JD

    更新日期:2017-08-01 00:00:00

  • Behavioral health services in urban American Indian health organizations: A descriptive portrait.

    abstract::The federal Indian Health Service (IHS) is the primary funding source for health services designated for American Indians (AIs; Gone & Trimble, 2012). Urban Indian health organizations (UIHOs), funded in part by IHS, are typically the only sites in large metropolitan settings offering treatments tailored to AI health ...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/ser0000160

    authors: Pomerville A,Gone JP

    更新日期:2018-02-01 00:00:00

  • Hardiness protects against problematic alcohol use in male, but not female, soldiers.

    abstract::Military service members are at high risk for problematic substance use compared with the general population; deployment and combat exposure further increases this risk. It is thus critical to identify resiliency factors that can buffer the negative effects of military experiences and potentially prevent problematic a...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/ser0000409

    authors: Kulak JA,Homish DL,Hoopsick RA,Fillo J,Bartone PT,Homish GG

    更新日期:2020-01-23 00:00:00

  • Public servant, silent servant: A call to action for advocacy training in public service settings.

    abstract::Views on what is important in training for psychologists are evolving, reflecting a broadening understanding of the role psychologists can and should play in societal change. Since the development of the scientist-practitioner model after World War II, arguments around training have focused on the appropriate balance ...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/ser0000387

    authors: Hunt MG,Miller RA,Stacy MA,Lynam S,Carr ER

    更新日期:2019-08-19 00:00:00

  • Coming home: A prospective study of family reintegration following deployment to a war zone.

    abstract::The consequences of deployment extend beyond the service member to impact the entire family. The current investigation evaluated the unique challenges of family reintegration for partnered service members using a prospective design. In total, 76 partnered service members who deployed on a year-long, high-risk mission ...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/ser0000020

    authors: Balderrama-Durbin C,Cigrang JA,Osborne LJ,Snyder DK,Talcott GW,Slep AM,Heyman RE,Tatum J,Baker M,Cassidy D,Sonnek S

    更新日期:2015-08-01 00:00:00

  • Endorsed and Anticipated Stigma Inventory (EASI): a tool for assessing beliefs about mental illness and mental health treatment among military personnel and veterans.

    abstract::Many military personnel and veterans who would benefit from mental health treatment do not seek care, underscoring the need to identify factors that influence initiation and retention in mental health care. Both endorsed and anticipated mental health stigma may serve as principal barriers to treatment seeking. To date...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/a0032780

    authors: Vogt D,Di Leone BA,Wang JM,Sayer NA,Pineles SL,Litz BT

    更新日期:2014-02-01 00:00:00

  • Yoga as an intervention for psychological symptoms following trauma: A systematic review and quantitative synthesis.

    abstract::Despite evidence of the physiologic impact of trauma, treatments are only beginning to focus on the impact of trauma on the body. Yoga may be a promising treatment for trauma sequelae, given research that supports yoga for general distress. The present study aims to systematically assess and quantitatively synthesize ...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/ser0000191

    authors: Nguyen-Feng VN,Clark CJ,Butler ME

    更新日期:2019-08-01 00:00:00

  • Motivational interviewing to reduce risky sexual behaviors among at-risk male youth: A randomized controlled pilot study.

    abstract:BACKGROUND:Despite male youth taking more sexual risks that lead to unwanted partner pregnancy and/or sexually transmitted infections (STIs), research evaluating interventions for risky sex has focused almost exclusively on adolescent and adult females. With STIs among male youth on the rise, behavioral interventions t...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/ser0000498

    authors: Bassett SS,Delaney DJ,Moore AM,Clair-Michaud M,Clarke JG,Stein LAR

    更新日期:2021-01-07 00:00:00

  • Comorbid antisocial and substance misuse proclivity and mental health service utilization by female inmates: testing the worst of both worlds hypothesis with the PAI.

    abstract::The primary purpose of this study was to establish whether female inmates with comorbid proclivity for antisocial behavior and substance misuse, as measured by the Personality Assessment Inventory (PAI; Morey, 2007), use more mental health-related services than female inmates with either antisocial or substance misuse...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/ser0000012

    authors: Walters GD,Magaletta PR

    更新日期:2015-02-01 00:00:00

  • Community-based service requests and utilization among pregnant women incarcerated in jail.

    abstract::Pregnant incarcerated women represent a unique population in the criminal justice system that has been largely overlooked in terms of their service-related needs. The present study examines 241 pregnant incarcerated women's service requests and preincarceration service utilization related to material help (e.g., food,...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/ser0000314

    authors: Kelsey CM,Thompson MJ,Dallaire DH

    更新日期:2020-11-01 00:00:00

  • Adjustment disorders: A research gaps analysis.

    abstract::Adjustment disorders are among the most commonly diagnosed mental health disorders in both civilian and military clinical settings. Despite their high prevalence, adjustment disorders have received little research attention. The many gaps in our understanding of this group of disorders hinder the development of adequa...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/ser0000517

    authors: Morgan MA,Kelber MS,Workman DE,Beech EH,Garvey Wilson AL,Edwards-Stewart A,Belsher BE,Evatt DP,Otto J,Skopp NA,Bush NE,Campbell M

    更新日期:2021-01-28 00:00:00

  • Mental health needs of federal female offenders.

    abstract::Mental health problems are increasingly being recognized as one of the greatest challenges faced by correctional systems in the effective management of their populations. Over the past decade, the number of federally sentenced female offenders in Canada presenting with mental health problems has risen significantly, f...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/a0029653

    authors: Derkzen D,Booth L,Taylor K,McConnell A

    更新日期:2013-02-01 00:00:00

  • The preliminary study of individual cognitive behavior therapy for Japanese patients with social anxiety disorder.

    abstract::Research has demonstrated the effectiveness of both individual and group cognitive behavior therapy (CBT) programs for social anxiety disorder (SAD) with patients in many countries. The present preliminary study reports the effectiveness of individual CBT for Japanese patients with SAD. Fifteen outpatients diagnosed w...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/a0034781

    authors: Shirotsuki K,Kodama Y,Nomura S

    更新日期:2014-05-01 00:00:00

  • When bipolar was still called manic depression: Getting sick in the era of the DSM-II.

    abstract::This article is a first-person account of what it was like to be bipolar in the late 1970s, in the final days of the DSM-II. The field was on the verge of transitioning from psychodynamic psychiatry to biological psychiatry. During this period, nosology and etiology were confounded, and there was little diagnostic agr...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/ser0000407

    authors: Shahar FG

    更新日期:2020-01-09 00:00:00

  • You're not alone: A public health response to immigrant/refugee distress in the current sociopolitical context.

    abstract::Recent political events and policy changes in the United States have fueled antirefugee/immigrant rhetoric and an increase of xenophobic harassment and intimidation, which together present a significant threat to the physical and mental health of refugee/immigrant children and families. This article aims to provide an...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/ser0000381

    authors: Ford-Paz RE,Santiago CD,Coyne CA,Rivera C,Guo S,Rusch D,St Jean N,Hilado A,Cicchetti C

    更新日期:2019-08-29 00:00:00

  • Effectiveness of a social robot, "Paro," in a VA long-term care setting.

    abstract::Interest in animal assisted interventions (AAI) has grown over the years, but acceptance of AAI by the clinical and research community has been hampered by safety, hygiene, and logistical concerns. Advances in the field of social robotics have provided a promising route to deliver AAI while avoiding these aforemention...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/ser0000080

    authors: Lane GW,Noronha D,Rivera A,Craig K,Yee C,Mills B,Villanueva E

    更新日期:2016-08-01 00:00:00

  • Brain boosters: Evaluating a pilot program for memory complaints in veterans.

    abstract::This study investigated the feasibility and preliminary effectiveness of a pilot program designed to address subjective memory complaints among Veterans. The program, Brain Boosters, consisted of 10 once-weekly group sessions, during which psychoeducation and cognitive enhancement strategies were used to target memory...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/ser0000279

    authors: Roberts NA,Burleson MH,Burmeister LB,Bushnell ML,Epstein DR,Todd M,Walter CM,Powell K,Hoffmann N,Reynolds CM,Goren K

    更新日期:2020-02-01 00:00:00

  • An empirical evaluation of recovery transformation at a large community psychiatric rehabilitation organization.

    abstract::In recent decades, the concept of "recovery" from Severe Mental Illness (SMI) has gained increased prominence among organizations providing behavioral health services. Many states and organizations are currently developing plans to transform their mental health systems in accordance with recovery-oriented care. Even t...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/a0032747

    authors: Malinovsky I,Lehrer P,Silverstein SM,Shankman SA,O'Brien W,Samuelson T,van Nostrand G

    更新日期:2013-11-01 00:00:00

  • Mental health service use and help-seeking among women firefighters with a career history of suicidality.

    abstract::Research indicates that women firefighters may experience elevated rates of suicidal thoughts and behaviors; however, little is known about how at-risk women firefighters interface with mental health services and other support sources. This study aimed to identify rates of mental health service use and help-seeking, c...

    journal_title:Psychological services

    pub_type: 杂志文章

    doi:10.1037/ser0000202

    authors: Hom MA,Stanley IH,Spencer-Thomas S,Joiner TE

    更新日期:2018-08-01 00:00:00