Shannon Wiltsey Stirman

All Publications

• Implementing precision methods in personalizing psychological therapies: Barriers and possible ways forward. Behaviour research and therapy Deisenhofer, A. K., Barkham, M., Beierl, E. T., Schwartz, B., Aafjes-van Doorn, K., Beevers, C. G., Berwian, I. M., Blackwell, S. E., Bockting, C. L., Brakemeier, E. L., Brown, G., Buckman, J. E., Castonguay, L. G., Cusack, C. E., Dalgleish, T., de Jong, K., Delgadillo, J., DeRubeis, R. J., Driessen, E., Ehrenreich-May, J., Fisher, A. J., Fried, E. I., Fritz, J., Furukawa, T. A., Gillan, C. M., Gómez Penedo, J. M., Hitchcock, P. F., Hofmann, S. G., Hollon, S. D., Jacobson, N. C., Karlin, D. R., Lee, C. T., Levinson, C. A., Lorenzo-Luaces, L., McDanal, R., Moggia, D., Ng, M. Y., Norris, L. A., Patel, V., Piccirillo, M. L., Pilling, S., Rubel, J. A., Salazar-de-Pablo, G., Schleider, J. L., Schnurr, P. P., Schueller, S. M., Siegle, G. J., Uher, R., Watkins, E., Webb, C. A., Wiltsey Stirman, S., Wynants, L., Youn, S. J., Zilcha-Mano, S., Lutz, W., Cohen, Z. D. 2023; 172: 104443

  View details for DOI 10.1016/j.brat.2023.104443

  View details for PubMedID 38086157

• Development of a method for Making Optimal Decisions for Intervention Flexibility during Implementation (MODIFI): A modified Delphi study. Research square Brewer, S. K., Corbin, C. M., Baumann, A. A., Stirman, S. W., Jones, J. M., Pullmann, M. D., Lyon, A. R. 2023

  Abstract

  Background: Intervention adaptation is often necessary to improve the fit between evidence-based practices/programs and implementation contexts. Existing frameworks describe intervention adaptation processes but do not provide detailed steps for prospectively designing adaptations, are designed for researchers, and require substantial time and resources to complete. A pragmatic approach to guide implementers through developing and assessing adaptations in local contexts is needed. The goal of this project was to develop Making Optimal Decisions for Intervention Flexibility during Implementation (MODIFI), a method for intervention adaptation that leverages human centered design methods and is tailored to the needs of intervention implementers working in applied settings with limited time and resources.Method: MODIFI was iteratively developed via a mixed-methods modified Delphi process. Feedback was collected from 43 implementation research and practice experts. Two rounds of data collection gathered quantitative ratings of acceptability (Round 1) and feasibility (Round 2), as well as qualitative feedback regarding MODIFI revisions analyzed using conventional content analysis.Results: In Round 1, most participants rated all proposed components as essential but identified important avenues for revision which were incorporated into MODIFI prior to Round 2. Round 2 emphasized feasibility, where ratings were generally high and fewer substantive revisions were recommended. Round 2 changes largely surrounded operationalization of terms/processes and sequencing of content. Results include a detailed presentation of the final version of the three-step MODIFI method (Step 1: Learn about the users, local context, and intervention; Step 2: Adapt the intervention; Step 3: Evaluate the adaptation) along with a case example of its application.Discussion: MODIFI is a pragmatic method that was developed to extend the contributions of other research-based adaptation theories, models, and frameworks while integrating methods that are tailored to the needs of intervention implementers. Guiding teams to tailor evidence-based interventions to their local context may extend for whom, where, and under what conditions an intervention can be effective.

  View details for DOI 10.21203/rs.3.rs-3467152/v1

  View details for PubMedID 37961432

• The Role of Therapy Delivery and Clinic Organizational Factors in Explaining Therapist Effects for Trauma-Focused Psychotherapies in the Veterans Health Administration JOURNAL OF CONSULTING AND CLINICAL PSYCHOLOGY Sayer, N. A., Stirman, S., Rosen, C. S., Kehle-Forbes, S., Spoont, M. R., Eftekhari, A., Chard, K. M., Kaplan, A., Nelson, D. B. 2023; 91 (11): 665-679

  Abstract

  This study estimated the size of therapist effects (TEs) for dropout and clinical effectiveness of two trauma-focused psychotherapies (TFPs) and evaluated whether therapy delivery and clinic organizational factors explained observed TEs.Participants were 180 therapists (54.4% psychologists, 42.2% social workers) from 137 Veterans Health Administration facilities and 1,735 patients (24.7% women; 27.2% people of color) who completed at least two TFP sessions. Outcomes were dropout (< 8 TFP sessions) and for a subsample (n = 1,273), clinically meaningful improvement and recovery based on posttraumatic stress disorder checklist for DSM-5 (PCL-5) scores. Therapist-level predictors were ascertained through survey, manual chart review, and administrative data. Multilevel models estimated TEs.Over half (51.2%) of patients dropped out and those who dropped out were less likely to meet criteria for clinically meaningful improvement or recovery (ps < .001). Adjusting for case-mix and TFP type, therapists accounted for 5.812% (p < .001) of the unexplained variance in dropout. The average dropout rate for the 45 therapists in the top performing quartile was 27.0%, while the average dropout rate for the 45 therapists in the bottom performing quartile was 78.8%. Variation between therapists was reduced to 2.031% (p = .140) when therapists' mean of days between sessions, adherence, implementation climate, and caseload were added to multilevel models. TEs were nonsignificant for clinically meaningful improvement and recovery.Interventions targeting therapy delivery and clinic organization have the potential to reduce variation between therapists in TFP dropout, so that more patients stay engaged long enough to experience clinical benefit. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

  View details for DOI 10.1037/ccp0000832

  View details for Web of Science ID 001080745600004

  View details for PubMedID 37668578

  View details for PubMedCentralID PMC10592522

• Using the multiphase optimization strategy to adapt cognitive processing therapy (CPT MOST): study protocol for a randomized controlled factorial experiment. Trials Sripada, R. K., Peterson, C. L., Dziak, J. J., Nahum-Shani, I., Roberge, E. M., Martinson, A. A., Porter, K., Grau, P., Curtis, D., McElroy, S., Bryant, S., Gracy, I., Pryor, C., Walters, H. M., Austin, K., Ehlinger, C., Sayer, N., Wiltsey-Stirman, S., Chard, K. 2023; 24 (1): 676

  Abstract

  Approximately ten percent of US military veterans suffer from posttraumatic stress disorder (PTSD). Cognitive processing therapy (CPT) is a highly effective, evidence-based, first-line treatment for PTSD that has been widely adopted by the Department of Veterans Affairs (VA). CPT consists of discrete therapeutic components delivered across 12 sessions, but most veterans (up to 70%) never reach completion, and those who discontinue therapy receive only four sessions on average. Unfortunately, veterans who drop out prematurely may never receive the most effective components of CPT. Thus, there is an urgent need to use empirical approaches to identify the most effective components of CPT so CPT can be adapted into a briefer format.The multiphase optimization strategy (MOST) is an innovative, engineering-inspired framework that uses an optimization trial to assess the performance of individual intervention components within a multicomponent intervention such as CPT. Here we use a fractional factorial optimization trial to identify and retain the most effective intervention components to form a refined, abbreviated CPT intervention package. Specifically, we used a 16-condition fractional factorial experiment with 270 veterans (N = 270) at three VA Medical Centers to test the effectiveness of each of the five CPT components and each two-way interaction between components. This factorial design will identify which CPT components contribute meaningfully to a reduction in PTSD symptoms, as measured by PTSD symptom reduction on the Clinician-Administered PTSD Scale for DSM-5, across 6 months of follow-up. It will also identify mediators and moderators of component effectiveness.There is an urgent need to adapt CPT into a briefer format using empirical approaches to identify its most effective components. A brief format of CPT may reduce attrition and improve efficiency, enabling providers to treat more patients with PTSD. The refined intervention package will be evaluated in a future large-scale, fully-powered effectiveness trial. Pending demonstration of effectiveness, the refined intervention can be disseminated through the VA CPT training program.ClinicalTrials.gov NCT05220137. Registration date: January 21, 2022.

  View details for DOI 10.1186/s13063-023-07669-3

  View details for PubMedID 37858262

  View details for PubMedCentralID PMC10588087

• Sudden gains in PTSD symptoms and social functioning in cognitive processing therapy for posttraumatic stress disorder. Psychotherapy research : journal of the Society for Psychotherapy Research Antonopoulos, I., Carney, A. E., Wiltsey Stirman, S., Monson, C. M. 2023: 1-12

  Abstract

  Sudden gains (SGs) are rapid symptom improvements between two consecutive therapy sessions that predict treatment outcomes. This study investigated SGs in posttraumatic stress disorder (PTSD) symptoms, interpersonal relationship functioning, and social role functioning in Cognitive Processing Therapy (CPT).Participants were 121 patients and 81 therapists involved in a parent randomized controlled hybrid implementation-effectiveness trial of CPT. Descriptive analyses examined the frequency and timing of different forms of SGs. Multilevel modeling examined the impact of the three SGs on outcomes.PTSD SGs occurred more often and at different sessions than SGs in facets of social functioning. Most individuals experienced only one form of SG and there were no significant clinical or demographic differences in those who had PTSD only SGs, social functioning only SGs, or both SGs. PTSD SGs and interpersonal relationship functioning SGs both predicted changes in PTSD symptoms and interpersonal difficulties over time, but not changes in social role functioning. SGs in social role functioning predicted all three forms of outcomes.The findings suggest that there are multiple forms of SGs in CPT beyond primary symptom changes that are predictive of patient outcomes. Clinicians should highlight various SGs that patients experience to further enhance outcomes.

  View details for DOI 10.1080/10503307.2023.2265046

  View details for PubMedID 37847997

• Implementation Science and Practice-Oriented Research: Convergence and Complementarity. Administration and policy in mental health Youn, S. J., Boswell, J. F., Douglas, S., Harris, B. A., Aajmain, S., Arnold, K. T., Creed, T. A., Gutner, C. A., Orengo-Aguayo, R., Oswald, J. M., Stirman, S. W. 2023

  Abstract

  Implementation science is the scientific study of methods to promote the uptake of research findings and other evidence-based practices in routine care, with the goal of improving the quality and effectiveness of health services (Bauer et al., 2015). In addition to this common goal, practice-oriented psychotherapy research (and researchers) and implementation science (and scientists) share a common focus on the people and the places where treatment happens. Thus, there exists strong potential for combining these two approaches. In this article, we provide a primer on implementation science for psychotherapy researchers and highlight important areas and examples of convergence and complementarity between implementation science and practice-oriented psychotherapy research. Specifically, we (a) define and describe the core features of implementation science; (b) discuss similarities and areas of complementarity between implementation science and practice-oriented psychotherapy research; (c) discuss a case example that exemplifies the integration of implementation science and practice-oriented research; and (d) propose directions for future research and collaborations that leverage both implementation science and practice-oriented research.

  View details for DOI 10.1007/s10488-023-01296-5

  View details for PubMedID 37646966

• Treatment Length and Symptom Improvement in Prolonged Exposure and Present-Centered Therapy for Posttraumatic Stress Disorder: Comparing Dose-Response and Good-Enough Level Models in Two Manualized Interventions JOURNAL OF CONSULTING AND CLINICAL PSYCHOLOGY Thompson-Hollands, J., Lunney, C. A., Sloan, D. M., Wiltsey Stirman, S., Schnurr, P. P. 2023

  Abstract

  The dose-response model of change in psychotherapy posits that each session of therapy is incrementally beneficial across patients. The contrasting good-enough level model suggests that patients improve at different rates in therapy and discontinue treatment when they are satisfied with their improvement. Support for each theory has been mixed, and many prior studies have relied on samples of patients receiving unstructured treatment approaches. We conducted this study to compare these two theories across two manualized treatments for posttraumatic stress disorder (PTSD).Two hundred eighty-four female veterans and military service members with PTSD (Mage = 44.79; 54.6% White non-Hispanic, 6.7% Black non-Hispanic, 37% other) were randomized to receive 10 sessions of prolonged exposure (PE), a trauma-focused therapy, or present-centered therapy (PCT), a non-trauma-focused therapy. Participants completed the PTSD Checklist (PCL) at even-numbered treatment sessions, and the timing of dropout/treatment completion was monitored.The point of highest risk for dropout differed between the treatments, with risk in PE corresponding to the beginning of imaginal exposures. In the PE condition, but not in PCT, a higher number of sessions completed increased the likelihood of achieving reliable clinically significant improvement. Across treatments, the rate of change in PTSD symptoms did not differ according to the number of sessions completed (b = 0.06, p = .687).Findings support the dose-response model of change in psychotherapy. There were notable differences in dropout across the treatment conditions, including rates, timing, and implications for outcomes. These differences likely reflect differences in content between the protocols. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

  View details for DOI 10.1037/ccp0000834

  View details for Web of Science ID 001032873900001

  View details for PubMedID 37471022

• Elucidating the Elements of Clinical Case Consultation in Cognitive Processing Therapy elucider les elements de la consultation de cas cliniques en therapie du processus cognitif COUNSELING PSYCHOLOGIST Landy, M. H., Vezer, E., Bance, S., Loskot, T., Ip, J., Zeifman, A. P., Mutschler, C., Thomas, F. C., McShane, K., Monson, C. M., Stirman, S. 2023

  View details for DOI 10.1177/00110000231166103

  View details for Web of Science ID 001001591100001

• Provider Decisions to Use Evidence-Based Psychotherapy for PTSD Among Veterans: Assessments of Overidentification With the Sick Role and Comorbid Personality Disorders TRAUMATOLOGY Song, J., Garcia, H. A., Finley, E. P., Stirman, S. 2023

  View details for DOI 10.1037/trm0000433

  View details for Web of Science ID 000970462000001

• Evaluation of measures of sustainability and sustainability determinants for use in community, public health, and clinical settings: a systematic review. Implementation science : IS Hall, A., Shoesmith, A., Doherty, E., McEvoy, B., Mettert, K., Lewis, C. C., Wolfenden, L., Yoong, S., Kingsland, M., Shelton, R. C., Wiltsey Stirman, S., Imad, N., Sutherland, R., Nathan, N. 2022; 17 (1): 81

  Abstract

  Sustainability is concerned with the long-term delivery and subsequent benefits of evidence-based interventions. To further this field, we require a strong understanding and thus measurement of sustainability and what impacts sustainability (i.e., sustainability determinants). This systematic review aimed to evaluate the quality and empirical application of measures of sustainability and sustainability determinants for use in clinical, public health, and community settings.Seven electronic databases, reference lists of relevant reviews, online repositories of implementation measures, and the grey literature were searched. Publications were included if they reported on the development, psychometric evaluation, or empirical use of a multi-item, quantitative measure of sustainability, or sustainability determinants. Eligibility was not restricted by language or date. Eligibility screening and data extraction were conducted independently by two members of the research team. Content coverage of each measure was assessed by mapping measure items to relevant constructs of sustainability and sustainability determinants. The pragmatic and psychometric properties of included measures was assessed using the Psychometric and Pragmatic Evidence Rating Scale (PAPERS). The empirical use of each measure was descriptively analyzed.A total of 32,782 articles were screened from the database search, of which 37 were eligible. An additional 186 publications were identified from the grey literature search. The 223 included articles represented 28 individual measures, of which two assessed sustainability as an outcome, 25 covered sustainability determinants and one explicitly assessed both. The psychometric and pragmatic quality was variable, with PAPERS scores ranging from 14 to 35, out of a possible 56 points. The Provider Report of Sustainment Scale had the highest PAPERS score and measured sustainability as an outcome. The School-wide Universal Behaviour Sustainability Index-School Teams had the highest PAPERS score (score=29) of the measure of sustainability determinants.This review can be used to guide selection of the most psychometrically robust, pragmatic, and relevant measure of sustainability and sustainability determinants. It also highlights that future research is needed to improve the psychometric and pragmatic quality of current measures in this field.This review was prospectively registered with Research Registry (reviewregistry1097), March 2021.

  View details for DOI 10.1186/s13012-022-01252-1

  View details for PubMedID 36514059

  View details for PubMedCentralID PMC9746194

• Initiating Cognitive Processing Therapy (CPT) in Community Settings: A Qualitative Investigation of Therapist Decision-Making. Administration and policy in mental health Thomas, F. C., Loskot, T., Mutschler, C., Burdo, J., Lagdamen, J., Sijercic, I., Lane, J. E., Liebman, R. E., Finley, E. P., Monson, C. M., Wiltsey-Stirman, S. 2022

  Abstract

  Various organizations have provided treatment guidelines intended to aid therapists in deciding how to treat posttraumatic stress disorder (PTSD). Yet evidence-based psychotherapies (EBPs) for PTSD in the community may be difficult to obtain. Although strides have been made to implement EBPs for PTSD in institutional settings such as the United States Veterans Affairs, community uptake remains low. Factors surrounding clients' decisions to enroll in EBPs have been identified in some settings; however less is known regarding trained therapists' decisions related to offering trauma-focused therapies or alternative treatment options. Thus, the aim of the current study was to examine therapist motivations to initiate CPT in community settings. The present study utilizes data from a larger investigation aiming to support the sustained implementation of Cognitive Processing Therapy (CPT) in community mental health treatment settings. Enrolled therapists participated in phone interviews discussing their opinions of CPT, preferred treatments for PTSD, and process in assessing appropriate PTSD treatments for clients. Semi-structured interviews (N=29) were transcribed and analyzed using a directed content analysis approach. Several themes emerged regarding therapists' decision-making in selecting PTSD treatments. Therapist motivations to use EBPs for PTSD, primarily CPT, were identified at the client (e.g., perceived compatibility with client-level characteristics), therapist (e.g., time limitations), and clinic levels (e.g., leadership support). The results provide insight into the complex array of factors that affect sustainability of EBPs for PTSD in community settings and inform future dissemination of EBPs, including training efforts in community settings.

  View details for DOI 10.1007/s10488-022-01229-8

  View details for PubMedID 36370226

• A pilot randomized effectiveness trial of the unified protocol in trauma-exposed veterans. Depression and anxiety Gutner, C. A., Song, J., Canale, C. A., Suvak, M. K., Litwack, S. D., Niles, B. L., Stirman, S. W. 2022

  Abstract

  BACKGROUND: The unified protocol (UP) is a promising transdisgnostic treatment for emotional disorders; limited data exists with trauma-exposed populations. This study compared effectiveness of the UP, presented centered therapy (PCT), and treatment as usual (TAU) in trauma-exposed veterans presenting to routine care.METHOD: Trauma-exposed veterans with one or more emotional disorder diagnoses participated in a pilot hybrid-1 effectiveness/preimplementation study. Thirty-seven male and female veterans were randomized to one of three conditions.RESULTS: Multilevel growth curve modeling demonstrated improvement over time across conditions with large effect sizes (range: -2.15 to -3.32), with the UP demonstrating the greatest change. The between group effect sizes for reductions in number of comorbid diagnoses were medium to small and statistically significant (TAU and UP, d=0.49, p=.056; TAU and PCT d=0.18, p=.166, UP and PCT d=0.31, p=.229). Only the UP led to a decrease in the number of comorbid diagnoses (d=-0.71). Psychosocial functioning varied by group, with slight increases in impairment in PCT and TAU, and medium effect size reduction in the UP. Only the UP exhibited significant decreases in self-reported anxiety and depression. Between group differences for UP and PCT were medium to large and statistically significant for depression across two measures (d=-0.72 to d=-1.40).CONCLUSIONS: This represents the first trial examining effectiveness of the UP, PCT, and TAU in trauma-exposed veterans. Despite a small sample, large effect size differences demonstrated promising advantages for the UP.Trial Registration Number: NCT02944994.

  View details for DOI 10.1002/da.23288

  View details for PubMedID 36258655

• Multilevel Factors in Providers' Decisions to Utilize CPT in Military- and Veteran-Serving Treatment Settings PSYCHOLOGICAL SERVICES Loskot, T., Lagdamen, J., Mutschler, C., Thomas, F., Kannan, K., Beristianos, M., Cook, J., Finley, E., Monson, C., Wiltsey-Stirman, S. 2022

  Abstract

  Numerous guidelines exist to inform decision-making regarding psychological treatment of patients with posttraumatic stress disorder (PTSD). While strides have been made in the implementation of evidence-based psychotherapies (EBPs) for PTSD in the United States. Department of Veterans Affairs (VA), a large population of veterans does not receive such services. Research has been conducted on veterans' decisions to enroll in EBPs; however, less is known about providers' perspectives related to offering trauma-focused therapies to the military and veteran population, particularly outside the United States. This study utilizes baseline data from a larger investigation aimed to support the sustained implementation of cognitive processing therapy (CPT) in U.S. VA and Canadian Operational Stress Injury (OSI) and Department of Defense settings. Providers who trained in CPT (N = 55) participated in interviews regarding their opinions of CPT, preferred treatments for PTSD, and their process in assessing appropriate PTSD treatments for each patient. A directed content analysis approach was used to identify themes for providers' decision-making to utilize CPT within the context of four Consolidated Framework for Implementation Research (CFIR) domains. In the outer setting domain, providers reported disconnect from policy and leadership as a barrier, and in the inner setting CFIR domain, providers reported multiple facilitators: available resources, leadership support, and compatibility with CPT. The CFIR domain for characteristics of the individuals aligned with a theme of theoretical orientation and training as a facilitator. The intervention characteristics domain aligned with facilitators and barriers; complexity of CPT was a barrier, but relative advantage and perceived strength of evidence were facilitators toward implementation. The systems surrounding and supporting EBP delivery within the U.S. VA, Canada OSI, and Canadian Forces clinics have more similarities than differences regarding barriers and facilitators to delivering CPT. Despite variability in funding and training, provider experiences across all three systems suggest similar themes. Further investigation is needed to determine whether these findings extend to community samples or sites not yet offering EBPs. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

  View details for DOI 10.1037/ser0000715

  View details for Web of Science ID 000866452000001

  View details for PubMedID 36227297

• Adaptations of evidence-based trauma-focused interventions for children and adolescents: a systematic review. Implementation science communications Lange, B. C., Nelson, A., Lang, J. M., Stirman, S. W. 2022; 3 (1): 108

  Abstract

  Rates of potentially traumatic events (PTEs) and other forms of adversity among children are high globally, resulting in the development of a number of evidence-based interventions (EBIs) to address the adverse outcomes stemming from these experiences. Though EBIs are intended to be delivered according to set parameters, these EBIs are frequently adapted. However, little is known about existing adaptations of EBIs for children who experienced PTEs or other adversities. As such, this review aimed to determine: (1) why existing EBIs designed to address PTEs and other adversities experienced by children are adapted, (2) what processes are used to determine what elements should be adapted, and (3) what components of the intervention are adapted.Nine academic databases and publicly available search engines were used to identify academic and grey literature. Initial screening, full-text review, data extraction, and quality determinations were completed by two members of the research team. Data were synthesized narratively for each adapted EBI by research question.Forty-two studies examining the adaptations of nine different EBIs were located, with Trauma-Focused Cognitive Behavioral Therapy and Cognitive Behavioral Intervention for Trauma in Schools being the most commonly adapted EBIs. Most frequently, EBIs were adapted to improve fit with a new population and to address cultural factors. Most commonly, researchers in combination with others made decisions about adapting interventions, though frequently who was involved in these decisions was not described. Common content adaptations included the addition of intervention elements and the tailoring/tweaking/refining of intervention materials. Common contextual adaptations included changes to the intended population, changes to the channel of treatment delivery, and changes to who administered the intervention.Most published studies of EBI adaptions have been developed to improve fit and address cultural factors, but little research is available about adaptations made by clinicians in day-to-day practice. Efforts should be made to evaluate the various types of adaptations and especially whether adaptations improve access to services or improve child outcomes in order to ensure that all children exposed to trauma can access effective treatment.The protocol for this systematic review was published with PROSPERO (CRD42020149536).

  View details for DOI 10.1186/s43058-022-00348-5

  View details for PubMedID 36209138

• Implementation context and burnout among Department of Veterans Affairs psychotherapists prior to and during the COVID-19 pandemic. Journal of affective disorders Rosen, C. S., Kaplan, A. N., Nelson, D. B., La Bash, H., Chard, K. M., Eftekhari, A., Kehle-Forbes, S., Stirman, S. W., Sayer, N. A. 2022

  Abstract

  BACKGROUND: The first goal of this study was to assess longitudinal changes in burnout among psychotherapists prior to (T1) and during the COVID-19 pandemic (T2). The second objective was to assess the effects of job demands, job resources (including organizational support for evidence-based psychotherapies, or EBPs) and pandemic-related stress (T2 only) on burnout.METHOD: Psychotherapists providing EBPs for posttraumatic stress disorder in U.S. Department of Veterans Affairs (VA) facilities completed surveys assessing burnout, job resources, and job demands prior to (T1; n = 346) and during (T2; n = 193) the COVID-19 pandemic.RESULTS: Burnout prevalence increased from 40 % at T1 to 56 % at T2 (p < .001). At T1, stronger implementation climate and implementation leadership (p < .001) and provision of only cognitive processing therapy (rather than use of prolonged exposure therapy or both treatments; p < .05) reduced burnout risk. Risk factors for burnout at T2 included T1 burnout, pandemic-related stress, less control over when and how to deliver EBPs, being female, and being a psychologist rather than social worker (p < .02). Implementation leadership did not reduce risk of burnout at T2.LIMITATIONS: This study involved staff not directly involved in treating COVID-19, in a healthcare system poised to transition to telehealth delivery.CONCLUSION: Organizational support for using EBPs reduced burnout risk prior to but not during the pandemic. Pandemic related stress rather than increased work demands contributed to elevated burnout during the pandemic. A comprehensive approach to reducing burnout must address the effects of both work demands and personal stressors.

  View details for DOI 10.1016/j.jad.2022.09.141

  View details for PubMedID 36191645

• An Examination of Individual and Organizational Theory in a Pilot Virtual Facilitated Learning Collaborative to Implement Written Exposure Therapy PSYCHOLOGICAL SERVICES Worley, C. B., Rosen, C. S., LoSavio, S. T., Aajmain, S. T., Stirman, S., Sloan, D. M. 2022

  Abstract

  Participant training alone is typically insufficient to ensure adoption of a new treatment. This study provides preliminary data on a pilot program that implemented written exposure therapy (WET) through a virtual facilitated learning collaborative (VFLC) that combined clinician training with implementation support. Ninety-five mental health clinicians from Veterans Health Administration clinics enrolled in the VFLC. Clinicians received 6 hr of training in WET plus weekly group consultation on training cases for 12-16 weeks. Clinic leaders participated in monthly group calls with facilitators to develop and track implementation plans, address barriers, and share resources. Clinicians completed the Perceived Characteristics of Intervention Scale and Implementation Climate Scale before training and after consultation, and the Intention Scale for providers after the program. Clinicians' positive perceptions of WET increased over time, t(85) = -8.80, p < .001, d = 0.95, and changes were moderated by how much reduction in symptoms their patients experienced, t(151) = -2.13, p = .035. The implementation climate for WET also improved over time, t(85) = -3.55, p < .001, d = 0.36. Consistent with the theory of planned behavior, clinicians' intention to continue using WET after training was influenced by their perceptions and attitudes about WET, subjective norms, and perceived behavioral control. The VFLC model was feasible and associated with increases in clinicians' and leaders' support for using WET. Patient outcomes predicted the amount of change in clinicians' perceptions about WET. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

  View details for DOI 10.1037/ser0000698

  View details for Web of Science ID 000850637300001

  View details for PubMedID 36074601

• Competence in Delivering Cognitive Processing Therapy and the Therapeutic Alliance Both Predict PTSD Symptom Outcomes. Behavior therapy Keefe, J. R., Hernandez, S., Johanek, C., Landy, M. S., Sijercic, I., Shnaider, P., Wagner, A. C., Lane, J. E., Monson, C. M., Stirman, S. W. 2022; 53 (5): 763-775

  Abstract

  Cognitive Processing Therapy (CPT) is efficacious in treating PTSD, but there remains a need to improve outcomes for individuals who do not fully respond to treatment. Differences between patient-therapist dyads in the fidelity (i.e., adherence and competence) of CPT delivery and the quality of the therapeutic relationship may partly explain differential levels of symptom improvement. Sessions were sampled from a randomized trial comparing different consultation conditions in training therapists new to CPT. Among 69 patients, one session from Sessions 1-3 and one session from Sessions 4-7 were reliably rated for adherence and competence using the CPT Therapist Adherence and Competence Scale, and for therapeutic alliance using the Working Alliance Inventory-Observer scale. Mixed models, including detrending using a fixed effect of session, predicted self-reported Posttraumatic Stress Disorder Checklist (PCL-IV) scores in one session using process scores from the previous session. The statistical interaction between fidelity and alliance scores to predict outcome was also examined. Alliance had significant, positive correlations (rs = 0.18-0.21) with same-session adherence and competence. Higher competence scores and higher therapeutic alliance scores in one session were independently associated with lower PCL-IV scores in the subsequent session. Adherence scores, which tended to be very high with relatively less variability, did not significantly relate to subsequent-session PCL-IV scores. Competence significantly interacted with alliance, such that sessions high in both competence and alliance predicted especially lower subsequent-session PCL-IV scores. A strong therapeutic alliance may have a synergistic, salutary effect with the competent delivery of CPT.

  View details for DOI 10.1016/j.beth.2021.12.003

  View details for PubMedID 35987537

• Implementing Evidence-Based Mental-Health Treatments: Attending to Training, Fidelity, Adaptation, and Context CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE Stirman, S. 2022

  View details for DOI 10.1177/09637214221109601

  View details for Web of Science ID 000844287000001

• Identifying and Exploring Sustainability Determinants of Mental Health Recovery-Oriented Interventions: A Mixed Methods Study Protocol. Global implementation research and applications Sofouli, E., Wiltsey-Stirman, S., Groleau, D., Perreault, M., Piat, M. 2022: 1-13

  Abstract

  Mental health recovery is the new paradigm in the mental health service delivery system worldwide. Recovery-oriented services go beyond traditional clinical care that is centered on symptom remission, aiming to help people: restore social connections with other individuals and the community; develop hope and optimism for the future; reconstruct an identity beyond that of a "mental patient"; discover meaning in life; and feel empowered to gain control over treatment (CHIME framework). Over the last ten years, several efforts at implementation of recovery-oriented interventions have been documented in the scientific literature. However, little attention has been given to their sustainability, even though it is reported that not all health interventions can fully sustain their activities beyond the initial implementation phase. The aim of this mixed methods case study is to better understand the factors that determine the sustainability of two recovery-oriented interventions (peer support and recovery training) after their roll-out in four organizations in Canada that provide community housing for adults with mental health challenges. Qualitative and quantitative data will be collected from managers, service providers, and implementation team members that oversaw the implementation process along with organizational documents. Data collection and analysis will be guided by the Consolidated Framework for Sustainability Constructs in Healthcare, the Framework for Reporting Adaptations and Modifications, and the Program Sustainability Assessment Tool. Findings will expand our current evidence base on the intersection of sustainability and mental health recovery interventions that remains under-explored.

  View details for DOI 10.1007/s43477-022-00052-5

  View details for PubMedID 36035969

• Promises and pitfalls in implementation science from the perspective of US-based researchers: learning from a pre-mortem IMPLEMENTATION SCIENCE Beidas, R. S., Dorsey, S., Lewis, C. C., Lyon, A. R., Powell, B. J., Purtle, J., Saldana, L., Shelton, R. C., Stirman, S., Lane-Fall, M. B. 2022; 17 (1): 55

  Abstract

  Implementation science is at a sufficiently advanced stage that it is appropriate for the field to reflect on progress thus far in achieving its vision, with a goal of charting a path forward. In this debate, we offer such reflections and report on potential threats that might stymie progress, as well as opportunities to enhance the success and impact of the field, from the perspective of a group of US-based researchers.Ten mid-career extramurally funded US-based researchers completed a "pre-mortem" or a group brainstorming exercise that leverages prospective hindsight to imagine that an event has already occurred and to generate an explanation for it - to reduce the likelihood of a poor outcome. We came to consensus on six key themes related to threats and opportunities for the field: (1) insufficient impact, (2) too much emphasis on being a "legitimate science," (3) re-creation of the evidence-to-practice gap, (4) difficulty balancing accessibility and field coherence, (5) inability to align timelines and priorities with partners, and (6) overly complex implementation strategies and approaches.We submit this debate piece to generate further discussion with other implementation partners as our field continues to develop and evolve. We hope the key opportunities identified will enhance the future of implementation research in the USA and spark discussion across international groups. We will continue to learn with humility about how best to implement with the goal of achieving equitable population health impact at scale.

  View details for DOI 10.1186/s13012-022-01226-3

  View details for Web of Science ID 000840306000001

  View details for PubMedID 35964095

  View details for PubMedCentralID PMC9375077

• Temporary PTSD Symptom Increases Among Individuals Receiving CPT in a Hybrid Effectiveness-Implementation Trial: Potential Predictors and Association With Overall Symptom Change Trajectory PSYCHOLOGICAL TRAUMA-THEORY RESEARCH PRACTICE AND POLICY Larsen, S. E., Mackintosh, M., La Bash, H., Evans, W. R., Suvak, M. K., Shields, N., Lane, J. M., Sijercic, I., Monson, C. M., Wiltsey Stirman, S. 2022; 14 (5): 853-861

  Abstract

  Concern about symptom worsening with trauma-focused treatment may be one factor hindering the implementation of evidence-based treatments for PTSD, like cognitive processing therapy (CPT), despite evidence for their efficacy. Previous studies have examined the frequency and effect of symptom exacerbation, or temporary symptom increases, on outcomes, but primarily in randomized clinical trials.We examined this issue in a community sample of participants receiving CPT from front-line clinicians learning to deliver CPT in a randomized controlled implementation trial of training strategies. Patient participants (n = 183) completed self-report measures of PTSD symptoms at each session.Most participants (67.3%) experienced at least one temporary symptom increase during CPT (only 1.6% continued to have higher symptoms by the end of treatment). Demographic variables, comorbid conditions (i.e., depression, anxiety, substance use), and baseline PTSD symptom levels did not predict symptom increases. Importantly, symptom increases did not predict treatment noncompletion, posttreatment PTSD symptom levels, or loss of probable PTSD diagnosis. Moreover, growth curve modeling revealed that temporary symptom increases did not predict the trajectory of PTSD symptoms over the course of treatment.The rates of symptom increases, which were higher than in previous studies, may be attributed to a routine care sample or to the differences in session timing and measurement. These results add to a nascent literature documenting that symptom increases may be a normal, transient part of treatment that do not impact a patient's ability to have symptom improvement during a course of CPT. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

  View details for DOI 10.1037/tra0000545

  View details for Web of Science ID 000814350400020

  View details for PubMedID 31971424

• Associations between system, organizational, and individual characteristics with sustained EBP fidelity across mental health systems Stirman, S., Finley, E., Song, J., Masina, T., Aajmain, S., Lagdamen, J., Loskot, T., Swanson, K., LaBash, H., Lane, J., Sijercic, I., Liebman, R., Park, A., Shields, N., Monson, C. BMC. 2022

  View details for Web of Science ID 000805777300002

• Delivery of Written Exposure Therapy for PTSD in a University Counseling Center PSYCHOLOGICAL SERVICES Morissette, S. B., Ryan-Gonzalez, C., Blessing, A., Judkins, J., Crabtree, M., Hernandez, M. F., Wiltsey-Stirman, S., Sloan, D. M. 2022

  Abstract

  Posttraumatic stress disorder (PTSD) occurs at high rates among college students, and there is an urgent need to develop brief and accessible interventions to help these at-risk students achieve academic and career success. This open-trial pilot study tested the feasibility and effectiveness of Written Exposure Therapy (WET; Sloan & Marx, 2019), a brief, five-session exposure-based treatment, when delivered in a real-world Counseling Services Center. Students who met criteria for probable PTSD were assessed at baseline, posttreatment, and 3-month follow-up using self-report assessments of PTSD and depression. Of 28 eligible college students, 22/28 (78.6%) completed at least one treatment session, and of those students, 14/22 (63.6%) completed the full five sessions, 12 of whom completed both the posttreatment assessment and the 3-month follow-up assessment. Data were analyzed using intent-to-treat (N = 22) and per-protocol (n = 12) samples. As hypothesized, in both samples, PTSD symptoms decreased from baseline to posttreatment (η² = .60-.81; very large effects), and these improvements were maintained at the 3-month follow-up. Similar findings were observed with respect to decreases in self-reported depression, but not with respect to decreases in educational impairment or increases in academic self-efficacy. Qualitative data indicated that both students and therapists found the treatment credible and acceptable. These findings offer preliminary support for the utility of WET for PTSD when delivered in a student counseling services center. Suggestions for adapting WET within a student counseling services environment are discussed. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

  View details for DOI 10.1037/ser0000608

  View details for Web of Science ID 000749773500001

  View details for PubMedID 35113623

• Mental health clinician perspectives regarding factors impacting implementation of evidence-based psychotherapies in Veterans Health Administration community-based outpatient clinics. General hospital psychiatry Brennan, L. A., Brady, J. E., Drummond, K. L., Wiltsey-Stirman, S., Gutner, C. A., Iverson, K. M. 2022; 75: 54-60

  Abstract

  Uptake of Evidence-Based Psychotherapies (EBPs) by mental health (MH) clinicians, especially in community settings, remains highly variable. This formative pilot study aimed to understand the attitudes and practices of Veterans Health Administration community-based MH clinicians regarding EBPs and to identify multi-level factors that enable and hinder EBP implementation in this unique context.Semi-structured interviews were conducted with MH clinicians (N = 40) working in community-based outpatient clinics (CBOCs) in metro/urban (n = 20) and non-metro/rural (n = 20) locations. Interviews were guided by the Consolidated Framework for Implementation Research and were analyzed using rapid content analysis. Results were organized by system-, clinician-, patient-, and innovation-levels.EBPs were consistently perceived as important to delivering quality MH care, with most clinicians having received training in at least one VHA EBP. However, limited EBP training and consultation opportunities, inadequate autonomy to schedule EBP sessions, high and complex caseloads, and feelings of isolation at CBOCs decreased EPB use. Social workers perceived disparities in EBP training access relative to psychologists. Some barriers were more salient in non-metro/rural settings (e.g., patient-level privacy concerns).Increased EBP training opportunities- particularly for social workers-, greater flexibility over schedules and caseloads, and more mechanisms for consultation and professional development may increase EBP uptake in community-based clinics.

  View details for DOI 10.1016/j.genhosppsych.2022.01.001

  View details for PubMedID 35182907

• Assessment of modifications to evidence-based psychotherapies using administrative and chart note data from the US department of veterans affairs health care system. Frontiers in public health Wiltsey Stirman, S., La Bash, H., Nelson, D., Orazem, R., Klein, A., Sayer, N. A. 2022; 10: 984505

  Abstract

  Background: The US Department of Veterans Affairs (VA) has over 15 years of experience in delivery of evidence-based psychotherapies (EBPs). This paper describes strategies for using clinical documentation and administrative data to understand adherence and modifications to EBPs for Posttraumatic Stress Disorder (PTSD).Methods: This study focused on two EBPs for PTSD, Cognitive Processing Therapy (CPT) and Prolonged Exposure (PE). The sample included VA therapists from across the US who provided CPT and PE and the patients they treated over a 1-year period. The data sources for this study were templated EBP chart notes and VA administrative data. We used a manual review of note content and administrative data rules to code therapy adherence and modifications in 7,297 EBP sessions for 1,257 patients seen by 182 therapists. Two trained coders rated each therapy note and resolved discrepancies through consensus. To contextualize and explain variation in adherence and modifications, we conducted brief 30-45-min semi-structured interviews with a purposive subsample of these therapists (n = 32).Findings: Combining manual chart review and administrative data allowed for identification of 11 types of modifications. Raters disagreed on adherence for 30% of notes. The disagreement stemmed from the presence of therapy modifications that were not clearly documented, necessitating the development of decision rules and strategies for modification coding. Both therapists and patients contributed to the variance in the extent to which different modifications occurred. Therapist interviews demonstrated therapist awareness of modifying the protocols in the ways identified through chart review.Conclusion: Healthcare systems can use data collected as part of routine care to understand how and when EBPs are modified but need to develop scalable strategies to document adaptations and modifications to EBPs in routine care.

  View details for DOI 10.3389/fpubh.2022.984505

  View details for PubMedID 36457312

• Feasibility and Preliminary Efficacy of a Public Mobile App to Reduce Symptoms of Postdisaster Distress in Adolescent Wildfire Survivors: Sonoma Rises PSYCHOLOGICAL SERVICES Heinz, A. J., Wiltsey-Stirman, S., Jaworski, B. K., Sharin, T., Rhodes, L., Steinmetz, S., Taylor, K., Gorman, B., Mason, D., Marikos, S., McGovern, M. 2021

  Abstract

  In October 2017, Northern California experienced devastating and historic wildfires leaving the community in need of support to foster emotional resilience during the recovery process. Adolescents represent a particularly vulnerable population in the wake of disaster, and digital mental health interventions may hold promise for reaching teens at scale. The present study examined the feasibility and efficacy of a mobile mental health app for disaster, Sonoma Rises. A multiple-baseline single-case experimental design (SCED) utilizing a research-enabled version of the app was employed with seven adolescents who experienced significant damage to their homes and schools in the wildfires. Participants completed daily mood ratings, weekly measures of posttraumatic stress symptoms, internalizing and externalizing symptoms, psychosocial functioning, and then pre-post-measures of anxiety, depression, wellbeing, sleep, academic engagement, and perceived social support as well as quantitative and qualitative measures of intervention satisfaction and feasibility. Sonoma Rises was found to be feasible in terms of engagement, satisfaction, and likelihood of recommending to a friend. During the study, another wildfire occurred and all participants underwent a prolonged mandated evacuation and were subject to a series of extended power outages. Uptake of the publicly available version of the Sonoma Rises app among the general population was modest but engagement among users was sustained. Lessons learned are offered to contribute to the science and practice of building, disseminating, and implementing digital tools to conduct more equitable disaster mental health outreach and research. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

  View details for DOI 10.1037/ser0000576

  View details for Web of Science ID 000733335700001

  View details for PubMedID 34780209

• The Role of the Consultant in Consultation for an Evidence-Based Treatment for PTSD PSYCHOLOGICAL SERVICES Johnson, C., La Bash, H., Song, J., Dunlap, K., Lagdamen, J., Suvak, M., Landy, M. H., Shields, N., Monson, C. M., Stirman, S. 2021

  Abstract

  Consultation is an important implementation strategy to improve treatment fidelity and clinical outcomes, yet research has not identified the aspects of consultation that differentially affects clinician skill development and client symptom change. Thus, the present study investigated the effect of the consultant, consultation activities, and consultants' (n = 6) perceptions of consultees (n = 60) on post-traumatic stress disorder (PTSD) treatment fidelity and client outcomes. In addition, we assessed the accuracy of consultants' evaluations of clinicians using the Perceived Enthusiasm, Skill, and Participation scale (P-ESP). Results indicated that there was a significant effect of consultant on adherence to, but not competence in, delivering Cognitive Processing Therapy (CPT). The effect of the consultant on PTSD symptom change was not significant. Consultants significantly differed in their discussion of CPT strategies and their application to individual cases, but did not differ on reviewing and providing feedback on fidelity. Consultant perceptions as assessed by the P-ESP were not associated with clinicians' current levels of adherence or competence, suggesting that consultants may not accurately assess clinician skill during consultation. Client PTSD symptom change neither predicted, nor was predicted by, consultants' perceptions of their consultees' skill. This article outlines potential reasons for consultant effects and possible biases at play that may reduce the accuracy of consultant perceptions and presents suggestions on alternative strategies to assess clinician skill during consultation. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

  View details for DOI 10.1037/ser0000592

  View details for Web of Science ID 000733210800001

  View details for PubMedID 34735197

• Graduate Training and Provider Concerns About Distress and Comprehension in PTSD Treatment Choice: A Mediation Analysis PSYCHOLOGICAL SERVICES Song, J., Garcia, H. A., Finley, E. P., Stirman, S. 2021; 18 (4): 533-542

  Abstract

  The Veterans Health Administration (VHA) recommends that patients with posttraumatic stress disorder (PTSD) receive either of the 2 frontline evidence-based psychotherapies, cognitive processing therapy (CPT) and prolonged exposure (PE). However, VHA providers have reported low use of these treatments, and voiced their concerns over exposing patients to distress in PE and their patients not understanding CPT. In the current study, we surveyed VHA providers (N = 225) in PTSD clinical teams across the United States on their graduate school training experience in structured cognitive-behavioral therapy protocols, agreement with the 2 provider concerns, and use of the 2 treatments. Results from our mediation analyses indicated that graduate school training in structured protocols led to lower discomfort of exposing patients to distress during PE, and in turn, greater PE utilization. However, there was no significant relationship between graduate school training and CPT utilization. Findings suggest an important role for graduate training in the uptake of guideline recommended treatment for PTSD at VHA. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

  View details for DOI 10.1037/ser0000429

  View details for Web of Science ID 000716342900010

  View details for PubMedID 32378933

• A Glimpse into the "Black Box": Which Elements of Consultation in an EBP are Associated with Client Symptom Change and Therapist Fidelity? Implementation research and practice Mallard Swanson, K., Song, J., Beristianos, M., Aajmain, S., Lane, J. E., Landy, M. S., Suvak, M. K., Shields, N., Monson, C. M., Stirman, S. W. 2021; 2: 26334895211051791

  Abstract

  Background: Consultation is an implementation strategy that improves delivery and clinical outcomes for Cognitive Processing Therapy (CPT), an evidence-based practice (EBP) for posttraumatic stress disorder (PTSD). However, little is known about the specific components of consultation that influence the fidelity of treatment delivery or clinical outcomes. Methods: The current study examined whether specific activities performed during CPT consultation meetings were associated with better fidelity to the CPT protocol among 60 newly trained therapists or improved clinical outcomes among 135 clients treated by these therapists. Consultation activities that fall under three broad categories (discussion of the application of CPT to individual cases, review/feedback on fidelity, and technical difficulties) were measured by consultant checklists for each consultation session. Treatment fidelity (adherence to the protocol and competence of delivery) was rated by trained observers for a random sample of therapists' CPT sessions following consultation. The self-reported PTSD Checklist-IV assessed PTSD symptom change. Results: Multilevel regression analyses indicated that higher therapist consultation attendance predicted a greater decrease in their clients' PTSD symptoms and that attendance was not associated with observer-rated treatment fidelity. Discussion of the application of specific CPT strategies was the only consultation activity that was significantly associated with greater improvement in PTSD symptoms. Lastly, no consultation activities were significantly associated with treatment fidelity. Conclusions: Our findings suggest that specific consultation strategies such as emphasizing the discussion of the application of specific CPT strategies to individual cases during consultation meetings may be effective in improving the clinical outcomes of CPT.

  View details for DOI 10.1177/26334895211051791

  View details for PubMedID 37090000

  View details for PubMedCentralID PMC9978606

• Effectiveness of written exposure therapy for posttraumatic stress disorder in the Department of Veterans Affairs Healthcare System. Psychological trauma : theory, research, practice and policy LoSavio, S. T., Worley, C. B., Aajmain, S. T., Rosen, C. S., Wiltsey Stirman, S., Sloan, D. M. 2021

  Abstract

  OBJECTIVE: Written Exposure Therapy (WET) for posttraumatic stress disorder (PTSD) has been shown to be efficacious in clinical trials; however, research is needed to determine WET's effectiveness in clinical practice settings. Additionally, research is needed to understand whether patient characteristics or treatment delivery format moderate outcomes.METHOD: Patient outcomes (n = 277) were assessed as part of a multisite training and implementation program in the Department of Veterans Affairs (VA). During treatment, patients completed self-report measures of PTSD, depression, and functional impairment. Patient characteristics (i.e., demographics, psychiatric comorbidity, trauma type) and treatment delivery format (i.e., telehealth vs. in-person) were assessed as treatment moderators.RESULTS: Intent-to-treat analyses indicated that WET was effective in reducing PTSD symptoms (d = .84), depression symptoms (d = .47), and functional impairment (d = .36) during treatment. Approximately one quarter of patients dropped out of treatment prematurely. No moderators of PTSD treatment outcome were observed; however, telehealth delivery was associated with lower dropout.CONCLUSIONS: WET was an effective approach across a range of patient characteristics in this sample of veterans with PTSD. WET was also effective whether delivered in-person or via telehealth. WET is a promising treatment option for veteran patients in VA clinical care settings. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

  View details for DOI 10.1037/tra0001148

  View details for PubMedID 34726451

• Therapist Self-Efficacy in Delivering Cognitive Processing Therapy in a Randomized Controlled Implementation Trial COGNITIVE AND BEHAVIORAL PRACTICE Pace, B. T., Song, J., Suvak, M. K., Shields, N., Monson, C. M., Stirman, S. 2021; 28 (3): 327-335

  View details for Web of Science ID 000670526200001

• Strides Toward Recovery From Intimate Partner Violence: Elucidating Patient-Centered Outcomes to Optimize a Brief Counseling Intervention for Women JOURNAL OF INTERPERSONAL VIOLENCE Grillo, A. R., Danitz, S. B., Dichter, M. E., Driscoll, M. A., Gerber, M. R., Hamilton, A. B., Wiltsey-Stirman, S., Iverson, K. M. 2021; 36 (15-16): NP8431-NP8453

  View details for DOI 10.1177/0886260519846408

  View details for Web of Science ID 000673363400070

• Rising From the Ashes by Expanding Access to Community Care After Disaster: An Origin Story of the Wildfire Mental Health Collaborative and Preliminary Findings PSYCHOLOGICAL SERVICES Heinz, A. J., Wiltsey-Stirman, S., Sharin, T., Loskot, T., Mason, D., Jaworski, B. K., McGovern, M. 2021

  Abstract

  In October of 2017 and 2019, Sonoma County California endured historic wildfires and subsequent community trauma. The Sonoma Wildfire Mental Health Collaborative was created to (a) democratize access to evidence-based mental health resources and services for personal recovery and long-term community resilience building, and to (b) measure the reach and efficacy of the strategies employed in order to create a knowledge base to inform disaster response in other communities. Offerings included a mind-body yoga program and training in Skills for Psychological Recovery (SPR) for counselors who wished to provide services to individuals impacted by the wildfires. An evaluation of the mental health strategies employed revealed that (a) the mind-body program was well-received, with a high degree of satisfaction and self-reported benefit among individuals who attended trauma-informed yoga classes and (b) counselors found SPR to be a practical, flexible short-term intervention for individuals in the aftermath of the wildfires and expressed moderate to high levels of intent to use it in practice. Importantly, the evaluation of the 2017 wildfire mental health response was compromised by the Kincade Fire in 2019, in which prolonged mandatory evacuations and power outages impacted response rates. The origin story is shared for how a community collaborative was built. Lessons learned are discussed and recommendations summarized so as to contribute to the science and practice of disaster mental health outreach. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

  View details for DOI 10.1037/ser0000553

  View details for Web of Science ID 000733109800001

  View details for PubMedID 34180706

• Recovering From Intimate Partner Violence Through Strengths and Empowerment (RISE): Development, Pilot Testing, and Refinement of a Patient-Centered Brief Counseling Intervention for Women PSYCHOLOGICAL SERVICES Iverson, K. M., Danitz, S. B., Driscoll, M., Vogt, D., Hamilton, A. B., Gerber, M. R., Stirman, S., Shayani, D. R., Suvak, M. K., Dichter, M. E. 2021

  Abstract

  This article describes the rationale, development, and preliminary examination of a brief, variable-length (up to six sessions), modular-based counseling intervention for women who experience intimate partner violence (IPV). Recovering from IPV through Strengths and Empowerment (RISE) is an empowerment and skills-focused treatment that incorporates Motivational Interviewing. RISE was developed to fill the gap in interventions for women who disclose IPV within integrated healthcare settings such as the Veterans Health Administration (VHA). Fifteen women Veterans with past-year IPV participated in an open trial at two VHA hospitals to evaluate the potential helpfulness, feasibility, and acceptability of RISE using a mixed-methods approach to assessment. Qualitative feedback from women Veterans and five RISE clinicians (psychologists and social workers) was collected posttreatment. Descriptive analyses of quantitative psychosocial outcomes before and after the intervention provide evidence of support for RISE as potentially helpful in improving psychosocial well-being. High retention and high satisfaction ratings, along with positive qualitative feedback from both IPV survivor participants and clinicians, supported intervention feasibility and acceptability. Overall, this pilot study offers feasibility and acceptability data for RISE as a potentially helpful intervention for women experiencing past-year IPV. Refinements to RISE based on the open trial and subsequent testing of the clinical effectiveness of the intervention are discussed. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

  View details for DOI 10.1037/ser0000544

  View details for Web of Science ID 000733085000001

  View details for PubMedID 34110870

• A pilot study comparing tools for tracking implementation strategies and treatment adaptations. Implementation research and practice Walsh-Bailey, C., Palazzo, L. G., Jones, S. M., Mettert, K. D., Powell, B. J., Wiltsey Stirman, S., Lyon, A. R., Rohde, P., Lewis, C. C. 2021; 2: 26334895211016028

  Abstract

  Tailoring implementation strategies and adapting treatments to better fit the local context may improve their effectiveness. However, there is a dearth of valid, reliable, pragmatic measures that allow for the prospective tracking of strategies and adaptations according to reporting recommendations. This study describes the development and pilot testing of three tools to be designed to serve this purpose.Measure development was informed by two systematic reviews of the literature (implementation strategies and treatment adaptation). The three resulting tools vary with respect to the degree of structure (brainstorming log = low, activity log = moderate, detailed tracking log = high). To prospectively track treatment adaptations and implementation strategies, three stakeholder groups (treatment developer, implementation practitioners, and mental health providers) were randomly assigned one tool per week through an anonymous web-based survey for 12 weeks and incentivized to participate. Three established implementation outcome measures, the Acceptability of Intervention Measure, Intervention Appropriateness Measure, and Feasibility of Intervention Measure, were used to assess the tools. Semi-structured interviews were conducted to gather more nuanced information from stakeholders regarding their perceptions of the tools and the tracking process.The three tracking tools demonstrated moderate to good acceptability, appropriateness, and feasibility; the activity log was deemed the most feasible of the three tools. Implementation practitioners rated the tools the highest of the three stakeholder groups. The tools took an average of 15 min or less to complete.This study sought to fill methodological gaps that prevent stakeholders and researchers from discerning which strategies are most important to deploy for promoting implementation and sustainment of evidence-based practices. These tools would allow researchers and practitioners to track whether activities were treatment adaptations or implementation strategies and what barrier(s) each targets. These tools could inform prospective tailoring of implementation strategies and treatment adaptations, which would promote scale out and spread.Strategies to support the implementation of evidence-based practices may be more successful if they are carefully customized based on local factors. Evidence-based practices themselves may be thoughtfully changed to better meet the needs of the settings and recipients. This study reports on a pilot study that aimed to create various types of tools to help individuals involved in implementation efforts track the actions they take to modify and implement interventions. These tools allow individuals to track the types of activities they are involved in, when the activities occurred, who was involved in the implementation efforts, and the reasons or rationale for the actions. The three tools in this study used a combination of open-ended and forced-response questions to test how the type of data recorded changed. Participants generally found the tools quick and easy to use and helpful in planning the delivery of an evidence-based practice. Most participants wanted more training in implementation science terminology and how to complete the tracking tools. Participating mental health providers would have liked more opportunities to review the data collected from the tools with their supervisors to use the data to improve the delivery of the evidence-based practice. These tools can help researchers, providers, and staff involved in implementation efforts to better understand what actions are needed to improve implementation success. Future research should address gaps identified in this study, such as the need to involve more participants in the tool development process.

  View details for DOI 10.1177/26334895211016028

  View details for PubMedID 37090012

  View details for PubMedCentralID PMC9978654

• Sustainment of cognitive processing therapy: Reach and fidelity across three mental health systems Stirman, S., Finley, E., Lagdamen, J., Swanson, K., Song, J., Masina, T., Aajmain, S., LaBash, H., Suvak, M., Ramirez, V., Lane, J., Roesch, S., Shields, N., Monson, C. BMC. 2021

  View details for Web of Science ID 000652220000008

• The Effect of PTSD Symptom Change on Suicidal Ideation in a Combined Military and Civilian Sample Engaged in Cognitive Processing Therapy BEHAVIOR THERAPY Johnson, C. M., Holmes, S. C., Suvak, M. K., Song, J., Shields, N., Lane, J. M., Sijercic, I., Cohen, Z. D., Stirman, S., Monson, C. M. 2021; 52 (3): 774-784

  View details for Web of Science ID 000651119500019

• A Novel Approach to the Assessment of Fidelity to a Cognitive Behavioral Therapy for PTSD Using Clinical Worksheets: A Proof of Concept With Cognitive Processing Therapy BEHAVIOR THERAPY Stirman, S., Gutner, C. A., Gamarra, J., Suvak, M. K., Vogt, D., Johnson, C., Wachen, J., Dondanville, K. A., Yarvis, J. S., Mintz, J., Peterson, A. L., Young-McCaughan, S., Resick, P. A., STRONG STAR Consortium 2021; 52 (3): 656-672

  View details for Web of Science ID 000651119500010

• A personalized index to inform selection of a trauma-focused or non-trauma-focused treatment for PTSD. Behaviour research and therapy Stirman, S. W., Cohen, Z. D., Lunney, C. A., DeRubeis, R. J., Wiley, J. F., Schnurr, P. P. 2021; 142: 103872

  Abstract

  PTSD treatment guidelines recommend several treatments with extensive empirical support, including Prolonged Exposure (PE), a trauma-focused treatment and Present-Centered Therapy (PCT), a non-trauma-focused therapy. Research to inform treatment selection has yielded inconsistent findings with single prognostic variables that are difficult to integrate into clinical decision-making. We examined whether a combination of prognostic factors can predict different benefits in a trauma-focused vs. a non-trauma-focused psychotherapy. We applied a multi-method variable selection procedure and developed a prognostic index (PI) with a sample of 267 female veterans and active-duty service members (mean age 45; SD=9.37; 53% White) with current PTSD who began treatment in a randomized clinical trial comparing PE and PCT. We conducted linear regressions predicting outcomes (Clinician-Administered PTSD Scale score) with treatment condition, the PI, and the interaction between the PI and treatment condition. The interaction between treatment type and PI moderated treatment response, moderated post-treatment symptom severity,b= 0.30,SEb= 0.15 [95% CI: 0.01, 0.60],p= .049. For the 64% of participants with the best prognoses, PE resulted in better post-treatment outcomes; for the remainder, there was no difference. Use of a PI may lead to optimized patient outcomes and greater confidence when selecting trauma-focused treatments.

  View details for DOI 10.1016/j.brat.2021.103872

  View details for PubMedID 34051626

• The FRAME-IS: a framework for documenting modifications to implementation strategies in healthcare. Implementation science : IS Miller, C. J., Barnett, M. L., Baumann, A. A., Gutner, C. A., Wiltsey-Stirman, S. 2021; 16 (1): 36

  Abstract

  BACKGROUND: Implementation strategies are necessary to ensure that evidence-based practices are successfully incorporated into routine clinical practice. Such strategies, however, are frequently modified to fit local populations, settings, and contexts. While such modifications can be crucial to implementation success, the literature on documenting and evaluating them is virtually nonexistent. In this paper, we therefore describe the development of a new framework for documenting modifications to implementation strategies.DISCUSSION: We employed a multifaceted approach to developing the Framework for Reporting Adaptations and Modifications to Evidence-based Implementation Strategies (FRAME-IS), incorporating multiple stakeholder perspectives. Development steps included presentations of initial versions of the FRAME-IS to solicit structured feedback from individual implementation scientists ("think-aloud" exercises) and larger, international groups of researchers. The FRAME-IS includes core and supplementary modules to document modifications to implementation strategies: what is modified, the nature of the modification (including the relationship to core elements or functions), the primary goal and rationale for the modification, timing of the modification, participants in the modification decision-making process, and how widespread the modification is. We provide an example of application of the FRAME-IS to an implementation project and provide guidance on how it may be used in future work.CONCLUSION: Increasing attention is being given to modifications to evidence-based practices, but little work has investigated modifications to the implementation strategies used to implement such practices. To fill this gap, the FRAME-IS is meant to be a flexible, practical tool for documenting modifications to implementation strategies. Its use may help illuminate the pivotal processes and mechanisms by which implementation strategies exert their effects.

  View details for DOI 10.1186/s13012-021-01105-3

  View details for PubMedID 33827716

• Getting Routine Intimate Partner Violence Screening Right: Implementation Strategies Used in Veterans Health Administration (VHA) Primary Care. Journal of the American Board of Family Medicine : JABFM Adjognon, O. L., Brady, J. E., Gerber, M. R., Dichter, M. E., Grillo, A. R., Hamilton, A. B., Stirman, S. W., Iverson, K. M. 2021; 34 (2): 346–56

  Abstract

  BACKGROUND: Evidence supports the clinical effectiveness of intimate partner violence (IPV) screening programs, but less is known about implementing and sustaining them. This qualitative study identified implementation strategies used to integrate IPV screening programs within Veterans Health Administration (VHA) women's health primary care.METHODS: Thirty-two administrators and clinician key informants from 11 VHA facilities participated in semistructured interviews. Implementation strategies were identified using established definitions from implementation science literature, through multistep content analysis, involving site comparisons by implementation status.RESULTS: We identified 8 implementation strategies. Three were present across all sites: (1) conduct ongoing IPV trainings, (2) conduct educational meetings and outreach visits, and (3) develop and distribute educational materials. Five strategies were unique to early adopting sites: (4) identify and prepare champions, (5) change record systems to remind clinicians, (6) create a learning collaborative through advisory boards or workgroups, (7) audit and provide feedback with relay of clinical data to providers, and (8) access new funding.DISCUSSION: Strategies align with and extend literature addressing barriers to screening. Evidence shows that effective IPV screening implementation in primary care requires a bundle of well-defined, carefully selected strategies.CONCLUSIONS: Implementation strategies used collectively can enable integration of IPV screening programs in primary care.

  View details for DOI 10.3122/jabfm.2021.02.200311

  View details for PubMedID 33833003

• The Effect of Therapeutic Alliance on Dropout in Cognitive Processing Therapy for Posttraumatic Stress Disorder. Journal of traumatic stress Sijercic, I. n., Liebman, R. E., Stirman, S. W., Monson, C. M. 2021

  Abstract

  A substantial number of individuals who undergo cognitive processing therapy (CPT) for posttraumatic stress disorder (PTSD) drop out before receiving a full course of treatment. Therapeutic alliance, defined as the working relationship between the therapist and client, is a dynamic process within therapy that may change over time. Research suggests that therapeutic alliance is associated with dropout in various treatments. However, no studies have yet examined the association between therapeutic alliance and dropout in CPT, and few studies have examined therapeutic alliance longitudinally over the course of treatment. Examining alliance in CPT through different methods may increase clinicians' understanding of how to tailor interventions to prevent treatment dropout. The present study examined the association between therapeutic alliance and treatment dropout among 169 participants in a randomized implementation effectiveness trial. In total, 33.1% of clients dropped out over the course of CPT, and nearly half of these individuals dropped out during the first six sessions. Continuous-time survival analysis results indicated that mean ratings of alliance significantly predicted treatment dropout, Wald χ2 (1, N = 167) = 4.08, Exp(β) = .64, p = .043, whereas initial alliance, late alliance, and change in alliance over treatment did not. These findings suggest that overall therapeutic alliance is an important predictor of dropout from CPT.

  View details for DOI 10.1002/jts.22676

  View details for PubMedID 33772892

• Investigation of Therapist Effects on Patient Engagement in Evidence-Based Psychotherapies for Posttraumatic Stress Disorder in the Veterans Health Administration. Journal of traumatic stress Sayer, N. A., Wiltsey-Stirman, S., Rosen, C. S., Bernardy, N. C., Spoont, M. R., Kehle-Forbes, S. M., Eftekhari, A., Chard, K. M., Nelson, D. B. 2021

  Abstract

  The present study examined whether certain Veterans Health Administration (VHA) therapists have more success than others in keeping patients engaged in evidence-based psychotherapies for posttraumatic stress disorder (PTSD). Our objective was to use multilevel modeling to quantify the variability between therapists in two indicators of patient engagement: early dropout (i.e., < 3 sessions) and adequate dose (i.e., ≥ 8 sessions). The phenomenon of systematic variability between therapists in patients' treatment experience and outcomes is referred to as "therapist effects." The sample included the 2,709 therapists who provided individual cognitive processing therapy (CPT) or prolonged exposure (PE) to 18,461 veterans with PTSD across 140 facilities in 2017. Data were extracted from administrative databases. For CPT, therapist effects accounted for 10.9% of the variance in early dropout and 8.9% of the variance in adequate dose. For PE, therapist effects accounted for 6.0% and 8.8% of the variance in early dropout and adequate dose, respectively. Facility only accounted for an additional 1.1%-3.1% of the variance in early dropout and adequate dose. For CPT, patients' odds of receiving an adequate dose almost doubled, OR = 1.41/0.72 = 1.96, if they were seen by a therapist in the highest compared with the lowest retention decile. For PE, the odds of a patient receiving an adequate dose were 84% higher, OR = 1.38/0.75 = 1.84, when treated by a therapist in the highest compared with the lowest retention decile. Therapist skills and work environment may contribute to variability across therapists in early dropout and adequate dose.

  View details for DOI 10.1002/jts.22679

  View details for PubMedID 34048602

• Recovering From Intimate Partner Violence Through Strengths and Empowerment: Findings From a Randomized Clinical Trial. The Journal of clinical psychiatry Iverson, K. M., Danitz, S. B., Shayani, D. R., Vogt, D., Stirman, S. W., Hamilton, A. B., Mahoney, C. T., Gerber, M. R., Dichter, M. E. 2021; 83 (1)

  Abstract

  Objective: Recovering from Intimate Partner Violence through Strengths and Empowerment (RISE) is a brief, variable-length (1-6 sessions), modular, individualized psychosocial counseling intervention for women experiencing intimate partner violence (IPV). Pilot findings demonstrated the potential helpfulness, acceptability, and feasibility of RISE; however, a randomized clinical trial (RCT) is needed to support program effectiveness.Methods: This RCT enrolled 60 women who experienced IPV within the prior year. Participants were recruited from an urban Veterans Health Administration hospital (October 2018 to September 2020). Participants completed a pretreatment assessment that included measures of relevant outcomes (primary: empowerment, self-efficacy, patient activation, and valued living; secondary: depression symptoms, IPV, and satisfaction with the intervention) and were randomly assigned to RISE or an enhanced care as usual (ECAU) condition. RISE participants received 1 to 6 sessions. ECAU participants received a single session consisting of psychoeducation, safety planning, resources, and referrals. Participants were reassessed 10 and 14 weeks after enrollment.Results: Intent-to-treat analyses using unconditional growth models revealed significant time-by-condition effects: RISE participants demonstrated higher increases in empowerment (d = 3.46) and self-efficacy (d = 1.09). RISE participants also experienced significant improvements in valued living (d = 0.53), depression symptoms (d = 0.49), and IPV reduction (d = 1.07) over time; however, the lack of a significant difference by condition suggested similar effectiveness of the interventions on these outcomes. Satisfaction was significantly higher for RISE than ECAU (d = 1.23).Conclusions: Results indicate the effectiveness of RISE in enhancing psychosocial well-being, especially empowerment and self-efficacy, among women experiencing IPV, for whom accessible health care-based interventions are needed.Trial Registration: ClinicalTrials.gov identifier: NCT03261700.

  View details for DOI 10.4088/JCP.21m14041

  View details for PubMedID 34813687

• Changes in Community Clinicians' Attitudes and Competence following a Transdiagnostic Cognitive Behavioral Therapy Training. Implementation research and practice Creed, T. A., Crane, M. E., Calloway, A., Olino, T. M., Kendall, P. C., Stirman, S. W. 2021; 2

  Abstract

  Background: Although the literature suggest that attitudes toward evidence-based practices (EBPs) are associated with provider use of EBPs, less is known about the association between attitudes and how competently EBPs are delivered. This study examined how initial attitudes and competence relate to improvements in attitudes and competence following EBP training.Methods: Program evaluation data was collected during implementation of an EBP in a large community mental health network. Clinicians (N=891) received intensive training in cognitive behavioral therapy followed by six months of consultation. Attitudes were assessed using the Evidence-Based Practice Attitude Scale, and competence was assessed using the Cognitive Therapy Rating Scale. Data were analyzed by fitting three latent change score models to examine the relationship between changes in attitudes and competence across the training and within its two phases (workshop phase, consultation phase).Results: Latent change models identified significant improvement in attitudes (Ms latent change≥1.03, SEs≤ 0.18, zs≥6.55, ps< .001) and competence (Ms latent change ≥14.16, SEs≤3.10, zs≥2.82, ps<.001) across the full training and in each phase. Higher pre-workshop attitudes predicted significantly greater change in competence in the workshop and across training (bs≥1.62, SEs≤0.90, z≥1.09, p<.04, beta≥0.10); however, contrary to our hypothesis, post-workshop attitudes did not significantly predict change in competence in consultation (b=1.62, SE=0.86, z=1.87, p=.06, beta=0.09). Change in attitudes and change in competence in the training period and within the two phases were not significantly correlated.Conclusions: Results indicate that pre-training attitudes about EBPs present a target for implementation interventions, given their relation to changes in both attitudes and competence throughout training. Following participation in in itial training workshops, other factors such as subjective norms, implementation culture, or system-level policy shifts may be more predictive of change in competence through consultation.

  View details for DOI 10.1177/26334895211030220

  View details for PubMedID 34541540

• Expanding the reach of psychological science through implementation science: Introduction to the special issue. The American psychologist Wiltsey Stirman, S., Beidas, R. S. 2020; 75 (8): 1033–37

  Abstract

  Implementation science is the study of methods to promote the systematic uptake of effective practices into routine care settings with the broad goal of ensuring that scientific discoveries realize their potential and improve people's lives. As a field, implementation science includes three primary foci: (a) understanding the context in which individuals will implement practices that have a strong, established evidence base; (b) developing implementation approaches that target the factors that may accelerate or hinder implementation; and (c) conducting pragmatic trials to test these implementation approaches. Psychological science has contributed substantially to the knowledge and methods used in implementation science. In medicine and public health, these contributions have been leveraged to facilitate the uptake of screening and prevention programs, hand hygiene to reduce infection transmission, and many medical innovations. In behavioral health settings, implementation science has often focused on specific forms of psychotherapy, with emphasis on the evidence-based psychological practices that are highlighted in treatment guidelines. This article provides an overview of the field, with an emphasis on the bidirectional relationship between implementation science, and psychological science, illustrated through the articles in this special issue of the American Psychologist. It concludes with recommendations for future research at the intersection of implementation science and psychological science. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

  View details for DOI 10.1037/amp0000774

  View details for PubMedID 33252942

• An Intervention Mapping Process to Increase Evidence-Based Psychotherapy Within a Complex Healthcare System AMERICAN PSYCHOLOGIST Crowe, C., Collie, C., Johnson, C., Stirman, S. 2020; 75 (8): 1116–29

  Abstract

  In response to recommendations from the Special Committee on posttraumatic stress disorder (PTSD), the United States Department of Veterans Affairs, Veterans Health Administration (VHA) chartered a workgroup to identify strategies for improving the reach and fidelity of evidence-based psychotherapies (EBPs) implemented by VHA through clinician training initiatives. The workgroup, which comprised stakeholders in a variety of roles within the VHA, used an Intervention Mapping process, a practical approach to designing change strategies based on theory, evidence, and stakeholder input. High-level recommendations centered around implementation of recent VHA/Department of Defense (VA/DoD) treatment guidelines. In addition to recommended first-line and suggested second-line treatments, the guidelines include measurement-based care and shared decision making around EBPs and their alternatives to ensure that care is goal-oriented and patient-centered. To support increased reach and fidelity, the workgroup made four broad recommendations: (a) enhancing leadership support; (b) alignment of policies, programs, and processes that influence reach of EBPs as recommended in clinical practice guidelines, including implementation support to accompany EBP trainings; (c) use of clinical data to inform decision making at multiple levels, and to provide fidelity support when outcomes are lower than expected or desired; and (d) increasing veteran and stakeholder education and awareness of guideline recommendations and availability of EBPs. These recommendations accompanied a more detailed set of recommended steps for implementation. This article describes the Intervention Mapping process and a summary of resulting workgroup recommendations. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

  View details for DOI 10.1037/amp0000631

  View details for Web of Science ID 000595557900008

  View details for PubMedID 33252949

• Proceedings of the Fifth Biennial Conference of the Society for Implementation Research Collaboration (SIRC) 2019: where the rubber meets the road: the intersection of research, policy, and practice - part 1. Implementation science : IS Landes, S. J., Kerns, S. E., Pilar, M. R., Walsh-Bailey, C., Yu, S. H., Byeon, Y. V., Crane, M. E., Larson, M., Bullock, H. L., Baumann, A. A., Comtois, K. A., Darnell, D., Dorsey, S., Fizur, P., Lewis, C. C., Moullin, J. C., Pierson, A., Powell, B. J., Stanick, C. F., Wiltsey Stirman, S., Franks, R. P. 2020; 15 (Suppl 3): 76

  View details for DOI 10.1186/s13012-020-01034-7

  View details for PubMedID 32998755

• Graduate school training in structured cognitive behavioral therapy protocols predicts greater evidence based psychotherapy reach Song, J., Garcia, H., Finley, E., Stirman, S. BMC. 2020

  View details for Web of Science ID 000576910000136

• Patterns of change in physical functioning and posttraumatic stress disorder with cognitive processing therapy in a randomized controlled implementation trial. European journal of psychotraumatology Song, J., Johnson, C., Suvak, M. K., Shields, N., Lane, J. E., Monson, C. M., Wiltsey-Stirman, S. 2020; 11 (1): 1801166

  Abstract

  Background: Physical health concerns (e.g. chronic pain, fatigue) are common among clients with posttraumatic stress disorder (PTSD). Prior research has indicated that clients report improved physical functioning and fewer physical health symptoms after receiving Cognitive Processing Therapy (CPT) for PTSD. However, less is known about the impact of physical functioning on the clients' PTSD symptom improvement in CPT. Objective: The current study examined the patterns of change of and between physical functioning and PTSD symptoms over the course of CPT among a diverse military, veteran, and community sample. Method: We collected clients' (N = 188) physical functioning and PTSD symptom severity prior to and during CPT using the 12-Item Short Form Health Survey and the PTSD Checklist. We used multilevel modelling to 1) evaluate the impact of baseline physical functioning on the PTSD symptom trajectory, 2) examine the trajectory of physical functioning, and 3) assess the dynamics between physical functioning and PTSD symptoms over the course of CPT. Results: Our multilevel analyses indicated that 1) physical functioning significantly improved for those with low levels of functioning prior to treatment, 2) poorer baseline physical functioning predicted slower improvements in PTSD symptoms, and 3) poorer physical functioning in one session predicted less PTSD symptom improvement by the next session. Conclusions: Our findings demonstrate that while physical functioning can interfere with PTSD symptom improvement, physical functioning can also improve over the course of CPT. In light of the interconnected nature of physical health and PTSD symptoms, clinicians may need to attend to lower levels of physical functioning when providing CPT or other trauma-focused therapies. Future research to determine whether specific treatment adaptations may benefit such clients is needed.

  View details for DOI 10.1080/20008198.2020.1801166

  View details for PubMedID 33062209

  View details for PubMedCentralID PMC7534295

• Commentary: Challenges and Opportunites in the Assessment of Fidelity and Related Constructs. Administration and policy in mental health Stirman, S. W. 2020

  View details for DOI 10.1007/s10488-020-01069-4

  View details for PubMedID 32715432

• Clinician-Reported Modification to a CBT Approach in Children's Mental Health JOURNAL OF EMOTIONAL AND BEHAVIORAL DISORDERS Meza, R. D., Jungbluth, N., Sedlar, G., Martin, P., Berliner, L., Wiltsey-Stirman, S., Dorsey, S. 2020; 28 (2): 104–13

  View details for DOI 10.1177/1063426619828369

  View details for Web of Science ID 000532379000004

• Bidirectional Relationships Between Posttraumatic Stress Disorder and Social Functioning During Cognitive Processing Therapy. Behavior therapy Lord, K. A., Suvak, M. K., Holmes, S., Shields, N., Lane, J. E., Sijercic, I., Wagner, A. C., Stirman, S. W., Monson, C. M. 2020; 51 (3): 447–60

  Abstract

  This study investigated temporal relationships between posttraumatic stress symptoms and two indicators of social functioning during cognitive processing therapy. Participants were 176 patients (51.5% female, M age = 39.46 [SD = 11.51], 89.1% White, 42.6% active duty military/veteran) who participated in at least two assessment time points during a trial of cognitive processing therapy. Posttraumatic stress disorder (PTSD) symptoms (PTSD Checklist for DSM-IV) and interpersonal relationship and social role functioning problems (Outcome Questionnaire-45) were assessed prior to each of 12 sessions. Multivariate multilevel lagged analyses indicated that interpersonal relationship problems predicted subsequent PTSD symptoms (b = .22, SE = 0.09, cr = 2.53, p = .01, pr = .46) and vice versa (b = .05, SE = 0.02, cr = 2.11, p = .04, pr = .16); and social role functioning problems predicted subsequent PTSD symptoms (b = .21, SE = 0.10, cr = 2.18, p = .03, pr = .16) and vice versa (b = .06, SE = 0.02, cr = 3.08, p < .001, pr = .23). Military status moderated the cross-lag from social role functioning problems to PTSD symptoms (b = -.35, t = -2.00, p = .045, pr = .16). Results suggest a robust association between PTSD symptoms and social functioning during cognitive processing therapy with a reciprocal relationship between PTSD symptoms and social functioning over time. Additionally, higher social role functioning problems for patients with military status indicate smaller reductions in PTSD symptoms from session to session.

  View details for DOI 10.1016/j.beth.2019.08.002

  View details for PubMedID 32402260

• Feasibility of a 3-Week Intensive Treatment Program for Service Members and Veterans With PTSD PSYCHOLOGICAL TRAUMA-THEORY RESEARCH PRACTICE AND POLICY Held, P., Klassen, B. J., Boley, R. A., Stirman, S., Smith, D. L., Brennan, M. B., Van Horn, R., Pollack, M. H., Karnik, N. S., Zalta, A. K. 2020; 12 (4): 422–30

  Abstract

  The purpose of the present study was to detail the patient flow and establish the feasibility of a brief 3-week intensive treatment program (ITP) for veterans with posttraumatic stress disorder (PTSD).The present study examined data from 648 veterans referred to a non-Veterans Affairs ITP for PTSD from January 2016 to February 2018 to determine the flow of patients into and through the ITP and evaluate individuals' satisfaction with treatment.On average, 25.9 individuals contacted the ITP each month expressing interest in the program. A large proportion of individuals who completed an intake evaluation were accepted (72.2%) into the ITP. Of those accepted, 70.6% ultimately attended the ITP, and the vast majority of veterans who attended the ITP completed treatment (91.6%). Logistic regression results suggested that among veterans who were accepted to the program, those who were legally separated or divorced had significantly greater odds of attending the program compared to single veterans. Veterans were highly satisfied with the 3-week ITP and rated cognitive processing therapy components as the most helpful part of the program.The present study demonstrates that ITP formats for PTSD are of interest and acceptable to veterans, and this format allows individuals to receive high doses of evidence-based treatments in a short amount of time. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

  View details for DOI 10.1037/tra0000485

  View details for Web of Science ID 000525399500012

  View details for PubMedID 31318250

  View details for PubMedCentralID PMC6980160

• Message Delivery for the Treatment of Posttraumatic Stress Disorder: Longitudinal Observational Study of Symptom Trajectories. Journal of medical Internet research Malgaroli, M., Hull, T. D., Wiltsey Stirman, S., Resick, P. 2020; 22 (4): e15587

  Abstract

  BACKGROUND: Individuals with posttraumatic stress disorder (PTSD) face symptoms that can hinder access to treatment, such as avoidance and guilt. Telemedicine offers a technological solution to increase access to mental health care and overcome barriers to treatment. Although an increasing body of literature focused on synchronous telehealth (eg, live video), no studies have examined the delivery of PTSD treatment via two-way multimedia messages (ie, texting or messaging).OBJECTIVE: The aim of this study was to conduct a longitudinal observation of treatment for PTSD delivered using two-way asynchronous messaging. We also sought to identify individual and treatment characteristics that could predict the observed outcome differences.METHODS: Outpatients diagnosed with PTSD (N=475) received interventions from licensed therapists, which were delivered via messaging once or more than once per day, 5 days a week for 12 weeks. PTSD symptoms were assessed every 3 weeks using the PTSD Checklist for Diagnostic and Statistical Manual of Mental Disorders-5. Trajectories of PTSD symptoms were identified using growth mixture modeling (GMM). Using logistic regression, the demographic, treatment, and messaging characteristics of patient groups that improved were compared with the characteristics of patient groups that did not improve.RESULTS: The GMM identified 4 trajectories of PTSD symptoms: moderate improvement (197/475, 41.4%), high symptoms (197/475, 41.4%), chronic symptoms (61/475, 12.9%), and acute improvement (20/475, 4.3%). Patients with a clinically significant reduction in PTSD symptoms (231/475, 48.6%) were more likely to communicate via video (odds ratio [OR] 1.01, 95% CI 1.01-1.05; P=.03), have a higher working alliance with their therapist (OR 1.03, 95% CI 1.01-1.05; P=.02), and be at their first treatment experience (OR 2.03, 95% CI 1.18-3.54; P=.01). Treatment adherence was associated with greater therapeutic alliance (OR 1.07, 95% CI 1.03-1.10; P<.001), education (OR 2.13, 95% CI 1.13-4.03; P=.02), and more patient-generated messages per week (OR 1.08, 95% CI 1.04-1.13; P<.001).CONCLUSIONS: Multimedia message delivery for PTSD treatment showed symptom-reduction rates similar to traditional forms of treatment delivery, suggesting further study of messaging as a treatment medium. Most patients completed an 8-week course, reflecting the acceptability of messaging interventions. Delivering treatment via two-way messaging offers increased opportunities for widespread access to mental health care.

  View details for DOI 10.2196/15587

  View details for PubMedID 32347814

• Provider General Attitudes Versus Specific Perceptions of Evidence-Based Psychotherapies for PTSD PSYCHOLOGICAL SERVICES Cook, J. M., Thompson, R., Simiola, V., Stirman, S., Schnurr, P. P. 2020; 17 (1): 46–53

  Abstract

  This study examined the role of attitudes toward evidence-based psychotherapies (EBPs) in predicting use of prolonged exposure (PE) and cognitive processing therapy (CPT), two EBPs for posttraumatic stress disorder (PTSD) among PTSD treatment providers within the Department of Veterans Affairs. Providers' general attitudes toward EBPs, as well as their specific perceptions of PE and CPT, were examined as potential predictors of use. One hundred fifty-nine providers from 38 Department of Veterans Affairs' residential PTSD programs across the United States completed an online survey that included the predictors listed as well as self-reported use of PE on an individual basis and CPT on an individual and on a group basis. Although general attitudes toward EBPs were related to use of individually administered CPT, they were not related to use of PE or group-administered CPT. For each of the 3 treatments, however, specific positive perceptions were related to use. In examination of other training, skill, and delivery-related variables, general attitudes appear more in line with perceptions and delivery of CPT than PE. Perhaps this is because of the unique exposure component of PE. Assessing provider perceptions of specific EBPs may help providers in guiding their own practice as well as aid treatment developers, trainers, and administrators to more effectively tailor dissemination and implementation efforts. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

  View details for DOI 10.1037/ser0000280

  View details for Web of Science ID 000509400100006

  View details for PubMedID 30265069

  View details for PubMedCentralID PMC6437015

• Iterative Decision-making for Evaluation of Adaptations (IDEA): A decision tree for balancing adaptation, fidelity, and intervention impact. Journal of community psychology Miller, C. J., Wiltsey-Stirman, S., Baumann, A. A. 2020

  Abstract

  BACKGROUND: Evidence-based practices (EBPs) are frequently adapted to maximize outcomes while maintaining fidelity to core EBP elements. Many step-by-step frameworks for adapting EBPs have been developed, but these models may not account for common complexities in the adaptation process. In this paper, we introduce the Iterative Decision-making for Evaluation of Adaptations (IDEA), a tool to guide adaptations that addresses these issues.FRAMEWORK DESIGN AND USE: Adapting EBPs requires attending to key contingencies incorporated into the IDEA, including: the need for adaptations; fidelity to core EBP elements; the timeframe in which to make adaptations; the potential to collect pilot data; key clinical and implementation outcomes; and stakeholder viewpoints. We use two examples to illustrate application of the IDEA.CONCLUSIONS: The IDEA is a practical tool to guide EBP adaptation that incorporates important decision points and the dynamism of ongoing adaptation. Its use may help implementation scientists, clinicians, and administrators maximize EBP impact.

  View details for DOI 10.1002/jcop.22279

  View details for PubMedID 31970812

• Effectiveness of training methods for delivery of evidence-based psychotherapies: a systematic review. Implementation science : IS Valenstein-Mah, H. n., Greer, N. n., McKenzie, L. n., Hansen, L. n., Strom, T. Q., Wiltsey Stirman, S. n., Wilt, T. J., Kehle-Forbes, S. M. 2020; 15 (1): 40

  Abstract

  Extensive efforts have been made to train mental health providers in evidence-based psychotherapies (EBPs); there is increasing attention focused on the methods through which providers are trained to deliver EBPs. Evaluating EBP training methods is an important step in determining which methods are most effective in increasing provider skill and improving client outcomes.We searched MEDLINE (Ovid) and PsycINFO for randomized controlled trials published from 1990 through June 2019 that evaluated EBP training methods to determine the effectiveness of EBP training modalities on implementation (provider and cost) and client outcomes. Eligible studies (N = 28) were evaluated for risk of bias, and the overall strength of evidence was assessed for each outcome. Data was extracted by a single investigator and confirmed by a second; risk of bias and strength of evidence were independently rated by two investigators and determined by consensus.Overall, EBP training improved short-term provider satisfaction, EBP knowledge, and adherence compared to no training or self-study of training materials (low to moderate strength of evidence). Training in an EBP did not increase treatment adoption compared to no training or self-study. No specific active EBP training modality was found to consistently increase provider EBP knowledge, skill acquisition/adherence, competence, adoption, or satisfaction compared to another active training modality. Findings were mixed regarding the additive benefit of post-training consultation on these outcomes. No studies evaluated changes in provider outcomes with regards to training costs and few studies reported on client outcomes.The majority of included studies had a moderate risk of bias and strength of evidence for the outcomes of interest was generally low or insufficient. Few studies reported effect sizes. The ability to identify the most effective EBP training methods was limited by low strength of evidence for the outcomes of interest and substantial heterogeneity among studies.EBP training may have increased short-term provider satisfaction, EBP knowledge, and adherence though not adoption. Evidence was insufficient on training costs and client outcomes. Future research is needed on EBP training methods, implementation, sustainability, client outcomes, and costs to ensure efforts to train providers in EBPs are effective, efficient, and durable.The protocol for this review is registered in PROSPERO (CRD42018093381).

  View details for DOI 10.1186/s13012-020-00998-w

  View details for PubMedID 32460866

• Targeted assessment and context-tailored implementation of change strategies (TACTICS) to increase evidence based psychotherapy in military behavioral health clinics: Design of a cluster-randomized stepped-wedge implementation study. Contemporary clinical trials Rosen, C. S., Davis, C. A., Riggs, D. n., Cook, J. n., Peterson, A. L., Young-McCaughan, S. n., Comtois, K. A., Haddock, C. K., Borah, E. V., Dondanville, K. A., Finley, E. P., Jahnke, S. A., Poston, W. S., Wiltsey-Stirman, S. n., Neitzer, A. n., Broussard, C. R., Brzuchalski, M. A., Clayton, M. S., Conforte, L. T., Flores, A. n., Hein, J. n., Keith, C. F., Jinkerson, C. J., Letendre, M. n., Nofziger, D. n., Pollick, K. n., Santiago, C. K., Waggoner, L. C., Woodworth, C. n., McLean, C. P. 2020: 106008

  Abstract

  Despite efforts by the U.S. Department of Defense to train behavioral health (BH) providers in evidence-based psychotherapies (EBPs) for posttraumatic stress disorder (PTSD), numerous barriers limit EBP implementation. A context-tailored implementation approach called TACTICS (Targeted Assessment and Context-Tailored Implementation of Change Strategies) holds promise for increasing the use of EBPs such as prolonged exposure therapy (PE) in military treatment facilities. TACTICS combines a needs assessment, a rubric for selecting implementation strategies based on local barriers, an implementation toolkit, and external facilitation to support local champions and their implementation teams in enacting changes. This paper describes the rationale for and design of a study that will evaluate whether TACTICS can increase implementation of PE for PTSD and improve patient outcomes in military BH clinics relative to provider training in PE alone.The study is a multi-site, cluster randomized, stepped-wedge trial, with the military treatment facility as the unit of analysis. Eight facilities undergo a provider-training phase, followed by 5 months of TACTICS implementation. The timing of TACTICS at each facility is randomly assigned to begin 9, 14, or 19 months after beginning the provider-training phase. Primary analyses will compare the proportion of PTSD patients receiving PE and patients' mean improvement in PTSD symptoms before and after the onset of TACTICS.TACTICS endeavors to balance standardization of empirically-supported implementation strategies with the flexibility of application necessary for success across varied clinical settings. If successful, TACTICS may represent a systematic and scalable method of promoting and supporting EBP implementation.Clinicaltrials.gov Identifier: NCT03663452.

  View details for DOI 10.1016/j.cct.2020.106008

  View details for PubMedID 32330670

• Realizing the Promise of Learning Organizations to Transform Mental Health Care: Telepsychiatry Care As an Exemplar. Psychiatric services (Washington, D.C.) Beidas, R. S., Wiltsey Stirman, S. n. 2020: appips202000257

  Abstract

  To address the global mental health crisis exacerbated by the COVID-19 pandemic, an urgent need has emerged to transform the accessibility, efficiency, and quality of mental health care. The next suite of efforts to transform mental health care must foster the implementation of "learning organizations," that is, organizations that continuously improve patient-centered care through ongoing data collection. The concept of learning organizations is highly regarded, but the key features of such organizations, particularly those providing mental health care, are less well defined. Using telepsychiatry care as an example, the authors of this Open Forum concretely describe the key building blocks for operationalizing a learning organization in mental health care to set a research agenda for services transformation.

  View details for DOI 10.1176/appi.ps.202000257

  View details for PubMedID 32781927

• Patterns of change in physical functioning and posttraumatic stress disorder with cognitive processing therapy in a randomized controlled implementation trial EUROPEAN JOURNAL OF PSYCHOTRAUMATOLOGY Song, J., Johnson, C., Suvak, M. K., Shields, N., Lane, J. M., Monson, C. M., Wiltsey-Stirman, S. 2020; 11 (1)

  View details for DOI 10.1080/20008198.2020.1801166

  View details for Web of Science ID 000570655500001

• Towards a comprehensive model for understanding adaptations' impact: the model for adaptation design and impact (MADI). Implementation science : IS Kirk, M. A., Moore, J. E., Wiltsey Stirman, S., Birken, S. A. 2020; 15 (1): 56

  Abstract

  BACKGROUND: Implementation science is shifting from qualifying adaptations as good or bad towards understanding adaptations and their impact. Existing adaptation classification frameworks are largely descriptive (e.g., who made the adaptation) and geared towards researchers. They do not help practitioners in decision-making around adaptations (e.g., is an adaptation likely to have negative impacts? Should it be pursued?). Moreover, they lack constructs to consider "ripple effects" of adaptations (i.e., both intended and unintended impacts on outcomes, recognizing that an adaptation designed to have a positive impact on one outcome may have unintended impacts on other outcomes). Finally, they do not specify relationships between adaptations and outcomes, including mediating and moderating relationships. The objective of our research was to promote systematic assessment of intended and unintended impacts of adaptations by using existing frameworks to create a model that proposes relationships among constructs.MATERIALS AND METHODS: We reviewed, consolidated, and refined constructs from two adaptation frameworks and one intervention-implementation outcome framework. Using the consolidated and refined constructs, we coded qualitative descriptions of 14 adaptations made to an existing evidence-based intervention; the 14 adaptations were designed in prior research by a stakeholder panel using a modified Delphi approach. Each of the 14 adaptations had detailed descriptions, including the nature of the adaptation, who made it, and its goal and reason. Using coded data, we arranged constructs from existing frameworks into a model, the Model for Adaptation Design and Impact (MADI), that identifies adaptation characteristics, their intended and unintended impacts (i.e., ripple effects), and potential mediators and moderators of adaptations' impact on outcomes. We also developed a decision aid and website ( MADIguide.org ) to help implementation scientists apply MADI in their work.RESULTS AND CONCLUSIONS: Our model and associated decision aids build on existing frameworks by comprehensively characterizing adaptations, proposing how adaptations impact outcomes, and offering practical guidance for designing adaptations. MADI encourages researchers to think about potential causal pathways of adaptations (e.g., mediators and moderators) and adaptations' intended and unintended impacts on outcomes. MADI encourages practitioners to design adaptations in a way that anticipates intended and unintended impacts and leverages best practice from research.

  View details for DOI 10.1186/s13012-020-01021-y

  View details for PubMedID 32690104

• Training During a Pandemic: Successes, Challenges, and Practical Guidance From a Virtual Facilitated Learning Collaborative Training Program for Written Exposure Therapy. Journal of traumatic stress Worley, C. B., LoSavio, S. T., Aajmain, S. n., Rosen, C. n., Stirman, S. W., Sloan, D. M. 2020

  Abstract

  In response to COVID-19, continued workforce training is essential to ensure that evidence-based treatments are available on the frontline to meet communities' ongoing and emerging mental health needs. However, training during a pandemic imposes many new challenges. This paper describes a multisite training and implementation pilot program, facets of which allowed for continued training despite the onset of the COVID-19 pandemic and subsequent social distancing guidelines. This virtual facilitated learning collaborative in Written Exposure Therapy, an evidence-based treatment for posttraumatic stress disorder, included virtual workshop training, phone-based clinical consultation, implementation-focused video calls for program leadership, and program evaluation. Data are presented about program enrollees and patient impact following the onset of COVID-19-related social distancing restrictions. Challenges, successes, and practical guidance are discussed to inform the field regarding training strategies likely to be durable in an uncertain, dynamic healthcare landscape.

  View details for DOI 10.1002/jts.22589

  View details for PubMedID 33007149

• When user-centered design meets implementation science: integrating provider perspectives in the development of an intimate partner violence intervention for women treated in the United States' largest integrated healthcare system. BMC women's health Danitz, S. B., Stirman, S. W., Grillo, A. R., Dichter, M. E., Driscoll, M., Gerber, M. R., Gregor, K., Hamilton, A. B., Iverson, K. M. 2019; 19 (1): 145

  Abstract

  BACKGROUND: Intimate partner violence (IPV) against women is a global health problem that is a substantial source of human suffering. Within the United States (US), women veterans are at high risk for experiencing IPV. There is an urgent need for feasible, acceptable, and patient-centered IPV counseling interventions for the growing number of women treated in the US's largest integrated healthcare system, the Veterans Health Administration (VHA). Implementation science and user-centered-design (UCD) can play an important role in accelerating the research-to-practice pipeline. Recovering from IPV through Strengths and Empowerment (RISE) is a flexible, patient-centered, modular-based program that holds promise as a brief counseling intervention for women veterans treated in VHA. We utilized a UCD approach to develop and refine RISE (prior to formal effectiveness evaluations) by soliciting early feedback from the providers where the intervention will ultimately be implemented. The current study reports on the feedback from VHA providers that was used to tailor and refine RISE.METHOD: We conducted and analyzed semi-structured, key-informant interviews with VHA providers working in clinics relevant to the delivery of IPV interventions (n=23) at two large medical centers in the US. Participants' mean age was 42.6years (SD=11.6), they were predominately female (91.3%) and from a variety of relevant disciplines (39.1% psychologists, 21.7% social workers, 17.4% physicians, 8.7% registered nurses, 4.3% psychiatrists, 4.3% licensed marriage and family therapists, 4.3% peer specialists). We conducted rapid content analysis using a hybrid inductive-deductive approach.RESULTS: Providers perceived RISE as highly acceptable and feasible, noting strengths including RISE's structure, patient-centered agenda, and facilitation of provider comfort in addressing IPV. Researchers identified themes related to content and context modifications, including requests for additional safety check-ins, structure for goal-setting, and suggestions for how to develop and implement RISE-specific trainings.CONCLUSIONS: These findings have guided refinements to RISE prior to formal effectiveness testing in VHA. We discuss implications for the use of UCD in intervention development and refinement for interventions addressing IPV and other trauma in health care settings globally.TRIAL REGISTRATION: ClinicalTrials.gov identifier: NCT03261700; Date of registration: 8/25/2017, date of enrollment of first participant in trial: 10/22/2018. Unique Protocol ID: IIR 16-062.

  View details for DOI 10.1186/s12905-019-0837-8

  View details for PubMedID 31771557

• Examining patterns of dose response for clients who do and do not complete cognitive processing therapy. Journal of anxiety disorders Holmes, S. C., Johnson, C. M., Suvak, M. K., Sijercic, I., Monson, C. M., Wiltsey Stirman, S. 2019: 102120

  Abstract

  Trauma-focused therapies, including Cognitive Processing Therapy (CPT; Resick et al., 2016), are effective at reducing clients' PTSD symptoms. A limitation to these treatments, however, is client completion of them. The current study examined temporal patterns of treatment non-completion and the relationships among non-completion, PTSD, and overall mental health functioning outcomes, among clients in a randomized controlled CPT implementation trial. Two models of symptom change were tested: 1) dose-effect model (i.e., clients uniformly improve with additional sessions at a negatively accelerating rate); and 2) the good-enough level model (i.e., clients remain in therapy until they have achieved sufficient improvement, thus clients who attend fewer sessions improve at quicker rates). Results indicated that 42% of clients did not complete treatment, with most discontinuing between sessions two and five. Data did not fit the dose-effect or good-enough level model. Rather, clients who improved at a greater rate in their PTSD symptoms and overall mental health functioning attended more sessions. The average client had the best outcomes when they completed all 12 sessions. Identifying clients who may be at risk for discontinuing treatment, and making a concerted effort toward retaining them, is imperative to reduce non-completion rates and ultimately improve client outcomes.

  View details for DOI 10.1016/j.janxdis.2019.102120

  View details for PubMedID 31585686

• The Association Between Clinician and Perceived Organizational Factors withEarly Fidelity to Cognitive Processing Therapy for Posttraumatic Stress Disorder in a Randomized Controlled Implementation Trial. Administration and policy in mental health Sijercic, I., Lane, J. E., Gutner, C. A., Monson, C. M., Stirman, S. W. 2019

  Abstract

  A common metric for determining implementation success is the measurement of clinician adherence to, and competence in, delivering a psychotherapy. The present study examined clinician and organizational factors as predictors of early adherence and competence among 78 clinicians delivering cognitive processing therapy (CPT), an evidence-based psychotherapy (EBP) for posttraumatic stress disorder, in a randomized controlled implementation trial. Results indicated that clinicians' willingness to adopt an EBP if required to do so was significantly associated with early adherence and competence in CPT delivery. Level of clinician education was significantly associated with early competence in delivering CPT. Organizational factors did not predict early adherence or competence. Implications of the findings are discussed.

  View details for DOI 10.1007/s10488-019-00966-7

  View details for PubMedID 31463667

• Intimate Partner Violence Screening Programs in the Veterans Health Administration: Informing Scale-up of Successful Practices. Journal of general internal medicine Iverson, K. M., Adjognon, O., Grillo, A. R., Dichter, M. E., Gutner, C. A., Hamilton, A. B., Stirman, S. W., Gerber, M. R. 2019

  Abstract

  OBJECTIVES: Screening women for intimate partner violence (IPV) is increasingly expected in primary care, consistent with clinical prevention guidelines (e.g., United States Preventive Services Task Force). Yet, little is known about real-world implementation of clinical practices or contextual factors impacting IPV screening program success. This study identified successful clinical practices, and barriers to and facilitators of IPV screening program implementation in the Veterans Health Administration (VHA).DESIGN: Descriptive, qualitative study of a purposeful sample of 11 Veterans Affairs Medical Centers (VAMCs) categorized as early and late adopters of IPV screening programs within women's health primary care clinics. VAMCs were categorized based on performance measures collected by VHA operations partners.PARTICIPANTS: Thirty-two administrators and clinician key informants (e.g., Women's Health Medical Directors, IPV Coordinators, and physicians) involved in IPV screening program implementation decisions from six early- and five late-adopting sites nationwide.MAIN MEASURES: Participants reported on IPV screening and response practices, and contextual factors impacting implementation, in individual 1-h semi-structured phone interviews. Transcripts were analyzed using rapid content analysis with key practices and issues synthesized in profile summaries. Themes were identified and iteratively revised, utilizing matrices to compare content across early- and late-adopting sites.KEY RESULTS: Five successful clinical practices were identified (use of two specific screening tools for primary IPV screening and secondary risk assessment, multilevel resource provision and community partnerships, co-location of mental health/social work, and patient-centered documentation). Multilevel barriers (time/resource constraints, competing priorities and mounting responsibilities in primary care, lack of policy, inadequate training, and discomfort addressing IPV) and facilitators (engaged IPV champions, internal and external supports, positive feedback regarding IPV screening practices, and current, national attention to violence against women) were identified.CONCLUSIONS: Findings advance national efforts by highlighting successful clinical practices for IPV screening programs and informing strategies useful for enhancing their implementation within and beyond the VHA, ultimately improving services and women's health.

  View details for DOI 10.1007/s11606-019-05240-y

  View details for PubMedID 31420827

• Treatment selection among posttraumatic stress disorder (PTSD) specialty care providers in the Veterans Health Administration: A thematic analysis. Psychological trauma : theory, research, practice and policy Finley, E. P., Garcia, H. A., Ramirez, V. A., Haro, E. K., Mignogna, J., DeBeer, B., Wiltsey-Stirman, S. 2019

  Abstract

  OBJECTIVE: Although efforts to implement evidence-based psychotherapies (EBPs) require understanding how providers view and initiate these interventions, little is known regarding provider treatment selection in posttraumatic stress disorder (PTSD) care. The current study examines how specialty PTSD clinic providers within the Veterans Health Administration (VHA) describe reasons for selecting specific psychotherapies in PTSD treatment planning.METHOD: VHA psychotherapists in specialty PTSD care clinics completed a national online survey of treatment attitudes and practices, including an open-ended item inquiring about treatment selection. Thematic analysis was used to develop a framework describing factors in VHA providers' PTSD treatment selection.RESULTS: Of 250 survey participants, 219 provided description of their treatment selection process. Providers identified four domains of factors impacting treatment planning: (1) provider factors (e.g., training), (2) perceived characteristics of the intervention (e.g., structural features), (3) patient factors (e.g., characteristics of the patient and symptom presentation), and (4) organizational context (e.g., VHA policy). Assessment of appropriate treatments for an individual patient was described as resulting from interaction across these domains, particularly perceived fit between patient needs and specific treatments.CONCLUSIONS: Provider decision making has been understudied in implementation science. Although prior research has emphasized the role of organizational context in EBP reach, our findings suggest that other factors are salient when decisions are made at the level of the individual patient. Results suggest that increased attention to treatment selection and focused training in use of decision aids and shared decision making may have utility in increasing uptake, reach, and sustainment of EBPs among VHA PTSD specialty providers. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

  View details for DOI 10.1037/tra0000477

  View details for PubMedID 31204813

• Strides Toward Recovery From Intimate Partner Violence: Elucidating Patient-Centered Outcomes to Optimize a Brief Counseling Intervention for Women. Journal of interpersonal violence Grillo, A. R., Danitz, S. B., Dichter, M. E., Driscoll, M. A., Gerber, M. R., Hamilton, A. B., Wiltsey-Stirman, S., Iverson, K. M. 2019: 886260519840408

  Abstract

  Women in the United States continue to experience intimate partner violence (IPV) at unprecedented rates, necessitating the development and implementation of personalized, effective healthcare-based interventions. Methods of developing patient-centered interventions for IPV should elicit the voice of the target population (i.e., women who experience IPV) while assuring that outcomes identified as important are incorporated into the refined intervention. This pilot study is part of a multiphase, larger study aiming to refine an IPV intervention and clinical outcome measurements prior to formal evaluation of the effectiveness of the intervention. Specifically, this study elucidates patient-centered outcomes identified by women who have experienced IPV. Women patients of the Veterans Health Administration (VHA) in New England participated in focus groups to provide feedback and desired outcomes of a new IPV intervention. Patient-centered outcomes were defined by the participants. Focus groups were transcribed and analyzed using conventional content analysis and matrix analysis. A total of 25 women participated in focus groups ( n = 5) at two large VHA facilities. Participant feedback revealed five common themes related to desired outcomes. Women opined increased feelings of empowerment as a key outcome of engaging in an IPV intervention. Women desired increased social connectedness and support to be gained during treatment, citing providers and other survivors of IPV as exemplary sources. Self-esteem was viewed as critical to enhancing recovery, as was increased knowledge across domains of IPV (e.g., warning signs, the link between mental and physical health for self and children). Finally, women identified valued action and goal setting, such as achieving more independence, as an optimal outcome. Addressing IPV against women requires patient-centered interventions that specifically target the types of outcomes deemed important by the end users: women who experience IPV. Findings have implications for tailoring treatments for IPV and selecting measures that tap into women's desired outcomes.

  View details for PubMedID 30994401

• Randomized Cost-Effectiveness Trial of Group Interpersonal Psychotherapy (IPT) for Prisoners With Major Depression JOURNAL OF CONSULTING AND CLINICAL PSYCHOLOGY Johnson, J. E., Stout, R. L., Miller, T. R., Zlotnick, C., Cerbo, L. A., Andrade, J. T., Nargiso, J., Bonner, J., Wiltsey-Stirman, S. 2019; 87 (4): 392–406

  Abstract

  This study tested the effectiveness and cost-effectiveness of interpersonal psychotherapy (IPT) for major depressive disorder (MDD) among prisoners. It is the first fully powered randomized trial of any treatment (pharmacological or psychosocial) targeting MDD among incarcerated individuals.One hundred eighty-one male (n = 117) and female (n = 64) prisoners from prison facilities in 2 states were randomized to group IPT (delivered by master's-level and nonspecialist prison counselors) for MDD plus prison treatment as usual (TAU) or to TAU alone. Participants' average age was 39 (range = 20-61); 20% were African American and 19% were Hispanic. Outcomes assessed at posttreatment and 3-month follow-up included depressive symptoms (primary; assessed using the Hamilton Rating Scale for Depression), suicidality (assessed with the Beck Scale for Suicide Ideation and Beck Hopelessness Scale), in-prison functioning (i.e., enrollment in correctional programs; discipline reports; aggression/victimization; and social support), remission from MDD, and posttraumatic stress disorder symptoms.IPT reduced depressive symptoms, hopelessness, and posttraumatic stress disorder symptoms, and increased rates of MDD remission relative to prison TAU alone. Effects on hopelessness were particularly strong. Cost per patient was $2,054 including costs for IPT training and supervision or $575 without these costs. For providers running their second or subsequent IPT group, cost per additional week in remission from MDD (relative to TAU alone) was $524 ($148 excluding training and supervision costs, which would not be needed for established programs).IPT is effective and cost-effective and we recommend its use for MDD among prisoners. It is currently the only treatment for MDD evaluated among incarcerated individuals. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

  View details for DOI 10.1037/ccp0000379

  View details for Web of Science ID 000461486100007

  View details for PubMedID 30714749

  View details for PubMedCentralID PMC6482450

• Provider Fidelity and Modifications to Cognitive Processing Therapy in a Diverse Community Health Clinic: Associations With Clinical Change JOURNAL OF CONSULTING AND CLINICAL PSYCHOLOGY Marques, L., Valentine, S. E., Kaysen, D., Mackintosh, M., De Silva, L., Ahles, E. M., Youn, S., Shtasel, D. L., Simon, N. M., Wiltsey-Stirman, S. 2019; 87 (4): 357–69

  Abstract

  The purpose of this study is to examine associations between therapist adherence, competence, and modifications of an evidence-based protocol (EBP) delivered in routine clinical care and client outcomes.Data were derived from a NIMH-funded implementation-effectiveness hybrid study of Cognitive Processing Therapy (CPT) for PTSD in a diverse community health center. Providers (n = 19) treated clients (n = 58) as part of their routine clinical care. Clients completed the PCL-S and PHQ-9 at baseline, after each CPT session, and posttreatment. CPT sessions were rated for treatment fidelity and therapist modifications.Overall, therapist adherence was high, although it decreased across sessions suggesting potential drift. Therapist competence ratings varied widely. Therapists made on average 1.6 fidelity-consistent and 0.4 fidelity-inconsistent modifications per session. Results show that higher numbers of fidelity-consistent modifications were associated with larger reductions in posttraumatic stress and depressive symptoms. High adherence ratings were associated with greater reductions in depressive symptoms, whereas higher competence ratings were associated with greater reduction in posttraumatic stress symptoms.The results highlight the importance of differentially assessing therapist adherence, competence, and modifications to EBP in usual care settings. The findings also suggest that effective EBP delivery in routine care may require minor adaptations to meet client needs, consistent with previous studies. Greater attention to fidelity and adaptation can enhance training so providers can tailor while retaining core components of the intervention. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

  View details for DOI 10.1037/ccp0000384

  View details for Web of Science ID 000461486100004

  View details for PubMedID 30883163

  View details for PubMedCentralID PMC6430611

• Developing a rubric for matching implementation strategies to barriers: Cross-walking implementation theory and practice Rosen, C., Riggs, D., Peterson, A., Young-McCaughan, S., Borah, E., Brim, W., Comtois, K., Cook, J., Davis, C., Dondanville, K., Finley, E., French, L., Mistretta, M., Neitzer, A., Wiltsey-Stirman, S., McLean, C. BMC. 2019

  View details for Web of Science ID 000584552900071

• Getting intimate partner violence screening implementation right: Identifying best clinical practices, implementation strategies and contextual factors for success Iverson, K., Adjognon, O., Alessandra, G., Dichter, M., Gerber, M., Gutner, C., Hamilton, A., Stirman, S. BMC. 2019

  View details for Web of Science ID 000584552900170

• Mixed Methods Analysis of Implementation of Interpersonal Psychotherapy (IPT) for Major Depressive Disorder in Prisons in a Hybrid Type I Randomized Trial. Administration and policy in mental health Johnson, J. E., Hailemariam, M. n., Zlotnick, C. n., Richie, F. n., Sinclair, J. n., Chuong, A. n., Stirman, S. W. 2019

  Abstract

  This article describes a mixed methods evaluation of implementation of interpersonal psychotherapy (IPT) in the first fully-powered trial of any treatment for major depressive disorder in an incarcerated population. Assessments in this Hybrid Type I trial included surveys of prison providers and administrators (n = 71), measures of feasibility and acceptability to prison patients (n = 90), and a planned document review (n = 460) to assess potential determinants of implementation. Quantitative and qualitative results indicated that IPT was a good fit for prisoners, and that prisoners and providers were enthusiastic about IPT. Providers were open to feedback, open to learning evidence-based practices, and committed to helping their clients. Limited treatment staff and variable supervision and collegial support may pose implementation challenges. For widespread prison implementation, scalable models for ongoing IPT training and supervision are needed.

  View details for DOI 10.1007/s10488-019-00996-1

  View details for PubMedID 31797190

• Usual Care Among Providers Treating Women Veterans: Managing Complexity and Multimorbidity in the Era of Evidence-Based Practice. Administration and policy in mental health Hamilton, A. B., Wiltsey-Stirman, S. n., Finley, E. P., Klap, R. n., Mittman, B. S., Yano, E. M., Oishi, S. n. 2019

  Abstract

  To better understand VA providers' approaches to and perspectives on providing care to women Veterans, providers (n = 97) in primary care and mental health settings were interviewed about women's perceived treatment needs, types of care provided, and perceptions of evidence-based treatments (EBTs) for this population. Providers perceived that women Veteran VA users are often diagnostically complex and require a coordinated approach to treatment planning. They struggled with decisions about how to offer services such as EBTs and collaborative care in light of comorbidity and psychosocial stressors, and endorsed the belief that a tailored approach and consideration of these factors is essential in providing care.

  View details for DOI 10.1007/s10488-019-00961-y

  View details for PubMedID 31468284

• Standardized Assessment and Measurement-Based Care AMERICAN PSYCHIATRIC ASSOCIATION PUBLISHING TEXTBOOK OF PSYCHIATRY, 7TH EDITION Rosen, C. S., Lindley, S. N., Stirman, S., Roberts, L. W. 2019: 1095–1110

  View details for Web of Science ID 000550979400041

• Stakeholder Preferences on Transdiagnostic Psychosocial Treatment for Trauma-Exposed Veterans. Administration and policy in mental health Gutner, C. A., Canale, C. A., Vento, S. A., Wiltsey Stirman, S. n. 2019

  Abstract

  While modular and transdiagnostic approaches may address implementation challenges, there remains limited investigation into the fit within large healthcare systems. The current study examines qualitative interviews from patients, clinicians and administrative stakeholders in the Veterans Administration about experiences with, and views of, the Unified Protocol (UP; Barlow et al. in The unified protocol for transdiagnostic treatment of emotional disorders: therapist guide, Oxford University Press, New York, 2011) to understand potential for implementation. Qualitative interviews were conducted based on an established implementation framework and speak to implementation of transdiagnostic treatment in veterans, including insight into barriers, facilitators, intervention characteristics, patient characteristics, and system level variables. The UP demonstrated promise for improving efficiency, satisfaction and personalizing mental healthcare.

  View details for DOI 10.1007/s10488-019-00948-9

  View details for PubMedID 31187316

• The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions. Implementation science : IS Wiltsey Stirman, S. n., Baumann, A. A., Miller, C. J. 2019; 14 (1): 58

  Abstract

  This paper describes the process and results of a refinement of a framework to characterize modifications to interventions. The original version did not fully capture several aspects of modification and adaptation that may be important to document and report. Additionally, the earlier framework did not include a way to differentiate cultural adaptation from adaptations made for other reasons. Reporting additional elements will allow for a more precise understanding of modifications, the process of modifying or adapting, and the relationship between different forms of modification and subsequent health and implementation outcomes.We employed a multifaceted approach to develop the updated FRAME involving coding documents identified through a literature review, rapid coding of qualitative interviews, and a refinement process informed by multiple stakeholders. The updated FRAME expands upon Stirman et al.'s original framework by adding components of modification to report: (1) when and how in the implementation process the modification was made, (2) whether the modification was planned/proactive (i.e., an adaptation) or unplanned/reactive, (3) who determined that the modification should be made, (4) what is modified, (5) at what level of delivery the modification is made, (6) type or nature of context or content-level modifications, (7) the extent to which the modification is fidelity-consistent, and (8) the reasons for the modification, including (a) the intent or goal of the modification (e.g., to reduce costs) and (b) contextual factors that influenced the decision. Methods of using the framework to assess modifications are outlined, along with their strengths and weaknesses, and considerations for research to validate these measurement strategies.The updated FRAME includes consideration of when and how modifications occurred, whether it was planned or unplanned, relationship to fidelity, and reasons and goals for modification. This tool that can be used to support research on the timing, nature, goals and reasons for, and impact of modifications to evidence-based interventions.

  View details for DOI 10.1186/s13012-019-0898-y

  View details for PubMedID 31171014

• Client-level predictors of treatment engagement, outcome and dropout: moving beyond demographics. General psychiatry Youn, S. J., Mackintosh, M. A., Wiltsey Stirman, S. n., Patrick, K. A., Aguilar Silvan, Y. n., Bartuska, A. D., Shtasel, D. L., Marques, L. n. 2019; 32 (6): e100153

  Abstract

  Despite the availability of evidence-based treatments for posttraumatic stress disorder (PTSD), significant heterogeneity in the effectiveness of PTSD treatment persists, especially in community settings. Client demographics used to understand this variability in treatment outcome and dropout have yielded mixed results. Despite increasing evidence for the importance of attending to treatment engagement in community settings, few studies have explored client-level predictors.The purpose of this study is to explore client-level predictors of treatment outcome and dropout beyond client demographics, and to identify client-level predictors of treatment engagement in community settings.Secondary data analysis was conducted with data collected as part of an implementation-effectiveness hybrid study of cognitive processing therapy (CPT) for PTSD in a diverse community health centre. Providers (n=19) treated (n=52) clients as part of their routine clinical care. Non-demographic client-level predictors included barriers to treatment, quality of life, session-level language and employment history assessed at baseline. Treatment engagement included number of weeks in the study, number of sessions with repeated CPT content, number of unique CPT sessions attended, frequency of session attendance and consistency of session attendance.Results showed language as a significant predictor of treatment engagement. There were significant differences between Spanish and English-speaking clients, with the former having a tendency to repeat more session content than the latter (β=1.4 sessions, p=0.003), and also less likely to attend treatment frequently (r=0.62, p=0.009) and consistently (r=0.57, p=0.027) if high logistical and financial barriers were endorsed. Irrespective of language, clients who reported high quality of life at baseline were less likely to repeat CPT session content (β=-0.3, p=0.04), and those with increased baseline barriers to treatment had deceleration in PTSD symptom improvement over time (β=-0.62, p<0.05). In terms of treatment engagement moderators impacting treatment outcome, clients who repeated more session content were more likely to complete treatment (OR=1.84, p=0.037).Identification of client-level predictors of treatment engagement, outcome and dropout is essential to optimise treatment, particularly in community settings.

  View details for DOI 10.1136/gpsych-2019-100153

  View details for PubMedID 31922091

  View details for PubMedCentralID PMC6936970

• What are we even trying to implement? Considering the relative merits of promoting evidence-based protocols, principles, practices, or policies CLINICAL PSYCHOLOGY-SCIENCE AND PRACTICE Stirman, S., Comer, J. S. 2018; 25 (4)

  View details for DOI 10.1111/cpsp.12269

  View details for Web of Science ID 000453048600008

• A randomized controlled effectiveness trial of training strategies in cognitive processing therapy for posttraumatic stress disorder: Impact on patient outcomes BEHAVIOUR RESEARCH AND THERAPY Monon, C. M., Shields, N., Suvak, M. K., Lane, J. M., Shnaider, P., Landy, M. H., Wagner, A. C., Sijercic, I., Masina, T., Wanklyn, S. G., Stirman, S. 2018; 110: 31–40

  Abstract

  This randomized controlled hybrid implementation/effectiveness trial aimed to compare the impact of three different models of training and consultation by examining the PTSD treatment outcomes achieved by therapists who were learning a front-line recommended psychotherapy for posttraumatic stress disorder (PTSD), Cognitive Processing Therapy (CPT; Resick, Monson, & Chard, 2017). Therapists (N = 134) were randomized into one of three conditions after attending a standard CPT training workshop: No Consultation with delayed feedback on CPT fidelity, Standard Consultation involving discussion and conceptualization of cases without session audio review, and Consultation Including Audio Review, which included a review of segments of audiorecorded CPT sessions. Across all training conditions, the patients treated by these therapists (N = 188) evidenced statistically significant reductions in PTSD symptoms, (d = -0.95 to -1.78), comorbid symptoms and functioning (d = -0.27 to -0.51). However, patients of therapists in the Standard Consultation condition (ΔPTSD = - 19.64, d = -1.78) experienced significantly greater improvement than those in the No Consultation condition (ΔPTSD = - 10.54, d = -0.95, ΔDEV = 6.30, ΔParms = 2, p = .043). This study demonstrates that patients who receive evidence-based psychotherapy for PTSD in routine care settings can experience significant symptom improvement. Our findings also suggest that to maximize patient benefit, therapist training should include consultation, but that audio review of sessions during consultation may not be necessary, at least for structured protocols. Implications for implementation, including the reduction of burden and cost of post-workshop support, are discussed.

  View details for PubMedID 30218837

• Homework Completion, Patient Characteristics, and Symptom Change in Cognitive Processing Therapy for PTSD. Behavior therapy Stirman, S. W., Gutner, C. A., Suvak, M. K., Adler, A., Calloway, A., Resick, P. 2018; 49 (5): 741–55

  Abstract

  We evaluated the impact of homework completion on change in PTSD symptoms in the context of two randomized controlled trials of Cognitive Processing Therapy for PTSD (CPT). Female participants (n = 140) diagnosed with PTSD attended at least one CPT session and were assigned homework at each session. The frequency of homework completion was assessed at the beginning of each session and PTSD symptoms were assessed every other session. Piecewise growth models were used to examine the relationship between homework completion and symptom change. CPT version (with vs without the written trauma account) did not moderate associations between homework engagement and outcomes. Greater pretreatment PTSD symptoms predicted more Session 1 homework completion, but PTSD symptoms did not predict homework completion at other timepoints. More homework completion after Sessions 2 and 3 was associated with less change in PTSD from Session 2 to Session 4, but larger pre-to-post treatment changes in PTSD. Homework completion after Sessions 2 and 3 was associated with greater symptom change among patients who had fewer years of education. More homework completion after Sessions 8 and 9 was associated with larger subsequent decreases in PTSD. Average homework completion was not associated with client characteristics. In the second half of treatment, homework engagement was associated with less dropout. The results suggest that efforts to increase engagement in homework may facilitate symptom change.

  View details for PubMedID 30146141

• Use of Reflective Journaling to Understand Decision Making Regarding Two Evidence-Based Psychotherapies for PTSD: Practice Implications. Practice innovations (Washington, D.C.) Cook, J. M., Simiola, V., McCarthy, E., Ellis, A., Wiltsey Stirman, S. 2018; 3 (3): 153–67

  Abstract

  As part of a longitudinal investigation on implementation of 2 evidence-based psychotherapies (EBPs) for posttraumatic stress disorder, psychotherapists from 38 Department of Veterans Affairs residential treatment programs across the United States were asked to complete reflective journals every 4 months for a 1-year time period in regard to their successes and challenges in using prolonged exposure and cognitive processing therapy. This paper provides content analysis on the reflective journals of 24 of these providers. Five main themes were identified: EBPs are great but not sufficient for patients in residential treatment with chronic posttraumatic stress disorder and complicated life circumstances, and thus, more treatment is necessary after discharge. Modifications were made or thought needed for optimal outcome and successful delivery of these 2 EBPs; some providers blended aspects of prolonged exposure and cognitive processing therapy; what happens when providers and patients do not agree on choice of which EBP to first implement; and provider concerns on when to discontinue an EBP. Reflective journaling appears to be a promising way for trainers and treatment developers to gather important information about the clinical application and decision-making process for front-line providers, which may offer insight into how to improve EBP implementation and sustainability. Incorporating reflective journaling and strategies for accomplishing this into training, supervision, and consultation may also be 1 strategy for increasing feedback, expanding implementation, and informing ways to increase sustainability of EBPs in populations with multiple clinical and psychosocial needs.

  View details for PubMedID 30906873

• Homework Completion, Patient Characteristics, and Symptom Change in Cognitive Processing Therapy for PTSD BEHAVIOR THERAPY Stirman, S., Gutner, C. A., Suvak, M. K., Adler, A., Calloway, A., Resick, P. 2018; 49 (5): 741–55

  View details for DOI 10.1016/j.beth.2017.12.001

  View details for Web of Science ID 000445300700009

• Protocol for the ROSE sustainment (ROSES) study, a sequential multiple assignment randomized trial to determine the minimum necessary intervention to maintain a postpartum depression prevention program in prenatal clinics serving low-income women IMPLEMENTATION SCIENCE Johnson, J. E., Wiltsey-Stirman, S., Sikorskii, A., Miller, T., King, A., Blume, J. L., Xuan Pham, Simas, T., Poleshuck, E., Weinberg, R., Zlotnick, C. 2018; 13: 115

  Abstract

  More research on sustainment of interventions is needed, especially return on investment (ROI) studies to determine cost-benefit trade-offs for effort required to sustain and how much is gained when effective programs are sustained. The ROSE sustainment (ROSES) study uses a sequential multiple assignment randomized (SMART) design to evaluate the effectiveness and cost-effectiveness of a stepwise approach to sustainment of the ROSE postpartum depression prevention program in 90 outpatient clinics providing prenatal care to pregnant women on public assistance. Postpartum depression (PPD) is common and can have lasting consequences. Outpatient clinics offering prenatal care are an opportune place to provide PPD prevention because most women visit while pregnant. The ROSE (Reach Out, Stay Strong, Essentials for mothers of newborns) program is a group educational intervention to prevent PPD, delivered during pregnancy. ROSE has been found to reduce cases of PPD in community prenatal settings serving low-income pregnant women.All 90 prenatal clinics will receive enhanced implementation as usual (EIAU; initial training + tools for sustainment). At the first time at which a clinic is determined to be at risk for failure to sustain (i.e., at 3, 6, 9, 12, and 15 months), that clinic will be randomized to receive either (1) no additional implementation support (i.e., EIAU only), or (2) low-intensity coaching and feedback (LICF). If clinics receiving LICF are still at risk at subsequent assessments, they will be randomized to either (1) EIAU + LICF only, or (2) high-intensity coaching and feedback (HICF). Additional follow-up interviews will occur at 18, 24, and 30 months, but no implementation intervention will occur after 18 months. Outcomes include (1) percent sustainment of core program elements at each time point, (2) health impact (PPD rates over time at each clinic) and reach, and (3) ROI (costs and cost-effectiveness) of each sustainment step. Hypothesized mechanisms include sustainment of capacity to deliver core elements and engagement/ownership.This study is the first randomized trial evaluating the ROI of a stepped approach to sustainment, a critical unanswered question in implementation science. It will also advance knowledge of implementation mechanisms and clinical care for an at-risk population.Clinicaltrials.gov, NCT03267563 . Registered June 14, 2018.

  View details for PubMedID 30134941

• Leveraging routine clinical materials and mobile technology to assess CBT fidelity: the Innovative Methods to Assess Psychotherapy Practices (imAPP) study IMPLEMENTATION SCIENCE Stirman, S., Marques, L., Creed, T. A., Gutner, C. A., DeRubeis, R., Barnett, P. G., Kuhn, E., Suvak, M., Owen, J., Vogt, D., Jo, B., Schoenwald, S., Johnson, C., Mallard, K., Beristianos, M., La Bash, H. 2018; 13: 69

  Abstract

  Identifying scalable strategies for assessing fidelity is a key challenge in implementation science. However, for psychosocial interventions, the existing, reliable ways to test treatment fidelity quality are often labor intensive, and less burdensome strategies may not reflect actual clinical practice. Cognitive behavioral therapies (CBTs) provide clinicians with a set of effective core elements to help treat a multitude of disorders, which, evidence suggests, need to be delivered with fidelity to maximize potential client impact. The current "gold standard" for rating CBTs is rating recordings of therapy sessions, which is extremely time-consuming and requires a substantial amount of initial training. Although CBTs can vary based on the target disorder, one common element employed in most CBTs is the use of worksheets to identify specific behaviors and thoughts that affect a client's ability to recover. The present study will develop and evaluate an innovative new approach to rate CBT fidelity, by developing a universal CBT scoring system based on worksheets completed in therapy sessions.To develop a scoring system for CBT worksheets, we will compile common CBT elements from a variety of CBT worksheets for a range of psychiatric disorders and create adherence and competence measures. We will collect archival worksheets from past studies to test the scoring system and assess test-retest reliability. To evaluate whether CBT worksheet scoring accurately reflects clinician fidelity, we will recruit clinicians who are engaged in a CBT for depression, anxiety, and/or posttraumatic stress disorder. Clinicians and clients will transmit routine therapy materials produced in session (e.g., worksheets, clinical notes, session recordings) to the study team after each session. We will compare observer-rated fidelity, clinical notes, and fidelity-rated worksheets to identify the most effective and efficient method to assess clinician fidelity. Clients will also be randomly assigned to either complete the CBT worksheets on paper forms or on a mobile application (app) to learn if worksheet format influences clinician and client experience or differs in terms of reflecting fidelity.Scoring fidelity using CBT worksheets may allow clinics to test fidelity in a short and effective manner, enhancing continuous quality improvement in the workplace. Clinicians and clinics can use such data to improve clinician fidelity in real time, leading to improved patient outcomes.ClinicalTrials.gov NCT03479398 . Retrospectively registered March 20, 2018.

  View details for PubMedID 29789017

• A Pragmatic Approach to Guide Implementation evaluation Research: strategy Mapping for Complex Interventions FRONTIERS IN PUBLIC HEALTH Huynh, A. K., Hamilton, A. B., Farmer, M. M., Bean-Mayberry, B., Stirman, S., Moin, T., Finley, E. P. 2018; 6: 134

  Abstract

  Greater specification of implementation strategies is a challenge for implementation science, but there is little guidance for delineating the use of multiple strategies involved in complex interventions. The Cardiovascular (CV) Toolkit project entails implementation of a toolkit designed to reduce CV risk by increasing women's engagement in appropriate services. The CV Toolkit project follows an enhanced version of Replicating Effective Programs (REP), an evidence-based implementation strategy, to implement the CV Toolkit across four phases: pre-conditions, pre-implementation, implementation, and maintenance and evolution. Our current objective is to describe a method for mapping implementation strategies used in real time as part of the CV Toolkit project. This method supports description of the timing and content of bundled strategies and provides a structured process for developing a plan for implementation evaluation.We conducted a process of strategy mapping to apply Proctor and colleagues' rubric for specification of implementation strategies, constructing a matrix in which we identified each implementation strategy, its conceptual group, and the corresponding REP phase(s) in which it occurs. For each strategy, we also specified the actors involved, actions undertaken, action targets, dose of the implementation strategy, and anticipated outcome addressed. We iteratively refined the matrix with the implementation team, including use of simulation to provide initial validation.Mapping revealed patterns in the timing of implementation strategies within REP phases. Most implementation strategies involving the development of stakeholder interrelationships and training and educating stakeholders were introduced during the pre-conditions or pre-implementation phases. Strategies introduced in the maintenance and evolution phase emphasized communication, re-examination, and audit and feedback. In addition to its value for producing valid and reliable process evaluation data, mapping implementation strategies has informed development of a pragmatic blueprint for implementation and longitudinal analyses and evaluation activities.We update recent recommendations on specification of implementation strategies by considering the implications for multi-strategy frameworks and propose an approach for mapping the use of implementation strategies within complex, multi-level interventions, in support of rigorous evaluation. Developing pragmatic tools to aid in operationalizing the conduct of implementation and evaluation activities is essential to enacting sound implementation research.

  View details for PubMedID 29868542

• In rape trauma PTSD, patient characteristics indicate which trauma-focused treatment they are most likely to complete DEPRESSION AND ANXIETY Keefe, J. R., Stirman, S., Cohen, Z. D., DeRubeis, R. J., Smith, B. N., Resick, P. A. 2018; 35 (4): 330–38

  Abstract

  Dropout rates for effective therapies for posttraumatic stress disorder (PTSD) can be high, especially in practice settings. Although clinicians have intuitions regarding what treatment patients may complete, there are few systematic data to drive those judgments.A multivariable model of dropout risk was constructed with randomized clinical trial data (n = 160) comparing prolonged exposure (PE) and cognitive processing therapy (CPT) for rape-induced PTSD. A two-step bootstrapped variable selection algorithm was applied to identify moderators of dropout as a function of treatment condition. Employing identified moderators in a model, fivefold cross-validation yielded estimates of dropout probability for each patient in each condition. Dropout rates between patients who did and did not receive their model-indicated treatment were compared.Despite equivalent dropout rates across treatments, patients assigned to their model-indicated treatment were significantly less likely to drop out relative to patients who did not (relative risk = 0.49 [95% CI: 0.29-0.82]). Moderators included in the model were: childhood physical abuse, current relationship conflict, anger, and being a racial minority, all of which were associated with higher likelihood of dropout in PE than CPT.Individual differences among patients affect the likelihood they will complete a particular treatment, and clinicians can consider these moderators in treatment planning. In the future, treatment selection models could be used to increase the percentage of patients who will receive a full course of treatment, but replication and extension of such models, and consideration of how best to integrate them into routine practice, are needed.

  View details for PubMedID 29489037

• A comparison of two learning collaborative strategies to support newly trained clinicians in delivering cognitive processing therapy Wiltsey-Stirman, S., Beristianos, M., Shields, N., Mallard, K., Masina, T., Haine-Schalgel, R., Miller, C., Suvak, M., Johnson, C., Carreno, P. K., Monson, C. BIOMED CENTRAL LTD. 2018

  View details for Web of Science ID 000428649900060

• Adaptation in dissemination and implementation science Baumann, A. A., Cabassa, L. J., Wiltsey-Stirman, S. BIOMED CENTRAL LTD. 2018

  View details for Web of Science ID 000428649900092

• The effect of message board correspondence on therapist fidelity and adaptation in cognitive processing therapy for PTSD Johnson, C., Mallard, K., Carreno, P., Beristianos, M., Masina, T., Shields, N., Monson, C., Wiltsey-Stirman, S. BIOMED CENTRAL LTD. 2018

  View details for Web of Science ID 000428649900089

• VA Residential Treatment Providers' Use of Two Evidence-Based Psychotherapies for PTSD: Global Endorsement Versus Specific Components PSYCHOLOGICAL TRAUMA-THEORY RESEARCH PRACTICE AND POLICY Thompson, R., Simiola, V., Schnurr, P. P., Stirman, S., Cook, J. M. 2018; 10 (2): 131–39

  Abstract

  Despite a growing body of knowledge about the dissemination of evidence-based psychotherapies (EBPs), their actual use in clinical settings is not well understood. The purpose of the current study was to compare self-reported component use with global use for 2 EBPs for posttraumatic stress disorder (PTSD), prolonged exposure (PE), and cognitive processing therapy (CPT).Around 174 providers from 38 VA PTSD residential treatment programs were asked about both global use and component use of PE and CPT.Among frequent users of these EBPs, component use was generally high, especially for low-intensity and nonspecific components. For each form of treatment, there were a small number of providers who reported using the treatment frequently but did not use most of the key components of the treatment.These findings highlight the importance of understanding the modifications that providers make to EBPs and suggest the importance of flexibility within fidelity to these treatments. (PsycINFO Database Record

  View details for DOI 10.1037/tra0000220

  View details for Web of Science ID 000427747400001

  View details for PubMedID 27893265

  View details for PubMedCentralID PMC5446934

• Testing a Web-Based, Trained-Peer Model to Build Capacity for Evidence-Based Practices in Community Mental Health Systems PSYCHIATRIC SERVICES German, R. E., Adler, A., Frankel, S. A., Stirman, S., Pinedo, P., Evans, A. C., Beck, A. T., Creed, T. A. 2018; 69 (3): 286–92

  View details for DOI 10.1176/appl.ps.201700029

  View details for Web of Science ID 000435441100010

• Impact of age of onset of psychosis and engagement in higher education on duration of untreated psychosis JOURNAL OF MENTAL HEALTH Hardy, K. V., Noordsy, D. L., Ballon, J. S., McGovern, M. P., Salomon, C., Stirman, S. 2018; 27 (3): 257–62

  Abstract

  The average age of onset of psychosis coincides with the age of college enrollment. Little is known about the impact of educational engagement on DUP in a college-aged population.To determine DUP, and the impact of educational engagement, for college-aged participants of the RAISE study (n = 404).We conducted secondary data analyses on the publicly available RAISE dataset. Subsamples were analyzed to determine the impact of age and educational engagement on DUP.DUP was significantly shorter (p < 0.02) for participants who were college-aged (18-22 years, n = 44) and engaged in post-secondary education (median = 12 weeks, mean = 29 weeks) compared with participants who were college-aged and not engaged in higher education (n = 92, median = 29 weeks, mean = 44 weeks).Educational engagement appears to be associated with a shorter DUP. This may be partially explained by the presence of on-site wellness centers in college settings. However, even among young people who engaged in post-secondary education DUP was still at, or beyond, the upper limit of WHO recommendations in this group. Future research exploring how colleges could improve their capacity to detect and refer at risk students for treatment at an earlier stage is recommended.

  View details for PubMedID 29707996

• Decision making and the use of evidence based practice: Is the three-legged stool balanced? Practice innovations (Washington, D.C.) Stewart, R. E., Chambless, D. L., Stirman, S. W. 2018; 3 (1): 56–67

  Abstract

  This article presents the results of a qualitative analysis of interviews with 25 psychologists in independent practice, with a focus on decision making with a selected patient. We endeavored to examine how clinical decision making intersected with the principles of evidence based practice (EBP) as laid out by Spring (2007). Clinicians reported that diagnostic impressions were generally formulated through unstructured assessment rather than validated instruments, and that treatment selection was based on therapists' perceptions of a treatment's match with client characteristics. Therapists viewed CBTs as appropriate for addressing symptoms but believed they needed to depart from CBT strategies to address underlying issues. Nonetheless, they often defined successes and failures in treatment in terms of symptoms. Overall, clinicians rarely mentioned utilization of research evidence for assessment or treatment selection and practice. Results are discussed within the framework of EBP.

  View details for DOI 10.1037/pri0000063

  View details for PubMedID 32219174

  View details for PubMedCentralID PMC7098661

• A hybrid type I randomized effectiveness-implementation trial of patient navigation to improve access to services for children with autism spectrum disorder. BMC psychiatry Broder-Fingert, S. n., Walls, M. n., Augustyn, M. n., Beidas, R. n., Mandell, D. n., Wiltsey-Stirman, S. n., Silverstein, M. n., Feinberg, E. n. 2018; 18 (1): 79

  Abstract

  Significant racial, ethnic, and socioeconomic disparities exist in access to evidence-based treatment services for children with autism spectrum disorder (ASD). Patient Navigation (PN) is a theory-based care management strategy designed to reduce disparities in access to care. The purpose of this study is to test the effectiveness of PN a strategy to reduce disparities in access to evidence-based services for vulnerable children with ASD, as well as to explore factors that impact implementation.This study uses a hybrid type I randomized effectiveness/implementation design to test effectiveness and collect data on implementation concurrently. It is a two-arm comparative effectiveness trial with a target of 125 participants per arm. Participants are families of children age 15-27 months who receive a positive screen for ASD at a primary care visit at urban clinics in Massachusetts (n = 6 clinics), Connecticut (n = 1), and Pennsylvania (n = 2). The trial measures diagnostic interval (number of days from positive screen to diagnostic determination) and time to receipt of evidence-based ASD services/recommended services (number of days from date of diagnosis to receipt of services) in those with PN compared to and activated control -Conventional Care Management - which is similar to care management received in a high quality medical home. At the same time, a mixed-method implementation evaluation is being carried out.This study will examine the effectiveness of PN to reduce the time to and receipt of evidence-based services for vulnerable children with ASD, as well as factors that influence implementation. Findings will tell us both if PN is an effective approach for improving access to evidence-based care for children with ASD, and inform future strategies for dissemination.NCT02359084 Registered February 1, 2015.

  View details for PubMedID 29587698

  View details for PubMedCentralID PMC5870193

• The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care ANNUAL REVIEW OF PUBLIC HEALTH, VOL 39 Shelton, R. C., Cooper, B., Stirman, S., Fielding, J. E., Brownson, R. C., Green, L. W. 2018; 39: 55–76

  Abstract

  There is strong interest in implementation science to address the gap between research and practice in public health. Research on the sustainability of evidence-based interventions has been growing rapidly. Sustainability has been defined as the continued use of program components at sufficient intensity for the sustained achievement of desirable program goals and population outcomes. This understudied area has been identified as one of the most significant translational research problems. Adding to this challenge is uncertainty regarding the extent to which intervention adaptation and evolution are necessary to address the needs of populations that differ from those in which interventions were originally tested or implemented. This review critically examines and discusses conceptual and methodological issues in studying sustainability, summarizes the multilevel factors that have been found to influence the sustainability of interventions in a range of public health and health care settings, and highlights key areas for future research.

  View details for PubMedID 29328872

• Empirical Examinations of Modifications and Adaptations to Evidence-Based Psychotherapies: Methodologies, Impact, and Future Directions CLINICAL PSYCHOLOGY-SCIENCE AND PRACTICE Stirman, S., Gamarra, J. M., Bartlett, B. A., Calloway, A., Gutner, C. A. 2017; 24 (4): 396–420

  Abstract

  This review describes methods used to examine the modifications and adaptations to evidence-based psychological treatments (EBPTs), assesses what is known about the impact of modifications and adaptations to EBPTs, and makes recommendations for future research and clinical care. One hundred eight primary studies and three meta-analyses were identified. All studies examined planned adaptations, and many simultaneously investigated multiple types of adaptations. With the exception of studies on adding or removing specific EBPT elements, few studies compared adapted EBPTs to the original protocols. There was little evidence that adaptations in the studies were detrimental, but there was also limited consistent evidence that adapted protocols outperformed the original protocols, with the exception of adding components to EBPTs. Implications for EBPT delivery and future research are discussed.

  View details for PubMedID 29593372

  View details for PubMedCentralID PMC5866913

• Adaptation in dissemination and implementation science Baumann, A. A., Cabassa, L. J., Wiltsey-Stirman, S. BMC. 2017

  View details for Web of Science ID 000572466900092

• The effect of message board correspondence on therapist fidelity and adaptation in cognitive processing therapy for PTSD Johnson, C., Mallard, K., Carreno, P., Beristianos, M., Masina, T., Shields, N., Monson, C., Wiltsey-Stirman, S. BMC. 2017

  View details for Web of Science ID 000572466900089

• A comparison of two learning collaborative strategies to support newly trained clinicians in delivering cognitive processing therapy Wiltsey-Stirman, S., Beristianos, M., Shields, N., Mallard, K., Masina, T., Haine-Schalgel, R., Miller, C., Suvak, M., Johnson, C., Carreno, P. K., Monson, C. BMC. 2017

  View details for Web of Science ID 000572466900060

• Therapist Report of Adaptations to Delivery of Evidence-Based Practices Within a System-Driven Reform of Publicly Funded Children's Mental Health Services. Journal of consulting and clinical psychology Lau, A., Barnett, M., Stadnick, N., Saifan, D., Regan, J., Wiltsey Stirman, S., Roesch, S., Brookman-Frazee, L. 2017

  Abstract

  This study examined clinical adaptations reported by community therapists to multiple evidence-based practices (EBPs) currently implemented in children's mental health services. Based on an item set informed by Stirman and colleagues' model (2015), 2 factors emerged describing Augmenting adaptations and Reducing/Reordering adaptations. We used multilevel modeling to examine therapist- and practice-level predictors of therapist reports of each type of adaptation.Data were drawn from an online survey, including a novel therapist report measure of EBP adaptations, completed by 572 therapists (89.2% female, Mage = 37.08 years, 33.4% non-Hispanic White) delivering EBPs in the context of a system-driven, fiscally mandated implementation effort.Analyses revealed that the 2 types of therapist adaptations (Augmenting and Reducing/Reordering) could be readily discriminated, with therapists reporting significantly more Augmenting than Reducing/Reordering adaptations. Therapists of Hispanic/Latino ethnicity and with fewer years of experience reported more extensive Augmenting adaptations, but no therapist background characteristics were associated with Reducing/Reordering adaptations. Therapists' general attitudes that EBPs diverged from their personal approach to therapy were associated with reporting more Augmenting and Reducing/Reordering adaptations. In contrast, negative perceptions toward the specific EBP predicted Reducing/Reordering adaptations, but not Augmenting adaptations.Community therapist reports suggest that most adaptations undertaken involve engaging with the practice to augment the fit of the EBPs for local contexts; however, when practices were perceived negatively, therapists were more likely to make adaptations reducing or rearranging components. (PsycINFO Database Record

  View details for DOI 10.1037/ccp0000215

  View details for PubMedID 28471210

  View details for PubMedCentralID PMC5501960

• Going off-script: modifications to Cognitive Processing Therapy (CPT) in a community mental health clinic Marques, L., Dixon, L., Ahles, E., Valentine, S., Monson, C., Shtasel, D., Stirman, S. BMC. 2017

  View details for Web of Science ID 000410978100097

• Planning for the long-term: considering sustainment Vogel, A., Stirman, S. BMC. 2017

  View details for Web of Science ID 000410978100005

• Strategies for assessing fidelity to evidence-based interventions: a comparison of feasibility, accuracy, and associations with clinical outcomes Stirman, S., Carreno, P., Mallard, K., Masina, T., Monson, C. BMC. 2017

  View details for Web of Science ID 000410978100069

• Improving and sustaining delivery of CPT for PTSD in mental health systems: a cluster randomized trial. Implementation science Wiltsey Stirman, S., Finley, E. P., Shields, N., Cook, J., Haine-Schlagel, R., Burgess, J. F., Dimeff, L., Koerner, K., Suvak, M., Gutner, C. A., Gagnon, D., Masina, T., Beristianos, M., Mallard, K., Ramirez, V., Monson, C. 2017; 12 (1): 32-?

  Abstract

  Large-scale implementation of evidence-based psychotherapies (EBPs) such as cognitive processing therapy (CPT) for posttraumatic stress disorder can have a tremendous impact on mental and physical health, healthcare utilization, and quality of life. While many mental health systems (MHS) have invested heavily in programs to implement EBPs, few eligible patients receive EBPs in routine care settings, and clinicians do not appear to deliver the full treatment protocol to many of their patients. Emerging evidence suggests that when CPT and other EBPs are delivered at low levels of fidelity, clinical outcomes are negatively impacted. Thus, identifying strategies to improve and sustain the delivery of CPT and other EBPs is critical. Existing literature has suggested two competing strategies to promote sustainability. One emphasizes fidelity to the treatment protocol through ongoing consultation and fidelity monitoring. The other focuses on improving the fit and effectiveness of these treatments through appropriate adaptations to the treatment or the clinical setting through a process of data-driven, continuous quality improvement. Neither has been evaluated in terms of impact on sustained implementation.To compare these approaches on the key sustainability outcomes and provide initial guidance on sustainability strategies, we propose a cluster randomized trial with mental health clinics (n = 32) in three diverse MHSs that have implemented CPT. Cohorts of clinicians and clinical managers will participate in 1 year of a fidelity oriented learning collaborative or 1 year of a continuous quality improvement-oriented learning collaborative. Patient-level PTSD symptom change, CPT fidelity and adaptation, penetration, and clinics' capacity to deliver EBP will be examined. Survey and interview data will also be collected to investigate multilevel influences on the success of the two learning collaborative strategies. This research will be conducted by a team of investigators with expertise in CPT implementation, mixed method research strategies, quality improvement, and implementation science, with input from stakeholders in each participating MHS.It will have broad implications for supporting ongoing delivery of EBPs in mental health and healthcare systems and settings. The resulting products have the potential to significantly improve efforts to ensure ongoing high quality implementation and consumer access to EBPs.NCT02449421 . Registered 02/09/2015.

  View details for DOI 10.1186/s13012-017-0544-5

  View details for PubMedID 28264720

• Testing a Web-Based, Trained-Peer Model to Build Capacity for Evidence-Based Practices in Community Mental Health Systems. Psychiatric services (Washington, D.C.) German, R. E., Adler, A. n., Frankel, S. A., Stirman, S. W., Pinedo, P. n., Evans, A. C., Beck, A. T., Creed, T. A. 2017: appips201700029

  Abstract

  Use of expert-led workshops plus consultation has been established as an effective strategy for training community mental health (CMH) clinicians in evidence-based practices (EBPs). Because of high rates of staff turnover, this strategy inadequately addresses the need to maintain capacity to deliver EBPs. This study examined knowledge, competency, and retention outcomes of a two-phase model developed to build capacity for an EBP in CMH programs.In the first phase, an initial training cohort in each CMH program participated in in-person workshops followed by expert-led consultation (in-person, expert-led [IPEL] phase) (N=214 clinicians). After this cohort completed training, new staff members participated in Web-based training (in place of in-person workshops), followed by peer-led consultation with the initial cohort (Web-based, trained-peer [WBTP] phase) (N=148). Tests of noninferiority assessed whether WBTP was not inferior to IPEL at increasing clinician cognitive-behavioral therapy (CBT) competency, as measured by the Cognitive Therapy Rating Scale.WBTP was not inferior to IPEL at developing clinician competency. Hierarchical linear models showed no significant differences in CBT knowledge acquisition between the two phases. Survival analyses indicated that WBTP trainees were less likely than IPEL trainees to complete training. In terms of time required from experts, WBTP required 8% of the resources of IPEL.After an initial investment to build in-house CBT expertise, CMH programs were able to use a WBTP model to broaden their own capacity for high-fidelity CBT. IPEL followed by WBTP offers an effective alternative to build EBP capacity in CMH programs, rather than reliance on external experts.

  View details for PubMedID 29137558

• A Non-randomized Comparison of Strategies for Consultation in a Community-Academic Training Program to Implement an Evidence-Based Psychotherapy. Administration and policy in mental health Stirman, S. W., Pontoski, K. n., Creed, T. n., Xhezo, R. n., Evans, A. C., Beck, A. T., Crits-Christoph, P. n. 2017; 44 (1): 55–66

  Abstract

  Despite the central role of training and consultation in the implementation of evidence-based psychological interventions (EBPIs), comprehensive reviews of research on training have highlighted serious gaps in knowledge regarding best practices. Consultation after initial didactic training appears to be of critical importance, but there has been very little research to determine optimal consultation format or interventions. This observational study compared two consultation formats that included review of session audio and feedback in the context of a program to train clinicians (n = 85) in community mental health clinics to deliver cognitive therapy (CT). A "gold standard" condition in which clinicians received individual feedback after expert consultants reviewed full sessions was compared to a group consultation format in which short segments of session audio were reviewed by a group of clinicians and an expert consultant. After adjusting for potential baseline differences between individuals in the two consultation conditions, few differences were found in terms of successful completion of the consultation phase or in terms of competence in CT at the end of consultation or after a 2 year follow-up. However, analyses did not support hypotheses regarding non-inferiority of the group consultation condition. While both groups largely maintained competence, clinicians in the group consultation condition demonstrated increases in competence over the follow-up period, while a sub-group of those in the individual condition experienced decreases. These findings, if replicated, have important implications for EBP implementation programs, as they suggest that observation and feedback is feasible in community mental health setting, and that employing this method in a group format is an effective and efficient consultation strategy that may enhance the implementation and sustainability of evidence-based psychotherapies.

  View details for PubMedID 26577646

  View details for PubMedCentralID PMC5293547

• The Role of Context in the Implementation of Trauma-Focused Treatments: Effectiveness Research and Implementation in Higher and Lower Income Settings. Current opinion in psychology Chen, J. A., Olin, C. C., Stirman, S. W., Kaysen, D. n. 2017; 14: 61–66

  Abstract

  In recent years, the implementation of trauma-focused treatments has expanded across settings that vary widely in the availability of resources, infrastructure, and personnel. The present review aims to inform researchers, policy makers, trainers, and administrators about this diverse range of research. Taking a global health perspective, this review of effectiveness trials and implementation studies compares strategies used in high-income countries to those in low- and medium-income countries. A primary difference between studies in high-income and low- and medium-income countries is the relative emphasis placed on fidelity or adaptation. Adaptations used in low- and medium-income countries might offer useful ideas for increasing the portability, impact, and accessibility of evidence-based interventions in high-income countries.

  View details for PubMedID 28713852

• Implementation of Transdiagnostic Cognitive Therapy in Community Behavioral Health: The Beck Community Initiative JOURNAL OF CONSULTING AND CLINICAL PSYCHOLOGY Creed, T. A., Frankel, S. A., German, R. E., Green, K. L., Jager-Hyman, S., Taylor, K. P., Adler, A. D., Wolk, C. B., Stirman, S. W., Waltman, S. H., Williston, M. A., Sherrill, R., Evans, A. C., Beck, A. T. 2016; 84 (12): 1116-1126

  Abstract

  Progress bringing evidence-based practice (EBP) to community behavioral health (CBH) has been slow. This study investigated feasibility, acceptability, and fidelity outcomes of a program to implement transdiagnostic cognitive therapy (CT) across diverse CBH settings, in response to a policy shift toward EBP.Clinicians (n = 348) from 30 CBH programs participated in workshops and 6 months of consultation. Clinician retention was examined to assess feasibility, and clinician feedback and attitudes were evaluated to assess implementation acceptability. Experts rated clinicians' work samples at baseline, mid-, and end-of-consultation with the Cognitive Therapy Rating Scale (CTRS) to assess fidelity.Feasibility was demonstrated through high program retention (i.e., only 4.9% of clinicians withdrew). Turnover of clinicians who participated was low (13.5%) compared to typical CBH turnover rates, even during the high-demand training period. Clinicians reported high acceptability of EBP and CT, and self-reported comfort using CT improved significantly over time. Most clinicians (79.6%) reached established benchmarks of CT competency by the final assessment point. Mixed-effects hierarchical linear models indicated that CTRS scores increased significantly from baseline to the competency assessment (p < .001), on average by 18.65 points. Outcomes did not vary significantly between settings (i.e., outpatient vs. other).Even clinicians motivated by policy-change rather than self-nomination may feasibly be trained to deliver a case-conceptualization driven EBP with high levels of competency and acceptability. (PsycINFO Database Record

  View details for DOI 10.1037/ccp0000105

  View details for Web of Science ID 000389304500008

  View details for PubMedID 27379492

  View details for PubMedCentralID PMC5125881

• A Review of Studies on the System-Wide Implementation of Evidence-Based Psychotherapies for Posttraumatic Stress Disorder in the Veterans Health Administration. Administration and policy in mental health Rosen, C. S., Matthieu, M. M., Wiltsey Stirman, S., Cook, J. M., Landes, S., Bernardy, N. C., Chard, K. M., Crowley, J., Eftekhari, A., Finley, E. P., Hamblen, J. L., Harik, J. M., Kehle-Forbes, S. M., MEIS, L. A., Osei-Bonsu, P. E., Rodriguez, A. L., RUGGIERO, K. J., Ruzek, J. I., Smith, B. N., Trent, L., Watts, B. V. 2016; 43 (6): 957-977

  Abstract

  Since 2006, the Veterans Health Administration (VHA) has instituted policy changes and training programs to support system-wide implementation of two evidence-based psychotherapies (EBPs) for posttraumatic stress disorder (PTSD). To assess lessons learned from this unprecedented effort, we used PubMed and the PILOTS databases and networking with researchers to identify 32 reports on contextual influences on implementation or sustainment of EBPs for PTSD in VHA settings. Findings were initially organized using the exploration, planning, implementation, and sustainment framework (EPIS; Aarons et al. in Adm Policy Ment Health Health Serv Res 38:4-23, 2011). Results that could not be adequately captured within the EPIS framework, such as implementation outcomes and adopter beliefs about the innovation, were coded using constructs from the reach, effectiveness, adoption, implementation, maintenance (RE-AIM) framework (Glasgow et al. in Am J Public Health 89:1322-1327, 1999) and Consolidated Framework for Implementation Research (CFIR; Damschroder et al. in Implement Sci 4(1):50, 2009). We highlight key areas of progress in implementation, identify continuing challenges and research questions, and discuss implications for future efforts to promote EBPs in large health care systems.

  View details for PubMedID 27474040

• Providers' Perspectives of Factors Influencing Implementation of Evidence-Based Treatments in a Community Mental Health Setting: A Qualitative Investigation of the Training-Practice Gap PSYCHOLOGICAL SERVICES Marques, L., Dixon, L., Valentine, S. E., Borba, C. C., Simon, N. M., Stirman, S. 2016; 13 (3): 322–31

  Abstract

  This study aims to elucidate relations between provider perceptions of aspects of the consolidated framework for implementation research (Damschroder et al., 2009) and provider attitudes toward the implementation of evidence-based treatments (EBTs) in an ethnically diverse community health setting. Guided by directed content analysis, we analyzed 28 semistructured interviews that were conducted with providers during the pre-implementation phase of a larger implementation study for cognitive processing therapy for posttraumatic stress disorder (Resick et al., 2008). Our findings extend the existing literature by also presenting provider-identified client-level factors that contribute to providers' positive and negative attitudes toward EBTs. Provider-identified client-level factors include the following: client motivation to engage in treatment, client openness to EBTs, support networks of family and friends, client use of community and government resources, the connection and relationship with their therapist, client treatment adherence, client immediate needs or crises, low literacy or illiteracy, low levels of education, client cognitive limitations, and misconceptions about therapy. These results highlight the relations between provider perceptions of their clients, provider engagement in EBT training, and subsequent adoption of EBTs. We present suggestions for future implementation research in this area. (PsycINFO Database Record

  View details for DOI 10.1037/ser0000087

  View details for Web of Science ID 000383106000014

  View details for PubMedID 27281696

  View details for PubMedCentralID PMC4980224

• Cognitive Processing Therapy for Spanish-speaking Latinos: A Formative Study of a Model-Driven Cultural Adaptation of the Manual to Enhance Implementation in a Usual Care Setting. Journal of clinical psychology Valentine, S. E., Borba, C. P., Dixon, L., Vaewsorn, A. S., Guajardo, J. G., Resick, P. A., Wiltsey Stirman, S., Marques, L. 2016

  Abstract

  As part of a larger implementation trial for cognitive processing therapy (CPT) for posttraumatic stress disorder (PTSD) in a community health center, we used formative evaluation to assess relations between iterative cultural adaption (for Spanish-speaking clients) and implementation outcomes (appropriateness and acceptability) for CPT.Qualitative data for the current study were gathered through multiple sources (providers: N = 6; clients: N = 22), including CPT therapy sessions, provider fieldnotes, weekly consultation team meetings, and researcher fieldnotes. Findings from conventional and directed content analysis of the data informed refinements to the CPT manual.Data-driven refinements included adaptations related to cultural context (i.e., language, regional variation in wording), urban context (e.g., crime/violence), and literacy level. Qualitative findings suggest improved appropriateness and acceptability of CPT for Spanish-speaking clients.Our study reinforces the need for dual application of cultural adaptation and implementation science to address the PTSD treatment needs of Spanish-speaking clients.

  View details for DOI 10.1002/jclp.22337

  View details for PubMedID 27378013

  View details for PubMedCentralID PMC5215988

• Dabblers, bedazzlers, or total makeovers: Clinician modification of a common elements cognitive behavioral therapy approach Meza, R. D., Dorsey, S., Stirman, S., Sedlar, G., Lucid, L. BMC. 2016

  View details for Web of Science ID 000410976900044

• Proceedings of the 3rd Biennial Conference of the Society for Implementation Research Collaboration (SIRC) 2015: advancing efficient methodologies through community partnerships and team science : Seattle, WA, USA. 24-26 September 2015. Implementation science : IS Lewis, C., Darnell, D., Kerns, S., Monroe-DeVita, M., Landes, S. J., Lyon, A. R., Stanick, C., Dorsey, S., Locke, J., Marriott, B., Puspitasari, A., Dorsey, C., Hendricks, K., Pierson, A., Fizur, P., Comtois, K. A., Palinkas, L. A., Chamberlain, P., Aarons, G. A., Green, A. E., Ehrhart, M. G., Trott, E. M., Willging, C. E., Fernandez, M. E., Woolf, N. H., Liang, S. L., Heredia, N. I., Kegler, M., Risendal, B., Dwyer, A., Young, V., Campbell, D., Carvalho, M., Kellar-Guenther, Y., Damschroder, L. J., Lowery, J. C., Ono, S. S., Carlson, K. F., Cottrell, E. K., O’Neil, M. E., Lovejoy, T. L., Arch, J. J., Mitchell, J. L., Lewis, C. C., Marriott, B. R., Scott, K., Coldiron, J. S., Bruns, E. J., Hook, A. N., Graham, B. C., Jordan, K., Hanson, R. F., Moreland, A., Saunders, B. E., Resnick, H. S., Stirman, S. W., Gutner, C. A., Gamarra, J., Vogt, D., Suvak, M., Wachen, J. S., Dondanville, K., Yarvis, J. S., Mintz, J., Peterson, A. L., Borah, E. V., Litz, B. T., Molino, A., McCaughan, S. Y., Resick, P. A., Pandhi, N., Jacobson, N., Serrano, N., Hernandez, A., Schreiter, E. Z., Wietfeldt, N., Karp, Z., Pullmann, M. D., Lucenko, B., Pavelle, B., Uomoto, J. A., Negrete, A., Cevasco, M., Kerns, S. E., Franks, R. P., Bory, C., Miech, E. J., Damush, T. M., Satterfield, J., Satre, D., Wamsley, M., Yuan, P., O’Sullivan, P., Best, H., Velasquez, S., Barnett, M., Brookman-Frazee, L., Regan, J., Stadnick, N., Hamilton, A., Lau, A., Regan, J., Hamilton, A., Stadnick, N., Barnett, M., Lau, A., Brookman-Frazee, L., Stadnick, N., Lau, A., Barnett, M., Regan, J., Roesch, S., Brookman-Frazee, L., Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L., Smith, J. L., Matthieu, M. M., Proctor, E. K., Kirchner, J. E., Waltz, T. J., Powell, B. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. J., Proctor, E. K., Kirchner, J. E., Matthieu, M. M., Rosen, C. S., Waltz, T. J., Powell, B. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Proctor, E. K., Kirchner, J. E., Walker, S. C., Bishop, A. S., Lockhart, M., Rodriguez, A. L., Manfredi, L., Nevedal, A., Rosenthal, J., Blonigen, D. M., Mauricio, A. M., Dishion, T. D., Rudo-Stern, J., Smith, J. D., Locke, J., Wolk, C. B., Harker, C., Olsen, A., Shingledecker, T., Barg, F., Mandell, D., Beidas, R. S., Hansen, M. C., Aranda, M. P., Torres-Vigil, I., Hartzler, B., Steinfeld, B., Gildred, T., Harlin, Z., Shephard, F., Ditty, M. S., Doyle, A., Bickel, J. A., Cristaudo, K., Fox, D., Combs, S., Lischner, D. H., Van Dorn, R. A., Tueller, S. J., Hinde, J. M., Karuntzos, G. T., Monroe-DeVita, M., Peterson, R., Darnell, D., Berliner, L., Dorsey, S., Murray, L. K., Botanov, Y., Kikuta, B., Chen, T., Navarro-Haro, M., DuBose, A., Korslund, K. E., Linehan, M. M., Harker, C. M., Karp, E. A., Edmunds, S. R., Ibañez, L. V., Stone, W. L., Andrews, J. H., Johnides, B. D., Hausman, E. M., Hawley, K. M., Prusaczyk, B., Ramsey, A., Baumann, A., Colditz, G., Proctor, E. K., Botanov, Y., Kikuta, B., Chen, T., Navarro-Haro, M., DuBose, A., Korslund, K. E., Linehan, M. M., Harker, C. M., Karp, E. A., Edmunds, S. R., Ibañez, L. V., Stone, W. L., Choy-Brown, M., Andrews, J. H., Johnides, B. D., Hausman, E. M., Hawley, K. M., Prusaczyk, B., Ramsey, A., Baumann, A., Colditz, G., Proctor, E. K., Meza, R. D., Dorsey, S., Wiltsey-Stirman, S., Sedlar, G., Lucid, L., Dorsey, C., Marriott, B., Zounlome, N., Lewis, C., Gutner, C. A., Monson, C. M., Shields, N., Mastlej, M., Landy, M. S., Lane, J., Stirman, S. W., Finn, N. K., Torres, E. M., Ehrhart, M. G., Aarons, G. A., Malte, C. A., Lott, A., Saxon, A. J., Boyd, M., Scott, K., Lewis, C. C., Pierce, J. D., Lorthios-Guilledroit, A., Richard, L., Filiatrault, J., Hallgren, K., Crotwell, S., Muñoz, R., Gius, B., Ladd, B., McCrady, B., Epstein, E., Clapp, J. D., Ruderman, D. E., Barwick, M., Barac, R., Zlotkin, S., Salim, L., Davidson, M., Bunger, A. C., Powell, B. J., Robertson, H. A., Botsko, C., Landes, S. J., Smith, B. N., Rodriguez, A. L., Trent, L. R., Matthieu, M. M., Powell, B. J., Proctor, E. K., Harned, M. S., Navarro-Haro, M., Korslund, K. E., Chen, T., DuBose, A., Ivanoff, A., Linehan, M. M., Garcia, A. R., Kim, M., Palinkas, L. A., Snowden, L., Landsverk, J., Sweetland, A. C., Fernandes, M. J., Santos, E., Duarte, C., Kritski, A., Krawczyk, N., Nelligan, C., Wainberg, M. L., Aarons, G. A., Sommerfeld, D. H., Chi, B., Ezeanolue, E., Sturke, R., Kline, L., Guay, L., Siberry, G., Bennett, I. M., Beidas, R., Gold, R., Mao, J., Powers, D., Vredevoogd, M., Unutzer, J., Schroeder, J., Volpe, L., Steffen, J., Dorsey, S., Pullmann, M. D., Kerns, S. E., Jungbluth, N., Berliner, L., Thompson, K., Segell, E., McGee-Vincent, P., Liu, N., Walser, R., Runnals, J., Shaw, R. K., Landes, S. J., Rosen, C., Schmidt, J., Calhoun, P., Varkovitzky, R. L., Landes, S. J., Drahota, A., Martinez, J. I., Brikho, B., Meza, R., Stahmer, A. C., Aarons, G. A., Williamson, A., Rubin, R. M., Powell, B. J., Hurford, M. O., Weaver, S. L., Beidas, R. S., Mandell, D. S., Evans, A. C., Powell, B. J., Beidas, R. S., Rubin, R. M., Stewart, R. E., Wolk, C. B., Matlin, S. L., Weaver, S., Hurford, M. O., Evans, A. C., Hadley, T. R., Mandell, D. S., Gerke, D. R., Prusaczyk, B., Baumann, A., Lewis, E. M., Proctor, E. K., McWilliam, J., Brown, J., Tucker, M., Conte, K. P., Lyon, A. R., Boyd, M., Melvin, A., Lewis, C. C., Liu, F., Jungbluth, N., Kotte, A., Hill, K. A., Mah, A. C., Korathu-Larson, P. A., Au, J. R., Izmirian, S., Keir, S., Nakamura, B. J., Higa-McMillan, C. K., Cooper, B. R., Funaiole, A., Dizon, E., Hawkins, E. J., Malte, C. A., Hagedorn, H. J., Berger, D., Frank, A., Lott, A., Achtmeyer, C. E., Mariano, A. J., Saxon, A. J., Wolitzky-Taylor, K., Rawson, R., Ries, R., Roy-Byrne, P., Craske, M., Simmons, D., Torrente, C., Nathanson, L., Carroll, G., Smith, J. D., Brown, K., Ramos, K., Thornton, N., Dishion, T. J., Stormshak, E. A., Shaw, D. S., Wilson, M. N., Choy-Brown, M., Tiderington, E., Smith, B. T., Padgett, D. K., Rubin, R. M., Ray, M. L., Wandersman, A., Lamont, A., Hannah, G., Alia, K. A., Hurford, M. O., Evans, A. C., Saldana, L., Schaper, H., Campbell, M., Chamberlain, P., Shapiro, V. B., Kim, B. E., Fleming, J. L., LeBuffe, P. A., Landes, S. J., Lewis, C. C., Rodriguez, A. L., Marriott, B. R., Comtois, K. A., Lewis, C. C., Stanick, C., Weiner, B. J., Halko, H., Dorsey, C. 2016; 11 Suppl 1 (Suppl 1): 85

  Abstract

  Introduction to the 3rd Biennial Conference of the Society for Implementation Research Collaboration: advancing efficient methodologies through team science and community partnerships Cara Lewis, Doyanne Darnell, Suzanne Kerns, Maria Monroe-DeVita, Sara J. Landes, Aaron R. Lyon, Cameo Stanick, Shannon Dorsey, Jill Locke, Brigid Marriott, Ajeng Puspitasari, Caitlin Dorsey, Karin Hendricks, Andria Pierson, Phil Fizur, Katherine A. Comtois A1: A behavioral economic perspective on adoption, implementation, and sustainment of evidence-based interventions Lawrence A. Palinkas A2: Towards making scale up of evidence-based practices in child welfare systems more efficient and affordable Patricia Chamberlain A3: Mixed method examination of strategic leadership for evidence-based practice implementation Gregory A. Aarons, Amy E. Green, Mark. G. Ehrhart, Elise M. Trott, Cathleen E. Willging A4: Implementing practice change in Federally Qualified Health Centers: Learning from leaders’ experiences Maria E. Fernandez, Nicholas H. Woolf, Shuting (Lily) Liang, Natalia I. Heredia, Michelle Kegler, Betsy Risendal, Andrea Dwyer, Vicki Young, Dayna Campbell, Michelle Carvalho, Yvonne Kellar-Guenther A3: Mixed method examination of strategic leadership for evidence-based practice implementation Gregory A. Aarons, Amy E. Green, Mark. G. Ehrhart, Elise M. Trott, Cathleen E. Willging A4: Implementing practice change in Federally Qualified Health Centers: Learning from leaders’ experiences Maria E. Fernandez, Nicholas H. Woolf, Shuting (Lily) Liang, Natalia I. Heredia, Michelle Kegler, Betsy Risendal, Andrea Dwyer, Vicki Young, Dayna Campbell, Michelle Carvalho, Yvonne Kellar-Guenther A5: Efficient synthesis: Using qualitative comparative analysis and the Consolidated Framework for Implementation Research across diverse studies Laura J. Damschroder, Julie C. Lowery A6: Establishing a veterans engagement group to empower patients and inform Veterans Affairs (VA) health services research Sarah S. Ono, Kathleen F. Carlson, Erika K. Cottrell, Maya E. O’Neil, Travis L. Lovejoy A7: Building patient-practitioner partnerships in community oncology settings to implement behavioral interventions for anxious and depressed cancer survivors Joanna J. Arch, Jill L. Mitchell A8: Tailoring a Cognitive Behavioral Therapy implementation protocol using mixed methods, conjoint analysis, and implementation teams Cara C. Lewis, Brigid R. Marriott, Kelli Scott A9: Wraparound Structured Assessment and Review (WrapSTAR): An efficient, yet comprehensive approach to Wraparound implementation evaluation Jennifer Schurer Coldiron, Eric J. Bruns, Alyssa N. Hook A10: Improving the efficiency of standardized patient assessment of clinician fidelity: A comparison of automated actor-based and manual clinician-based ratings Benjamin C. Graham, Katelin Jordan A11: Measuring fidelity on the cheap Rochelle F. Hanson, Angela Moreland, Benjamin E. Saunders, Heidi S. Resnick A12: Leveraging routine clinical materials to assess fidelity to an evidence-based psychotherapy Shannon Wiltsey Stirman, Cassidy A. Gutner, Jennifer Gamarra, Dawne Vogt, Michael Suvak, Jennifer Schuster Wachen, Katherine Dondanville, Jeffrey S. Yarvis, Jim Mintz, Alan L. Peterson, Elisa V. Borah, Brett T. Litz, Alma Molino, Stacey Young McCaughanPatricia A. Resick A13: The video vignette survey: An efficient process for gathering diverse community opinions to inform an intervention Nancy Pandhi, Nora Jacobson, Neftali Serrano, Armando Hernandez, Elizabeth Zeidler- Schreiter, Natalie Wietfeldt, Zaher Karp A14: Using integrated administrative data to evaluate implementation of a behavioral health and trauma screening for children and youth in foster care Michael D. Pullmann, Barbara Lucenko, Bridget Pavelle, Jacqueline A. Uomoto, Andrea Negrete, Molly Cevasco, Suzanne E. U. Kerns A15: Intermediary organizations as a vehicle to promote efficiency and speed of implementation Robert P. Franks, Christopher Bory A16: Applying the Consolidated Framework for Implementation Research constructs directly to qualitative data: The power of implementation science in action Edward J. Miech, Teresa M. Damush A17: Efficient and effective scaling-up, screening, brief interventions, and referrals to treatment (SBIRT) training: a snowball implementation model Jason Satterfield, Derek Satre, Maria Wamsley, Patrick Yuan, Patricia O’Sullivan A18: Matching models of implementation to system needs and capacities: addressing the human factor Helen Best, Susan Velasquez A19: Agency characteristics that facilitate efficient and successful implementation efforts Miya Barnett, Lauren Brookman-Frazee, Jennifer Regan, Nicole Stadnick, Alison Hamilton, Anna Lau A20: Rapid assessment process: Application to the Prevention and Early Intervention transformation in Los Angeles County Jennifer Regan, Alison Hamilton, Nicole Stadnick, Miya Barnett, Anna Lau, Lauren Brookman-Frazee A21: The development of the Evidence-Based Practice-Concordant Care Assessment: An assessment tool to examine treatment strategies across practices Nicole Stadnick, Anna Lau, Miya Barnett, Jennifer Regan, Scott Roesch, Lauren Brookman-Frazee A22: Refining a compilation of discrete implementation strategies and determining their importance and feasibility Byron J. Powell, Thomas J. Waltz, Matthew J. Chinman, Laura Damschroder, Jeffrey L. Smith, Monica M. Matthieu, Enola K. Proctor, JoAnn E. Kirchner A23: Structuring complex recommendations: Methods and general findings Thomas J. Waltz, Byron J. Powell, Matthew J. Chinman, Laura J. Damschroder, Jeffrey L. Smith, Monica J. Matthieu, Enola K. Proctor, JoAnn E. Kirchner A24: Implementing prolonged exposure for post-traumatic stress disorder in the Department of Veterans Affairs: Expert recommendations from the Expert Recommendations for Implementing Change (ERIC) project Monica M. Matthieu, Craig S. Rosen, Thomas J. Waltz, Byron J. Powell, Matthew J. Chinman, Laura J. Damschroder, Jeffrey L. Smith, Enola K. Proctor, JoAnn E. Kirchner A25: When readiness is a luxury: Co-designing a risk assessment and quality assurance process with violence prevention frontline workers in Seattle, WA Sarah C. Walker, Asia S. Bishop, Mariko Lockhart A26: Implementation potential of structured recidivism risk assessments with justice- involved veterans: Qualitative perspectives from providers Allison L. Rodriguez, Luisa Manfredi, Andrea Nevedal, Joel Rosenthal, Daniel M. Blonigen A27: Developing empirically informed readiness measures for providers and agencies for the Family Check-Up using a mixed methods approach Anne M. Mauricio, Thomas D. Dishion, Jenna Rudo-Stern, Justin D. Smith A28: Pebbles, rocks, and boulders: The implementation of a school-based social engagement intervention for children with autism Jill Locke, Courtney Benjamin Wolk, Colleen Harker, Anne Olsen, Travis Shingledecker, Frances Barg, David Mandell, Rinad S. Beidas A29: Problem Solving Teletherapy (PST.Net): A stakeholder analysis examining the feasibility and acceptability of teletherapy in community based aging services Marissa C. Hansen, Maria P. Aranda, Isabel Torres-Vigil A30: A case of collaborative intervention design eventuating in behavior therapy sustainment and diffusion Bryan Hartzler A31: Implementation of suicide risk prevention in an integrated delivery system: Mental health specialty services Bradley Steinfeld, Tory Gildred, Zandrea Harlin, Fredric Shephard A32: Implementation team, checklist, evaluation, and feedback (ICED): A step-by-step approach to Dialectical Behavior Therapy program implementation Matthew S. Ditty, Andrea Doyle, John A. Bickel III, Katharine Cristaudo A33: The challenges in implementing muliple evidence-based practices in a community mental health setting Dan Fox, Sonia Combs A34: Using electronic health record technology to promote and support evidence-based practice assessment and treatment intervention David H. Lischner A35: Are existing frameworks adequate for measuring implementation outcomes? Results from a new simulation methodology Richard A. Van Dorn, Stephen J. Tueller, Jesse M. Hinde, Georgia T. Karuntzos A36: Taking global local: Evaluating training of Washington State clinicians in a modularized cogntive behavioral therapy approach designed for low-resource settings Maria Monroe-DeVita, Roselyn Peterson, Doyanne Darnell, Lucy Berliner, Shannon Dorsey, Laura K. Murray A37: Attitudes toward evidence-based practices across therapeutic orientations Yevgeny Botanov, Beverly Kikuta, Tianying Chen, Marivi Navarro-Haro, Anthony DuBose, Kathryn E. Korslund, Marsha M. Linehan A38: Predicting the use of an evidence-based intervention for autism in birth-to-three programs Colleen M. Harker, Elizabeth A. Karp, Sarah R. Edmunds, Lisa V. Ibañez, Wendy L. Stone A39: Supervision practices and improved fidelity across evidence-based practices: A literature review Mimi Choy-Brown A40: Beyond symptom tracking: clinician perceptions of a hybrid measurement feedback system for monitoring treatment fidelity and client progress Jack H. Andrews, Benjamin D. Johnides, Estee M. Hausman, Kristin M. Hawley A41: A guideline decision support tool: From creation to implementation Beth Prusaczyk, Alex Ramsey, Ana Baumann, Graham Colditz, Enola K. Proctor A42: Dabblers, bedazzlers, or total makeovers: Clinician modification of a common elements cognitive behavioral therapy approach Rosemary D. Meza, Shannon Dorsey, Shannon Wiltsey-Stirman, Georganna Sedlar, Leah Lucid A43: Characterization of context and its role in implementation: The impact of structure, infrastructure, and metastructure Caitlin Dorsey, Brigid Marriott, Nelson Zounlome, Cara Lewis A44: Effects of consultation method on implementation of cognitive processing therapy for post-traumatic stress disorder Cassidy A. Gutner, Candice M. Monson, Norman Shields, Marta Mastlej, Meredith SH Landy, Jeanine Lane, Shannon Wiltsey Stirman A45: Cross-validation of the Implementation Leadership Scale factor structure in child welfare service organizations Natalie K. Finn, Elisa M. Torres, Mark. G. Ehrhart, Gregory A. Aarons A46: Sustainability of integrated smoking cessation care in Veterans Affairs posttraumatic stress disorder clinics: A qualitative analysis of focus group data from learning collaborative participants Carol A. Malte, Aline Lott, Andrew J. Saxon A47: Key characteristics of effective mental health trainers: The creation of the Measure of Effective Attributes of Trainers (MEAT) Meredith Boyd, Kelli Scott, Cara C. Lewis A48: Coaching to improve teacher implementation of evidence-based practices (EBPs) Jennifer D. Pierce A49: Factors influencing the implementation of peer-led health promotion programs targeting seniors: A literature review Agathe Lorthios-Guilledroit, Lucie Richard, Johanne Filiatrault A50: Developing treatment fidelity rating systems for psychotherapy research: Recommendations and lessons learned Kevin Hallgren, Shirley Crotwell, Rosa Muñoz, Becky Gius, Benjamin Ladd, Barbara McCrady, Elizabeth Epstein A51: Rapid translation of alcohol prevention science John D. Clapp, Danielle E. Ruderman A52: Factors implicated in successful implementation: evidence to inform improved implementation from high and low-income countries Melanie Barwick, Raluca Barac, Stanley Zlotkin, Laila Salim, Marnie Davidson A53: Tracking implementation strategies prospectively: A practical approach Alicia C. Bunger, Byron J. Powell, Hillary A. Robertson A54: Trained but not implementing: the need for effective implementation planning tools Christopher Botsko A55: Evidence, context, and facilitation variables related to implementation of Dialectical Behavior Therapy: Qualitative results from a mixed methods inquiry in the Department of Veterans Affairs Sara J. Landes, Brandy N. Smith, Allison L. Rodriguez, Lindsay R. Trent, Monica M. Matthieu A56: Learning from implementation as usual in children’s mental health Byron J. Powell, Enola K. Proctor A57: Rates and predictors of implementation after Dialectical Behavior Therapy Intensive Training Melanie S. Harned, Marivi Navarro-Haro, Kathryn E. Korslund, Tianying Chen, Anthony DuBose, André Ivanoff, Marsha M. Linehan A58: Socio-contextual determinants of research evidence use in public-youth systems of care Antonio R. Garcia, Minseop Kim, Lawrence A. Palinkas, Lonnie Snowden, John Landsverk A59: Community resource mapping to integrate evidence-based depression treatment in primary care in Brazil: A pilot project Annika C. Sweetland, Maria Jose Fernandes, Edilson Santos, Cristiane Duarte, Afrânio Kritski, Noa Krawczyk, Caitlin Nelligan, Milton L. Wainberg A60: The use of concept mapping to efficiently identify determinants of implementation in the National Institute of Health--President’s Emergent Plan for AIDS Relief Prevention of Mother to Child HIV Transmission Implementation Science Alliance Gregory A. Aarons, David H. Sommerfeld, Benjamin Chi, Echezona Ezeanolue, Rachel Sturke, Lydia Kline, Laura Guay, George Siberry A61: Longitudinal remote consultation for implementing collaborative care for depression Ian M. Bennett, Rinad Beidas, Rachel Gold, Johnny Mao, Diane Powers, Mindy Vredevoogd, Jurgen Unutzer A62: Integrating a peer coach model to support program implementation and ensure long- term sustainability of the Incredible Years in community-based settings Jennifer Schroeder, Lane Volpe, Julie Steffen A63: Efficient sustainability: Existing community based supervisors as evidence-based treatment supports Shannon Dorsey, Michael D Pullmann, Suzanne E. U. Kerns, Nathaniel Jungbluth, Lucy Berliner, Kelly Thompson, Eliza Segell A64: Establishment of a national practice-based implementation network to accelerate adoption of evidence-based and best practices Pearl McGee-Vincent, Nancy Liu, Robyn Walser, Jennifer Runnals, R. Keith Shaw, Sara J. Landes, Craig Rosen, Janet Schmidt, Patrick Calhoun A65: Facilitation as a mechanism of implementation in a practice-based implementation network: Improving care in a Department of Veterans Affairs post-traumatic stress disorder outpatient clinic Ruth L. Varkovitzky, Sara J. Landes A66: The ACT SMART Toolkit: An implementation strategy for community-based organizations providing services to children with autism spectrum disorder Amy Drahota, Jonathan I. Martinez, Brigitte Brikho, Rosemary Meza, Aubyn C. Stahmer, Gregory A. Aarons A67: Supporting Policy In Health with Research: An intervention trial (SPIRIT) - protocol and early findings Anna Williamson A68: From evidence based practice initiatives to infrastructure: Lessons learned from a public behavioral health system’s efforts to promote evidence based practices Ronnie M. Rubin, Byron J. Powell, Matthew O. Hurford, Shawna L. Weaver, Rinad S. Beidas, David S. Mandell, Arthur C. Evans A69: Applying the policy ecology model to Philadelphia’s behavioral health transformation efforts Byron J. Powell, Rinad S. Beidas, Ronnie M. Rubin, Rebecca E. Stewart, Courtney Benjamin Wolk, Samantha L. Matlin, Shawna Weaver, Matthew O. Hurford, Arthur C. Evans, Trevor R. Hadley, David S. Mandell A70: A model for providing methodological expertise to advance dissemination and implementation of health discoveries in Clinical and Translational Science Award institutions Donald R. Gerke, Beth Prusaczyk, Ana Baumann, Ericka M. Lewis, Enola K. Proctor A71: Establishing a research agenda for the Triple P Implementation Framework Jenna McWilliam, Jacquie Brown, Michelle Tucker A72: Cheap and fast, but what is “best?”: Examining implementation outcomes across sites in a state-wide scaled-up evidence-based walking program, Walk With Ease Kathleen P Conte A73: Measurement feedback systems in mental health: Initial review of capabilities and characteristics Aaron R. Lyon, Meredith Boyd, Abigail Melvin, Cara C. Lewis, Freda Liu, Nathaniel Jungbluth A74: A qualitative investigation of case managers’ attitudes toward implementation of a measurement feedback system in a public mental health system for youth Amelia Kotte, Kaitlin A. Hill, Albert C. Mah, Priya A. Korathu-Larson, Janelle R. Au, Sonia Izmirian, Scott Keir, Brad J. Nakamura, Charmaine K. Higa-McMillan A75: Multiple pathways to sustainability: Using Qualitative Comparative Analysis to uncover the necessary and sufficient conditions for successful community-based implementation Brittany Rhoades Cooper, Angie Funaiole, Eleanor Dizon A76: Prescribers’ perspectives on opioids and benzodiazepines and medication alerts to reduce co-prescribing of these medications Eric J. Hawkins, Carol A. Malte, Hildi J. Hagedorn, Douglas Berger, Anissa Frank, Aline Lott, Carol E. Achtmeyer, Anthony J. Mariano, Andrew J. Saxon A77: Adaptation of Coordinated Anxiety Learning and Management for comorbid anxiety and substance use disorders: Delivery of evidence-based treatment for anxiety in addictions treatment centers Kate Wolitzky-Taylor, Richard Rawson, Richard Ries, Peter Roy-Byrne, Michelle Craske A78: Opportunities and challenges of measuring program implementation with online surveys Dena Simmons, Catalina Torrente, Lori Nathanson, Grace Carroll A79: Observational assessment of fidelity to a family-centered prevention program: Effectiveness and efficiency Justin D. Smith, Kimbree Brown, Karina Ramos, Nicole Thornton, Thomas J. Dishion, Elizabeth A. Stormshak, Daniel S. Shaw, Melvin N. Wilson A80: Strategies and challenges in housing first fidelity: A multistate qualitative analysis Mimi Choy-Brown, Emmy Tiderington, Bikki Tran Smith, Deborah K. Padgett A81: Procurement and contracting as an implementation strategy: Getting To Outcomes® contracting Ronnie M. Rubin, Marilyn L. Ray, Abraham Wandersman, Andrea Lamont, Gordon Hannah, Kassandra A. Alia, Matthew O. Hurford, Arthur C. Evans A82: Web-based feedback to aid successful implementation: The interactive Stages of Implementation Completion (SIC)TM tool Lisa Saldana, Holle Schaper, Mark Campbell, Patricia Chamberlain A83: Efficient methodologies for monitoring fidelity in routine implementation: Lessons from the Allentown Social Emotional Learning Initiative Valerie B. Shapiro, B.K. Elizabeth Kim, Jennifer L. Fleming, Paul A. LeBuffe A84: The Society for Implementation Research Collaboration (SIRC) implementation development workshop: Results from a new methodology for enhancing implementation science proposals Sara J. Landes, Cara C. Lewis, Allison L. Rodriguez, Brigid R. Marriott, Katherine Anne Comtois A85: An update on the Society for Implementation Research Collaboration (SIRC) Instrument Review Project

  View details for DOI 10.1186/s13012-016-0428-0

  View details for PubMedID 27357964

  View details for PubMedCentralID PMC4928139

• Leveraging routine clinical materials to assess fidelity to an evidence-based psychotherapy Stirman, S., Gutner, C. A., Gamarra, J., Vogt, D., Suvak, M., Wachen, J., Dondanville, K., Yarvis, J. S., Mintz, J., Peterson, A. L., Borah, E. V., Litz, B. T., Molino, A., McCaughan, S., Resick, P. A. BMC. 2016

  View details for Web of Science ID 000410976900014

• Effects of consultation method on implementation of cognitive processing therapy for post-traumatic stress disorder Gutner, C. A., Monson, C. M., Shields, N., Mastlej, M., Landy, M. H., Lane, J., Stirman, S. BMC. 2016

  View details for Web of Science ID 000410976900046

• Effectiveness of an Evidence-Based Quality Improvement Approach to Cultural Competence Training: The Veterans Affairs' "Caring for Women Veterans" Program. journal of continuing education in the health professions Fox, A. B., Hamilton, A. B., Frayne, S. M., Wiltsey-Stirman, S., Bean-Mayberry, B., Carney, D., Di Leone, B. A., Gierisch, J. M., Goldstein, K. M., Romodan, Y., Sadler, A. G., Yano, E. M., Yee, E. F., Vogt, D. 2016; 36 (2): 96-103

  Abstract

  Although providing culturally sensitive health care is vitally important, there is little consensus regarding the most effective strategy for implementing cultural competence trainings in the health care setting. Evidence-based quality improvement (EBQI), which involves adapting evidence-based practices to meet local needs, may improve uptake and effectiveness of a variety of health care innovations. Yet, to our knowledge, EBQI has not yet been applied to cultural competence training. To evaluate whether EBQI could enhance the impact of an evidence-based training intended to improve veterans affairs health care staff gender sensitivity and knowledge (Caring for Women Veterans; CWV), we compared the reach and effectiveness of EBQI delivery versus standard web-based implementation strategies of CWV and assessed barriers and facilitators to EBQI implementation.Workgroups at four diverse veterans affairs health care sites were randomized to either an EBQI or standard web-based implementation condition (SI). All EBQI sites selected a group-based implementation strategy. Employees (N = 84) completed pretraining and posttraining assessments of gender sensitivity and knowledge, and focus groups/interviews were conducted with leadership and staff before and after implementation.Reach of CWV was greater in the EBQI condition versus the SI condition. Whereas both gender sensitivity and knowledge improved in the EBQI condition, only gender sensitivity improved in the SI condition. Qualitative analyses revealed that the EBQI approach was well received, although a number of barriers were identified.Findings suggest that EBQI can enhance the uptake and effectiveness of employee trainings. However, the decision to pursue EBQI must be informed by a consideration of available resources.

  View details for DOI 10.1097/CEH.0000000000000073

  View details for PubMedID 27262152

• Study protocol: Hybrid Type I cost-effectiveness and implementation study of interpersonal psychotherapy (IPT) for men and women prisoners with major depression CONTEMPORARY CLINICAL TRIALS Johnson, J. E., Miller, T. R., Stout, R. L., Zlotnick, C., Cerbo, L. A., Andrade, J. T., Wiltsey-Stirman, S. 2016; 47: 266-274

  Abstract

  This article describes the protocol for a Hybrid Type I cost-effectiveness and implementation study of interpersonal psychotherapy (IPT) for men and women prisoners with major depressive disorder (MDD). The goal is to promote uptake of evidence-based treatments in criminal justice settings by conducting a randomized effectiveness study that collects implementation data, including a full cost-effectiveness analysis.More than 2.3 million people are incarcerated in the United States on any given day. MDD is the most common severe mental illness among incarcerated individuals. Despite the prevalence and consequences of MDD among incarcerated populations, this study will be the first fully-powered randomized trial of any treatment for MDD in an incarcerated population.Given the politically charged nature of the justice system, advantageous health outcomes are often not enough to get an intervention implemented in prisons. To increase the policy impact of this trial, we sought advice from prison providers and administrators about outcomes that would be persuasive to policy-makers and defensible to the public. In this trial, effectiveness questions will be answered using a randomized clinical trial design comparing IPT plus prison treatment as usual (TAU) to TAU alone, with outcomes including depressive symptoms (primary), suicidality, and in prison functioning (enrollment and completion of correctional programs; disciplinary and incident reports; aggression/victimization; social support). Implementation outcomes will include cost-effectiveness; feasibility and acceptability of IPT to clients, providers, and administrators; prison provider intervention fidelity, attitudes, and competencies; and barriers and facilitators of implementation assessed through surveys, interviews, and process notes.

  View details for DOI 10.1016/j.cct.2016.01.013

  View details for Web of Science ID 000374606900035

  View details for PubMedID 26845030

  View details for PubMedCentralID PMC4962862

• Avoidance as an obstacle to preventing depression among urban women at high risk for violent trauma. Archives of women's mental health Silverstein, M., Kistin, C., Bair-Merritt, M., Wiltsey-Stirman, S., Feinberg, E., Diaz-Linhart, Y., Sandler, J., Chen, N., Cabral, H. 2016; 19 (1): 63-70

  Abstract

  The impact of depression interventions is often attenuated in women who have experienced trauma. We explored whether psychological avoidance could explain this phenomenon. We synthesized two pilot randomized trials of problem-solving education (PSE) among a total of 93 urban mothers. Outcomes included depressive symptoms and perceived stress. Mothers with avoidant coping styles experienced an average 1.25 episodes of moderately severe depressive symptoms over 3 months of follow-up, compared to 0.40 episodes among those with non-avoidant coping (adjusted incident rate ratio [aIRR] 2.18; 95 % CI 1.06, 4.48). PSE tended to perform better among mothers with non-avoidant coping. Among mothers with non-avoidant coping, PSE mothers experienced an average 0.24 episodes, compared to 0.58 episodes among non-avoidant controls (aIRR 0.27; 95 % CI 0.05, 1.34). Among mothers with avoidant coping, PSE mothers experienced an average 1.26 episodes, compared to 1.20 episodes among avoidant controls (aIRR 0.76; 95 % CI 0.44, 1.33). This trend toward differential impact persisted when avoidance was measured as a problem-solving style and among traumatized mothers with and without avoidant PTSD symptoms. Further research is warranted to explore the hypothesis that psychological avoidance could explain why certain depression treatment and prevention strategies break down in the presence of trauma.

  View details for DOI 10.1007/s00737-015-0521-4

  View details for PubMedID 25833808

• Symptom exacerbations in trauma-focused treatments: Associations with treatment outcome and non-completion BEHAVIOUR RESEARCH AND THERAPY Larsen, S. E., Stirman, S. W., Smith, B. N., Resick, P. A. 2016; 77: 68-77

  Abstract

  Trauma-focused treatments are underutilized, partially due to clinician concerns that they will cause symptom exacerbation or dropout. We examined a sample of women undergoing Prolonged Exposure (PE), Cognitive Processing Therapy (CPT), and a version of CPT (CPT-C) without a written trauma narrative to investigate the possibility of symptom exacerbation. Participants (n = 192) were drawn from two RCT's. Participants were administered self-report measures of PTSD symptoms (i.e., the PTSD Symptom Scale or Posttraumatic Diagnostic Scale [PSS/PDS]) and the Clinician-Administered PTSD Scale. Exacerbations were defined as increases greater than 6.15 points on the PSS/PDS. A minority of participants experienced PTSD exacerbations during treatment, and there were no significant differences across treatment type (28.6% in CPT, 20.0% in PE, and 14.7% in CPT-C). Neither diagnostic nor trauma-related factors at pre-treatment predicted symptom exacerbations. Those who experienced exacerbations had higher post-treatment PSS/PDS scores and were more likely to retain a PTSD diagnosis (both small but statistically significant effects). However, even those who experienced an exacerbation experienced clinically significant improvement by end of treatment. Further, symptom exacerbations were not related to treatment non-completion. These results indicate that trauma-focused treatments are safe and effective, even for the minority of individuals who experience temporary symptom increases.

  View details for DOI 10.1016/j.brat.2015.12.009

  View details for Web of Science ID 000370899200009

  View details for PubMedID 26731171

• Delivering cognitive processing therapy in a community health setting: The influence of Latino culture and community violence on posttraumatic cognitions. Psychological trauma : theory, research, practice and policy Marques, L., Eustis, E. H., Dixon, L., Valentine, S. E., Borba, C. P., Simon, N., Kaysen, D., Wiltsey-Stirman, S. 2016; 8 (1): 98-106

  Abstract

  Despite the applicability of cognitive processing therapy (CPT) for posttraumatic stress disorder (PTSD) to addressing sequelae of a range of traumatic events, few studies have evaluated whether the treatment itself is applicable across diverse populations. The present study examined differences and similarities among non-Latino, Latino Spanish-speaking, and Latino English-speaking clients in rigid beliefs-or "stuck points"-associated with PTSD symptoms in a sample of community mental health clients. We utilized the procedures of content analysis to analyze stuck point logs and impact statements of 29 participants enrolled in a larger implementation trial for CPT. Findings indicated that the content of stuck points was similar across Latino and non-Latino clients, although fewer total stuck points were identified for Latino clients compared to non-Latino clients. Given that identification of stuck points is central to implementing CPT, difficulty identifying stuck points could pose significant challenges for implementing CPT among Latino clients and warrants further examination. Thematic analysis of impact statements revealed the importance of family, religion, and the urban context (e.g., poverty, violence exposure) in understanding how clients organize beliefs and emotions associated with trauma. Clinical recommendations for implementing CPT in community settings and the identification of stuck points are provided. (PsycINFO Database Record

  View details for DOI 10.1037/tra0000044

  View details for PubMedID 25961865

  View details for PubMedCentralID PMC4641844

• Female veterans' preferences for counseling related to intimate partner violence: Informing patient-centered interventions. General hospital psychiatry Iverson, K. M., Stirman, S. W., Street, A. E., Gerber, M. R., Carpenter, S. L., Dichter, M. E., Bair-Merritt, M. n., Vogt, D. n. 2016; 40: 33–38

  Abstract

  Female veterans are at high risk for intimate partner violence (IPV). A critical issue in the provision of health care to women who experience IPV is the delivery of effective brief counseling interventions that address women's unique needs. We aimed to identify female veterans' priorities and preferences for healthcare-based IPV counseling.A 2014 Web-based survey was administered to a national sample of US female veterans. Among 411 respondents (75% participation rate), 55% (n=226) reported IPV during their lifetime. These women identified priorities for the content focus of IPV-related counseling and preferences for the delivery of these services.Women prioritized counseling that focuses on physical safety and emotional health, with learning about community resources being a relatively lower priority. Participants preferred counseling to focus specifically on enhancing coping skills and managing mental health symptoms. In addition, women want counseling to be individualized and preferred the option to meet with a counselor immediately following disclosure. Affordable services and attention to privacy concerns were of paramount importance in the context of IPV-related counseling.These findings can inform patient-centered brief counseling interventions for women who experience IPV, which may ultimately reduce health disparities and violence among this population.

  View details for PubMedID 27083252

• Bridging the Gap Between Research and Practice in Mental Health Service Settings: An Overview of Developments in Implementation Theory and Research. Behavior therapy Stirman, S. W., Gutner, C. A., Langdon, K. n., Graham, J. R. 2016; 47 (6): 920–36

  Abstract

  Twenty years after Sobell's (1996) influential call to integrate advances in behavior therapy into clinical settings, significant progress has been made in implementation science. In this narrative review, we provide an overview of implementation research findings and highlight recent findings that can inform efforts to bridge the gap between research and practice in mental health service settings. Key findings are summarized, organized according to levels of influence described in two implementation frameworks: The Exploration, Planning, Implementation, and Sustainment Framework (EPIS; Aarons et al., 2011) and the Consolidated Framework for Implementation Research (CFIR; Damschroder et al., 2009). Important levels of influence to consider when implementing new treatments include the outer context, inner context, characteristics of the individual, and characteristics of the innovation. Research on strategies to prepare clinicians to deliver evidence-based psychosocial treatments (EBPTs) and to address contextual barriers to implementation at each level is described, with discussion of implications for the implementation of EBPTs and next steps for research.

  View details for PubMedID 27993341

• System-Wide Implementation of Routine Outcome Monitoring and Measurement Feedback System in a National Network of Operational Stress Injury Clinics. Administration and policy in mental health Ross, D. F., Ionita, G. n., Stirman, S. W. 2016; 43 (6): 927–44

  Abstract

  This manuscript reviews the development and implementation process of the Client Reported Outcome Monitoring Information System in the VA Canada Operational Stress Injury National Network, and reports on outcomes of an evaluation to assess usage, barriers, and facilitators to implementation. The majority of clinicians reported regular use of routine outcomes monitoring, although objective data suggested somewhat lower actual use. In general, clinicians endorsed all barriers and most facilitators as influencing their use of routine outcomes monitoring in a minor way. However, users and non-users differed in their endorsement of facilitators and barriers. Implications for research and implementation efforts are discussed.

  View details for PubMedID 27444375

• Bridging the gap between research and practice in mental health service settings: An overview of developments in implementation theory and research Behavior Therapy Wiltsey Stirman, S., Gutner, C. A., Jessica, G., Langdon, K. 2016

  View details for DOI 10.1016/j.beth.2015.12.001

• Impact of Childhood Abuse on Physical and Mental Health Status and Health Care Utilization Among Female Veterans MILITARY MEDICINE Mercado, R. C., Wiltsey-Stirman, S., Iverson, K. M. 2015; 180 (10): 1065-1074

  Abstract

  To determine whether childhood abuse predicts health symptoms and health care use among female veterans.Participants were 369 female patients at Veterans Affairs hospitals in New England who completed a mail survey. Multiple regression analyses were conducted to determine the differential impact of childhood physical abuse and childhood sexual abuse on health symptoms and health care use, while accounting for age, race, military branch, and military sexual trauma (MST).In our sample, 109 (29%) female veterans reported experiencing childhood abuse. After adjusting for age, race, military branch, childhood sexual abuse, and MST, childhood physical abuse was predictive of poorer physical health, and greater depressive and post-traumatic stress disorder symptoms. No significant association was found between childhood sexual abuse and poor physical or mental health status. After adjusting for other factors, childhood physical abuse was associated with more frequent use of medical health care. Childhood sexual abuse was not a predictor for health care use.Childhood physical abuse remains an important contributor to physical health and mental health, even after adjusting for the more proximate experience of MST. Screening for adverse childhood experiences may facilitate access to appropriate physical and mental health treatment among female veterans.

  View details for DOI 10.7205/MILMED-D-14-00719

  View details for Web of Science ID 000364632900018

  View details for PubMedID 26444469

• Relationships between clinician-level attributes and fidelity-consistent and fidelity-inconsistent modifications to an evidence-based psychotherapy IMPLEMENTATION SCIENCE Stirman, S. W., Gutner, C. A., Crits-Christoph, P., Edmunds, J., Evans, A. C., Beidas, R. S. 2015; 10

  Abstract

  Clinicians often modify evidence-based psychotherapies (EBPs) when delivering them in routine care settings. There has been little study of factors associated with or implications of modifications to EBP protocols. This paper differentiates between fidelity-consistent and fidelity-inconsistent modifications and it examines the potential influence of two clinician characteristics, training outcomes, and attitudes toward EBPs on fidelity-consistent and fidelity-inconsistent modifications of cognitive behavioral therapy in a sample of clinicians who had been trained to deliver these treatments for children or adults.Survey and coded interview data collected 2 years after completion of training programs in cognitive behavioral therapy were used to examine associations between successful or unsuccessful completion of training, clinician attitudes, and modifications. Modifications endorsed by clinicians were categorized as fidelity-consistent or fidelity-inconsistent and entered as outcomes into separate regression models, with training success and attitudes entered as independent variables.Successful completion of a training program was associated with subsequent fidelity-inconsistent modifications but not fidelity-consistent modifications. Therapists who reported greater openness to using EBPs prior to training reported more fidelity-consistent modifications at follow-up, and those who reported greater willingness to adopt EBPs if they found them appealing were more likely to make fidelity-inconsistent modifications.Implications of these findings for training, implementation, EBP sustainment, and future studies are discussed. Research on contextual and protocol-related factors that may impact decisions to modify EBPs will be an important future direction of study to complement to this research.

  View details for DOI 10.1186/s13012-015-0308-z

  View details for Web of Science ID 000359338100001

  View details for PubMedCentralID PMC4534152

• Relationships between clinician-level attributes and fidelity-consistent and fidelity-inconsistent modifications to an evidence-based psychotherapy. Implementation science : IS Wiltsey Stirman, S., Gutner, C. A., Crits-Christoph, P., Edmunds, J., Evans, A. C., Beidas, R. S. 2015; 10: 115

  Abstract

  Clinicians often modify evidence-based psychotherapies (EBPs) when delivering them in routine care settings. There has been little study of factors associated with or implications of modifications to EBP protocols. This paper differentiates between fidelity-consistent and fidelity-inconsistent modifications and it examines the potential influence of two clinician characteristics, training outcomes, and attitudes toward EBPs on fidelity-consistent and fidelity-inconsistent modifications of cognitive behavioral therapy in a sample of clinicians who had been trained to deliver these treatments for children or adults.Survey and coded interview data collected 2 years after completion of training programs in cognitive behavioral therapy were used to examine associations between successful or unsuccessful completion of training, clinician attitudes, and modifications. Modifications endorsed by clinicians were categorized as fidelity-consistent or fidelity-inconsistent and entered as outcomes into separate regression models, with training success and attitudes entered as independent variables.Successful completion of a training program was associated with subsequent fidelity-inconsistent modifications but not fidelity-consistent modifications. Therapists who reported greater openness to using EBPs prior to training reported more fidelity-consistent modifications at follow-up, and those who reported greater willingness to adopt EBPs if they found them appealing were more likely to make fidelity-inconsistent modifications.Implications of these findings for training, implementation, EBP sustainment, and future studies are discussed. Research on contextual and protocol-related factors that may impact decisions to modify EBPs will be an important future direction of study to complement to this research.

  View details for DOI 10.1186/s13012-015-0308-z

  View details for PubMedID 26268633

  View details for PubMedCentralID PMC4534152

• African American and European American Veterans' Perspectives on Receiving Mental Health Treatment PSYCHOLOGICAL SERVICES Castro, F., AhnAllen, C. G., Wiltsey-Stirman, S., Lester-Williams, K., Klunk-Gillis, J., Dick, A. M., Resick, P. A. 2015; 12 (3): 330-338

  Abstract

  Little is known about client attitudes, especially veterans', toward the types of structured interventions that are increasingly being offered in public sector and U.S. Department of Veterans Affairs mental health clinics, nor is the possible impact these attitudes may have on treatment engagement well understood. Previous work indicates that attitudes of African Americans and European Americans toward treatment may differ in important ways. Attitudes toward treatment have been a proposed explanation for lower treatment engagement and higher dropout rates among African Americans compared with European Americans. Yet to date, the relationship between race and attitudes toward treatment and treatment outcomes has been understudied and the findings inconclusive. The purpose of this study was to explore African American and European American veteran attitudes toward mental health care, especially as they relate to structured treatments. Separate focus groups were conducted with 24 African American and 37 European American military veterans. In general, both groups reported similar reasons for seeking 0treatment and similar thoughts regarding the purpose of therapy. Differences emerged primarily regarding therapist preferences. In both groups, some participants expressed favorable opinions of structured treatments and others expressed negative views; treatment preferences did not appear to be influenced by race.

  View details for DOI 10.1037/a0038702

  View details for Web of Science ID 000358689300016

  View details for PubMedID 25822316

  View details for PubMedCentralID PMC4516607

• System-Level Influences on the Sustainability of a Cognitive Therapy Program in a Community Behavioral Health Network. Psychiatric services Stirman, S. W., Matza, A., Gamarra, J., Toder, K., Xhezo, R., Evans, A. C., Hurford, M., Beck, A. T., Crits-Christoph, P., Creed, T. 2015; 66 (7): 734-742

  Abstract

  The purpose of this study was to examine influences on the sustainability of a program to implement an evidence-based psychotherapy in a mental health system.Interviews with program administrators, training consultants, agency administrators, and supervisors (N=24), along with summaries of program evaluation data and program documentation, were analyzed with a directed content-analytic approach.Findings suggested a number of interconnected and interacting influences on sustainability, including alignment with emerging sociopolitical influences and system and organizational priorities; program-level adaptation and evolution; intervention flexibility; strong communication, collaboration, planning, and support; and perceived benefit. These individual factors appeared to mutually influence one another and contribute to the degree of program sustainability achieved at the system level. Although most influences were positive, financial planning and support emerged as potentially both facilitator and barrier, and evaluation of benefits at the patient level remained a challenge.Several factors appeared to contribute to the sustainability of a psychosocial intervention in a large urban mental health system and warrant further investigation. Understanding interconnections between multiple individual facilitators and barriers appears critical to advancing understanding of sustainability in dynamic systems and adds to emerging recommendations for other implementation efforts. In particular, implications of the findings include the importance of implementation strategies, such as long-term planning, coalition building, clarifying roles and expectations, planned adaptation, evaluation, diversification of financing strategies, and incentivizing implementation.

  View details for DOI 10.1176/appi.ps.201400147

  View details for PubMedID 25828878

  View details for PubMedCentralID PMC4490058

• Hormone therapy use in women veterans accessing veterans health administration care: a national cross-sectional study. Journal of general internal medicine Gerber, M. R., King, M. W., Pineles, S. L., Wiltsey-Stirman, S., Bean-Mayberry, B., Japuntich, S. J., Haskell, S. G. 2015; 30 (2): 169-175

  Abstract

  The majority of women Veterans using VA (Veterans Administration) care fall in the 45-65 year-old age range. Understanding how menopause is managed in this group is of importance to optimizing their health.National population estimates showed a prevalence of hormone therapy (HT) use by women over 45 years of 4.7 % (2009-2010). Our study described the frequency of HT use among women Veterans in VA, and examined whether mental health (MH) was predictive of HT use.This was a cross-sectional analysis of national VA administrative data for fiscal year 2009.Women Veterans over the age of 45 (N = 157,195) accessing VA outpatient care were included in the analysis.Logistic regression analyses using HT use as the dependent variable.Mean age was 59.4 years (SD =12.2, range =46-110), and 16,227 (10.3 %) of all women used HT. Hysterectomy (OR 3.99 [3.53, 4.49]) and osteoporosis (1.34 [1.27, 1.42]) were the strongest medical indicators of HT use. A total of 49,557 (31.5 %) women in the sample received at least one primary diagnosis of a MH disorder and were more likely to use HT than women with no MH diagnoses (unadjusted OR 1.56, 95 % CI [1.50, 1.61]). Women Veterans with a mood disorder (depression/bipolar) or anxiety disorder [post-traumatic stress disorder (PTSD), other anxiety diagnoses] were more likely to use HT after controlling for demographics and medical comorbidity.The prevalence of HT use among women Veterans using VA is more than twice that of the general population. Prior work suggested that women Veterans were discontinuing HT at comparable rates, but these data demonstrate that decline in VA HT use has not kept pace with that of civilian medical care. The association of MH diagnosis with HT use suggests that MH plays an important role in VA rates. Further study is needed to understand contributing patient and provider factors.

  View details for DOI 10.1007/s11606-014-3073-9

  View details for PubMedID 25373833

  View details for PubMedCentralID PMC4314474

• Assessing Variability and Implementation Fidelity of Suicide Prevention Safety Planning in a Regional VA Healthcare System CRISIS-THE JOURNAL OF CRISIS INTERVENTION AND SUICIDE PREVENTION Gamarra, J. M., Luciano, M. T., Gradus, J. L., Stirman, S. W. 2015; 36 (6): 433-439

  Abstract

  In 2008, the Veterans Health Administration (VHA) implemented the use of safety planning for suicide prevention. A safety plan is a list of strategies, developed collaboratively with a provider, for a patient to use when suicide risk is elevated. Despite the use of safety plans in VHA, little is known about implementation fidelity, the extent to which safety plans are delivered as intended, or patient-level outcomes of safety planning.This study aimed to explore the implementation fidelity of safety planning in a regional VHA hospital and examine the associations between safety plan quality and completeness with patient outcomes.A comprehensive chart review was conducted for patients who were flagged as high risk for suicide (N = 200). Completeness and quality were coded, as well as information about patient and provider interactions regarding safety plan use.Safety plans were mostly complete and of moderate quality, although variability existed, particularly in quality. Limited evidence of follow-up regarding safety planning was found in the medical charts. Higher quality was associated with fewer subsequent psychiatric hospitalizations.Variability in implementation fidelity and infrequent follow-up suggest a need for additional training and support regarding the use of safety plans for suicide prevention.

  View details for DOI 10.1027/0227-5910/a000345

  View details for Web of Science ID 000368047200007

  View details for PubMedCentralID PMC4675034

• Women Veterans' Preferences for Intimate Partner Violence Screening and Response Procedures Within the Veterans Health Administration RESEARCH IN NURSING & HEALTH Iverson, K. M., Huang, K., Wells, S. Y., Wright, J. D., Gerber, M. R., Wiltsey-Stirman, S. 2014; 37 (4): 302-311

  Abstract

  Intimate partner violence (IPV) is a significant health issue faced by women veterans, but little is known about their preferences for IPV-related care. Five focus groups were conducted with 24 women Veterans Health Administration (VHA) patients with and without a lifetime history of IPV to understand their attitudes and preferences regarding IPV screening and responses within VHA. Women veterans wanted disclosure options, follow-up support, transparency in documentation, and VHA and community resources. They supported routine screening for IPV and articulated preferences for procedural aspects of screening. Women suggested that these procedures could be provided most effectively when delivered with sensitivity and connectedness. Findings can inform the development of IPV screening and response programs within VHA and other healthcare settings.

  View details for DOI 10.1002/nur.21602

  View details for Web of Science ID 000340665400006

  View details for PubMedID 24990824

• VHA Primary Care Providers' Perspectives on Screening Female Veterans for Intimate Partner Violence: A Preliminary Assessment JOURNAL OF FAMILY VIOLENCE Iverson, K. M., Wells, S. Y., Wiltsey-Stirman, S., Vaughn, R., Gerber, M. R. 2013; 28 (8): 823-831

  View details for DOI 10.1007/s10896-013-9544-7

  View details for Web of Science ID 000325776500007

• Community Mental Health Provider Modifications to Cognitive Therapy: Implications for Sustainability PSYCHIATRIC SERVICES Stirman, S. W., Calloway, A., Toder, K., Miller, C. J., Devito, A. K., Meisel, S. N., Xhezo, R., Evans, A. C., Beck, A. T., Crits-Christoph, P. 2013; 64 (10): 1056-1059

  Abstract

  This study identified modifications to an evidence-based psychosocial treatment (cognitive therapy) within a community mental health system after clinicians had received intensive training and consultation.A coding system, consisting of four types of contextual modifications, 12 types of content-related modifications, seven levels at which modifications can occur, and a code for changes to training or evaluation processes, was applied to data from interviews with 27 clinicians who treat adult consumers within a mental health system.Nine of 12 content modifications were endorsed, and four (tailoring, integration into other therapeutic approaches, loosening structure, and drift) accounted for 65% of all modifications identified. Contextual modifications were rarely endorsed by clinicians in this sample. Modifications typically occurred at the client or clinician level.Clinicians in community mental health settings made several modifications to an evidence-based practice (EBP), often in an effort to improve the fit of the intervention to the client's needs or to the clinician's therapeutic style. These findings have implications for implementation and sustainability of EBPs in community settings, client-level outcomes, and training and consultation.

  View details for DOI 10.1176/appi.ps.201200456

  View details for Web of Science ID 000327278200029

  View details for PubMedID 24081406

  View details for PubMedCentralID PMC3851297

• Longitudinal course of anxiety sensitivity and PTSD symptoms in cognitive-behavioral therapies for PTSD JOURNAL OF ANXIETY DISORDERS Gutner, C. A., Nillni, Y. I., Suvak, M., Wiltsey-Stirman, S., Resick, P. A. 2013; 27 (7): 728-734

  Abstract

  Anxiety sensitivity (AS) has been conceptualized as trait-like vulnerability and maintenance factor for PTSD. Although recent literature has demonstrated its malleability during treatment, few have examined its influence on and effect from PTSD treatment. Using multilevel regression analyses we examined: (a) changes in AS during treatment and (b) whether pre-treatment AS predicted PTSD treatment response, in sample of female victims of interpersonal trauma receiving one of three treatments (cognitive processing therapy, cognitive processing therapy-cognitive, and written accounts). Participants exhibited reductions in total ASI scores from pre- to post-treatment. Growth curve modeling revealed slightly different trajectories of PTSD symptoms as a function of pre-treatment AS, and overall decreases in PTSD symptoms during treatment were not associated with pretreatment AS. Pretreatment AS dimensions impacted PTSD total scores and symptoms clusters differentially. Clinical and theoretical implications for these results are discussed.

  View details for DOI 10.1016/j.janxdis.2013.09.010

  View details for Web of Science ID 000327685600014

  View details for PubMedID 24176804

  View details for PubMedCentralID PMC3860054

• A randomized controlled dismantling trial of post-workshop consultation strategies to increase effectiveness and fidelity to an evidence-based psychotherapy for Posttraumatic stress disorder IMPLEMENTATION SCIENCE Stirman, S. W., Shields, N., Deloriea, J., Landy, M. S., Belus, J. M., Maslej, M. M., Monson, C. M. 2013; 8

  Abstract

  Posttraumatic Stress Disorder (PTSD) is a serious mental health condition with substantial costs to individuals and society. Among military veterans, the lifetime prevalence of PTSD has been estimated to be as high as 20%. Numerous research studies have demonstrated that short-term cognitive-behavioral psychotherapies, such as Cognitive Processing Therapy (CPT), lead to substantial and sustained improvements in PTSD symptoms. Despite known benefits, only a minority of clinicians provide these therapies. Transferring this research knowledge into clinical settings remains one of the largest hurdles to improving the health of veterans with PTSD. Attending a workshop alone is insufficient to promote adequate knowledge transfer and sustained skill; however, relatively little research has been conducted to identify effective post-training support strategies.The current study investigates whether clinicians receiving post-workshop support (six-month duration) will deliver CPT with greater fidelity (i.e., psychotherapy adherence and competence) and have improved patient outcomes compared with clinicians receiving no formal post-workshop support. The study conditions are: technology-enhanced group tele-consultation; standard group tele-consultation; and fidelity assessment with no consultation. The primary outcome is independent assessment (via audio-recordings) of the clinicians' adherence and competence in delivering CPT. The secondary outcome is observed changes in patient symptoms during and following treatment as a function of clinician fidelity. Post-consultation interviews with clinicians will help identify facilitators and barriers to psychotherapy skill acquisition. The study results will inform how best to implement and transfer evidence-based psychotherapy (e.g., CPT) to clinical settings to attain comparable outcomes to those observed in research settings.Findings will deepen our understanding of how much and what type of support is needed following a workshop to help clinicians become proficient in delivering a new protocol. Several influences on clinician learning and patient outcomes will be discussed. An evidence-based model of clinical consultation will be developed, with the ultimate goal of informing policy and influencing best practice in clinical consultation.ClinicalTrials.gov: NCT01861769.

  View details for DOI 10.1186/1748-5908-8-82

  View details for Web of Science ID 000322964300001

  View details for PubMedCentralID PMC3750558

• Clinicians' Perspectives on Cognitive Therapy in Community Mental Health Settings: Implications for Training and Implementation ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH Stirman, S. W., Gutierrez-Colina, A., Toder, K., Esposito, G., Barg, F., Castro, F., Beck, A. T., Crits-Christoph, P. 2013; 40 (4): 274-285

  Abstract

  Policymakers are investing significant resources in large-scale training and implementation programs for evidence-based psychological treatments (EBPTs) in public mental health systems. However, relatively little research has been conducted to understand factors that may influence the success of efforts to implement EBPTs for adult consumers of mental health services. In a formative investigation during the development of a program to implement cognitive therapy (CT) in a community mental health system, we surveyed and interviewed clinicians and clinical administrators to identify potential influences on CT implementation within their agencies. Four primary themes were identified. Two related to attitudes towards CT: (1) ability to address client needs and issues that are perceived as most central to their presenting problems, and (2) reluctance to fully implement CT. Two themes were relevant to context: (1) agency-level barriers, specifically workload and productivity concerns and reactions to change, and (2) agency-level facilitators, specifically, treatment planning requirements and openness to training. These findings provide information that can be used to develop strategies to facilitate the implementation of CT interventions for clients being treated in public-sector settings.

  View details for DOI 10.1007/s10488-012-0418-8

  View details for Web of Science ID 000320338600004

  View details for PubMedID 22426739

  View details for PubMedCentralID PMC3434254

• Development of a framework and coding system for modifications and adaptations of evidence-based interventions IMPLEMENTATION SCIENCE Stirman, S., Miller, C. J., Toder, K., Calloway, A. 2013; 8: 65

  Abstract

  Evidence-based interventions are frequently modified or adapted during the implementation process. Changes may be made to protocols to meet the needs of the target population or address differences between the context in which the intervention was originally designed and the one into which it is implemented [Addict Behav 2011, 36(6):630-635]. However, whether modification compromises or enhances the desired benefits of the intervention is not well understood. A challenge to understanding the impact of specific types of modifications is a lack of attention to characterizing the different types of changes that may occur. A system for classifying the types of modifications that are made when interventions and programs are implemented can facilitate efforts to understand the nature of modifications that are made in particular contexts as well as the impact of these modifications on outcomes of interest.We developed a system for classifying modifications made to interventions and programs across a variety of fields and settings. We then coded 258 modifications identified in 32 published articles that described interventions implemented in routine care or community settings.We identified modifications made to the content of interventions, as well as to the context in which interventions are delivered. We identified 12 different types of content modifications, and our coding scheme also included ratings for the level at which these modifications were made (ranging from the individual patient level up to a hospital network or community). We identified five types of contextual modifications (changes to the format, setting, or patient population that do not in and of themselves alter the actual content of the intervention). We also developed codes to indicate who made the modifications and identified a smaller subset of modifications made to the ways that training or evaluations occur when evidence-based interventions are implemented. Rater agreement analyses indicated that the coding scheme can be used to reliably classify modifications described in research articles without overly burdensome training.This coding system can complement research on fidelity and may advance research with the goal of understanding the impact of modifications made when evidence-based interventions are implemented. Such findings can further inform efforts to implement such interventions while preserving desired levels of program or intervention effectiveness.

  View details for DOI 10.1186/1748-5908-8-65

  View details for Web of Science ID 000320714900001

  View details for PubMedID 23758995

  View details for PubMedCentralID PMC3686699

• Research Setting Versus Clinic Setting: Which Produces Better Outcomes in Cognitive Therapy for Depression? COGNITIVE THERAPY AND RESEARCH Gibbons, C. R., Stirman, S. W., DeRubeis, R. J., Newman, C. F., Beck, A. T. 2013; 37 (3): 605-612

  Abstract

  To compare the outcomes of cognitive therapy for depression under controlled and clinically representative conditions, while holding several therapist and clinical assessment factors constant.Treatment outcomes for a sample of 23 adults with a primary diagnosis of Major Depressive Disorder who received cognitive therapy in an outpatient clinic were compared with outcomes of 18 clients who were treated in the cognitive therapy condition of a large, multi-site randomized clinical trial of treatments for depression. All participants had been treated by one of two therapists who served as clinicians in both settings. Individuals in the two samples were diagnostically and demographically similar (approximately 50% Female, 83% White). A variety of client characteristics, assessed prior to treatment, as well as the outcomes of treatment, were examined.Significantly superior treatment outcomes were observed in the individuals treated in the research study, relative to clients in the outpatient clinic, and the difference was not accounted for by intake characteristics. Individuals treated by the therapists in the RCT experienced almost three times as much improvement in depressive symptoms as clients seen in the outpatient setting.If replicated, the findings suggest that differences exist between treatment outcomes in research and outpatient settings and that these differences may not simply be due to therapist experience and training, or differences in patient populations. Future research should further examine the impact of fidelity monitoring, treatment expectation and motivation, and the duration and timing of treatment protocols on clinical outcomes.

  View details for DOI 10.1007/s10608-012-9499-7

  View details for Web of Science ID 000318817000020

  View details for PubMedCentralID PMC3661278

• Developing the next generation of dissemination and implementation researchers: insights from initial trainees IMPLEMENTATION SCIENCE Stamatakis, K. A., Norton, W. E., Stirman, S. W., Melvin, C., Brownson, R. C. 2013; 8

  Abstract

  Dissemination and implementation (D&I) research is a relatively young discipline, underscoring the importance of training and career development in building and sustaining the field. As such, D&I research faces several challenges in designing formal training programs and guidance for career development. A cohort of early-stage investigators (ESI) recently involved in an implementation research training program provided a resource for formative data in identifying needs and solutions around career development.Responses outlined fellows' perspectives on the perceived usefulness and importance of, as well as barriers to, developing practice linkages, acquiring additional methods training, academic advancement, and identifying institutional supports. Mentorship was a cross-cutting issue and was further discussed in terms of ways it could foster career advancement in the context of D&I research.Advancing an emerging field while simultaneously developing an academic career offers a unique challenge to ESIs in D&I research. This article summarizes findings from the formative data that outlines some directions for ESIs and provides linkages to the literature and other resources on key points.

  View details for DOI 10.1186/1748-5908-8-29

  View details for Web of Science ID 000318418300001

  View details for PubMedID 23497462

  View details for PubMedCentralID PMC3626831

• Recruiting older men for geriatric suicide research INTERNATIONAL PSYCHOGERIATRICS Bhar, S. S., Wiltsey-Stirman, S., Zembroski, D., McCray, L., Oslin, D. W., Brown, G. K., Beck, A. T. 2013; 25 (1): 88-95

  Abstract

  Clinical research is required to develop and evaluate suicide prevention interventions in the elderly. However, there is insufficient information available about how to best recruit suicidal older adults for such research. This study evaluated the success and efficiency of five recruitment strategies for a clinical trial on the efficacy of cognitive therapy for suicidal older men.For each strategy, the numbers of individuals approached, screened, and enrolled were calculated, and the expenses and time associated with each enrollment estimated. Men who were 60 years or older and who had a desire for suicide over the past month were eligible for the trial.Of 955 individuals considered for trial, 33 were enrolled. Most enrollments were sourced from the Veterans Affairs Behavioral Health Laboratory. Recruiting form this source was also the most time and cost efficient recruitment strategy in the study.Recruitment strategies are effective when they are based on collaborative relationships between researchers and providers, and utilize an existing infrastructure for involving patients in ongoing research opportunities.

  View details for DOI 10.1017/S104161021200138X

  View details for Web of Science ID 000312528400011

  View details for PubMedID 22929086

  View details for PubMedCentralID PMC4583196

• VA primary care providers’ perspectives on screening female Veterans for intimate partner violence: A preliminary assessment Journal of Family Violence Iverson, K. M., Wells, S. Y., Wiltsey Stirman, S., Vaughn, R., Gerber, M. R. 2013; 37: 302-311
• Development of a framework and coding system for modifications made to evidence-based programs and interventions Implementation Science Wiltsey Stirman, S. 2013
• A critical evaluation of the complex PTSD literature: Implications for DSM-5 JOURNAL OF TRAUMATIC STRESS Resick, P. A., Bovin, M. J., Calloway, A. L., Dick, A. M., King, M. W., Mitchell, K. S., Suvak, M. K., Wells, S. Y., Stirman, S. W., Wolf, E. J. 2012; 25 (3): 241-251

  Abstract

  Complex posttraumatic stress disorder (CPTSD) has been proposed as a diagnosis for capturing the diverse clusters of symptoms observed in survivors of prolonged trauma that are outside the current definition of PTSD. Introducing a new diagnosis requires a high standard of evidence, including a clear definition of the disorder, reliable and valid assessment measures, support for convergent and discriminant validity, and incremental validity with respect to implications for treatment planning and outcome. In this article, the extant literature on CPTSD is reviewed within the framework of construct validity to evaluate the proposed diagnosis on these criteria. Although the efforts in support of CPTSD have brought much needed attention to limitations in the trauma literature, we conclude that available evidence does not support a new diagnostic category at this time. Some directions for future research are suggested.

  View details for DOI 10.1002/jts.21699

  View details for Web of Science ID 000305576500003

  View details for PubMedID 22729974

• A Qualitative Investigation of Practicing Psychologists' Attitudes Toward Research-Informed Practice: Implications for Dissemination Strategies PROFESSIONAL PSYCHOLOGY-RESEARCH AND PRACTICE Stewart, R. E., Stirman, S. W., Chambless, D. L. 2012; 43 (2): 100-109

  Abstract

  This article presents the results of a qualitative analysis of interviews with 25 psychologists in independent practice, investigating everyday treatment decisions and attitudes about treatment outcome research and empirically supported treatments (ESTs). Clinicians noted positive aspects about treatment outcome research, such as being interested in what works. However, they had misgivings about the application of controlled research findings to their practices, were skeptical about using manualized protocols, and expressed concern that nonpsychologists would use EST lists to dictate practice. Clinicians reported practicing in an eclectic framework, and many reported including cognitive-behavioral elements in their practice. To improve their practice, they reported valuing clinical experience, peer networks, practitioner-oriented books, and continuing education when it was not too basic. Time and financial barriers concerned nearly all participants. Clinicians suggested they might be interested in ESTs if they could integrate them into their current frameworks, and if resources for learning ESTs were improved.

  View details for DOI 10.1037/a0025694

  View details for Web of Science ID 000302968800005

  View details for PubMedCentralID PMC3361756

• A Qualitative Investigation of Practicing Psychologists' Attitudes Toward Research-Informed Practice: Implications for Dissemination Strategies. Professional psychology, research and practice Stewart, R. E., Stirman, S. W., Chambless, D. L. 2012; 43 (2): 100-109

  Abstract

  This article presents the results of a qualitative analysis of interviews with 25 psychologists in independent practice, investigating everyday treatment decisions and attitudes about treatment outcome research and empirically supported treatments (ESTs). Clinicians noted positive aspects about treatment outcome research, such as being interested in what works. However, they had misgivings about the application of controlled research findings to their practices, were skeptical about using manualized protocols, and expressed concern that nonpsychologists would use EST lists to dictate practice. Clinicians reported practicing in an eclectic framework, and many reported including cognitive-behavioral elements in their practice. To improve their practice, they reported valuing clinical experience, peer networks, practitioner-oriented books, and continuing education when it was not too basic. Time and financial barriers concerned nearly all participants. Clinicians suggested they might be interested in ESTs if they could integrate them into their current frameworks, and if resources for learning ESTs were improved.

  View details for DOI 10.1037/a0025694

  View details for PubMedID 22654246

  View details for PubMedCentralID PMC3361756

• The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research IMPLEMENTATION SCIENCE Stirman, S. W., Kimberly, J., Cook, N., Calloway, A., Castro, F., Charns, M. 2012; 7

  Abstract

  The introduction of evidence-based programs and practices into healthcare settings has been the subject of an increasing amount of research in recent years. While a number of studies have examined initial implementation efforts, less research has been conducted to determine what happens beyond that point. There is increasing recognition that the extent to which new programs are sustained is influenced by many different factors and that more needs to be known about just what these factors are and how they interact. To understand the current state of the research literature on sustainability, our team took stock of what is currently known in this area and identified areas in which further research would be particularly helpful. This paper reviews the methods that have been used, the types of outcomes that have been measured and reported, findings from studies that reported long-term implementation outcomes, and factors that have been identified as potential influences on the sustained use of new practices, programs, or interventions. We conclude with recommendations and considerations for future research.Two coders identified 125 studies on sustainability that met eligibility criteria. An initial coding scheme was developed based on constructs identified in previous literature on implementation. Additional codes were generated deductively. Related constructs among factors were identified by consensus and collapsed under the general categories. Studies that described the extent to which programs or innovations were sustained were also categorized and summarized.Although "sustainability" was the term most commonly used in the literature to refer to what happened after initial implementation, not all the studies that were reviewed actually presented working definitions of the term. Most study designs were retrospective and naturalistic. Approximately half of the studies relied on self-reports to assess sustainability or elements that influence sustainability. Approximately half employed quantitative methodologies, and the remainder employed qualitative or mixed methodologies. Few studies that investigated sustainability outcomes employed rigorous methods of evaluation (e.g., objective evaluation, judgement of implementation quality or fidelity). Among those that did, a small number reported full sustainment or high fidelity. Very little research has examined the extent, nature, or impact of adaptations to the interventions or programs once implemented. Influences on sustainability included organizational context, capacity, processes, and factors related to the new program or practice themselves.Clearer definitions and research that is guided by the conceptual literature on sustainability are critical to the development of the research in the area. Further efforts to characterize the phenomenon and the factors that influence it will enhance the quality of future research. Careful consideration must also be given to interactions among influences at multiple levels, as well as issues such as fidelity, modification, and changes in implementation over time. While prospective and experimental designs are needed, there is also an important role for qualitative research in efforts to understand the phenomenon, refine hypotheses, and develop strategies to promote sustainment.

  View details for DOI 10.1186/1748-5908-7-17

  View details for Web of Science ID 000302479300001

  View details for PubMedID 22417162

  View details for PubMedCentralID PMC3317864

• Perspectives on Cognitive Therapy Training within Community Mental Health Settings: Implications for Clinician Satisfaction and Skill Development. Depression research and treatment Wiltsey Stirman, S., Miller, C. J., Toder, K., Calloway, A., Beck, A. T., Evans, A. C., Crits-Christoph, P. 2012; 2012: 391084-?

  Abstract

  Despite the mounting evidence of the benefits of cognitive therapy for depression and suicidal behaviors over usual care, like other evidence-based psychosocial treatments (EBTs), it has not been widely adopted in clinical practice. Studies have shown that training followed by intensive consultation is needed to prepare providers to an appropriate level of competency in complex, multisession treatment packages such as cognitive therapy. Given the critical role of training in EBT implementation, more information on factors associated with the success and challenges of training programs is needed. To identify potential reasons for variation in training outcomes across ten agencies in a large, urban community mental health system, we explored program evaluation data and examined provider, consultant, and training program administrator perspectives through follow-up interviews. Perceptions of cognitive therapy, contextual factors, and reactions to feedback on audio recordings emerged as broad categories of themes identified from interviews. These factors may interact and impact clinician efforts to learn cognitive therapy and deliver it skillfully in their practice. The findings highlight experiences and stakeholder perspectives that may contribute to more or less successful training outcomes.

  View details for DOI 10.1155/2012/391084

  View details for PubMedID 23056933

  View details for PubMedCentralID PMC3465974

• Training Community Mental Health Agencies in Cognitive Therapy for Schizophrenia. The Behavior therapist Riggs, S. E., Wiltsey-Stirman, S. n., Beck, A. T. 2012; 35 (2): 34–39

  View details for PubMedID 26401068

• Changes in Psychotherapy Utilization Among Consumers of Services for Major Depressive Disorder in the Community Mental Health System ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH Gibbons, M. B., Rothbard, A., Farris, K. D., Stirman, S. W., Thompson, S. M., Scott, K., Heintz, L. E., Gallop, R., Crits-Christoph, P. 2011; 38 (6): 495-503

  Abstract

  The goal of this investigation was to explore changes in psychotherapy utilization for patients with major depressive disorder (MDD) treated in community mental health agencies across two cohorts. We used a Medicaid claims database including approximately 300,000 public sector clients. Although the use of psychotherapy alone showed a small decrease, there was a large increase in the use of combined medication and psychotherapy as a treatment for MDD. Race was a significant predictor of both treatment type received and length of treatment. African American consumers were more likely to receive psychotherapy alone than combined treatment and attended significantly fewer psychotherapy sessions.

  View details for DOI 10.1007/s10488-011-0336-1

  View details for Web of Science ID 000300092700006

  View details for PubMedID 21298475

  View details for PubMedCentralID PMC3350098

• The Science of Training in Evidence-Based Treatments in the Context of Implementation Programs: Current Status and Prospects for the Future ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH Becker, K. D., Stirman, S. W. 2011; 38 (4): 217-222

  View details for DOI 10.1007/s10488-011-0361-0

  View details for Web of Science ID 000291804400001

  View details for PubMedID 21644028

  View details for PubMedCentralID PMC3565531

• Participation Bias among Suicidal Adults in a Randomized Controlled Trial SUICIDE AND LIFE-THREATENING BEHAVIOR Stirman, S. W., Brown, G. K., Ghahramanlou-Holloway, M., Fox, A. J., Chohan, M. Z., Beck, A. T. 2011; 41 (2): 203-209

  Abstract

  Although individuals who attempt suicide have poor compliance rates with treatment recommendations, the nature and degree of participation bias in clinical treatment research among these individuals is virtually unknown. The purpose of this study was to examine participation bias by comparing the demographic and diagnostic characteristics of adult suicide attempters who participated in a randomized controlled trial to a sample of nonparticipants. Results indicated that males and individuals with a diagnosis of substance abuse or dependence were more likely to be participants in the randomized controlled trial. The implications of these findings for suicide intervention research are discussed.

  View details for DOI 10.1111/j.1943-278X.2010.00011.x

  View details for Web of Science ID 000289247800009

  View details for PubMedID 21470296

  View details for PubMedCentralID PMC3367501

• Developing the mental health workforce: Review and application of training strategies from multiple disciplines Administration and Policy in Mental Health and Mental Health Services Research Lyon, A. 2011: 238-253
• The clinical effectiveness of cognitive therapy for depression in an outpatient clinic JOURNAL OF AFFECTIVE DISORDERS Gibbons, C. J., Fournier, J. C., Stirman, S. W., DeRubeis, R. J., Crits-Christoph, P., Beck, A. T. 2010; 125 (1-3): 169-176

  Abstract

  Cognitive therapy (CT) has been shown to be efficacious in the treatment of depression in numerous randomized controlled trials (RCTs). However, little evidence is available that speaks to the effectiveness of this treatment under routine clinical conditions.This paper examines outcomes of depressed individuals seeking cognitive therapy at an outpatient clinic (N=217, Center for Cognitive Therapy; CCT). Outcomes were then compared to those of participants in a large NIMH-funded RCT of cognitive therapy and medications as treatments for depression.The CCT is shown to be a clinically representative setting, and 61% of participants experienced reliable change in symptoms over the course of treatment; of those, 45% (36% of the total sample) met criteria for recovery by the end of treatment. Participants at CCT had similar outcomes to participants treated in the RCT, but there was some evidence that those with more severe symptoms at intake demonstrated greater improvement in the RCT than their counterparts at CCT.The CCT may not be representative of all outpatient settings, and the structure of treatment there was considerably different from that in the RCT. Treatment fidelity was not assessed at CCT.Depressed individuals treated with cognitive therapy in a routine clinical care setting showed a significant improvement in symptoms. When compared with outcomes evidenced in RCTs, there was little evidence of superior outcomes in either setting. However, for more severe participants, outcomes were found to be superior when treatment was delivered within an RCT than in an outpatient setting. Clinicians treating such patients in non-research settings may thus benefit from making modifications to treatment protocols to more closely resemble research settings.

  View details for DOI 10.1016/j.jad.2009.12.030

  View details for Web of Science ID 000281377100023

  View details for PubMedID 20080305

  View details for PubMedCentralID PMC2888955

• New psychotherapies for mood and anxiety disorders. Canadian journal of psychiatry. Revue canadienne de psychiatrie Wiltsey Stirman, S., Toder, K., Crits-Cristoph, P. 2010; 55 (4): 193-201

  Abstract

  To discuss psychotherapies for depression and anxiety that have emerged in recent years and to evaluate their current level of empirical support.An electronic and a manual literature search of psychotherapies for mood and anxiety disorders were conducted.Five new therapies for mood disorders and 3 interventions for posttraumatic stress disorder with co-occurring substance abuse met criteria for inclusion in this review. Fewer psychotherapies have been developed for other anxiety disorders. Although research for some of the psychotherapies has demonstrated superiority to usual care, none have firmly established efficacy or specific benefits over other established psychotherapies.A plurality of the new psychotherapies introduced and established in the past 5 years have been different assimilations of previously established cognitive-behavioural, interpersonal, or psychodynamic models. While initial results are promising for some, more rigorous efficacy trials and replications are necessary before conclusions can be drawn regarding their relative benefits.

  View details for PubMedID 20416142

  View details for PubMedCentralID PMC2964933

• Training and Consultation in Evidence-Based Psychosocial Treatments in Public Mental Health Settings: The ACCESS Model PROFESSIONAL PSYCHOLOGY-RESEARCH AND PRACTICE Stirman, S. W., Bhar, S. S., Spokas, M., Brown, G. K., Creed, T. A., Perivoliotis, D., Farabaugh, D. T., Grant, P. M., Beck, A. T. 2010; 41 (1): 48-56

  Abstract

  We present a model of training in evidence-based psychosocial treatments (EBTs). The ACCESS (assess and adapt, convey basics, consult, evaluate, study outcomes, sustain) model integrates principles and findings from adult education and training literatures, research, and practical suggestions based on a community-based clinician training program. Descriptions of the steps are provided as a means of guiding implementation efforts and facilitating training partnerships between public mental health agencies and practitioners of EBTs.

  View details for DOI 10.1037/a0018099

  View details for Web of Science ID 000274475600007

  View details for PubMedCentralID PMC3412177

• Developing research and recruitment while fostering stakeholder engagement in an IP-RISP for Depression Progress in Community Health Partnerships: Research, Education, and Action Wiltsey Stirman, S. 2010: 299-303
• Engagement and Retention of Suicide Attempters in Clinical Research Challenges and Solutions CRISIS-THE JOURNAL OF CRISIS INTERVENTION AND SUICIDE PREVENTION Gibbons, C. J., Stirman, S. W., Brown, G. K., Beck, A. T. 2010; 31 (2): 62-68

  Abstract

  High attrition rates in longitudinal research can limit study generalizability, threaten internal validity, and decrease statistical power. Research has demonstrated that there can be significant differences between participants who complete a research study and those who drop out prematurely, and that treatment outcomes may be dependent on retention in a treatment protocol.The current paper describes the challenges encountered when implementing a randomized controlled trial of cognitive therapy for the prevention of suicide attempts and the solutions developed to overcome these problems.Problems unique to suicide attempters are discussed, and strategies successfully implemented to boost retention rates are provided.The methods implemented appeared to increase retention rates in the randomized controlled trial.Many steps can be taken to work with this difficult population, and researchers are encouraged to be as involved and flexible with participants as possible.

  View details for DOI 10.1027/0227-5910/a000018

  View details for Web of Science ID 000277094400002

  View details for PubMedID 20418211

  View details for PubMedCentralID PMC2962927

• Unique and Common Mechanisms of Change Across Cognitive and Dynamic Psychotherapies JOURNAL OF CONSULTING AND CLINICAL PSYCHOLOGY Gibbons, M. B., Crits-Christoph, P., Barber, J. P., Stirman, S. W., Gallop, R., Goldstein, L. A., Temes, C. M., Ring-Kurtz, S. 2009; 77 (5): 801-813

  Abstract

  The goal of this article was to examine theoretically important mechanisms of change in psychotherapy outcome across different types of treatment. Specifically, the role of gains in self-understanding, acquisition of compensatory skills, and improvements in views of the self were examined. A pooled study database collected at the University of Pennsylvania Center for Psychotherapy Research, which includes studies conducted from 1995 to 2002 evaluating the efficacy of cognitive and psychodynamic therapies for a variety of disorders, was used. Patient samples included major depressive disorder, generalized anxiety disorder, panic disorder, borderline personality disorder, and adolescent anxiety disorders. A common assessment battery of mechanism and outcome measures was given at treatment intake, termination, and 6-month follow-up for all 184 patients. Improvements in self-understanding, compensatory skills, and views of the self were all associated with symptom change across the diverse psychotherapies. Changes in self-understanding and compensatory skills across treatment were predictive of follow-up symptom course. Changes in self-understanding demonstrated specificity of change to dynamic psychotherapy.

  View details for DOI 10.1037/a0016596

  View details for Web of Science ID 000270564400001

  View details for PubMedID 19803561

  View details for PubMedCentralID PMC2844256

• Public-academic partnerships: the Beck Initiative: a partnership to implement cognitive therapy in a community behavioral health system. Psychiatric services Stirman, S. W., Buchhofer, R., McLaulin, J. B., Evans, A. C., Beck, A. T. 2009; 60 (10): 1302-1304

  Abstract

  The Beck Initiative is a partnership between researchers and clinicians at a large university and an urban behavioral health managed care system. Both partners share a commitment to ensuring that consumers in the community have access to competently delivered, individualized, evidence-based mental health care and that the providers who serve them have the support they need to deliver high-quality evidence-based treatments. Central features of the program are individualized training and consultation in cognitive therapy for each provider agency and policies to promote the sustainability of the initiative and its continuing evolution to meet the needs of providers and consumers.

  View details for DOI 10.1176/appi.ps.60.10.1302

  View details for PubMedID 19797367

  View details for PubMedCentralID PMC2964939

• Suicide Risk Factors and Mediators Between Childhood Sexual Abuse and Suicide Ideation Among Male and Female Suicide Attempters JOURNAL OF TRAUMATIC STRESS Spokas, M., Wenzel, A., Stirman, S. W., Brown, G. K., Beck, A. T. 2009; 22 (5): 467-470

  Abstract

  The current study examined the manner in which childhood sexual abuse (CSA) history relates to risk factors for suicidal behavior among recent suicide attempters (n = 166). Men who recently attempted suicide and endorsed a CSA history had higher scores on measures of hopelessness and suicide ideation than men without a CSA history. Men with a CSA history were also more likely to have made multiple suicide attempts and meet diagnostic criteria for posttraumatic stress disorder and borderline personality disorder. In contrast, there were fewer group differences as a function of CSA history among the female suicide attempters. Hopelessness was a significant mediator between CSA history and suicide ideation in both men and women.

  View details for DOI 10.1002/jts.20438

  View details for Web of Science ID 000271493000016

  View details for PubMedID 19711488

  View details for PubMedCentralID PMC2767398

• CHANGES IN POSITIVE QUALITY OF LIFE OVER THE COURSE OF PSYCHOTHERAPY PSYCHOTHERAPY Crits-Christoph, P., Gibbons, M. B., Ring-Kurtz, S., Gallop, R., Stirman, S., Present, J., Temes, C., Goldstein, L. 2008; 45 (4): 419-430

  Abstract

  The objective of this study was to examine patients' reports of positive quality of life over the course of multiple forms of psychotherapy and disorders. Data from five studies using a common assessment battery were pooled to evaluate the magnitude of change in positive quality of life and explore the relation of change in positive quality of life to change in symptoms, and how these relations vary by disorder. Positive quality of life was measured at intake, termination, and during two post-treatment visits 6 and 12 months following termination. Results revealed that positive quality of life improves moderately over the course of psychotherapy and sustains the improvement through follow-up. Levels of positive quality of life and the degree of change in positive quality of life varied considerably by disorder. There also were moderate sized correlations between changes in positive quality of life and changes in symptomatic response and interpersonal functioning from intake to termination. Implications of the findings for clinical practice and future research are discussed.

  View details for DOI 10.1037/a0014340

  View details for Web of Science ID 000262213000001

  View details for PubMedCentralID PMC2786220

• Changes in Positive Quality of Life over the Course of Psychotherapy. Psychotherapy (Chicago, Ill.) Crits-Christoph, P., Connolly Gibbons, M. B., Ring-Kurtz, S., Gallop, R., Stirman, S., Present, J., Temes, C., Goldstein, L. 2008; 45 (4): 419-430

  Abstract

  The objective of this study was to examine patients' reports of positive quality of life over the course of multiple forms of psychotherapy and disorders. Data from five studies using a common assessment battery were pooled to evaluate the magnitude of change in positive quality of life and explore the relation of change in positive quality of life to change in symptoms, and how these relations vary by disorder. Positive quality of life was measured at intake, termination, and during two post-treatment visits 6 and 12 months following termination. Results revealed that positive quality of life improves moderately over the course of psychotherapy and sustains the improvement through follow-up. Levels of positive quality of life and the degree of change in positive quality of life varied considerably by disorder. There also were moderate sized correlations between changes in positive quality of life and changes in symptomatic response and interpersonal functioning from intake to termination. Implications of the findings for clinical practice and future research are discussed.

  View details for DOI 10.1037/a0014340

  View details for PubMedID 19960115

  View details for PubMedCentralID PMC2786220

• The applicability of randomized controlled trials of psychosocial treatments for PTSD to a veteran population JOURNAL OF PSYCHIATRIC PRACTICE Stirman, S. W. 2008; 14 (4): 199-208

  Abstract

  The extent to which the results of randomized controlled trials can be expected to generalize to clinical populations has been the subject of much debate. To examine this issue among a population of individuals diagnosed with posttraumatic stress disorder (PTSD), the clinical characteristics of Veterans Affairs (VA) patients with PTSD were compared to the eligibility criteria for clinical trials of psychosocial treatments for PTSD. Administrative data for 239,668 patients who received a diagnosis of PTSD within the VA healthcare system during the 2003 fiscal year were compared with inclusion and exclusion criteria of 31 clinical trials for PTSD. Based on available data, all patients appeared to be eligible for at least one study, and half (50%) were eligible for between 16 and 21 (50% or more) of the 31 studies examined. The studies for which the most veterans with PTSD would have been eligible targeted combat-related trauma or did not specify type of trauma in their eligibility criteria. Veterans who exhibited psychotic symptoms (3% of the sample) were ineligible for most, but not all, of the studies. However, most veterans with comorbid Axis I conditions, such as depression, anxiety disorders, and substance use disorders, were eligible for multiple studies. These findings, which indicate that the existing literature on the efficacy of psychosocial treatment may inform the treatment of the majority of veterans who present with PTSD, have applications for the design of future clinical trials and for consultation of the literature regarding appropriate treatments for veterans with PTSD.

  View details for Web of Science ID 000258110500002

  View details for PubMedID 18664888

• The applicability of randomized controlled trials of psychosocial treatments for Post-traumatic Stress Disorder to a Veteran population Journal of Psychiatric Practice Wiltsey-Stirman, S. 2008; 14: 199-208
• Psychiatric telephone contact following emergency department discharge reduces suicide re-attempts in people originally admitted for attempted suicide. Evidence-based mental health Brown, G. K., Wiltsey Stirman, S. n. 2007; 10 (1): 19

  View details for PubMedID 17255388

• Can the randomized controlled trial literature generalize to nonrandomized patients? JOURNAL OF CONSULTING AND CLINICAL PSYCHOLOGY Stirman, S. W., DeRubeis, R. J., Crits-Christoph, P., Rothman, A. 2005; 73 (1): 127-135

  Abstract

  To determine the extent to which published randomized controlled trials (RCTs) of psychotherapy can be generalized to a sample of outpatients, the authors matched information obtained from charts of patients who had been screened out of RCTs to inclusion and exclusion criteria from published RCT studies. Most of the patients in the sample who had primary diagnoses represented in the RCT literature were judged eligible for at least 1 RCT. However, many patients in the sample with substance use disorders or social anxiety disorder were not eligible for at least 2 RCTs. Common reasons that patients did not match with at least 2 published RCTs for psychotherapy included (a) patients were in partial remission, (b) patients failed to meet minimum severity or duration criteria, (c) patients were being treated with antidepressant medication, and (d) the disorder being studied was not primary (mostly for social anxiety patients). The implications of these findings for future research and clinical practice are discussed.

  View details for DOI 10.1037/0022.006X.73.1.127

  View details for Web of Science ID 000227000400014

  View details for PubMedID 15709839

• Achieving successful dissemination of empirically supported adult psychotherapies: A synthesis of dissemination theory Clinical Psychology: Science and Practice Wiltsey Stirman, S. 2004; 11: 343-359
• Are samples in randomized controlled trials of psychotherapy representative of community outpatients? A new methodology and initial findings JOURNAL OF CONSULTING AND CLINICAL PSYCHOLOGY Stirman, S. W., DeRubeis, R. J., Crits-Christoph, P., BRODY, P. E. 2003; 71 (6): 963-972

  Abstract

  To determine the extent to which published randomized controlled trials (RCTs) of psychotherapy can be generalized to a sample of community outpatients, the authors used a method of matching information obtained from outpatient charts to inclusion and exclusion criteria from published RCT studies. They found that 80% of the patients in their sample who had diagnoses represented in the RCT literature were judged eligible for at least 1 published RCT; however, 58% of the patients had primary diagnoses such as adjustment disorder or dysthymia, which were not represented in the existing psychotherapy outcome literature. The most common reasons that patients in their sample did not match with published RCTs for psychotherapy are listed, and the implications of these findings for research and practice are discussed.

  View details for DOI 10.1037/0022-006X.71.6.963

  View details for Web of Science ID 000186693600001

  View details for PubMedID 14622071

• Word use in the poetry of suicidal and nonsuicidal poets PSYCHOSOMATIC MEDICINE Stirman, S. W., Pennebaker, J. W. 2001; 63 (4): 517-522

  Abstract

  The purpose of this study was to determine whether distinctive features of language could be discerned in the poems of poets who committed suicide and to test two suicide models by use of a text-analysis program.Approximately 300 poems from the early, middle, and late periods of nine suicidal poets and nine nonsuicidal poets were compared by use of the computer text analysis program, Linguistic Inquiry and Word Count (LIWC). Language use within the poems was analyzed within the context of two suicide models.In line with a model of social integration, writings of suicidal poets contained more words pertaining to the individual self and fewer words pertaining to the collective than did those of nonsuicidal poets. In addition, the direction of effects for words pertaining to communication was consistent with the social integration model of suicide.The study found support for a model that suggests that suicidal individuals are detached from others and are preoccupied with self. Furthermore, the findings suggest that linguistic predictors of suicide can be discerned through text analysis.

  View details for Web of Science ID 000170119800001

  View details for PubMedID 11485104