163x Filetype PDF File size 0.52 MB Source: academic.oup.com
MILITARYMEDICINE,181,8:747, 2016 Dialectical Behavior Therapy Training and Desired Resources for Implementation: Results From a National Program Evaluation in the Veterans Health Administration Sara J. Landes, PhD*; Monica M. Matthieu, PhD, LCSW†‡; Brandy N. Smith, BA*; Lindsay R. Trent, PhD*; Allison L. Rodriguez, BA*; Janet Kemp, PhD, RN§; Caitlin Thompson, PhD∥ ABSTRACT Context: Little is known about nonresearch training experiences of providers who implement evidence- Downloaded from https://academic.oup.com/milmed/article/181/8/747/4158352 by guest on 26 September 2022 based psychotherapies for suicidal behaviors among veterans. Evidence Acquisition: This national program evaluation identified the history of training, training needs, and desired resources of clinicians who work with at-risk veterans in a national health care system. This sequential mixed methods national program evaluation used a post-only survey design to obtain needs assessment data from clinical sites (N = 59) within Veterans Health Administration (VHA) facili- ties that implemented dialectical behavior therapy (DBT). Data were also collected on resources preferred to support ongoing use of DBT. Results: While only 33% of clinical sites within VHA facilities reported that staff attended a for- mal DBT intensive training workshop, nearly 97% of participating sites reported having staff who completed self-study using DBT manuals. Mobile apps for therapists and clients and templates for documentation in the electronic health records to support measurement-based care were desired clinical resources. Conclusion: Results indicate that less- intensive training models can aid staff in implementing DBT in real-world health care settings. While more training is requested, a number of VHA facilities have successfully implemented DBT into the continuum of care for veterans at risk for suicide. INTRODUCTION There are a number of clinical and public health strategies 4 Suicide is a national public health concern representing the to address conditions associated with suicide. Of these, means 10th leading cause of death, occurring at an age-adjusted rate safety, promoting help seeking, access to care among those in of 12.57 per 100,000 individuals in the U.S. general popula- distress (e.g., hotlines), depression screening, and care man- tion in 2013.1 Veterans are estimated to comprise 20% of the agement are effective. Among clinical interventions, cogni- overall suicide rate in the United States, and the prevalence tive therapy, dialectical behavior therapy (DBT),5 medication rate of suicide is estimated to be higher among veterans than management, continuity of aftercare, and follow-up contact in the general population.2 A recent Department of Veterans (i.e., caring letters, safety planning) have some data to sup- Affairs (VA) Suicide Data Report3 indicates that although port reduction in suicide attempts and suicide. there have been no clear changes in the number of veterans To coalesce current national efforts in suicide preven- with suicidal behavior, there has been an increase in the tion specific to veteran and military populations, joint VA/ number of younger male VA health care users with suicidal Department of Defense (DoD) Clinical Practice Guidelines behavior. Given this, national efforts to prevent suicide among (CPG) for the Assessment and Management of Patients at the general public and veterans seeking VA health care are of Risk for Suicide were released in June 2013. Given the state paramount concern. of science reviewed at the time, the CPG provides no recom- mendations with the Strength of Recommendation of strong [A]orrecommendable[B],leaving the majority of prac- tices lacking sufficient evidence among veteran and military *National Center for PTSD, VA Palo Alto Health Care System, 795 populations. One treatment, DBT, is recommended; however, Willow Road, Menlo Park, CA 94025. with “insufficient” evidence for treating an underlying disor- †Central Arkansas Health Care System, Mental Health Quality Enrich- der (i.e., borderline personality disorder [BPD] or other per- ment Research Initiative (QUERI), 2200 Fort Roots Drive, Building 58, North Little Rock, AR 72114. sonality disorders characterized by emotional dysregulation ‡Saint Louis University, College for Public Health and Social Justice, and a history of suicide attempts and/or self-harm) in patients School of Social Work, Tegeler Hall, Suite 300, 3550 Lindell Boulevard, whohave suicidal behavior.6 Saint Louis, MO 63103. According to other reviews of the evidence, DBT is §VISN 2 Center of Excellence for Suicide Prevention, Canandaigua considered as an evidence-based psychotherapy (EBP) for VA Medical Center, 400 Fort Hill Avenue, Building 37, Canandaigua, NY14424. emotional dysregulation and suicidal behavior. The Substance ∥Office for Suicide Prevention, Mental Health Service, Department Abuse and Mental Health Services Administration’sNational of Veterans Affairs, 1575 I Street Northwest, Washington, DC 20420. Registry of Evidence-based Programs and Practices indepen- The results described are based on data analyzed by the authors and dently rated DBT as a well-researched treatment effective at does not represent the views of the Department of Veterans Affairs, the reducing suicide attempts, nonsuicidal self-injury, drug use, Veterans Health Administration, or the U.S. Government. doi: 10.7205/MILMED-D-15-00267 symptoms of eating disorders, and improving psychosocial MILITARY MEDICINE, Vol. 181, August 2016 747 Dialectical Behavior Therapy Training and Desired Resources for Implementation adjustment and treatment retention among civilians.7 DBT understand the current uptake and spread of DBT in VA has been examined in 11 randomized controlled trials and, health care settings and identify the history of training and in addition to the above, has been shown to be effective at training needs for implementing DBT, a national program reducing depression, hopelessness, anger, and impulsiveness evaluation of VHA facilities that have implemented DBT (see summary in Landes and Linehan).8 was initiated in 2013 in collaboration with VA’sOffice of DBT has been shown to be effective in the Veterans Suicide Prevention. This article presents results of this national Health Administration (VHA). Studies indicate that it was program evaluation. effective in reducing suicidal ideation, hopelessness, depres- 9 sion, and anger expression and helpful in reducing VA health METHODS care costs.10 VHA program evaluation has shown that DBT improves veterans’ clinical outcomes. Chiba and colleagues Study Design examined their DBT program and found a decrease in inpa- The overall study design was a sequential mixed methods Downloaded from https://academic.oup.com/milmed/article/181/8/747/4158352 by guest on 26 September 2022 tient admissions, inpatient days, and cost (presentation at national program evaluation study consisting of a quantita- the 2009 VA/DoD Evolving Paradigms II OEF/OIF National tive self-report survey and qualitative semi-structured inter- Conference). Nappi and colleagues piloted a DBT skills group views. The survey was administered first to sites within VHA 15 for depression and found improvement on depression, quality facilities (N =59).Thisquan! QUAL design was selected of life, and satisfaction (presentation at the 2012 Association so that quantitative results could directly inform design of the of Behavioral and Cognitive Therapies Conference). Even qualitative interview. The primary objective of the quantita- though DBT has evidence of effectiveness in VHA settings, tive data was to attain clinic-based needs assessment data and, it has historically received little attention in comparison to for the qualitative data, to attain in-depth information from other national EBP dissemination efforts, perhaps because of key stakeholders knowledgeable about implementing DBT limited information available on providers’ history of train- in VHA settings. ing, adoption, and current use of DBT within this national The data presented here are a subset of this larger study. health care system. This article focuses specifically on the training history and The “gold standard” of DBT training is the DBT Intensive resource preference data. The rationale for selecting this Training Course,8 provided in two 5-day trainings, separated subset of data is to inform national policy makers and VHA by 6 months of self-study. Studies on intensive training show clinical managers on the design and development of a national that in a county-wide implementation, intensive training was DBT training and implementation plan. Ethical approval for correlated with improvement in therapists’ attitudes toward this study was obtained from the appropriate VA institutional patients with BPD, greater confidence in DBT’s effective- review boards. 11 ness, and increased self-reported use. Research on a state- Ascertainment and Sample Characteristics wide implementation using intensive training revealed that clinicians acquired mastery over the DBT model and the- The ascertainment of the sample used a national program ory.12 Briefer training (i.e., 2-day workshop) has been found evaluation approach. Considering the need to obtain data to only increase provider attitudes toward and knowledge from all VHA sites identified with the use of DBT, the VA about clients with BPD and improve opinions regarding national health care system was our sampling area. We fur- treatment options for these clients.13 While intensive training ther limited our sampling frame to clinical sites that were is considered the gold standard to produce the expected identified on an internal VHA DBT resource Web site. The system-level outcomes of adoption of DBT in health care set- goal was to recruit at least 1 person per site to complete the tings for research purposes, community-based clinicians are survey on the site’s behalf or complete the survey as a team propelling the adoption and use of DBT in nonresearch health (either resulting in one submission per site). Characteristics care settings. of sites included VHA clinical sites implementing DBT. There There is emerging evidence about DBT training experi- were no exclusion criteria. ences among community providers (e.g., duration, intensity, and modality of training). One study examined therapists’ use Sampling Strategy 14 Sites were identified using a two-step, purposive, snowball of DBT, including the amount and type of training received. This study, involving therapists (N = 129) trained by a com- sampling process. First, the research team purposively iden- mercially available DBT training company, found that 64% tified providers who were their site’s point of contact on of therapists completed a 2-day workshop on skills training, the VHA DBT resource Web site. These individuals were 58%completed a 2-day workshop on individual therapy, and targeted for recruitment using their VA e-mail (N = 60). 39%hadparticipated in intensive training. For the second phase of sampling, the research team To our knowledge, no other studies have examined thera- focused on sites that had not yet been identified for the pist training in general health care or community settings, and VHA DBT resource Web site. Using snowball sampling even less is known about training and implementation of among their professional networks within VHA, the research DBT in the national veterans’ health care system. To better team requested the DBT points of contact for each site to 748 MILITARY MEDICINE, Vol. 181, August 2016 Dialectical Behavior Therapy Training and Desired Resources for Implementation share the invitation for study participation by forwarding the on the needs assessment data related to history of training recruitment e-mail with the survey link to others who might and training needs. Measures of central tendencies were cal- be implementing DBT in VHA. Given this professional net- culated to obtain rankings of resources. There were a total of work sampling strategy, data on the resulting nominated sites 67 survey responses. As data were collected about imple- were not collected. mentation of DBT in each site, when there were multiple respondents, data were combined, so each site had only one entry. The 67 responses included eight sites with more than Data Collection Procedures one respondent. The research team identified each survey by The research team used the Checklist for Reporting Results site based on facility information provided by respondents. of Internet E-Surveys16 to guide development and data col- Weekly meetings to review survey information guided team lection procedures in this Web-based survey. The survey decision making on the combination of data. When there Downloaded from https://academic.oup.com/milmed/article/181/8/747/4158352 by guest on 26 September 2022 was developed using a commercial Web-based platform were discrepancies between respondents at a site, a team of (i.e., Qualtrics, Provo, Utah). Survey usability and tech- two raters determined the most appropriate answer based nical functionality was pretested before fielding; testers on a number of rules. Rules included averaging data when reported no problems, and no changes were made. The appropriate; defaulting to a “yes” answer for yes/no items; survey was voluntary and not password protected or incen- and, when only one respondent completed an item, using tivized. Therefore, access was open, and responses were col- that respondent’s data. After the data were cleaned and com- lected from each unique visitor to the site. No demographic bined so that each site had one entry, there were a total of data were collected about individuals completing the survey 59 sites. Missing data exist for some variables and were on behalf of each site. noted accordingly. RESULTS Measures Surveys were collected between July 2013 and May 2014. History of DBT Training Among VHA Clinical There were two main parts. Part 1 had 6 sections that offered Providers a skip pattern if the respondent did not endorse at least one Each site was asked to identify from a list which training component of DBT (e.g., DBT skill groups). This skip pattern activities any DBT provider in their setting had received. was used to isolate clinical sites that offered any DBT compo- Fifty-seven sites completed these questions. Training activi- nent, as the remaining questions were tailored to inquire about ties were grouped as high (e.g., intensive training), medium each component offered. (e.g., 1- to 2-day workshop), and low intensity (e.g., reading The first section of part 1 allowed sites to describe their DBT books). The average number of high-intensity training clinic setting (e.g., type of treatment setting, number of DBT activities ranged from 0 to 5 (mean [M] = 1.68, SD = 1.34). staff). The next section addressed the context for delivering The average number of medium-intensity training activities DBT, such as the components of DBT and clients’ presenting ranged from 0 to 5 (M = 1.89, SD = 1.26). The average problems. The remainder gathered more details about each number of low-intensity training activities ranged from 0 to endorsed primary component of DBT (e.g., frequency, length, 3 (M = 2.60, SD = 0.73). Most sites reported engaging in and duration). low-intensity training activities. See Table I for a list of all Part 2 consisted of 4 sections. Section 1 focused on use training activities. of DBT strategies (e.g., diary cards) while section 2 focused on the types and amount of DBT training providers in their Training Needs and Desired Resources setting had received, resources used to implement DBT, and For the needs assessment, the survey assessed use of online- desired resources to support ongoing use of DBT. Two final or technology-related DBT resources and resources desired. sections related to barriers, using the DBT barriers to imple- Of the 54 sites responding, the majority indicated use of the mentation survey (unpublished instrument; Behavioral Tech, VHADBTresource Web site (n = 35; 65%). Other technol- Seattle, Washington) (α = 0.94), and facilitators to imple- ogy used included online DBT training (n = 14, 26%), DBT menting DBT (α = 0.82), were administered. The survey con- mobile phone app (n = 9, 17%), and “other” (n = 8, 15%). cluded with a section related to benefits of implementing DBT Other responses included DBT videos (n = 2, 4%), the inter- (α = 0.70). Nearly all survey items used multiple choice, Likert national DBT listserv (n = 3, 5%), creating a mindfulness scaling, or check all that apply as response options; text boxes DVD(n=1,2%),andaWebsite(dbtselfhelp.org; n =1,2%). were included for some response options for more description. To identify desired resources, sites rank ordered a list of 10 possible resources. The top-rated resource was formal DBT training, followed by funds for training (see Table II). Data Analysis Responses entered for other resources (n = 17) were catego- Data were analyzed using SPSS 21.0 for Windows (Armonk, rized; themes included (a) materials/supplies/tools (n =6), New York). Analysis included frequencies and descriptives (b) staffing/funding (n = 4), (c) education/training (n =3), MILITARY MEDICINE, Vol. 181, August 2016 749 Dialectical Behavior Therapy Training and Desired Resources for Implementation TABLEI Training Activities Endorsed by VHA Clinical Sites (N = 57) Type of Training n %Endorsed Low-Intensity Training 5 Read the DBT Skills Manual—Linehan’s Skills Training Manual for Borderline Personality Disorder 55 97 5 Read the DBT Book—Linehan’s Cognitive Behavioral Treatment of Borderline Personality Disorder 50 88 Read Other DBT Books (e.g., Koerner’s Doing Dialectical Behavior Therapy) 43 75 Medium-Intensity Training One- or 2-Day DBT Workshop 42 74 Seminar or Lectures on DBT in Graduate Training Programs (e.g., Time-limited Brief Seminars or a Lecture-type Presentation) 29 51 Participated in a DBT Study Group 43 30 Online DBT Training Course 13 23 Less than 1 Full Day Attending a DBT Workshop 712 Downloaded from https://academic.oup.com/milmed/article/181/8/747/4158352 by guest on 26 September 2022 High-Intensity Training DBTSupervision by Clinical Expert 29 51 Practicum or Internship Experience in Using DBT 26 46 Two5-Day DBT Intensive Training with 6 Months of Self-study (with a Team) 19 33 Formal Training Program (e.g., DBT Training Program in Internship Settings) 18 32 Graduate-Level Course as Part of Professional Training Program 4 7 Sites were asked to endorse a training activity if any provider in their setting had completed the training activity. Columns do not add up to 100. TABLEII Ranking of Desired Resources for Providing DBT by VHA Clinical Sites (N = 57) Resource Mean Ranking Modal Ranking Range of Ranking Intensive DBT Training Offered within VHA (e.g., Two 5-Day Trainings Separated 2.24 1 1–8 by 6 Months of Self-study) Funds for DBT Training (e.g., 2-Day DBT Workshops) 3.06 2 1–9 Videos on Using DBT with Veterans (e.g., DBT Groups, Individual Sessions) 3.83 3 1–8 DBTMonthly Consultation Calls for Clinicians in VHA 5.10 4 1–10 Mentoring Program for Clinicians Using DBT in VHA 5.86 5 1–11 DBTListserv for Clinicians in VHA 6.0 5 2–12 Software to Support Measurement-based Care and Outcomes Integration into the 6.84 7, 8 1–10 Electronic Health Record (e.g., Mental Health Test Assistant) Mobile Apps for Clients 7.87 9 1–11 Templates in the Electronic Health Record (e.g., Computerized Patient Record System) 7.18 10 1–11 Mobile Apps for Therapists 9.0 10 4–12 Sites completing the survey were asked to rank order a list of 10 desired resources and were given two fill-in-the-blank spaces to enter additional desired resources. Mean ranking indicates the mean ranking for each resource. The modal ranking indicates the modal ranking for each resource out of 12. The range indicates the range of all rankings for each resource. Information about text entered in the fill-in-the-blank resources is found in the text. (d) consultation/supervision (n = 2), (e) release time (n = 1), study may indicate otherwise. In this study, low-intensity and (f) VHA policy change (n = 1). training of self-study with DBT books may be at an accept- able level of learning for clinicians “initiating” DBT in VHA DISCUSSION settings. Nonetheless, results of the training needs assessment The aims of this article were to identify the history of train- reveal that sites would like additional DBT training, specifi- ing and training needs for sites implementing DBT in VHA. cally training at higher intensity levels (e.g., intensive train- While DBT intensive training is considered the gold stan- ing) offered within VHA or in the community. This finding is dard of training, only one-third of sites reported having any consistent with a previous national survey of clinicians in staff with a history of this high-intensity training. In terms of VHA, which indicated a desire for training in DBT, among 17 workshop attendance, the most frequently endorsed workshop other therapies. Given what is known about training in EBPs training was 1- or 2-day workshops, with about three-fourths in general, additional training such as intensive training and of sites reported having any staff attend this medium-intensity consultation is likely needed for clinicians to become adher- training. The most frequently endorsed type of low-intensity ent to DBT (as opposed to initiating a DBT program). training was reading of DBT books. With regard to resources, the most frequently endorsed While empirical DBT training literature suggests that technology resource was VHA’s internal DBT resource Web reading manuals and attending brief workshops may not be site developed to create a virtual community of practice. This 13 Web site brings together clinicians and sites engaged in DBT sufficient for changing provider behavior, results from this 750 MILITARY MEDICINE, Vol. 181, August 2016
no reviews yet
Please Login to review.