This study documented the implementation process of the evidence-based interventions and practices and explored the role that implementation supports play in how the funded programs evolve. The evaluation focused on 1) Intervention Activities - Activities undertaken by personnel in grantee agencies to directly assist clients; 2) Local Implementation Activities - Activities grantee agencies undertake to install the evidence-based practices in their agencies); and 3) External Implementation Supports - Activities undertaken by third parties to aid grantees as they implement evidence-based practices in their organizations. The Assertive Adolescent and Family Treatment program provided support for the training and implementation of evidence-based approaches to assessment and treatment for adolescents, transition-age youth, and their families/mentors. Grantees served adolescents (ages 12-17) or transition age youth (ages 18-24) who had substance use disorders and may also have had co-occurring mental disorders.
Implementation supports generally play a positive role in the program. Grantees reported using the range of supports to a great extent and found most of them to be helpful. They praised many of the supports and recommendations for future improvements. Sites with stronger implementation may have better client outcomes, controlling for background factors (including, but not limited to, the prevalence of evidence based practices at agency, or the proportion of clinical staff with Master's level education or above than sites with weaker implementations. This relationship is largely driven by lower overall implementation scores and worse client outcomes at two of the fourteen sites. Most sites were on target with many of the indicators of fidelity to implementation (staff training and certification and treatment process).
Report Title: Program Evaluation for Assertive Adolescent and Family Treatment (AAFT)
Agency Sponsor: SAMHSA, Substance Abuse and Mental Health Services Administration
Federal Contact: Darren Fulmore, 240-276-2824
Performer: Advocates for Human Potential, Inc.
Record ID: 10014 (September 14, 2012)