Using Evidence-Based Constructs to Assess Extent of Implementation of Evidence-Based Interventions. What would an implementation monitoring plan look like?


 Creating an implementation monitoring plan could involve tracking specific activities anticipated during each stage of implementation. To illustrate, table 2 presents sample implementation monitoring activities during a trial that implemented multidimensional treatment foster care (MTFC) at 3 sites in 51 counties (Chamberlain, Brown, & Saldana, 2011). Researchers involved in this work also conceptualized three phases of the change process similar to the three phases listed on page 3 of this brief. They collected information about a number of implementation activities associated with each phase, the amount of time associated with completing each implementation stage, and the percentage of activities completed. Table 2 provides readers with activities that could be included in an implementation monitoring plan for an evidence-based intervention in a human services setting.2

Phase Fidelity of Implementation Levels of Use (Action Taking) Stages of Concerns (Feelings/Perceptions) Sample Implementation Activities Completed
Creating Original/traditional practices
0. Nonuse: Doing nothing to learn about it.
Orientation: Exploring what it is.
Preparation: Deciding to use it.
Unconcerned: About what might be coming.
Informational: What is it?
Personal: What will it mean for me?
Date site is informed service/program is available.
Date of interest indicated.
Date agreed to consider implementation.
Date to first contact for preimplementation planning.
Date of first in-person meeting/feasibility call.
Date Feasibility Questionnaire is completed.
Date of cost/funding plan review.
Date of staff sequence, timeline, hiring plan review.
Date of foster parent recruitment review.
Date written implementation plan is complete.
Date service provider is selected.
Implementing Partial/limited configurations moving toward configurations that include more/all of the intervention Mechanical Use: Disjointed and inefficient, short-term focus. Task/management: It takes a lot of time.
Date agency checklist is completed.
Date first staff is hired.
Date Program Supervisor is trained.
Date clinical training is held.
Date foster parent training is held. Date data tracking system training is held.
Date of first program administrator call.
Date of first placement.
Date of first consult call.
Date first clinical meeting video is reviewed.
Sustaining Full configuration—full fidelity Advanced/higher fidelity configurations
IVA. Routine use: Stabilized and ongoing.
IVB. Refinement: Making adaptations to increase outcomes.
V. Integration: Teaming to use the intervention.
Renewal: Looking for the next thing.
Impact: These practices are successful with clients.
Impact: By working with my colleagues, we are having even greater success.
Impact: I wonder whether another way is needed now.
Date of first site visit.
Date of implementation review.
Date of first program assessment.
Date of certification application.
Date certified.

2 We acknowledge that the dynamic nature of change is not reflected in this table (e.g., there is not necessarily a linear relationship among phases, fidelity, and levels) and that all people in an organization or community might not be at the same level or stage.

View full report


"ib_Milestones.pdf" (pdf, 421.66Kb)

Note: Documents in PDF format require the Adobe Acrobat Reader®. If you experience problems with PDF documents, please download the latest version of the Reader®