The collection of data on service delivery and usage is also fairly common for PAS programs; these data have been used in several PAS evaluations and are also critically important to planning PAS programs and funding. The programs summarized in Exhibit 2-5 demonstrate three approaches to compiling data on services delivered.
|Program||Measures||Data Collection Method|
|Adoption Crossroads, Massachusetts||
||Web-based case management system|
|Adoption/Guardianship Preservation Program, Illinois||
|Statewide PAS Program, Texas||
||Service authorization forms|
Data on services delivered may serve as mediating variables in outcome evaluations, establishing the effect of specific types of services or a threshold service level necessary for effect. If used as part of an outcome evaluation, services must be documented as they are delivered rather than summarized at case closing. PAS program records are also unlikely to capture services that a family may have received from private providers or other sources not affiliated with the PAS program, which may influence outcomes (National Adoption Information Clearinghouse, 2002).
These examples demonstrate the range of data collected and data collection strategies for this form of evaluation. The client database used in the Massachusetts Adoption Crossroads program evaluation provided service data on a range of factors related to the delivery and receipt of services. The database is a web-based case management system that can be accessed by any of the program's regional providers and can produce either case-level or aggregate data in a variety of formats. In Illinois, evaluators of the Adoption/Guardianship Preservation Program drew on a range of data from case summary forms completed by workers at the close of services (with family consent). In Texas, regional PAS providers used service plans to record information at intake and case closing. Because the Texas PAS program is based on cost-reimbursement from the state, providers also fill out a service authorization form prior to service provision. Although this level of detail on services provided could be extremely useful for evaluation purposes, the data collected in these forms are currently not aggregated or analyzed at the regional or state level.