Evaluation of Family Preservation and Reunification Programs: Final Report - Volume Two. 9.2 Targeting


The findings of no effects of family preservation programs on placement rates and of problems in targeting these programs are not new, they have been observed in a number of rigorously designed experiments. (117) Partially as a result of these previous findings, efforts were made in this project to improve targeting. In New Jersey and Kentucky a screening instrument developed by the evaluators was employed to encourage referral of cases with a risk of imminent placement and to discourage referral of cases not at risk of placement. It is evident that this effort did not work; evidently, the screening instrument was a weak "intervention" in the problem of targeting.

Clearly, referring agents sent families to the programs that did not fit the criterion of imminent risk of placement. Our interviews with referring workers, discussed in earlier chapters, reveal some of the reasons. Workers acknowledged that they often did not refer cases that were at risk of placement, rather they used the programs for families that they thought could benefit from them. Evidently, they believed that in cases where placement was needed, family preservation services were not appropriate, contrary to the assumptions of the designers of these programs. But the programs were valued, and they were used to help families in the context of a generally service-poor child welfare system.

There are other possible explanations for the low placement rate in the control group. It is possible that in cases assigned to the control group, workers on those cases exerted efforts to prevent placement of the child. Placement prevention as a central value may pervade the system (perhaps more during the time we were collecting these data than now, it is possible that the Adoption and Safe Families Act has shifted emphasis away from this value). Of course, in this regard the philosophy of family preservation seems to have been widely adopted, even though rigorous evaluations have not shown placement prevention effects of its services.

But there are still other aspects of the targeting problem. Homebuilders has developed into a quite generalist program, used in a wide variety of cases. In Kentucky and New Jersey there is considerable heterogeneity in the cases referred to these services, in both characteristics and problems of families and in where the case is in the child welfare system. Families come from both the investigative and on-going phases of cases. (118) It seems likely that many of those referred from on-going caseloads are not referred because of likelihood of placement but because the case is not going well and everything else has been tried. (119) Families do not always appear to be in crisis, another important criterion for referral. Furthermore, a number of cases do not involve abuse or neglect, but rather are cases of child dependency or of parent-adolescent conflict. And the cases involve a wide range of ages of children at risk. It could be argued that this variation is detrimental to the development of programs. No one program can expect to be successful in all cases. Having such variation inevitably results in a lack of focus and prevents the development of specialized expertise in handling particular cases. The lack of focus and expertise is likely to affect the outcomes that can be expected. Furthermore, the variation in the character of cases must contribute to variations in outcomes.

A natural response to this state of affairs is that we must tighten up the targeting, demanding strict adherence to referral criteria. Our attempts to assist states to do this were clearly unsuccessful. We suggest that it will be extremely difficult to achieve the goal of better targeting. There are a number of reasons for this skepticism. Referring workers acknowledged that they often referred families that were not at risk of placement, at least not those at imminent risk of placement. We cannot fully explain why workers did not follow the rules for referrals, but we can propose some conjectures. Workers believe that they remove children from the home only when that is absolutely necessary, when no service can prevent placement. In this sense, one might conclude that family preservation values have come to pervade the system, there are few unnecessary placements, leaving few placements to be prevented with intensive services. (120) However, these services are valued by referring workers, they are responses to the needs of families (families other than those with children about to be placed), and services to meet those needs are scarce. Hence, family preservation programs are used for very real needs of families in the child welfare system.

Beyond this dynamic, there is the general tendency to expand the benefits of a good program. If a program is believed to be beneficial, it is often assumed that it will be useful for an ever-expanding range of cases. Evidently, this occurred in the states we studied. Expansion of the target group is aided by the fact that target group definitions usually have one or more vague terms that allow for the expression of discretion (e.g., most people's problems can be conceptualized as "crises").

Finally, our efforts to identify particular groups of families for which the programs are successful at preventing placement were mostly unfruitful. Hence we are unable to satisfy the demands of policy makers and practitioners for guidance on specific groups that might be targeted.

These circumstances, together with the fact that referrals to family preservation programs involve judgments that cannot be completely systematized or circumscribed, lead to our skepticism about the likelihood of improving targeting of these programs. Furthermore, it is possible that the programs are, by and large, being used in those circumstances for which they are best suited. (121)

View full report


"report2.pdf" (pdf, 978.24Kb)

Note: Documents in PDF format require the Adobe Acrobat Reader®. If you experience problems with PDF documents, please download the latest version of the Reader®