Performance Improvement 2003. Identifying a Uniform Data Set of Information/Data to Assess the Impacts of Activities Funded by the Office of Minority Health

This report examined obstacles to designing a uniform data set (UDS) to assess the impact of activities funded by the Office of Minority Health (OMH), which administers a broad array of grants and contracts aimed at eliminating disparities in health outcomes and access to services for minority groups. Taking into account the obstacles, as well as guidelines, legislation, performance measurement methodology, and databases, the evaluators described a recommended data system. The literature review attended to a variety of important contextual issues (e.g., recommendations regarding the evaluation of programs  like those administered by OMH). Site visits and focus groups with relevant players were carried out, and the UDS was then pilot-tested over a 3-month period with nine OMH grantees. In addition, a Technology Survey was conducted by telephone with 22 participants to assess the capacity and preference for gathering data for the UDS. Based on analyses summarized in the report, the evaluators recommended a web-based database and report generating system that would be user-friendly. In addition, it would allow the various projects around the country to enter their data into a national system, obtain needed technical support, and generate reports of data that were useful locally.

Due to the increased emphasis on data-based evaluation performance indicators, which are often difficult for community based organization (CBOs) to implement, a standard data set of performance measures was developed and proposed. The feasibility of implementation of the data set was evaluated through a pilot study.

The Office of Minority Health (OMH) funds a variety of grant and standard cooperative agreement programs, under its mandate to eliminate disparities in health for minorities. The program activities generally involve a mixture of health promotion, screening, access to services; treatment, training and education; materials development; case management; capacity-building; and development of community linkages. These programs are required to provide program evaluation data related to performance standards. At the same time, unique program contributions are often overlooked by standard reporting mechanism. The goals of the OMH UDS were to capture the unique program factors while incorporating the required uniform measures.

A Project Advisory Group (PAG) composed of representatives from Federal agencies and private organizations involved in similar efforts was organized. Current and past agency efforts to develop uniform data sets and performance measures, and major data set configurations and approaches that may be applicable to OMH were identified and reviewed. Focus groups, interviews, and site visits with current and past OMH grantees were conducted to identify specific needs with respect to a data set tailored to the unique characteristics of OMH grantees. A draft data set was developed, and a pilot test was conducted with nine grantees to assess efficacy and applicability of the data set for all OMH grantees.

The final UDS combined multiple data types, including numbers (e.g., counts of persons served or how many times a service was provided); specific results (e.g., of language interpretation) or pre- and post- tests for training sessions; and qualitative impacts using brief case studies. The results of the pilot test of the system indicated the system was easy to use and that data could be readily obtained. However, additional data collection was required at several sites in order to fully complete the forms. The major recommendation was to put the UDS on line.

Implementation of a reporting system such as the UDS would enable collection of standardized data across multiple types of organizations. An Internet-based system, potentially supported by a data coordinating center, would ensure the greatest access to the system.

AGENCY SPONSOR: Office of Public Health and Science, Office of Minority Health FEDERAL CONTACT: Violet Ryo-Hwa Woo, 301-443-9923

PIC ID: 7097

PERFORMER: Systems Development Group