Evaluation Design Options for the Long-Term Care Registered Apprenticeship Program. 5.1. Outcome Variables

09/01/2011

Exhibit 2 is a list of potential outcome variables for workers and employers for an evaluation of LTC RAPs. Some of these outcomes, such as wages and turnover, can be obtained from employers or from administrative records without having to ask the apprentices and the comparison group. Other outcomes, such as intent to leave, job satisfaction, and relationship with supervisor can be obtained only by gathering directly through focus groups or surveys with the workers themselves. Finally, some outcomes, such as skill proficiency, would be exceptionally very hard to obtain because of the lack of agreed upon measures and the difficulty and expense of data collection. Data on skill proficiency would need to be obtained either through direct observation of individual workers, an opinion ranking by supervisors, or by the completion of some test, and could be challenged as biased or not measuring true skill levels.

EXHIBIT 2. Potential Outcome Variables for Workers and Employers
Workers
  • Earnings and fringe benefits
  • Job tenure, turnover, intent to leave job, intent to leave field
  • Job satisfaction
  • Satisfaction with employer
  • Relationship with supervisor, clients, and other staff
  • Advancement to more advanced jobs (e.g., are apprentices more likely to say that they will obtain additional training)
  • Participation in means-tested public programs (e.g., food stamps, Temporary Assistance for Needy Families [TANF], Medicaid)
  • Satisfaction with LTC RAP
  • Skill proficiency
Employers
  • Offering of higher wages and more fringe benefits
  • Employer evaluation of apprentice skill development
  • Employer satisfaction with LTC RAP
  • Job tenure, turnover
  • Wages and fringe benefits provided
  • Provision of career ladder
  • Quality of care/Quality of Life
  • Net costs

Given their policy importance, quality of care outcomes at the level of the firm deserve special mention. Quality of care data in a standardized format is readily available for nursing homes and home health agencies, but not for other long-term care providers (Wiener, Freiman, and Brown, 2007 ). The Centers for Medicare and Medicaid Services (CMS) routinely posts detailed quality of care information for these two providers on their Nursing Home Compare and Home Health Compare web sites. Most of these measures are derived from resident and patient level data that is routinely and periodically collected on functional status and medical condition. In addition, for nursing homes, CMS regularly calculates summary measures, the Five Star Rating System, that includes information from the resident and patient assessments, staffing levels, and the health inspections. Data are not available on services for people with intellectual disabilities or for residential care facilities, such as assisted living facilities. Developing quality measures for these providers would be a major task and beyond the scope of a LTC RAP evaluation. In addition, even with the largest occupation, CNAs, there are currently only 56 employer sponsors, a sample size too small to detect differences in quality of care across nursing homes. Moreover, LTC RAPs are likely to have significant facility/agency-wide impacts only where apprentices account for a significant proportion of workers; it is probably unrealistic to expect a few apprentices in an organization to affect the overall quality of care.

View full report

Preview
Download

"LTCRAPedo.pdf" (pdf, 870.86Kb)

Note: Documents in PDF format require the Adobe Acrobat Reader®. If you experience problems with PDF documents, please download the latest version of the Reader®