Medicaid Utilization:
A Comparison between Pre- and Post-Employment

Appendix 2

Introduction

With the onset of Welfare Reform, numerous research questions have arisen. One overall prevailing question that continues to haunt Welfare Reform is whether members of a household (particularly children) have been hurt in the implementation of Welfare Reform and the onset of employment. There are indeed many questions on what happens inside the household now that a parent or head of the household must work. While this paper does not offer conclusive answers to these and other questions, it does however offer a brief examination into a household's utilization of Medicaid medical services before and after employment. While utilization of Medicaid medical services does not ensure good health and the lack of utilization does not necessarily indicate "poor" health, changes in the utilization patterns could serve as a warning signal to policy makers - giving administrators the opportunity to investigate. This paper examines the research question "Has Medicaid utilization changed for any member of a TANF household where at least 1 adult member has become employed?" While the findings of this paper do not answer that question conclusively, it does provide some preliminary information using several key administrative files.

Background

The SC Department of Social Services (SCDSS), with the assistance of the Budget and Control Board's Office of Research (ORS), has developed a statistical data warehouse. In this statistical data warehouse, information from several key administrative files are stripped off (either on a monthly or a quarterly basis) and are linked together to answer key research questions. This statistical data warehouse has in part become available through the result of the CHILD LINK federal grant that supported the development of Child Well-Being indicators. Key administrative files have included information from SCDSS's automated CHIPS systems (TANF and Food Stamps only populations); Child Welfare systems like Title XX, Foster Care Tracking, and Child Protective Services; Employment Security System's (ESC) WAGE match which provides quarterly wages on employed SCDSS clients; and the Department of Health and Human Services Medicaid Payment (and Eligibility) systems. For this study, information on the TANF population off of the SCDSS CHIPS system, from ESC's Wage Match, and from the Medicaid Eligibility and Payment systems was utilized.

Study Population

Because the intent of this study was to examine Medicaid Utilization before and after employment, selection of the study population was critical. The initial population of SCDSS AFDC/TANF clients was selected based upon a number of criteria.

  1. First, all cases must have been coded as an AFDC/TANF case, though not every client associated with a particular case had to be coded as an AFDC/TANF participant.
  2. Second, the case had to be closed for earned income (closure code of 'EI') within a time frame that allowed for adequate tracking using quarterly ESC Wage Match data. Given the availability of ESC data at the time of the study, these cases closed in June 1996, September 1996, or December 1996. No restriction on subsequent returns and closures was imposed.
  3. In order to provide adequate time frames to detect differences in utilization and to control for seasonality, the study population required l-year of pre-employment activity (and 1-year of post employment activity - see next step). Therefore third, each of these cases must have been an active AFDC/TANF case for at least one year prior to the closure date.
  4. The resulting population from step 3 was then matched to the quarterly ESC Wage Match information. In order to be retained, the case must have had at lease one adult earning wages in the first and last quarters of the post closure year. Continuous employment however was not a requirement.
  5. After controlling for one-year pre-employment and one-year post employment and the other above criteria, the resulting population was 1,635 clients. These clients then underwent cleaning to insure that any possible changes in name, etc. were captured for linking purposes. Date constants were also added to mark the beginning of the "pre-" period, the closure date, and the ending of the "post-" period.
  6. The 1,635 starting population was next linked to the Medicaid Eligibility files. The matching criteria used varying combinations of a number of key identifiers: SSN, full name, and date of birth. Numerous quality control checks were performed to ensure that clients were matched correctly. 1,557 of the 1,635 SCDSS clients identified linked to the Medicaid Eligibility files resulting in a 95.2% match rate.
  7. Because varying Medicaid Eligibility coverage can affect results, the Medicaid Eligibility coverage was next examined for any biases. This study used a working definition of Medicaid Eligibility coverage of 700 or more days of Medicaid eligibility (2 years less 1 month). One thousand and thirty one clients (1,031) met that definition.
  8. One result of using Medicaid coverage definition of 700+ days is that it eliminated most of the newborns. While there, is a great deal of interest, of course, about newborns, it was felt that within the confines of this study that an adequate comparison could not be done and that it would bias the study. All pregnancy related and post-partum claims were also excluded. Again, the purpose was to eliminate any bias introduced by a roughly nine (9) month gestation period within the context of a two-year study. For example, impact of conception in the post-period would fall outside the study's time frame, while pregnancies from the pre-period might result in deliveries in the post period. Differences in the lengths of individual pregnancies confounded our inability to determine dates of conceptions necessary to account for these claims. Therefore all claims of these types were excluded to eliminate their confounding effects. In addition, mothers who are pregnant and newborns require higher numbers of doctor's visits and other types of claims.. Over a two year time period that could again bias the results by inflating the number of claims. Because of the natural "aging" process and the 2-year time period, pregnancy related and post partum claims may not be "evenly distributed" across the period. For example, mothers who had a baby in the first year (pre-employment) period were less likely to have a baby in the next period (or post-employment) period.
  9. Those clients who met the 700 or more day requirement were next linked to the Medicaid Services files. Claims essentially were divided into three types: HIC (physician, clinic, and laboratory claims), Outpatient (which includes both emergency and non-emergency room visits) and Inpatient hospitalization. For HIC claims, only-physician visits were included. Outpatient claims were further sub-categorized as emergency and non-emergency visits. In addition, outpatient and HIC claims were summed thereby providing an index for ambulatory care utilization.
  10. For each claim type and combination of claims, the number of paid claims for the pre-employment and post-employment periods were summed.

Design

  1. One way Analysis of Variance (ANOVA) with repeated-measures factor was the tool elected to use for the analysis. This tool allowed for the analysis of the number of Medicaid claims per individual filed one year prior to employment versus the number of claims filed one year after employment.
  2. In an attempt to control for natural changes in medical care utilization as individuals age, the analysis was stratified by age. The design is affected by natural changes in people that may occur over time. Because the same population is included in both periods of time - the population quite literally is aging. This aging could bias the results. For example, a child from two years old to three years old may go to the doctor more often for illnesses than that same child who ages from three years old to four years old. Elderly adults also have much higher rates of utilization. The data allowed for three general age classifications to maintain sufficient sample sizes to detect meaningful differences in Medicaid utilization. Each age group had approximately 30% of the population. These age groups were defined as 0-5 years, 6-17 years, and 18 years and over. The pre-employment. and post-employment time frames covered the same months for any given individual thereby controlling for seasonal variations in medical care utilization.
  3. In order to partially test for this aging bias, a similar analysis was repeated on the entire 0-5 year old Medicaid population.

Limitations

  1. Analysis of variance with repeated measures is subject to some statistical assumptions involving the sample distributions. Repeated measures ANOVA assumes normal distributions with homogeneous variance in the pre- and post- groups. Unlike two-way and r-way ANOVA and least squares regression, repeated measures ANOVA is not particularly robust when these assumptions are violated. Violations tend to result in inflated F-ratios and greater likelihood of falsely rejecting the null hypotheses. In the case of this study, plots did not uncover dramatic departures from normality and the distributions will converge towards normality as sample size increases (i.e. they are asymmetrically normal). Plots also indicate rough homogeneity of variance though formal tests were not performed given the weakness of the substantive findings.
  2. The primary limitation of this design is the lack of a control group. Since all subjects in the study had at least one person in the household who became employed, no comparison can be made that can evaluate whether any potential differences in Medicaid utilization are due to changes in employment of persons in the household. In addition, finally, there may be factors other than employment, which explain any potential differences observed in Medicaid utilization. Examples of potential confounding factors in this study could be age or obtaining private medical insurance with employment.

Conclusions

Our analysis finds virtually no support for employment effects on Medicaid utilization by former TANF recipients. The evidence is weak and inconsistent. The substantive differences among pre- and post - employment means is typically .2 claims per person and never exceeds .45 claims when all claim categories are combined. Not surprisedly, few of these differences are statistically significant at the .05 level. Furthermore these insignificant results occur using a technique where undiagnosed violations of underlying statistical assumptions make finding a significant relationship more, rather than less, likely.

More importantly only one specific finding, a decrease in outpatient claims among 18+ year olds is supportive of the employment hypothesis. The magnitude of this difference is not large enough to effect overall claims. Total claims, as well as HIC claims, are instead attributable to aging and differences in the health care needs of 0-5 year olds. It is clear from our analysis of the Medicaid population as a whole, that Medicaid utilization declines as children move from infancy into childhood. This pattern is also found in the SCDSS linked population. In this case, over-all differences in the number of claims are attributable to decrease among 0-5 year olds, particularly through reductions in the number of HIC claims by this group. Thus overall differences in pre- and post- employment Medicaid utilization are an artifact of aging by 0-5 year olds during the time frame of this study.

While the findings for employment effects on Medicaid Utilization are, at best, very weak, it should not be inferred that these relationships do not merit further investigation. This initial study should be supplanted and refined with additional data, and by alternative research designs. A longer time frame might reveal relationships missed by this study. Continued expansion of the Employment Security Commission data set should allow for 18 month pre- and post- periods by early 1999. The results presented here also suggest that a more detailed comparison of the pre- and post- employment SCDSS populations to the general Medicaid populations be in order if only to determine how the SCDSS population differs.

Likewise other analytic strategies should prove useful. For example, the current study focused on controlling for the individual's state of health pre- and post- by examining the same person at each point in time (i.e. matched pairs). This strength brought certain trade-offs such as the inability to control for continuous variables effectively, the inability to use multiple controls, and a lost of statistical robustness. Future studies might use more powerful multivariate techniques coupled with a proxy to control for the health status of the individual.

Table 1.
SCDSS-Medicaid Linked Population
Pre-Employment versus Post-Employment Medicaid Utilization
Claim Type N Mean Std Dev. ANOVA. Results P < 0.05?
HIC
 All ages:     Pre-employment
                   Post-employment
 0-5 years:   Pre-employment
                   Post-employment
 6-17 years: Pre-employment
                   Post-employment
 18 + years: Pre-employment
                   Post-employment

1031
1031
337
337
412
412
282
282

1.42
1.25
1.27
1.02
1.14
1.04
2.01
1.84

3.52
2.85
2.70
2.46
3.21
2.68
4.60
3.40

F value = 3.51, p=0.061

F value = 4.26, p=0.040

F value = 0.48, p=0.487

F value = 0.63, p=0.428

No

Yes

No

No
Outpatient - All
 All ages:     Pre-employment
                   Post-employment
 0-5 years:   Pre-employment
                   Post-employment
 6-17 years: Pre-employment
                   Post-employment
 18 + years: Pre-employment
                   Post-employment
Outpatient - Emergency Room
 All ages:     Pre-employment
                   Post-employment
 0-5 years:   Pre-employment
                   Post-employment
 6-17 years: Pre-employment
                   Post-employment
 18 + years: Pre-employment
                   Post-employment
Non-Emergency Room
 All ages:     Pre-employment
                   Post-employment
 0-5 years:   Pre-employment
                   Post-employment
 6-17 years: Pre-employment
                   Post-employment
 18 + years: Pre-employment
                   Post-employment

1031
1031
337
337
412
412
282
282

1031
1031
337
337
412
412
282
282

1031
1031
337
337
412
412
282
282

1.39
1.19
1.33
1.18
0.94
0.81
2.12
1.75

0.77
0.66
0.83
0.69
0.51
0.44
1.07
0.93

0.62
0.53
0.50
0.49
0.43
0.37
1.06
0.82

2.59
2.05
2.03
2.05
1.65
1.52
3.85
2.55

1.82
1.27
1.35
1.13
1.00
0.87
2.88
1.77

1.56
1.41
1.37
1.64
1.20
1.02
2.07
1.55

F value = 7.53, p=0.006

F value = 1.28, p=0.259

F value = 2.50, p=0.114

F value = 4.13, p=0.043


F value = 5.55, p=0.019

F value = 3.36, p=0.068

F value = 1.18, p=0.179

F value = 1.27, p=0.261


F value = 3.10, p=0.079

F value = 0.01, p=0.907

F value = 1.03, p=0.310

F value = 3.81, p=0.052

Yes

No

No

Yes


Yes

No

No

No


No

No

No

No
HIC + All Outpatient
 All ages:     Pre-employment
                   Post-employment
 0-5 years:   Pre-employment
                   Post-employment
 6-17 years: Pre-employment
                   Post-employment
 18 + years: Pre-employment
                   Post-employment

1031
1031
337
337
412
412
282
282

2.81
2.44
2.60
2.20
2.07
1.86
4.13
3.58

4.79
3.91
3.68
3.48
3.86
3.48
6.59
4.69

F value = 9.30, p=0.002

F value = 4.45, p=0.036

F value = 1.97, p=0.161

F value = 3.28, p=0.071

Yes

Yes

No

No

Table 2.
Medicaid - Eligible Children (Ages 0-5 Years)
Care Utilization
Claim Type N Mean Std Dev. ANOVA Results P < 0.05?
HIC
 0-5 years: 1/1/96-12/31/96
                 1/1/97-12/31/97

54644
54644

1.71
1.62

4.37
3.70

F value = 27.56, p=0.0001

Yes
Outpatient - All
 0-5 years: 1/1/96-12/31/96
                 1/1/97-12/31/97
Outpatient - Emergency Room
 0-5 years: 1/1/96-12/31/96
                 1/1/97-12/31/97
Outpatient-Non-Emergency Room
 0-5 years: 1/1/96-12/31/96
                 1/1/97-12/31/97

54644
54644

54644
54644

54644
54644

1.52
1.26

0.85
0.71

0.67
0.56

2.77
2.47

1.37
1.20

2.20
1.98

F value = 652.48, p=0.0001


F value = 602.82, p=0.0001


F value = 213.61, p=0.0001

Yes


Yes


Yes
HIC + All Outpatient
 0-5 years: 1/1/96-12/31/96
                 1/1/97-12/31/97

54644
54644

3.23
2.90

5.61
4.89

F value = 295.14, p=0.0001

Yes

Where to?

[ Back to Report ]

[ ASPE Home Page | HHS Home Page ]