Absence of conflict of interest. This study was conducted by staff from Mathematica Policy Research. The review of this study was conducted by ICF Incorporated.
Citation
Fortson, K., Rotz, D., Burkander, P., Mastri, A., Schochet, P., Rosenberg, L., McConnell, S., & D'Amico, R. (2017). Providing Public Workforce Services to Job Seekers: 30-Month Impact Findings on the WIA Adult and Dislocated Worker Programs (No. 42e8b3550e40408f854b966d0229c3b5). Washington, DC: Mathematica Policy Research. [Comparison between Core-and-Intensive Services versus Core Services]
Highlights
- The study’s objective was to examine the impact of the Adult and Dislocated Worker programs on training, employment, earnings, and service receipt after 30 months. This summary focuses on the comparison between the group who received core-and-intensive services versus the group who received core services.
- The study was a randomized controlled trial, where customers in each local area were randomly assigned to one of three groups: full-WIA, core-and-intensive, or core. The authors compared the outcomes between the groups from baseline to 30 months after study enrollment.
- The study found that compared to core customers, core-and-intensive customers were significantly more likely to receive a credential through a training program and have higher earnings.
- The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to the Adult and Dislocated Worker programs and not to other factors.
Intervention Examined
Adult and Dislocated Worker programs
Features of the Intervention
The Adult and Dislocated Worker Programs are two programs that provide employment and training services to assist individuals in finding employment. The programs provide three tiers of service based on individual need. Tier one is Core Services that are available to all customers and include information and online tools to help customers find jobs. Tier two is Intensive Services that includes staff assistance in job searching, career counseling, career assessment, short-term vocational training, and case management. Tier three is Training designed to help customers train for employment in fields that are in high-demand using individual training account funds. Although the programs provide comparable services, the eligibility requirements differ. Customers are eligible for the Adult program services if they are 18 years of age or older. Customers are eligible for Dislocated Worker program services if they are 1) terminated or laid off from a job, but show attachment to the workforce and are unlikely to return to that industry, 2) laid off due to a plant closure or downsizing, 3) self-employed and unemployment is due to economic conditions, or 4) displaced homemakers
Features of the Study
The study was a randomized controlled trial. The authors randomly selected 30 Local Workforce Investment Areas (local areas) from 487 across six regions in the US. The local areas varied in size, funding, number of customers served, and degree of urbanicity. Two local areas declined participation and were replaced with areas similar in key characteristics to those originally selected. Two other sites dropped out of the evaluation too late for replacement; however, the authors used sampling weights to adjust for differences in sampling probabilities.
Study participants included all individuals living in the 28 local areas who were eligible for intensive services. When local area funds were limited, recipients of public assistance and low-income customers were prioritized. Of the individuals eligible for program services, some were excluded from the study based on certain circumstances to avoid jeopardizing the study design, which included Trade Adjustment Assistance participants, veterans, and customers referred by employers. The study included 35,665 customers who consented to participate and were randomly assigned to one of the three study groups: (1) “full-WIA” where customers could receive the full set of WIA core, intensive, and training services; (2) “core-and-intensive” where customers could receive core and intensive services only; and (3) “core” where customers could only receive core services. “Core-and-intensive” and “core” customers could receive the full suite of services after 15 months.
Data sources included a study registration form, a survey conducted 15 months and 30 months after study enrollment, WIA Standardized Record Data, National Directory of New Hires data, and financial data from the local areas. The authors used weighted statistical models and t-tests to compare service receipt, employment, earnings, and training outcomes across the three groups.
Findings
Employment
- The study found no statistically significant differences between core-and-intensive customers and core customers in employment or hours worked 30 months after study enrollment.
Earnings
- The study found that 30 months after study enrollment, core-and-intensive customers had significantly higher earnings than core customers ($43,211 versus $36,079).
Education and training
- The study found that 30 months after study enrollment, core-and-intensive customers were significantly more likely than core customers to receive a credential through a training program (24% versus 15%). However, the likelihood to complete a training program was not significantly different.
Public benefit receipt
- The study found no statistically significant differences between core-and-intensive customers and core customers in household income, receipt of public assistance, or receipt of unemployment compensation 30 months after study enrollment.
Considerations for Interpreting the Findings
The study authors noted that the programs’ impacts may be understated since customers were allowed to access other community-based employment and training services during the study. Take up of other services in the community might have contributed to the null findings for some outcomes. The authors also noted that random assignment rates for core-and-intensive and core groups were lower than full-WIA since programs did not want to deny services to a large proportion of customers. As a result, the authors administered the 15-month follow-up survey to a random sample of the full-WIA group.
Causal Evidence Rating
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Adult and Dislocated Worker programs and not to other factors.
Additional Sources
Rotz, D., Burkander, P., Grider, M., Fortson, K., Molinari, L., Sanchez-Eppler, E., & Cattell, L. (2017). Providing Public Workforce Services to Job Seekers: 30-Month Impact Findings on the WIA Adult and Dislocated Worker Programs, Technical Supplement (No. db04b33db50a4d45824da5a65edb3f0f). Washington, DC: Mathematica Policy Research.