Absence of conflict of interest.
Citation
Dauphinee, T., & Bishwakarma, R. (2018). SUN PATH comparison group study. Albuquerque, NM: University of New Mexico, Career to Cradle Policy Institute.
Highlights
- The study’s objective was to examine the impact of the Skill‐UP Network Pathways Acceleration in Technology and Healthcare (SUN PATH) program on education, earnings, and employment outcomes.
- The authors used a nonexperimental design to compare the outcomes of students who were in the SUN PATH program to a matched comparison group of students.
- The study found that SUN PATH students had higher rates of program completion, certificates/degree attainment, program retention, employment, and earnings than students in the comparison group.
- The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the SUN PATH program, but other factors might also have contributed.
Intervention Examined
The Skill‐UP Network Pathways Acceleration in Technology and Healthcare (SUN PATH) Program
Features of the Intervention
The U.S. Department of Labor's (DOL) Trade Adjustment Assistance Community College and Career Training (TAACCCT) program provided $1.9 billion in grants to community colleges to improve skills and support employment in high-demand industries, notably manufacturing, health care, information technology, energy, and transportation. Through four rounds of funding, DOL awarded 256 TAACCCT grants to approximately 800 educational institutions across the United States and its territories.
Launched in the fall of 2014 and funded through TAACCCT, the Skill‐UP Network Pathways Acceleration in Technology and Healthcare (SUN PATH) program created health career pathways at a consortium of 11 community college and college branch campuses in New Mexico. The consortium included Central New Mexico Community College, Eastern New Mexico University – Roswell and Ruidoso campuses, Mesalands Community College, New Mexico State University – Alamogordo, San Juan Community College, Santa Fe Community College, and the University of New Mexico – Gallup, Los Alamos, Taos, and Valencia campuses. The SUN PATH model was designed to accelerate and increase industry recognized credentials and degrees, and create a model for cross-system alignment between education, workforce, and employers. Specific activities included latticing and stacking credentials, improving instructional design, hiring instructors, enhancing technology-based and online learning offerings, coaching on industry recognized credentials, and using site coordinators and job development career coaches to integrate soft skills. Broad programs of study included Allied Health, Health Information Technology, and Emergency Medical Services. The SUN PATH program primarily served incumbent workers with smaller numbers of veterans, TAA-eligible workers, and low-skill workers.
Features of the Study
The nonexperimental study compared students who participated in the SUN PATH program to students who did not participate. Comparison students were drawn from eight colleges in New Mexico. The authors matched SUN PATH participants to similar nonparticipants using propensity scores developed from demographic, academic, and earnings information, and conducted a balance check on the matching quality. After matching, study participants included 1,821 students in the treatment group and 4,278 students in the comparison group. Using data from the New Mexico Higher Education Department and the New Mexico Department of Workforce Solutions (DWS), the authors conducted statistical analyses to examine differences in education, earnings, and employment outcomes between the groups.
Study Sites
- Clovis Community College in Clovis, New Mexico
- Luna Community College in San Miguel County, New Mexico
- New Mexico Junior College in Hobbs, New Mexico
- New Mexico State University in Carlsbad, New Mexico
- New Mexico State University in Dona Ana, New Mexico
- New Mexico State University in Grants, New Mexico
- Northern New Mexico College in Española, New Mexico
- Western New Mexico University in Silver City, New Mexico
Findings
Education and skills gain
- The study found that SUN PATH students had significantly higher completion rates in their program of study than students in the comparison group (46% vs. 15%).
- Relative to the comparison group, the study found that SUN PATH students earned significantly more certificates in less than one year (28% vs. 15%), certificates between one and two years (8% vs. 5%), and associate degrees (10% vs. 8%).
- The study also found significant differences between the groups in retention rates (46% SUN PATH students versus 41% of comparison students) and credit hours earned (SUN PATH students earned 22 credit hours versus 18 credit hours for comparison students).
Earning and wages
- For incumbent workers, the study found that significantly higher numbers of SUN PATH students received wage increases compared to students in the comparison group (62% vs. 55%).
Employment
- For non-incumbent workers, the study found significant differences in employment rates between the groups. Higher proportions of SUN PATH students were employed in the 1st quarter after program completion (46% vs. 28%) and in the 2nd and 3rd quarter after program completion (50% vs. 23%) compared to students in the comparison group.
Considerations for Interpreting the Findings
Although the study was a well-implemented nonexperimental design, this study had several issues that should be considered when interpreting the findings. Both the comparison group and the treatment groups drew from over 100 programs of study and the distribution between the programs of study was not equivalent with the comparison group drawing more heavily from general liberal arts degrees and general studies whereas the treatment group included students in nursing and medical technology programs. Graduates of general programs may not have the same employment prospects and may not represent the same type of students as those in more specific programs of study. Additionally, the implementation of the program varied across the colleges and these differences in implementation could have impacted the observed outcomes.
Causal Evidence Rating
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the SUN PATH program, but other factors might also have contributed.
Additional Sources
Davis, M.R., Hume, M., Carr, S.L., Dauphinee, T.L., & Heredia-Griego, M. (2018). New Mexico Junior College Trade Adjustment Assistance Community College Career Training Program (TAACCCT) FY17 final evaluation report. Albuquerque, NM: University of New Mexico, Center for Education Policy Research.