Absence of conflict of interest. This study was conducted by staff from ICF, which administers CLEAR. Therefore, the review of this study was conducted by an independent consultant trained in applying the CLEAR causal evidence guidelines.
Citation
Hendricks, A., Mitran, A., & Ferroggiaro, E. (2018). University of the District of Columbia - Final annual evaluation report TAACCCT grant program, round 4 (Contract #: PO-GF-2015-C-0134-DJ). Fairfax, VA: ICF.
Highlights
- The study’s objective was to examine the impact of the University of the District of Columbia Community College (UDC-CC) grant-funded healthcare and hospitality programs on education, earnings, and employment outcomes. This summary focuses on the healthcare program.
- The authors used a randomized controlled trial to compare the education, employment, and earnings outcomes of participants enrolled in healthcare pathway courses and received the contextualized learning program, compared to participants enrolled in the same program, who received the traditional curriculum.
- The study found that program participation was significantly related to increased credential attainment.
- The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the UDC-CC grant-funded healthcare program; other factors are likely to have contributed.
Intervention Examined
The University of the District of Columbia Community College (UDC-CC) TAACCCT Healthcare program
Features of the Intervention
The U.S. Department of Labor's (DOL) Trade Adjustment Assistance Community College and Career Training (TAACCCT) program provided $1.9 billion in grants to community colleges to improve skills and support employment in high-demand industries, notably manufacturing, health care, information technology, energy, and transportation. Through four rounds of funding, DOL awarded 256 TAACCCT grants to approximately 800 educational institutions across the United States and its territories.
The University of the District of Columbia Community College (UDC-CC) developed a program using TAACCCT grant funds to implement training pathways within the framework of the healthcare and hospitality industries. The goal was to develop a program in these high-growth, high-demand industries that addressed the needs of District employers. UDC-CC had previously received a TAACCCT grant that provided improved training pathways, focusing on low-skilled adults, both incumbent and new workers. The currently funded program expanded on the hospitality and healthcare programs by promoting lifelong learning and attainment of stackable credentials to assist participants in pursuing promising career pathways. Enhancements included contextualized and work-based learning, accelerated classes, technology-enabled classes, improved computer labs, staff and instructor development initiatives, and an improved student intake process.
Features of the Study
The study took place on the campus of the UDC-CC in Washington, District of Columbia. The authors used a randomized controlled trial to compare the outcomes of the treatment group to the control group. Participants included students enrolled between Summer 2016 and Spring 2018 in one of the seven courses in the healthcare pathway (Electronic Health Records, First Aid & CPR, Introduction to Healthcare, Medical Billing & Coding, Medical Office Administrative Assistant, Medical Terminology & Anatomy, and Nursing Assistant). All participants had the same recruitment and intake process, including the Comprehensive Adult Participant Assessment Systems exam, document check, and discussions with career advisors. The treatment group consisted of 291 students that were enrolled in the healthcare pathway program courses and received contextualized learning. The control group consisted of 188 students who were enrolled in the same healthcare course but received the traditional curriculum. The study used UDC-CC administrative records, follow-up surveys, and unemployment insurance data to examine the impact of the grant-funded healthcare program on education, earnings, and employment outcomes.
Findings
Education and skills gains
- The study found a significant relationship between grant-funded healthcare program participation and credential attainment, with higher proportions of students in the treatment group earning a certificate in a healthcare program (66%) than students in the control group (55%).
Earnings and wages
- The study did not find a significant relationship between grant-funded healthcare program participation and quarterly wages.
Employment
- The study did not find any statistically significant relationships between grant-funded healthcare program participation and full- or part-time employment.
Considerations for Interpreting the Findings
The study was a randomized controlled trial with unknown attrition in each group. In cases of high or unknown attrition, a study can receive a moderate causal evidence rating if the analysis controls for possible differences in background characteristics of the treatment and control groups. However, the authors in this study did not control for any such differences between the groups due to the empirical approach used. These preexisting differences between the groups—and not the grant-funded healthcare program—could explain the observed differences in outcomes. Therefore, the study is not eligible for a moderate causal evidence rating. Finally, the authors recognize that some contamination occurred between the treatment and control groups, leading to some control participants receiving elements of the treatment curriculum and thus potentially affecting the observed differences between the groups.
Causal Evidence Rating
The quality of causal evidence presented in this study is low because it was based on a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the UDC-CC grant-funded healthcare program; other factors are likely to have contributed.