There is no conflict of interest.
Citation
Roder, A., & Elliott, M. (2021). Eleven Year Gains: Project QUEST’s Investment Continues to Pay Dividends. New York: Economic Mobility Corporation.
Highlights
- The study examined the impact of Project QUEST on employment, earnings, education, and public benefits receipt outcomes.
- The study was a randomized controlled trial that assigned participants to the Project QUEST treatment or the control group. Using administrative data and statistical models, the authors compared differences in outcomes over eleven years between treatment and control group members.
- The study found statistically significant relationships between participation in Project Quest and increased employment, earnings, and postsecondary credentials, and decreased unemployment benefits.
- This study receives a high evidence rating. This means we are confident that the estimated effects are attributable to Project QUEST, and not to other factors.
Intervention Examined
Project QUEST
Features of the Intervention
In 1992, Communities Organized for Public Service and Metro Alliance created Project QUEST to help residents of San Antonio, Texas gain the skills needed for jobs in local industries. The program provides financial, academic, and personal support to assist low-income adults in obtaining postsecondary educational qualifications and securing well-paying jobs. Project QUEST offers: 1) financial assistance for tuition, fees, books, transportation, uniforms, licensing exams, and tutoring; 2) remedial instruction in math and reading; 3) counseling for personal and academic concerns; 4) referrals for assistance with utility bills, childcare, and other services as needed; 5) weekly life skills meetings; and 6) job placement assistance, including help with résumé writing, interview preparation, and employer referrals. During the study period, the program served adults training for healthcare careers who were not enrolled in college classes at the main community partners: San Antonio College and St. Philip’s College.
Features of the Study
The study was a randomized controlled trial conducted in San Antonio. Individuals who enrolled in the program between April 2006 and October 2008 were screened for eligibility and then randomly assigned within blocks based on their intended program of study (e.g., licensed vocational nurse, medical records coding). Of the 410 eligible individuals, 207 were randomly assigned to the treatment group and 203 to the control group. Career counselors worked with individuals in the treatment group, inviting them to participate in Project QUEST services. Members of the control group did not receive further support from Project QUEST but could independently enroll in college or training programs or seek other services. Most study participants were women (88.3%), identified as Latino (74.1%), were between the ages of 25 and 64 (69.3%), had a high school diploma (70.2%), and had children under age 18 at the time of study enrollment (71.2%). Almost 45% had previously attended college but did not earn a degree. Meanwhile, 84% had jobs in the year before the random assignment, with average annual earnings of about $13,000 (in 2019 dollars).
The study used administrative data on earnings and unemployment benefits from the Texas Workforce Commission and data on postsecondary enrollment and completion for the eleven years post-enrollment from the National Student Clearinghouse. Additionally, the study used data from a baseline survey conducted at study enrollment to examine the background characteristics of treatment and control group members. The authors used statistical models to compare differences in outcomes between treatment and control group members while controlling for their background characteristics and intended healthcare program track.
Findings
Employment
- The study found that the percentage of individuals employed in the treatment group was significantly higher than the control group for years 10 and 11 after enrollment.
- The study also found that the treatment group had a significantly higher percentage of individuals employed in the healthcare industry than the control group eleven years after enrollment.
- When explored by age category, the study found a statistically significant relationship between participation in Project QUEST and increased employment for individuals aged 35 to 64 during years 9 through 11.
Earnings and wages
- The study found that during the first two years after enrollment, the control group had higher average annual earnings than the treatment group. However, from years 4 through 6 and 9 to 10, the treatment group earned significantly more.
- The study also found that, over eleven years, the treatment group earned significantly more on average than the control group, especially for women and individuals aged 35 to 64 at the time of program enrollment.
Education and skills gain
- The study found that the treatment group earned significantly more credentials, certificates, and diplomas when compared to the control group across the eleven years.
- The study also found that the treatment group earned significantly more NSC-covered credentials than the control group, including healthcare credentials, healthcare certificates or diplomas, and healthcare college degrees across the eleven years.
Public benefits receipt
- The study found that the percentage of the treatment group who received unemployment benefits was significantly lower than the control group for year 3.
Considerations for Interpreting the Findings
The authors estimated many related impacts on employment, earnings, education, and public benefits receipt outcomes. Performing multiple statistical tests on related outcomes makes it more likely that some impacts will be found statistically significant purely by chance and not because they reflect program effectiveness. The authors did not perform statistical adjustments to account for the multiple tests, so the number of statistically significant findings in these domains is likely to be overstated.
Causal Evidence Rating
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Project QUEST, and not to other factors.