Title,Citation,Topic_area,Study_type,Study_evidence_rating,Outcome_effectiveness,Findings,Intervention_program,Topics,Target_population,Firm_characteristics,Geographic_setting,Original_publication_date,Original_publication_link "A comparison of student outcomes and overall retention between a 10-week accelerated and a 15-week traditional curriculum in a postsecondary apprenticeship training program","Adams, G. (2013). A comparison of student outcomes and overall retention between a 10-week accelerated and a 15-week traditional curriculum in a postsecondary apprenticeship training program (Doctoral dissertation). Available from ProQuest Dissertations & Theses A&I. (Accession No. 3575536).","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Training-Low-Favorable impacts Training","Summary: The study’s objective was to examine the impact of compressed delivery of a World Class Shipbuilding apprenticeship program on program retention. The Apprentice School of Newport News Shipbuilding compressed its delivery of program instructional hours from 75 weeks (five 15-week terms) to 40 weeks (four 10-week terms) in January 2009. The author compared administrative data on program completion for all apprentices who enrolled at the school from January 2004 to December 2008 (the comparison group) with those who enrolled from January 2009 to June 2012 (the treatment group). The study found that students who enrolled in the 40-week program were 17 percentage points more likely to be retained in the program than students who enrolled in the 75-week program, a statistically significant finding. The quality of causal evidence presented in this report is low because the treatment and comparison groups were not equivalent before the intervention, and the author did not adjust for these differences during analysis. This means we are not confident that the estimated effects are attributable to the compression of the apprenticeship program; other factors are likely to have contributed.","the Apprentice School of Newport News Shipbuilding","Registered apprenticeship Work based and other occupational training",Adult,Manufacturing,"United States",2013, "National evaluation of Youth Corps: Findings at follow-Up","Price, C., Williams, J., Simpson, L., Jastrzab, J., & Markovitz, C. (2011). National evaluation of Youth Corps: Findings at follow-up. Cambridge, MA: Abt Associates, Inc.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment Training-Mod/high-No impacts Training","Summary: The study’s objective was to examine the impact of Youth Corps, a diverse set of programs that offer educational services, employment and training, and community service activities to young adults. The programs’ effectiveness was evaluated using a randomized controlled trial conducted at 21 Youth Corps program sites. The study found a statistically significant positive impact on participants’ annual income 18 months after random assignment. There was no evidence of statistically significant impacts on employment, education, or training 30 months after random assignment, which was the primary follow-up period examined in the study. The quality of causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to Youth Corps, although other factors could also have contributed.","Youth Corps Programs","Job search assistance and supportive services Other training and education Youth programs",Youth,,"United States",2011,http://www.nationalservice.gov/pdf/nat_eval_youthcorps_impactreport.pdf "Staying on course: Three-year results of the National Guard Youth ChalleNGe Evaluation.","Millenky, M., Bloom, D., Muller-Ravett, S., & Broadus, J. (2011). Staying on course: Three-year results of the National Guard Youth ChalleNGe Evaluation. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Training-Mod/high-Favorable impacts Training","Summary: This report presents results from a three-year follow-up study of the National Guard Youth ChalleNGe program, a disciplinary and educational intervention for unemployed youth ages 16 to 18 who are not in school. Earlier reports examined outcomes at 9 and 21 months. The program’s effectiveness was evaluated using a randomized controlled trial conducted in 10 states. This report examined the effects of the program on participants’ educational attainment, earnings, employment, and other outcomes measured through a survey conducted about three years after participants entered the study. The study found statistically significant, positive impacts of the ChalleNGe program on employment, earnings, education, and training outcomes measured after three years. The quality of causal evidence presented in this study is high because it is a well-conducted randomized controlled trial. This means we have confidence that the effects estimated in this study are attributable to the National Guard Youth ChalleNGe program.","the National Guard Youth ChalleNGe Program","Basic skills Community college education and other classroom training Mentoring Other training and education Youth programs",Youth,,"United States",2011,http://www.mdrc.org/sites/default/files/full_510.pdf "Longer-term impacts of mentoring, educational services, and learning incentives: Evidence from a randomized trial in the United States","Rodríguez-Planas, N. (2012). Longer-term impacts of mentoring, educational services, and learning incentives: Evidence from a randomized trial in the United States. American Economic Journal: Applied Economics, 4(4):121–139.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains Training-Mod/high-No impacts Training","Summary: The report’s objective was to evaluate the long-term impacts of the Quantum Opportunity Program (QOP)—which included case management and mentoring, education, developmental activities, community service, supportive services, and financial incentives—on high school completion and postsecondary education. About 1,100 9th-grade students from 11 high schools were randomly assigned to the treatment group, which could enroll in QOP, or the control group, which could not participate in QOP activities. The study team administered a survey to treatment and control group members at three follow-up periods to collect information on postsecondary educational attainment and labor market outcomes. The report found few statistically significant impacts on the educational and employment-related outcomes examined. The quality of the causal evidence presented in this report for the analysis of the third follow-up period is high because it is based on a well-conducted randomized controlled trial. This means we are confident that any impacts observed would be attributable to the QOP, not to other factors. However, the quality of causal evidence for the analyses of the other two follow-up periods is low.","Quantum Opportunities Program (QOP)","Mentoring Other training and education Youth programs",Youth,,"United States",2010, "Making the transition: Interim results of the National Guard Youth ChalleNGe program evaluation","Millenky, M., Bloom, D., & Dillon, C. (2010). Making the transition: Interim results of the National Guard Youth ChalleNGe program evaluation. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Training-Mod/high-Favorable impacts Training","Summary: This report presents results from a 21-month follow-up study of the National Guard Youth ChalleNGe program, a disciplinary and educational intervention for unemployed youth ages 16 to 18 who are not in school. Related reports examine outcomes at 9 months and 3 years post-intervention. The program’s effectiveness was evaluated using a randomized controlled trial conducted in 10 states. This report examined the effects of the program on participants’ educational attainment, earnings, employment, and other outcomes measured through a survey conducted about 21 months after participants entered the study. The study found statistically significant, positive impacts of the ChalleNGe program on earnings, education, and training outcomes measured after 21 months. The quality of causal evidence presented in this study is high because it is a well-implemented randomized controlled trial. This means we are confident that the effects estimated in this study are attributable to the National Guard Youth ChalleNGe program, and not to other factors.","the National Guard Youth ChalleNGe Program","Basic skills Community college education and other classroom training Mentoring Other training and education Youth programs",Youth,,"United States",2010,http://www.mdrc.org/sites/default/files/full_434.pdf "Reengaging high school dropouts: Early results of the National Guard Youth ChalleNGe program evaluation.","Bloom, D., Gardenhire-Crooks, A., & Mandsager, C. (2009). Reengaging high school dropouts: Early results of the National Guard Youth ChalleNGe program evaluation. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Training-Mod/high-Favorable impacts Training","Summary: This report presents results from a 9-month follow-up study of the National Guard Youth ChalleNGe program, a disciplinary and educational intervention for unemployed youth ages 16 to 18 who are not in school. Related reports examine outcomes at 21 months and 3 years post-intervention. The program’s effectiveness was evaluated using a randomized controlled trial conducted in 10 states. This report examined the effects of the program on participants’ educational attainment, earnings, employment, and other outcomes measured through a survey conducted about 9 months after participants entered the study. The study found statistically significant, positive impacts of the ChalleNGe program on employment, education, and training outcomes measured after 9 months. The quality of causal evidence presented in this study is high because it is a well-implemented randomized controlled trial. This means we are confident that the effects estimated in this study are attributable to the National Guard Youth ChalleNGe program, and not to other factors.","the National Guard Youth ChalleNGe Program","Basic skills Community college education and other classroom training Mentoring Other training and education Youth programs",Youth,,"United States",2009,http://www.mdrc.org/publication/reengaging-high-school-dropouts/file-full "Managing customers’ training choices: Findings from the Individual Training Account experiment","McConnell, S., Stuart, E., Fortson, K., Decker, P., Perez-Johnson, I., Harris, B., & Salzman, J. (2006). Managing customers’ training choices: Findings from the Individual Training Account experiment. Final report, Series: ETAOP 2007-01. Washington, DC: Employment and Training Administration, U.S. Department of Labor.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Training-Mod/high-Favorable impacts Training","Summary: The study’s objective was to compare the impacts of individual training account (ITA) approaches on customers’ training completion, employment, earnings, and benefits receipt outcomes after 15 months. The authors randomly assigned about 8,000 adults and dislocated workers from eight workforce investment agencies across the United States to three ITA approaches: structured customer choice, maximum customer choice, or guided customer choice. The authors analyzed data from Unemployment Insurance (UI) records and from a survey conducted on a random subsample of study participants. The study found the customers in the structured customer choice approach received significantly higher amounts of public assistance benefits than did customers in the guided customer choice group. The study also found that the structured customer choice group had higher earnings and lower education and training compared with the maximum customer choice group, whereas the maximum customer choice group had lower earnings and higher public assistance benefits compared with the guided customer choice group. The quality of causal evidence provided in this study is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to differences in the ITA approaches, and not to other factors.","the Individual Training Accounts (ITA) Approaches","Other employment and reemployment Other training and education","Dislocated or displaced worker, Low income",,"United States",2006,http://scholar.google.com/scholar_url?url=http%3A//cire.mathematica-mpr.com/~/m… "Registered apprenticeship training in the U.S. construction industry","Glover, R. W., & Bilginsoy, C. (2005). Registered apprenticeship training in the U.S. construction industry. Education + Training, 47(4-5), 337-349.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Training-Low-No impacts Training","Summary: The study’s objective was to examine the impact of participation in building trades apprenticeship programs sponsored jointly by employers and unions on apprentices’ program completion rates. The authors compared the program completion rates of apprentices who participated in registered apprenticeship programs sponsored jointly by employers and labor unions with those who participated in programs sponsored unilaterally by employers. Data on apprentices’ characteristics, program participation, and completion came from the U.S. Department of Labor’s Registered Apprentices Information System and California State Apprenticeship Council databases. The authors’ analysis included apprentices in 31 states from 1996 to 2003. The study found that the completion rate for joint apprenticeships was higher than for nonjoint apprenticeships, but did not conduct any statistical tests of differences in completion rates. The quality of causal evidence presented in this report is low because the authors did not account for relevant pre-intervention characteristics in their analysis. This means we are not confident that the estimated effects are attributable to joint apprenticeship programs; other factors are likely to have contributed.",,"Registered apprenticeship Work based and other occupational training",Adult,Construction,"United States",2005, "The challenge of repeating success in a changing world: Final report on the Center for Employment Training replication sites","Miller, C., Bos, J., Porter, K., Tseng, F., & Abe, Y. (2005). The challenge of repeating success in a changing world: Final report on the Center for Employment Training replication sites. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Mixed impacts Education and skills gains Employment-Mod/high-Mixed impacts Employment Training-Mod/high-Favorable impacts Training","Summary: This report’s objective was to examine the effectiveness of the Center for Employment Training (CET) model. Under this model, local employers help design training programs and provide them in a work-like environment to economically disadvantaged youth who are not in school or employed. A separate report examined CET implementation. The effectiveness of the CET model in improving employment, earnings, and participation in education and training programs was evaluated using a randomized controlled trial (RCT) conducted in 12 sites in seven states. The study found few statistically significant impacts on outcomes measured over a 54-month follow-up period. The quality of the causal evidence presented in this study is moderate. This means we have confidence that the effects estimated in this study are attributable at least in part to the CET program. However, other factors not accounted for in the study might also have contributed to the estimated effect.","the Center for Employment Training (CET) Replication","Basic skills Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2005,http://www.mdrc.org/sites/default/files/full_530.pdf "National Job Corps Study: Findings using administrative earnings records data","Schochet, P., McConnell, S., & Burghardt, J. (2003). National Job Corps Study: Findings using administrative earnings records data. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Training-Mod/high-No impacts Training","Summary: The study’s objective was to estimate the impact on long-term earnings and employment of the Job Corps program, which offers intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. The program’s effectiveness was evaluated using a randomized controlled trial conducted in 48 states and the District of Columbia. The study found statistically significant, positive impacts of Job Corps on participants’ earnings within the first three years and employment within the first four years of follow-up, but no impacts of Job Corps on these outcomes in the fifth and sixth years. The quality of the causal evidence presented in this study is high. This means we are confident that the Job Corps program—not other factors—caused the estimated impacts. ","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2003,http://www.mathematica-mpr.com/publications/pdfs/jobcorpsadmin.pdf "National Job Corps Study: The impacts of Job Corps on participants’ employment and related outcomes","Schochet, P., Burghardt, J., & Glazerman, S. (2001). National Job Corps Study: The impacts of Job Corps on participants’ employment and related outcomes. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Training-Mod/high-Favorable impacts Training","Summary: The National Job Corps Study included several reports, including this final impact report. The report’s objective was to examine the impact of the Job Corps program on participants’ long-term earnings, employment, and other outcomes. It also described the participants’ Job Corps experiences. Job Corps offers intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. Its effectiveness was evaluated using a randomized controlled trial conducted in 48 states and the District of Columbia. This report found statistically significant, positive impacts of Job Corps on participants’ employment, earnings, and education and training outcomes measured after four years. The quality of the causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the Job Corps program—not other factors—caused the estimated impacts.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2001,http://wdr.doleta.gov/research/FullText_Documents/01-jcimpacts.pdf