Title,Citation,Topic_area,Study_type,Study_evidence_rating,Outcome_effectiveness,Findings,Intervention_program,Topics,Target_population,Firm_characteristics,Geographic_setting,Original_publication_date,Original_publication_link,"Review Protocol" "Encouraging evidence on a sector-focused advancement strategy","Hendra, R., Greenberg, D. H., Hamilton, G., Oppenheim, A. Pennington, A. Schaberg, K., and Tessler, B. L. (2016). Encouraging evidence on a sector-focused advancement strategy. New York: MDRC. [Towards Employment]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the WorkAdvance sectoral training program at the Towards Employment site on employment, earnings, education, and training from 2011 to 2015. The authors investigated similar research questions with three other sites, the profiles of which are available here. The study used a randomized controlled trial design to compare the treatment group, which was able to access the WorkAdvance program at the Towards Employment site, and the control group, which was not eligible for WorkAdvance services but could access other services in the community. The authors collected data from two sources: a follow-up survey and unemployment insurance (UI) wage and employment data. Using survey data, the authors found that those in the treatment group were significantly more likely to complete education or training compared with those in the control group. The authors found no statistically significant impacts of the program on employment or earnings from either the UI data or survey data. The quality of the causal evidence is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the WorkAdvance program at the Towards Employment site and not to other factors.","the WorkAdvance sectoral training program","Work based and other occupational training","Low income",,"Urban, United States",2020,https://files.eric.ed.gov/fulltext/ED568395.pdf,"Employment and Training Review Protocol" "WIOA impacts on community college student success (Doctoral dissertation).","Crumpton, J. A. (2019). WIOA impacts on community college student success (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 13861007).","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a workforce development program administered by a community college under the Workforce Innovation and Opportunity Act (WIOA) on education outcomes. This summary focuses on the comparison between WIOA program participants and non-participants. The author used a nonexperimental design to compare WIOA program student education outcomes (measured by degree or certificate attainment) to the outcomes of students with similar backgrounds (Pell Grant recipients) who were not enrolled in WIOA. Data from the community college were used to examine education success rates over the course of three years (2014-2017). The study found that WIOA program participants were significantly more likely to attain a degree or certificate than students who were not enrolled in the WIOA program. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the WIOA Program; other factors are likely to have contributed","Workforce Innovation and Opportunity Act (WIOA) program","Basic skills Capacity building programs Community college education and other classroom training Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Adult, Low income",,"Rural, United States",2019,https://search.proquest.com/openview/f270d29734cd670349c3aed2866ce41a/1?pq-orig…,"Community College Review Protocol" "Supervisor support training effects on veteran health and work outcomes in the civilian workplace","Hammer, L. B., Wan, W. H., Brockwood, K. J., Bodner, T., & Mohr, C. D. (2019). Supervisor support training effects on veteran health and work outcomes in the civilian workplace. Journal of Applied Psychology, 104(1), 52–69.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence",,"Summary: The study’s objective was to examine the impact of Veteran-Supportive Supervisor Training (VSST) on perceived health, functional impairment, job performance, and turnover intentions of employed veterans.  The primary design of the study was a cluster randomized controlled trial. The authors collected survey data before and at three and nine months after random assignment. Using a statistical model, the study authors compared the outcomes of individuals in the control group organizations to the individuals in the treatment group organizations.  The study did not find any statistically significant impacts on perceived health, functional impairment, job performance, or turnover intentions.   The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to VSST and not to other factors. However, the study did not find statistically significant effects. ","Veteran-Supportive Supervisor Training","Other training and education","Veteran or military",,,2019,https://pubmed.ncbi.nlm.nih.gov/30265016/,"Employment and Training Review Protocol" "Tightened immigration policies and the self-employment dynamics of Mexican immigrants","Wang, C. (2019). Tightened immigration policies and the self-employment dynamics of Mexican immigrants. Journal of Policy Analysis & Management, 38(4), 944–977. doi:10.1002/pam.22160",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of immigration policies after September 11, 2001, on self-employment among Mexican immigrants.  The study used a difference-in-differences model using Current Population Survey (CPS) data from 1996 to 2006.   The study found Mexican immigrants were substantially more likely to enter self-employment after 9/11, but there was no statistically significant difference in overall rates of self-employment.   The quality of causal evidence presented in this report is low because the events of 9/11 present a confounding factor. This means we are not confident that the estimated effects are attributable to immigration policies after 9/11; other factors are likely to have contributed.  ","Post-9/11 Immigration Policies","Foreign and temporary workers","Adult, Male, Migrant worker",,,2019,https://onlinelibrary.wiley.com/doi/full/10.1002/pam.22160,"Review Protocol" "Effects of a two-generation human capital program on low-income parents' education, employment, and psychological wellbeing.","Chase-Lansdale, P. L., Sabol, T. J., Eckrich Sommer, T., Chor, E., Cooperman, A. W., Brooks-Gunn, J., Yoshikawa, H., King, C., & Morris, A. (2019). Effects of a two-generation human capital program on low-income parents’ education, employment, and psychological wellbeing. Journal of Family Psychology, 33(4), 433-443.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of CareerAdvance on education, employment, and earnings outcomes. The study used a nonexperimental design to compare the outcomes of parents who participated in CareerAdvance to outcomes of parents who did not participate. The study found that parents in the treatment group had significantly higher rates of certification, more years of education, and higher rates of enrollment in education and training programs than parents in the comparison group. The treatment group also had significantly higher rates of employment in the healthcare sector, higher rates of part-time employment, and worked more irregular hours than the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the CareerAdvance program, but other factors might also have contributed.","CareerAdvance Program","Capacity building programs Community college education and other classroom training","Adult, Parent, Low income",,"United States",2019,https://www.semanticscholar.org/paper/Effects-of-a-two-generation-human-capital…,"Community College Review Protocol" "Information technology career preparation for rural areas.","Hahs-Vaughn, D. L., Swan, B., & Clark, M. H. (2019). Information technology career preparation for rural areas. Community College Journal of Research and Practice, 1-13.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Florida Information Technology Careers for Rural Areas (XCEL-IT) program on education, employment, and earnings outcomes. The authors used a nonexperimental design to compare the differences in outcomes between XCEL-IT program participants and a comparison group. The study found that XCEL-IT program participation was significantly related to program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the XCEL-IT program; other factors are likely to have contributed.","the Florida Information Technology Careers for Rural Areas (XCEL-IT)","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Unemployed, Veteran or military",,"Rural, United States",2019,,"Community College Review Protocol" "WIOA impacts on community college student success (Doctoral dissertation).","Crumpton, J. A. (2019). WIOA impacts on community college student success (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 13861007).","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a workforce development program administered by a community college under the Workforce Innovation and Opportunity Act (WIOA) on education outcomes. This summary focuses on the comparison between the community college WIOA program participants and the state workforce WIOA program participants. The author used a nonexperimental design to compare WIOA program student education outcomes (measured by degree or certificate attainment) to the outcomes of participants in WIOA programs administered by entities other than community colleges (throughout the state). Data from the community college and the State Board for Workforce Development were used to examine education success rates over the course of three years (2014-2017). The study found that WIOA program participants were significantly more likely to attain a degree or certificate than participants who entered the WIOA program through a state workforce development board. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the WIOA program; other factors are likely to have contributed","Workforce Innovation and Opportunity Act (WIOA) program","Basic skills Capacity building programs Community college education and other classroom training Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Adult, Low income",,"Rural, United States",2019,https://search.proquest.com/openview/f270d29734cd670349c3aed2866ce41a/1?pq-orig…,"Community College Review Protocol" "Recruiting and retaining dental labor in federal facilities: Harder than pulling teeth?","Richards, M. R., & Wing, C. (2019). Recruiting and retaining dental labor in federal facilities: Harder than pulling teeth? Health Economics, 28(11), 1356–1369. https://doi.org/10.1002/hec.3949",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of the Health Care Personnel Enhancement Act’s (HCPEA) authorization of flexible, and potentially more generous, pay packages for U.S. Veterans Administration (VA) dentists on job separation, hiring rates, and part-time employment.  The authors compared changes in the outcomes of VA dentists to those of federal occupations that were not affected by HCPEA. The authors used administrative data on federal employees from 2002 to 2012 from the Office of Personnel Management’s Central Personnel Data File. In addition to analyzing the full sample, the authors examined findings for early- and later-career employees.   The authors found that, among the full sample, the announcement of HCPEA was associated with a higher job separation rate, while the enactment of HCPEA was associated with a lower new-hire rate and lower likelihood of transitions from full-time to part-time employment.  The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the HCPEA; other factors are likely to have contributed.  ","Health Care Personnel Enhancement Act","Other wages and benefits","Veteran or military",,,2019,https://onlinelibrary.wiley.com/doi/full/10.1002/hec.3949,"Review Protocol" "Tanzania Youth Study of the Productive Social Safety Net (PSSN) impact evaluation: Endline report.","The Tanzania Cash Plus Evaluation Team (2018). Tanzania Youth Study of the Productive Social Safety Net (PSSN) impact evaluation: Endline report. Retrieved from: https://www.unicef-irc.org/publications/942-.html","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Mixed impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Productive Social Safety Net (PSSN) program on child labor and school participation outcomes. This summary focuses on the comparison of the PSSN group (both treatment groups) versus the control group. The study was a randomized controlled trial where villages were randomly assigned to one of three study arms: conditional cash transfer (CCT) only, CCT with a supplemental public works program (PWP), and the control condition. The authors used difference-in-differences models to compare the changes in outcomes between the groups. The study found that the probability of participation in paid work outside the household significantly decreased for children in PSSN households compared to children in control households. However, the probability of participation in livestock herding significantly increased for children in PSSN households compared to children in control households. Also, the probability of attending school significantly increased for children in PSSN households compared to children in control households. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable to the Productive Social Safety Net program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2018,https://www.unicef-irc.org/publications/942-.html,"Child Labor Review Protocol" "Southern Regional Technical College TAACCCT: Healthcare Career Works! (HCW) program third-party evaluation final report","WorkED Consulting. (2018). Southern Regional Technical College TAACCCT: Healthcare Career Works! (HCW) program third-party evaluation final report. Burke, VA: WorkED Consulting.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Healthcare Career Works! (HCW) program on education outcomes. The authors used a nonexperimental design to compare differences in education outcomes between HCW participants and a matched comparison group. The study found no statistically significant relationships between the HCW program and program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the HCW program; other factors are likely to have contributed.","Healthcare Career Works! (HCW)","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed, Veteran or military",,"United States",2018,,"Community College Review Protocol" "Health Profession Opportunity Grants (HPOG 1.0) impact study interim report: Program implementation and short-term impacts. (Report No. 2018-16a)","Peck, L. R., Werner, A., Harvill, E., Litwok, D., Moulton, S., Fountain, A. R., & Locke, G. (2018). Health Profession Opportunity Grants (HPOG 1.0) impact study interim report: Program implementation and short-term impacts. (Report No. 2018-16a). Washington, DC: Office of Planning. Research, and Evaluation, Administration for Children and Families, US Department of Health and Human Services.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Health Profession Opportunity Grant (HPOG) program on educational progress, earnings, and employment. The authors used a randomized controlled trial to analyze the effects of the program between a treatment group, an enhanced treatment group, and a control group. The study found that HPOG participants had significantly higher rates of educational progress, significantly higher earnings in the fifth quarter, and a significantly higher likelihood to be employed in healthcare than the control group. The quality of causal evidence presented in the study is high for the employment and earnings outcomes because they are based on a well-implemented randomized controlled trial with low attrition. However, the quality of causal evidence is moderate for the educational progress and employment in healthcare outcomes because sample attrition for these outcomes was high, but the authors controlled for key differences between the treatment and control groups at baseline. This means we are somewhat confident that estimated effects on these outcomes would be attributable to HPOG, but other factors might have also contributed.","the Health Profession Opportunity Grant (HPOG)","Capacity building programs Community college education and other classroom training","Adult, Low income",,"United States",2018,https://www.acf.hhs.gov/sites/default/files/opre/hpog_interim_appendices_final_…,"Community College Review Protocol" "Evaluation of Richland College's Veterans-Focused Engineering Technology Project: Final Report","Haviland, S., Van Noy, M., Kuang, L., Vinton, J., & Pardalis, N. (2018). Evaluation of Richland College's Veterans-Focused Engineering Technology Project: Final Report. New Brunswick, NJ: Rutgers University Education and Employment Research Center.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Richland College’s Veterans-Focused Engineering Technology Project on education outcomes. The authors used a nonexperimental design to compare education outcomes of program participants to a matched comparison group one and two years after enrollment. The study found that program participation was significantly associated with fewer credit hours earned one year after enrollment. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the Veterans-Focused Engineering Technology Project; other factors are likely to have contributed program.","the Veterans-Focused Engineering Technology Project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Veteran or military",,"United States",2018,https://smlr.rutgers.edu/sites/default/files/evaluation_of_richland_colleges_ve…,"Community College Review Protocol" "Trade Adjustment Assistance Community College Career Training Grant (TAACCCT): Final evaluation report","The Greater Cincinnati Supply Chain Career Development Center (SCCDC). (2018). Trade Adjustment Assistance Community College Career Training Grant (TAACCCT): Final evaluation report. Cincinnati, OH: Author.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of The Greater Cincinnati Supply Chain Career and Development Center’s (SCCDC) Supply Chain Management and Materials Handling & Logistics programs on education outcomes. The study used a nonexperimental design to compare the program completion of students enrolled in SCCDC programs to students in a matched comparison group. The study found that participation in the Supply Chain Management program, one of the SCCDC programs, was associated with a significant increase in the likelihood of program completion. The quality of causal evidence presented in this report is low because the authors used a comparison group from different academic programs presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the SCCDC programs; other factors are likely to have contributed.","the SCCDC’s Supply Chain Management and Materials Handling & Logistics Technologies Programs","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2018,https://www.skillscommons.org/handle/taaccct/17943,"Community College Review Protocol" "Third-party evaluation of MoSTEMWINs: Implementation, outcomes, and impact","Cosgrove, J., & Cosgrove, M. (2018). Third-party evaluation of MoSTEMWINs: Implementation, outcomes, and impact. St. Louis, MO: Cosgrove & Associates, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Missouri STEM Workforce Innovation Networks (MoSTEMWINs) program on education and employment outcomes. The authors used a nonexperimental design to compare education and employment outcomes of MoSTEMWINs participants to a historical comparison group. The study found that MoSTEMWINs participants were significantly more likely to complete the program and attain employment than the comparison group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the MoSTEMWINs program; other factors are likely to have contributed.",MoSTEMWINs,"Basic skills Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Unemployed, Veteran or military",,"United States",2018,http://www.skillscommons.org/bitstream/handle/taaccct/10845/MoSTEMWINs%20Mid-Po…,"Community College Review Protocol" "Tanzania Youth Study of the Productive Social Safety Net (PSSN) impact evaluation: Endline report","The Tanzania Cash Plus Evaluation Team (2018). Tanzania Youth Study of the Productive Social Safety Net (PSSN) impact evaluation: Endline report. Retrieved from: https://www.unicef-irc.org/publications/942-.html","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Mixed impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Productive Social Safety Net (PSSN) program on child labor and school participation outcomes. This summary focuses on the comparison of the conditional cash transfers with Public Works Program component treatment group versus the control group. The study was a randomized controlled trial where villages were randomly assigned to one of three study arms: conditional cash transfer (CCT) only, CCT with a supplemental public works program (PWP), and the control condition. The authors used difference-in-differences models to compare the changes in outcomes between the groups. The study found that the probability of participation in paid work outside the household significantly decreased for children in PWP households compared to children in control group households. However, the probability of participation in livestock herding significantly increased for children in PSSN households compared to children in control households. Also, the likelihood of dropping out of school significantly decreased for children in PSSN households compared to children in control households. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable to the Productive Social Safety Net program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2018,https://www.unicef-irc.org/publications/942-.html,"Child Labor Review Protocol" "Integrating economic strengthening and family coaching to reduce work-related health hazards among children of poor households: Burkina Faso","Karimli, L., Rost, L., & Ismayilova, L. (2018). Integrating economic strengthening and family coaching to reduce work-related health hazards among children of poor households: Burkina Faso. Journal of Adolescent Health, 62, S6-S14.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Health and safety-Low-No impacts Health and safety","Summary: The study’s objective was to examine the impact of the Trickle Up and Trickle Up Plus programs on children’s exposure to work-related hazards and abuse, and children’s work-related health outcomes. This summary focuses on the comparison between the Trickle Up intervention group and the control group. The study was a randomized controlled trial in the Nord Region of Burkina Faso, West Africa. Using three waves of survey data administered to children and adults separately, the authors conducted statistical models to compare the outcomes of treatment and control group members. The study found that Trickle Up program participation was significantly related to a reduction of hazardous work and abuse, compared with the control group. However, the study found no statistically significant relationship between the Trickle Up program and work-related health outcomes. The quality of causal evidence presented in this report is low because it was a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Trickle Up program; other factors are likely to have contributed.","Trickle Up Program","Child labor Health","Female, Other, Low income",,International,2018,https://www.researchgate.net/publication/322086777_Integrating_Economic_Strengt…,"Child Labor Review Protocol" "Heroes for Hire (H4H) program evaluation final report","Horwood, T., Campbell, J., McKinney, M., & Bishop, M. (2018). Heroes for Hire (H4H) program evaluation final report. Fairfax, VA: ICF.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Heroes for Hire (H4H) program on education and earnings outcomes. The authors used a nonexperimental design to compare the education outcomes of H4H program participants to a matched comparison group of students enrolled at the same college, at the same point of entry. and in similar programs of study. The authors also compared the earnings outcomes of students before and after participating in the H4H program. The study found that H4H participants were significantly more likely to complete the program and attain credit hours than the comparison group. In addition, participation in the H4H program was significantly associated with higher post-enrollment salaries compared to initial enrollment salaries. The quality of causal evidence presented in this study is low for the education outcomes because the authors did not ensure that the groups being compared were similar before the intervention nor include sufficient control variables. The quality of causal evidence is also low for the earnings outcomes because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects are attributable to the H4H program; other factors are likely to have contributed.","the Heroes for Hire (H4H) Program","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2018,,"Community College Review Protocol" "Improving the labor market outcomes of U.S. veterans: The long-run effect of the Transition Assistance Program","Li, X. (2018). Improving the labor market outcomes of U.S. veterans: The long-run effect of the Transition Assistance Program. New York: Syracuse University.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact the Transitional Assistance Program (TAP) had on outcomes related to employment, earnings, and education. The study used statistical models to compare veterans who had been offered and received TAP to veterans who were not offered TAP. Data came from the veterans supplement of the Current Population Survey for survey years 1995 to 2010. The study found positive associations between participation in TAP and employment, earnings, and education. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to TAP; other factors are likely to have contributed to the findings.","the Transitional Assistance Program","Job search assistance and supportive services Veterans' reemployment Other training and education","Dislocated or displaced worker, Veteran or military",,"United States",2018,,"Employment and Training Review Protocol" "Tanzania Youth Study of the Productive Social Safety Net (PSSN) impact evaluation: Endline report.","The Tanzania Cash Plus Evaluation Team (2018). Tanzania Youth Study of the Productive Social Safety Net (PSSN) impact evaluation: Endline report. Retrieved from: https://www.unicef-irc.org/publications/942-.html","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Productive Social Safety Net (PSSN) program on child labor and school participation outcomes. This summary focuses on the comparison of the conditional cash transfers (CCT) only treatment group versus the control group. The study was a randomized controlled trial where villages were randomly assigned to one of three study arms: conditional cash transfer (CCT) only, CCT with a supplemental public works program (PWP), and the control condition. The authors used difference-in-differences models to compare the changes in outcomes between the groups. The study found that the probability of participation in paid work outside the household significantly decreased for children in households receiving the CCT only compared to children in control households. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable to the Productive Social Safety Net program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2018,https://www.unicef-irc.org/publications/942-.html,"Child Labor Review Protocol" "New Jersey Health Professions Pathways to Regional Excellence project TAACCCT evaluation: Final report: Implementation and impact","Van Noy, M., Edwards, R., Haviland, S. B, McKay, H., Douglas, D., Mabe, W., Coty, V., Javed, S., Pardalis, N., Hubbard-Mattix, L., & Seith, D. (2018). New Jersey Health Professions Pathways to Regional Excellence project TAACCCT evaluation: Final report: Implementation and impact. Piscataway, NJ: Rutgers Education and Employment Research Center.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the New Jersey Health Professions Pathways to Regional Excellence Project (NJ-PREP) on earnings and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who participated in the Nj-PREP program to those that did not. The authors examined data from Unemployment Insurance records, state higher education records, and the New Jersey Consumer Report Card of Training Providers. The study did not find any statistically significant effects on employment or earnings. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the NJ-PREP, but other factors might also have contributed.","New Jersey Health Professions Pathways to Regional Excellence Project (NJ-PREP)","Capacity building programs Community college education and other classroom training","Adult, Low income",,"United States",2018,https://smlr.rutgers.edu/sites/default/files/nj_prep_taaccct_evaluation_finalre…,"Community College Review Protocol" "Integrating economic strengthening and family coaching to reduce work-related health hazards among children of poor households: Burkina Faso","Karimli, L., Rost, L., & Ismayilova, L. (2018). Integrating economic strengthening and family coaching to reduce work-related health hazards among children of poor households: Burkina Faso. Journal of Adolescent Health, 62, S6-S14.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Health and safety-Low-No impacts Health and safety","Summary: The study’s objective was to examine the impact of the Trickle Up and Trickle Up Plus programs on children’s exposure to work-related hazards and abuse, and children’s work-related health outcomes. This summary focuses on the comparison between the Trickle Up Plus intervention group and the control group. The study was a randomized controlled trial in the Nord Region of Burkina Faso, West Africa. Using three waves of survey data administered to children and adults separately, the authors conducted statistical models to compare the outcomes of treatment and control group members. The study found that Trickle Up Plus program participation was significantly related to a reduction of hazardous work and abuse, compared with the control group. However, the study found no statistically significant relationship between the Trickle Up program and work-related health outcomes. The quality of causal evidence presented in this report is low because it was a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Trickle Up Plus program; other factors are likely to have contributed.","Trickle Up Plus Program","Child labor Health","Female, Other, Low income",,International,2018,https://www.researchgate.net/publication/322086777_Integrating_Economic_Strengt…,"Child Labor Review Protocol" "SUN PATH comparison group study","Dauphinee, T., & Bishwakarma, R. (2018). SUN PATH comparison group study. Albuquerque, NM: University of New Mexico, Career to Cradle Policy Institute.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Skill‐UP Network Pathways Acceleration in Technology and Healthcare (SUN PATH) program on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare the outcomes of students who were in the SUN PATH program to a matched comparison group of students. The study found that SUN PATH students had higher rates of program completion, certificates/degree attainment, program retention, employment, and earnings than students in the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the SUN PATH program, but other factors might also have contributed.","the Skill‐UP Network Pathways Acceleration in Technology and Healthcare (SUN PATH) Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Other, Low-skilled, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18108/SUN%20PATH%20Compa…,"Community College Review Protocol" "TAACCCT building Illinois' bio-economy (BIB) consortium final evaluation report","The New Growth Group. (2018). TAACCCT building Illinois' bio-economy (BIB) consortium final evaluation report. Cleveland, OH: New Growth Group.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Building Illinois’ Bio-economy (BIB) consortium on education outcomes. The authors used a nonexperimental design to compare the outcomes of students in BIB grant-affected programs to a matched comparison group of students in non-BIB grant-affected programs. The study found a significant positive relationship between BIB program participation and program completion rates at two of the five colleges. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to participation in BIB grant-affected programs; other factors are likely to have contributed.","the Building Illinois’ Bio-economy (BIB) Consortium","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Veteran or military",,"United States",2018,,"Community College Review Protocol" "Kansas Technical Re/training Among Industry-targeted Networks (KanTRAIN) TAACCCT IV evaluation final report","Foster, L. R., Staklis, S., Ott, N. R., & Moyer, R. (2018). Kansas Technical Re/training Among Industry-targeted Networks (KanTRAIN) TAACCCT IV evaluation final report. Raleigh, NC: RTI International.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Kansas Technical Re/training Among Industry-targeted Networks (KanTRAIN) program on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare education, earnings, and employment outcomes of KanTRAIN participants to a matched comparison group. The study found KanTRAIN participants were significantly more likely to earn more credits per semester, pass a higher percentage of the credits attempted, attain more credentials, and earn a nondegree credential or a college degree, and receive a wage increase than the comparison group. The quality of causal evidence presented in this study is low because the authors used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the KanTRAIN program; other factors are likely to have contributed.","Kansas Technical Re/training Among Industry-targeted Networks (KanTRAIN)","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18334/KanTRAIN_TAACCCT_I…,"Community College Review Protocol" "An analysis of the Veterans Employment Initiative","Moses-Stanton, S. (2018). An analysis of the Veterans Employment Initiative. (Doctoral dissertation). Retrieved from ProQuest. Accession No. 10745075.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact Presidential Executive Order 13518 (EO13518) had on the employment of veterans who served in the military starting in September 2001 (Gulf War II-era veterans). The author used graphical analysis to examine employment outcomes for veterans and non-veterans after the implementation of EO13518. The study used Integrated Public Use Microdata Series (IPUMS USA) data for the years 2008, 2009, 2014, and 2015. The study did not show evidence of a relationship between the implementation of EO13518 and employment of Gulf War II-era veterans. The study did not statistically compare the employment of the veterans and non-veterans following implementation of the Executive Order. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we would not be confident that any estimated effects would be attributable to the implementation of EO13518; other factors would be likely to have contributed to the findings. However, the study did not find statistically significant effects.","Executive Order 13518","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2018,https://search.proquest.com/openview/c2ddd5b8502115f80bf2a7352fe1e281/1?cbl=187…,"Employment and Training Review Protocol" "Doubling graduation rates in a new state: Two-year findings from the ASAP Ohio demonstration","Sommo, C., Cullinan, D., Manno, M., Blake, S., & Alonzo, E. (2018). Doubling graduation rates in a new state: Two-year findings from the ASAP Ohio demonstration. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Ohio’s Accelerated Study in Associate Programs (ASAP) on community college students’ persistence, credit accumulation, and degree completion rates. The study was a randomized controlled trial conducted at three community colleges in Ohio. Eligible students were randomly assigned to either the treatment or control groups. The authors conducted statistical tests to examine differences in outcomes between the groups over four semesters. The study found that when compared to the control group, ASAP students had significantly higher enrollment rates and credit accumulation over the two-year period, and also had significantly higher degree completion rates. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to the Ohio Accelerated Study in Associate Programs, and not to other factors.","the Ohio Accelerated Study in Associate Programs (ASAP)","Community college education and other classroom training","Adult, Low income",,"United States",2018,https://files.eric.ed.gov/fulltext/ED592008.pdf,"Community College Review Protocol" "KCTCS Enhancing Programs for IT Certification (EPIC): Independent evaluation contracted by the Kentucky Community and Technical College System","Hughes, K., Belfield, C., Ran, F., & Jenkins, D. (2018). KCTCS Enhancing Programs for IT Certification (EPIC): Independent evaluation contracted by the Kentucky Community and Technical College System. New York, NY: Community College Research Center, Teacher's College, Columbia University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of the Enhancing Programs for IT Certification’s (EPIC) Learn on Demand (LoD) courses on community college students’ education outcomes. This summary focuses on the comparison between students who enrolled in EPIC LoD courses and students who enrolled in the traditional format courses. The authors used a nonexperimental design to compare the outcomes of students enrolled in EPIC LoD courses with those enrolled in traditional formats of courses where an EPIC LoD version was available. The study found that EPIC LoD course participation was significantly associated with increased course completion and certificate completion. The quality of causal evidence presented in this report is moderate for the course completion outcome because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the EPIC LoD courses, but other factors might also have contributed. For the certificate completion outcome, the quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the EPIC LoD courses; other factors are likely to have contributed.","the Enhancing Programs for IT Certification (EPIC) Project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2018,https://ccrc.tc.columbia.edu/media/k2/attachments/CCRC_KCTCS_EPIC_Report_09-26-…,"Community College Review Protocol" "Johnson County Community College (JCCC) TAACCCT final evaluation report","York, V. (2018). Johnson County Community College (JCCC) TAACCCT final evaluation report. Office of Educational Innovation and Evaluation. Manhattan, KS: Kansas State University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to evaluate the effects of Johnson County Community College’s (JCCC) Accelerated, Collaborative Technology Training Services (ACTTS) project on education outcomes. The author used a nonexperimental design to compare cohorts of students enrolled in ACTTS and comparison programs on five educational outcomes of interest. The study found that ACTTS students were significantly more likely than comparison group participants to complete their program of study, be retained in their program of study, complete credit hours, and earn credentials. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups being compared were similar before the intervention or include sufficient controls. This means we are not confident that the estimated effects are attributable to ACTTS; other factors are likely to have contributed.","JCCC’s Accelerated, Collaborative Technology Training Services (ACTTS) project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/17872/JCCC%20TAACCCT%20F…,"Community College Review Protocol" "Minnesota advanced manufacturing project: Final external evaluation report","Bucci, P., Evans, W.D., Friesenborg, L., Fox, D.A., Bishop, K., Balraj, N., & Jang, B. (2018). Minnesota advanced manufacturing project: Final external evaluation report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/18521/MnAMP%20Final%20Evaluation%20Report.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Minnesota Advanced Manufacturing Partnership (MnAMP) program on education outcomes. The authors used a nonexperimental design to compare education outcomes of MnAMP participants to a matched comparison group using institutional data. The study found that MnAMP program participation was significantly associated with earning fewer credits and fewer credentials relative to the comparison group. However, among students who attained credentials, participating in the MnAMP program was significantly associated with completing a one-year certificate in less time than comparison group students. The quality of causal evidence presented in this study is low because the authors used a comparison group from previous enrollment years, presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the MnAMP program; other factors are likely to have contributed.","Minnesota Advanced Manufacturing Partnership (MnAMP) Program","Capacity building programs Community college education and other classroom training","Adult, Unemployed, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18521/MnAMP%20Final%20Ev…,"Community College Review Protocol" "KCTCS Enhancing Programs for IT Certification (EPIC): Independent evaluation contracted by the Kentucky Community and Technical College System","Hughes, K., Belfield, C., Ran, F., & Jenkins, D. (2018). KCTCS Enhancing Programs for IT Certification (EPIC): Independent evaluation contracted by the Kentucky Community and Technical College System. New York, NY: Community College Research Center, Teacher's College, Columbia University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of the Enhancing Programs for IT Certification’s (EPIC) Learn on Demand (LoD) courses on community college students’ education outcomes. This summary focuses on the comparison between students who enrolled in EPIC LoD courses and students who enrolled in non-EPIC LoD courses. The authors used a nonexperimental design to compare the outcomes of students enrolled in EPIC LoD courses with those enrolled in non-EPIC LoD courses. The study found that EPIC LoD course participation was significantly associated with increased course completion and certificate completion. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the EPIC LoD courses, but other factors might also have contributed.","the Enhancing Programs for IT Certification (EPIC) Project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2018,https://ccrc.tc.columbia.edu/media/k2/attachments/CCRC_KCTCS_EPIC_Report_09-26-…,"Community College Review Protocol" "Mali Speed School Program: Long term impact","Dillon, A., Porreca, E., & Rosati, F. (2018). Mali Speed School Program: Long term impact. Understanding Children's Work (UCW) Working Paper Series. Rome, Italy: UCW","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Mali Speed School Program on child labor and education outcomes. The study used a randomized controlled trial to compare outcomes between children who participated in the Mali Speed School Program with children who did not. Using survey data, the authors conducted difference-in-differences models to examine long-term program outcomes between the groups. The study found that the percentage of children who worked in agriculture in the last seven days or wage employment in the previous 12 months was significantly lower in the treatment group than the control group. The study also found that the percentage of children enrolled in school five years after program implementation was significantly higher in the treatment group than the control group. The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Mali Speed School Program, but other factors might also have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2018,,"Child Labor Review Protocol" "Household micro-entrepreneurial activity and child work: Evidence from two African unconditional cash transfer programs","de Hoop, J., Groppo, V., & Handa, S. (2017). Household micro-entrepreneurial activity and child work: Evidence from two African unconditional cash transfer programs. Retrieved from https://sites.tufts.edu/neudc2017/files/2017/10/paper_303.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of unconditional cash transfers on child labor and school attendance in Malawi and Zambia. This summary focuses on the Zambia Multiple Categorical Targeting Group (MCTG) program. The study used a randomized controlled trial to compare outcomes between children in households that received the cash transfer with children in households that did not. The study found that children in the treatment group were significantly more likely than children in the control group to participate in livestock herding and collect water or firewood. However, program participants were significantly more likely to attend school than those in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to Zambia's Multiple Categorical Targeting Group program and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2017,,"Child Labor Review Protocol" "Essays on the economics of higher education: The academic and labor market outcomes to four to two-year transfer, summer enrollment, and year-round Pell","Liu, Y. T. (2017). Essays on the economics of higher education: The academic and labor market outcomes to four to two-year transfer, summer enrollment, and year-round Pell (Unpublished doctoral dissertation). Columbia University, New York, NY. doi: 10.7916/D8M90N11","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of receiving year-round Pell (YRP) funding on community college students’ enrollment, credit accumulation, degree completion, employment, and earnings. The study used a nonexperimental design to compare the effects of receiving the YRP funding on outcomes for those in the treatment group versus those in the comparison group. The study found that students who received YRP were significantly more likely to enroll in summer courses that year, earn more credits during the semester, and earn more money three years later. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the YRP, but other factors might also have contributed.","Year-Round Pell (YRP) funding","Community college education and other classroom training","Adult, Low income",,"United States",2017,https://academiccommons.columbia.edu/doi/10.7916/D8M90N11,"Community College Review Protocol" "Child schooling and child work in the presence of a partial education subsidy","de Hoop, J., Friedman, J., Kandpal, E., & Rosati, F. (2017). Child schooling and child work in the presence of a partial education subsidy. Retrieved from http://documents.worldbank.org/curated/en/501961504719564270/pdf/WPS8182.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of a conditional cash transfer program, the Pantawid Pamilya Pilipino Program, on children’s school attendance and participation and their participation in work inside and outside of their households. The study was a randomized controlled trial. The researchers used household surveys, administered at baseline and two and half years after the intervention began, to assess program impact on schooling and child labor outcomes between the treatment and control groups. The study found that, two and a half years after the program began, a significantly higher proportion of children participating in the program worked for pay outside of their household than children not participating in the program. However, there was a significantly greater proportion of children in the treatment group than the control group who attended school and attended school regularly. Similarly, children in the treatment group attended a significantly greater number of days of school than those in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the the Pantawid Pamilya Pilipino Program, and not to other factors.","Pantawid Pamilya Pilipino Program","Child labor","Other, Low income",,International,2017,http://documents.worldbank.org/curated/en/501961504719564270/pdf/WPS8182.pdf,"Child Labor Review Protocol" "Final evaluation report: Linn-Benton Community College","Kelley-Smith, A., Schoeph, K., Hamai, T., & Bishop, M. (2017). Final evaluation report: Linn-Benton Community College. Albany, OR: LB iLearn Campus.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to assess the impact of degree and certificate programming offered at Linn-Benton Community College’s (LBCC) iLearn campus compared to traditional programming offered at the community college on various educational, employment, and earnings outcomes. The study used a nonexperimental design to compare the outcomes of students enrolled in the Linn-Benton (LB) iLearn campus to students enrolled in traditional programming. The study found that program participation was significantly associated with increased rates of program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the LB iLearn campus program; other factors are likely to have contributed.","the LB iLearn Campus Program","Capacity building programs Community college education and other classroom training","Adult, Other barriers, Dislocated or displaced worker, Veteran or military",,"United States",2017,https://www.skillscommons.org/handle/taaccct/15675,"Community College Review Protocol" "Final evaluation Golden Triangle Modern Manufacturing Project","Harpole, S. (2017). Final evaluation Golden Triangle Modern Manufacturing Project. SHH Consulting, LLC","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Golden Triangle Modern Manufacturing Project on education, earnings, and employment outcomes. The author used a nonexperimental design to compare outcomes of Golden Triangle Modern Manufacturing Project participants to a matched comparison group. The study found that program participation was significantly associated with increases in program retention, credential attainment, and earnings. The quality of causal evidence presented in this study is low because the author used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to Golden Triangle Modern Manufacturing Project; other factors are likely to have contributed.","the Golden Triangle Modern Manufacturing Project","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed, Low-skilled, Veteran or military",,"United States",2017,https://www.skillscommons.org/handle/taaccct/15669,"Community College Review Protocol" "Household micro-entrepreneurial activity and child work: Evidence from two African unconditional cash transfer programs","de Hoop, J., Groppo, V., & Handa, S. (2017). Household micro-entrepreneurial activity and child work: Evidence from two African unconditional cash transfer programs. Retrieved from https://sites.tufts.edu/neudc2017/files/2017/10/paper_303.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Mixed impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of unconditional cash transfers on child labor and school attendance in Malawi and Zambia. This summary focuses on the Malawi Social Cash Transfer Program. The study used a randomized controlled trial to compare outcomes between children in households that received the cash transfer with children in households that did not. The study found children in the treatment group were less likely to work for pay outside of the household, had less time spent in paid work, were more likely to attend school, but had an increase in hazardous work than children in the control group; these findings were statistically significant. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to the Malawi Social Cash Transfer Program and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2017,,"Child Labor Review Protocol" "Quantitative analysis of an urban community college S-STEM program","Chapman, A. (2017). Quantitative analysis of an urban community college S-STEM program. (Unpublished doctoral dissertation). University of Phoenix, Phoenix, AZ.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Scholarships in Science, Technology, Engineering, and Mathematics (S-STEM) program on community college students’ success and progress. The study used a nonexperimental design to compare the outcomes of S-STEM program participants to a matched comparison group. Using administrative data from the community college, the author tested for group differences in student success and progress rate. The study found that participation in the S-STEM program was associated with significantly higher rates of student success and progress. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the S-STEM program, but other factors might also have contributed.","the Scholarships in Science, Technology, Engineering, and Mathematics (S-STEM) program","Community college education and other classroom training Mentoring Science, Technology, Engineering, and Math (STEM) programs","Adult, Low income",,"United States",2017,https://search.proquest.com/openview/0549b8ce7f3331a8abe04827df253116/1?pq-orig…,"Community College Review Protocol" "Project IMPACT: Innovative multi-industry partnership and career training project final evaluation report. Gateway Community Technical College","Jensen, J., Horohov, J., & Waddington, J. (2017). Project IMPACT: Innovative multi-industry partnership and career training project final evaluation report. Gateway Community Technical College. Lexington, KY: University of Kentucky, College of Education, Educational Policy Studies & Evaluation.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to assess the impact of Project IMPACT on education, earnings, and employment outcomes. Using academic records from the college as well as data obtained from the Kentucky Center for Workforce Statistics, the authors used a nonexperimental design to compare outcomes of Project IMPACT participants to outcomes of historical cohort students who were enrolled in the Project IMPACT programs of study prior to grant implementation. The study found that participating in Project IMPACT was significantly associated with a higher likelihood to take courses, pass courses, earn credits, and receive credentials. The study also found that participating in Project IMPACT was significantly associated with higher earnings in the quarter following enrollment. The quality of causal evidence presented in this study is low for the education and employment outcomes because the authors used a comparison group from previous enrollment years presenting a confounding factor and because the authors did not ensure the groups being compared were similar before the intervention, respectively. This means we are not confident that the estimated effects are attributable to Project IMPACT; other factors are likely to have contributed.","Project IMPACT","Employer partnerships Capacity building programs Community college education and other classroom training","Adult, Other barriers, Veteran or military",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/15674/IMPACT%20Final%20E…,"Community College Review Protocol" "The influence of Bolsa Familia conditional cash transfer program on child labor in Brazil","Pais, P. S. M., Silva, F. D. F., & Teixeira, E. C. (2017). The influence of Bolsa Familia conditional cash transfer program on child labor in Brazil. International Journal of Social Economics, 44(2), 206-221.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Unfavorable impacts Child labor","Summary: The objective of the study was to examine the impact of the Bolsa Familia conditional cash transfer program on child labor in Brazil. The study used a nonexperimental design to compare labor outcomes of children who received the conditional cash transfer with a matched comparison group of children who did not, based on data from a national household survey. The study found that the program was significantly related to an increase in child labor, with a 52.5 percent increase in hours spent on child labor for those receiving Bolsa Familia. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to Bolsa Familia; other factors are likely to have contributed.","Bolsa Familia","Child labor","Other, Low income",,International,2017,,"Child Labor Review Protocol" "Southeastern Economic and Education Leadership Consortium (SEELC) final report","Takyi-Laryea, A., Gall, A., Chamberlin, M., Naughton, L., & Spychala, B. G. (2017). Southeastern Economic and Education Leadership Consortium (SEELC) final report. Fairfax, VA: ICF.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the WorkKeys® assessment, a component of the TAACCCT-funded programming at Southeastern Economic and Education Leadership Consortium (SEELC) colleges, on education, earnings outcomes, and employment. The authors used a nonexperimental design to compare the education, earnings outcomes, and employment of SEELC program participants that took the WorkKeys® assessment to a matched comparison group of SEELC participants enrolled at the same colleges who did not take the assessment. The study found a significant relationship between taking the WorkKeys® assessment and earnings, with SEELC participants who took the assessment receiving higher post-program hourly wages than the comparison group of students who did not take the assessment. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups being compared were similar before the intervention nor include sufficient control variables. This means we are not confident that the estimated effects are attributable to the SEELC consortium WorkKeys® assessment; other factors are likely to have contributed.","the Southeastern Economic and Education Leadership Consortium (SEELC)","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2017,http://www.skillscommons.org/handle/taaccct/13986,"Community College Review Protocol" "Pima Community College Pathways to Healthcare Program: Implementation and early impact report (Report No. 2017-10)","Gardiner, K., Rolston, H., Fein, D., & Cho, S-W. (2017). Pima Community College Pathways to Healthcare Program: Implementation and early impact report (Report No. 2017-10). Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to assess the impact of the Pathways to Healthcare program on students’ education and employment outcomes. The study used a randomized controlled trial to compare outcomes of students enrolled in the Pathways to Healthcare program with non-participants. The study found that Pathways to Healthcare program participants had significantly higher average total hours of college occupational training, higher rates of certification receipt, and higher rates of credential receipt from a college than the control group. The quality of causal evidence presented in this study is high because it is based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to the Pathways to Healthcare program and not to other factors.","the Pathways to Healthcare Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Low-skilled, Low income","Health care and social assistance","United States",2017,https://www.acf.hhs.gov/sites/default/files/opre/pathways_to_healthcare_impleme…,"Community College Review Protocol" "Orthotics, Prosthetics, and Pedorthics (HOPE) careers consortium: Final evaluation report","Good, K., & Yeh-Ho, H. (2017). Orthotics, Prosthetics, and Pedorthics (HOPE) careers consortium: Final evaluation report. Denver, CO: McREL International.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Orthotics, Prosthetics & Pedorthics (HOPE) careers consortium program on education outcomes. The authors used a nonexperimental design to compare education outcomes of HOPE participants to a matched comparison group with institutional research data. The study found no significant associations between HOPE participation and program completion rates, completion of more than one certificate or degree, or furthering education status. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the HOPE program; other factors are likely to have contributed.","the Orthotics, Prosthetics & Pedorthics (HOPE) Careers Consortium Program","Capacity building programs Community college education and other classroom training","Adult, Other barriers, Dislocated or displaced worker, Unemployed, Veteran or military",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/13872/hope-consortium-tc…,"Community College Review Protocol" "The impact of the Child Grant Programme on child labour and education in Lesotho","Universita di Roma Tor Vergata, Centre for Economic and International Studies, the International Labour Organisation, UNICEF and the World Bank. (2017). The impact of the Child Grant Programme on child labour and education in Lesotho. Understanding Children's Work (UCW) Working Paper Series. Rome, Italy: UCW.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Child Grant Programme (CGP) on child labor and education outcomes in Lesotho. The study used a randomized controlled trial to compare outcomes between children in households that received the cash transfer with children in households that did not. The study found that participation in the CGP was significantly associated with increased school enrollment two years after the introduction of the program. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition and the treatment group received a second grant payment, the Food Emergency Grant, which presents a confound. This means we are not confident that the estimated effects are attributable to Child Grant Programme (CGP); other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2017,,"Child Labor Review Protocol" "Final evaluation report: Cincinnati State Technical and Community College: Greater Cincinnati Manufacturing Careers Accelerator (GCMCA)","Belville, J., Romano, G., Frisby, M., Chamberlin, M., & Strem, L. (2017). Final evaluation report: Cincinnati State Technical and Community College: Greater Cincinnati Manufacturing Careers Accelerator (GCMCA).","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Greater Cincinnati Manufacturing Careers Accelerator (GCMCA) program on education outcomes. The author used a nonexperimental design to compare the education persistence of students in the treatment group to students in a matched comparison group. The study found that students in the comparison group were significantly more likely to complete the program than students in the treatment group for both the Welding or Mechanical Engineering Technology Manufacturing and Design programs. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the Greater Cincinnati Manufacturing Careers Accelerator (GCMCA) program; other factors are likely to have contributed.    ","Greater Cincinnati Manufacturing Careers Accelerator (GCMCA) Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2017,,"Community College Review Protocol" "Butler Community College TAACCCT final evaluation report","Kansas State University Office of Educational Innovation and Evaluation. (2017). Butler Community College TAACCCT final evaluation report. Manhattan, KS: Kansas State University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Butler Community College Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant on education, earnings, and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were in the Butler TAACCCT Information Technology (IT) program to a comparison group. The study found that students in the Butler TAACCCT IT program were significantly more likely to complete their program, be retained in their program, and earn credentials than their counterparts in other selected Career and Technical Education (CTE) courses. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention or include sufficient controls. This means we are not confident that the estimated effects are attributable to the Butler TAACCCT IT program; other factors are likely to have contributed.","the Butler Community College TAACCCT Project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2017,https://www.skillscommons.org/handle/taaccct/15664,"Community College Review Protocol" "STEM-Connect at the University of Vermont, College of Engineering and Mathematical Sciences: Program evaluation final report","Farrell, R., Harris, D., Meyers, H., & Ratmeyer, S. (2017). STEM-Connect at the University of Vermont, College of Engineering and Mathematical Sciences: Program evaluation final report. Swanton, VT: Core Research and Evaluation.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the effects of the University of Vermont’s (UVM) Science, Technology, Engineering and Math (STEM) Connect program on earnings and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were enrolled in the UVM STEM-Connect program to a matched comparison group of students who took a STEM-Connect course but were not enrolled in the STEM-Connect program. The study found no statistically significant relationships between STEM-Connect program participation and average quarterly wages or employment rates. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the UVM STEM-Connect program; other factors are likely to have contributed.","the UVM STEM-Connect Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Unemployed, Veteran or military",,"United States",2017,http://www.skillscommons.org/bitstream/handle/taaccct/13127/STEM-Connect%20Fina…,"Community College Review Protocol" "TAACCCT3 INTERFACE project: Final evaluation report","Smith, L., Gregg, A., Roth, L., Stoeklen, P., Krueger, B., Lawton, G., & Knaeble, B. (2017). TAACCCT3 INTERFACE project: Final evaluation report. Menomonie, WI: University of Wisconsin-Stout, Applied Research Center, Wisconsin’s Polytechnic University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Intentional Networks Transforming Effective and Rigorous Facilitation of Assessment, Collaboration, and Education (INTERFACE) project on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare education, earnings, and employment outcomes of students in the INTERFACE program to a matched comparison group. The study found that INTERFACE students had significantly higher pass rates, graduation rates, and employment rates than students in the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the INTERFACE program, but other factors might also have contributed.","the Intentional Networks Transforming Effective and Rigorous Facilitation of Assessment, Collaboration, and Education (INTERFACE) Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Veteran or military",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/14262/INTERFACE%20Projec…,"Community College Review Protocol" "The impact of conditional cash transfers on the amount and type of child labor","Del Carpio, X. V., Loayza, N. V., & Wada T. (2016). The impact of conditional cash transfers on the amount and type of child labor. World Development, 80, 33-47. doi:10.1016/j.worlddev.2015.11.013","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of a conditional cash transfer (CCT) program on the amount and type of child labor conducted by children ages 8 to15. Types of child labor included household chores, farm labor (both at home and outside the home), and skill-forming activities defined as work in commerce, sales, or manufacturing activities outside the home. The study was a randomized controlled trial conducted in six municipalities in Nicaragua. Households from each community were randomly assigned into treatment and control groups. Treatment households received either the basic CCT or the basic CCT plus an additional a household grant for the creation of a micro business. Survey data were collected and child labor outcomes were analyzed using two statistical models. The study found that the program significantly reduced overall child labor, household chore labor, and farm labor for both treatment groups compared to the control group. The program had no effect on skill-forming labor for the treatment group that received the basic CCT but increased skill-forming labor for the children in the households that received the basic CCT plus the business grant. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to the Atención a Crisis program and not to other factors.","Atención a Crisis (“Attention to the Crisis”)","Child labor","Other, Low income",,International,2016,https://www.sciencedirect.com/science/article/pii/S0305750X15002934,"Child Labor Review Protocol" "Encouraging evidence on a sector-focused advancement strategy","Hendra, R., Greenberg, D. H., Hamilton, G., Oppenheim, A. Pennington, A. Schaberg, K., and Tessler, B. L. (2016). Encouraging evidence on a sector-focused advancement strategy. New York: MDRC. [Per Scholas]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the WorkAdvance sectoral training program at the Per Scholas site on employment, earnings, and education and training from 2011 to 2015. The authors investigated similar research questions with three other sites, the profiles of which are available here. The study used a randomized controlled trial design to compare the treatment group, which was able to access the WorkAdvance program at the Per Scholas site, and the control group, which was not eligible for WorkAdvance services but could access other services in the community. The authors collected data from two sources: a follow-up survey and unemployment insurance (UI) wage and employment data. The study found that the program had a statistically significant impact on quarterly earnings in the second and third years after random assignment (based on UI data) and average weekly earnings in the second year after random assignment (based on survey data). The study also found that the program did not have a significant impact on most employment outcomes. Using survey data, the authors found that members of the WorkAdvance group were significantly more likely to have obtained a degree or credential and to have completed a skills training program two years after random assignment. The quality of the causal evidence is moderate for employment and earnings outcomes based on UI data because those outcomes were based on a randomized controlled trial in which the authors did not demonstrate that they accounted for change in the probability of random assignment, but the authors did account for existing differences between the treatment and control groups. The quality of the causal evidence is moderate for education and training outcomes from the follow-up survey because those outcomes were based on a randomized controlled trial in which many people did not complete the follow-up survey, but the authors did account for existing differences between the treatment and control groups. This means we are somewhat confident that the estimated effects are attributable to the WorkAdvance program at the Per Scholas site, but other factors might also have contributed.","the WorkAdvance sectoral training program","Work based and other occupational training","STEM professional, Low income",,"Urban, United States",2016,https://files.eric.ed.gov/fulltext/ED568395.pdf,"Employment and Training Review Protocol" "Incorporating individualized placement and support principles into vocational rehabilitation for formerly incarcerated veterans","LePage, J. P., Lewis, A. A., Crawford, A. M., Parish, J. A., Ottomanelli, L., Washington, E. L., & Cipher, D. J. (2016). Incorporating individualized placement and support principles into vocational rehabilitation for formerly incarcerated veterans. Psychiatric Services, 67(7), 735-742.","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the effect of the Individual Placement and Support (IPS) program on employment and earnings outcomes for justice-involved veterans with a prior felony conviction and a mental illness or substance abuse disorder. The study team used a randomized controlled trial and statistical tests to examine differences between justice-involved veterans who were offered the IPS program and veterans who were not offered this program. Justice-involved veterans self-reported their outcomes, which were verified based on a review of paystubs or contact with employers. The study showed that the IPS program increased employment, wages, number of days employed, and number of hours worked. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the IPS program, not to other factors.","Individual Placement and Support (IPS)","Job search assistance and supportive services Supported employment or other employment supports Veterans' reemployment","Veteran or military",,"United States",2016,https://ps.psychiatryonline.org/doi/full/10.1176/appi.ps.201500058,"Reentry, Veterans Review Protocol" "Nursing interventions to help prevent children from working on the streets","Mert, K., & Kadioglu, H. (2016). Nursing interventions to help prevent children from working on the streets. International Nursing Review 63, 429–436. doi:10.1111/inr.12301","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor","Summary: The study’s objective was to assess the impact of a program developed to prevent children under 18 years of age from working on the street. The study was an interrupted time series design conducted in one neighborhood in the city of Izmit, Turkey. The authors compared the outcomes for mothers and their children before, immediately after, and three months after participating in The Streets are Not the Solution program. The study found that participating in the program was associated with a 44 percentage point decrease from pretest to posttest in the percentage of children who worked on the streets. However, the study did not include tests of statistical significance. The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the effects are attributable to the Streets are Not the Solution program; other factors are likely to have contributed.","The Streets are Not the Solution","Child labor","Female, Other, Parent",,International,2016,,"Child Labor Review Protocol" "The influence of conditional cash transfers on eligible children and their siblings","Lincove, J. A., & Parker, A. (2016). The influence of conditional cash transfers on eligible children and their siblings. Education Economics, 24(4), 352-373.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of Nicaragua’s Red de Proteccion Social (RPS) conditional cash transfer (CCT) program on attending school, working, and hours worked for children ages 6 to 16. The authors used data from an experimental design where communities were randomly assigned to participate in the program. The authors used difference-in-differences to estimate the effects of the program, controlling for child and family demographics separately by child gender and child age groups. The CCT was not associated with the probability of attending school and working for boys, but was associated with a statistically significant decrease in hours worked for boys ages 6-11 (2.8 hours) and for boys as 12-13 (8.7 hours). The program was also associated with a statistically significant 15.8 percent increase in the probability of school enrollment for girls ages 6-11. The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to the RPS conditional cash transfer program, although other factors could also have contributed.","Red de Protección Social (RPS)","Child labor","Other, Low income",,International,2016,http://www.janelincove.com/uploads/3/7/2/0/37205101/educaton_economics_2015.pdf,"Child Labor Review Protocol" "Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe","Fenton, R, Nyamukapa, C., Gregson, S., Robertson, L., Mushati, P., Thomas, R., & Eaton, J.W. (2016). Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe. Psychology, Health & Medicine, 21(8), 909-917","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of conditional cash transfers (CCT) and unconditional cash transfers (UCT) on child labor and schooling outcomes. This summary focuses on the comparison between the UCT group and the control group. The study was a randomized controlled trial in which households were randomly assigned to receive one of two cash transfers (conditional or unconditional) or to participate in the control group that did not receive a cash transfer. Using household survey data, the authors analyzed the impact of the treatment conditions on child labor and schooling outcomes a year after the intervention began. The study found that receipt of an unconditional cash transfer was significantly associated with an increases in school attendance for the poorest households, but not significantly related to child labor outcomes. The quality of causal evidence presented in this report is low because it based on a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before receiving the cash transfers. This means we are not confident that the estimated effects are attributable to the unconditional cash transfers; other factors are likely to have contributed.","Cash Transfer Program","Child labor","Other barriers, Other, Low income",,International,2016,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5044770/,"Child Labor Review Protocol" "Vincennes University Logistics Training and Education: Final evaluation report","Belville, J., Schoeph, K., Leger, R., Jenner, E., Maddox, D., Lass, K., & Beres, S. (2016). Vincennes University Logistics Training and Education Center: Final evaluation report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/9679/VU%20LTEC%20Final%20Evaluation%20Report%20TAACCCT%20R2_Sept%202016.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Logistics Training and Education Center (LTEC) initiative on employment and earnings outcomes. This summary focuses on the estimated outcomes of the Tractor-Trailer Driver Training (TTDT) program.  The authors used a nonexperimental design to compare the outcomes of TTDT program participants to a matched comparison group consisting of two student cohorts: a historical cohort of students from previous enrollment years and a concurrent cohort of students that attended a different college campus. The study did not find significant relationships between completion of the TTDT program and employment status or quarterly earnings. The quality of the causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Logistics Training and Education Center initiative; other factors are likely to have contributed.  ","Logistics Training and Education Center (LTEC) Initiative","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9679/VU%20LTEC%20Final%2…,"Community College Review Protocol" "Encouraging evidence on a sector-focused advancement strategy","Hendra, R., Greenberg, D. H., Hamilton, G., Oppenheim, A. Pennington, A. Schaberg, K., and Tessler, B. L. (2016). Encouraging evidence on a sector-focused advancement strategy. New York: MDRC. [St. Nicks Alliance]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the WorkAdvance sectoral training program at the St. Nicks Alliance site on employment, earnings, education, and training from 2011 to 2015. The authors investigated similar research questions with three other sites, the profiles of which are available here. The study used a randomized controlled trial design to compare the treatment group, which was able to access the WorkAdvance program at the St. Nicks Alliance site, and the control group, which was not eligible for WorkAdvance services but could access other services in the community. The authors collected data from two sources: a follow-up survey and unemployment insurance (UI) wage and employment data. Using UI data, the authors found that those assigned to the treatment group were significantly more likely to be ever employed in Quarters 2 to 5 after random assignment than those in the control group. Using survey data, the authors also found that those in the treatment group were significantly more likely to complete education or training than the control group. The quality of the causal evidence is high for employment and earnings outcomes based on UI data because those outcomes were based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects for those outcomes are attributable to the WorkAdvance program at the St. Nicks Alliance site and not to other factors. For education and training outcomes from the follow-up survey, the quality of the causal evidence is moderate because those outcomes were based on a randomized controlled trial in which many people did not complete the follow-up survey, but the authors did account for existing differences between the treatment and control groups. This means we are somewhat confident that the estimated effects for those outcomes are attributable to the WorkAdvance program at the St. Nicks Alliance site, but other factors might also have contributed.","the WorkAdvance sectoral training program","Work based and other occupational training","Low income",,"Urban, United States",2016,https://files.eric.ed.gov/fulltext/ED568395.pdf,"Employment and Training Review Protocol" "Evaluation of the Illinois Network for Advanced Manufacturing: Final Report","Westat. (2016). Evaluation of the Illinois Network for Advanced Manufacturing: Final Report. Rockville, MD: Westat & GEM Software Development, Inc.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Illinois Network for Advanced Manufacturing (INAM) program on education, earnings, and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were in the INAM program to a comparison group of students who took similar courses before the creation of INAM. Using data from college databases and the Illinois Department of Employment Security, the authors conducted statistical models to examine differences in outcomes between the groups. The study found that participation in the INAM program was significantly associated with improved rates of certificate or degree completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the INAM program; other factors are likely to have contributed.","the Illinois Network for Advanced Manufacturing (INAM)","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed, Other, Veteran or military",,"United States",2016,https://www.researchgate.net/publication/315664265_Evaluation_of_the_Illinois_N…,"Community College Review Protocol" "Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program","Glosser, A., Barden, B., Williams, S., Anderson, C. (2016). Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program. (OPRE Report 2016-77). Washington, DC: Office of Planning, Research, and Evaluation. [Contrast 3: Paid work experience versus on-the-job training]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of paid work experience, part of Los Angeles’ Subsidized and Transitional Employment Demonstration, on employment, earnings, and public benefit receipt relative to on-the-job training. The authors also investigated related impacts, the profiles of which are available [here]. The authors used regression methods in a randomized controlled trial study to examine the impacts of participating in paid work experience. The data sources included administrative wage records, subsidized employment payroll records, Temporary Assistance for Needy Families (TANF) benefit payment records, and survey data. The study found that paid work experience had positive, statistically significant impacts on employment, earnings, and benefit receipt compared with on-the-job training. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the paid work experience program and not to other factors.","Los Angeles’ Subsidized and Transitional Employment Demonstration","Adult and Dislocated Worker programs Job search assistance and supportive services Other training and education","Low income",,"Urban, United States",2016,https://www.mdrc.org/publication/testing-two-subsidized-employment-approaches-r…,"Employment and Training Review Protocol" "Retraining the Gulf Coast through Information Technology Pathways: Final impact evaluation report","Patnaik, A., & Prince, A. (2016). Retraining the Gulf Coast through Information Technology Pathways: Final Impact evaluation report. Austin, TX: The University of Texas at Austin, Lyndon B. Johnson School of Public Affairs.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Retraining the Gulf Coast Workforce through Information Technology Pathways Consortium (Gulf Coast IT Pathways) grant program on education outcomes. Using a nonexperimental design with institutional data from the college systems, the study authors compared students in the program to a matched historical cohort comparison group. The study found that the Gulf Coast IT Pathways program was significantly related to higher credential, certificate, or a degree attainment and higher credit hour accumulation. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Gulf Coast IT Pathways TAACCCT; other factors are likely to have contributed.","the Gulf Coast IT Pathways Program","Basic skills Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Low-skilled, Veteran or military",,"United States",2016,https://raymarshallcenter.org/files/2016/11/Retraining-the-Gulf-Coast-through-I…,"Community College Review Protocol" "Do education and health conditions matter in a large cash transfer? Evidence from a Honduran experiment","Benedetti, F., Ibarrarán, P., & McEwan, P. J. (2016). Do education and health conditions matter in a large cash transfer? Evidence from a Honduran experiment. Economic Development and Cultural Change, 64(4), 759-793. doi:10.1086/686583","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a conditional cash transfer on school enrollment and child labor. The study was a randomized controlled trial conducted in in low-income villages in Honduras. Villages were randomly assigned to the treatment and control groups. Baseline and follow-up survey data were collected from randomly selected households and analyzed using regression. The Bono 10,000 program significantly increased school enrollment but did not significantly reduce child labor. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Bono 10,000 program and not to other factors.","Bono 10,000","Child labor","Other, Low income",,International,2016,http://academics.wellesley.edu/Economics/mcewan/PDF/bono.pdf,"Child Labor Review Protocol" "Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe","Fenton, R., Nyamukapa, C., Gregson, S., Robertson, L., Mushati, P., Thomas, R., & Eaton, J. W. (2016) Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomized controlled trial in Zimbabwe. Psychology, Health & Medicine, 21(8), 909-917","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of conditional cash transfers (CCT) and unconditional cash transfers (UCT) on child labor and schooling outcomes. This summary focuses on the comparison between the CCT group and the control group. The study was a randomized controlled trial in which households were randomly assigned to receive one of two cash transfers (conditional or unconditional) or to participate in the control group that did not receive a cash transfer. Using household survey data, the authors analyzed the impact of the treatment conditions on child labor and schooling outcomes a year after the intervention began. The study found that receipt of a conditional cash transfer was significantly associated with a reduction in child work and increases in school attendance for the poorest households. The quality of causal evidence presented in this report is low because it based on a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before receiving the cash transfer. This means we are not confident that the estimated effects are attributable to the conditional cash transfer; other factors are likely to have contributed.","Cash Transfer Program","Child labor","Other barriers, Other, Low income",,International,2016,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5044770/,"Child Labor Review Protocol" "The Green Jobs and Health Care impact evaluation: Findings from the impact study of four training programs for unemployed and disadvantaged workers","Martinson, K., Williams, J., Needels, K., Peck, L., Moulton, S., Paxton, N., Mastri, A., Copson, E., Comfort, A., & Brown-Lyons, M. (2016). The Green Jobs and Health Care impact evaluation: Findings from the impact study of four training programs for unemployed and disadvantaged workers. Retrieved from https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2017-07%20Findings%20from%20the%20Impact%20Study.pdf","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Grand Rapids Community College (GRCC) Pathways to Prosperity program on education, earnings, and employment outcomes. The study was a randomized controlled trial. The authors used a baseline information form, the National Directory of New Hires (NDNH), a follow-up survey, and administrative program data to compare the outcomes between the treatment and control groups over an 18-month follow-up period. The study found that the GRCC Pathways to Prosperity program had a significant positive impact on completion rates for vocational training and life skills classes, and receipt of a vocational credential. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the GRCC Pathways to Prosperity program and not to other factors.","the Grand Rapids Community College (GRCC) Pathways to Prosperity Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Justice-involved, Other barriers, Unemployed, Low income",,"United States",2016,https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2017-07%20Findings%20f…,"Community College Review Protocol" "Do conditional cash transfers reduce child labor?: Evidence from the Philippines","Galang, I. M. (2016). Do conditional cash transfers reduce child labor?: Evidence from the Philippines (Unpublished Master's thesis). Tokyo, Japan: The University of Tokyo.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of the study was to examine the impact of the Philippines conditional cash transfer program, Pantawid Pamilyang Pilipino Program (4Ps), on child labor and school attendance. The authors used a nonexperimental design to compare the outcomes of children ages 12-14 that received the conditional cash transfers with those who did not, based on data from the 2011 Annual Poverty Indicator Survey. Using several demographic characteristics, they created a matched comparison group of families who did not receive the benefit to assess the effectiveness of the cash transfer program. The study found that receipt of the cash transfer was significantly associated with increased school attendance but not significantly associated with child labor. The quality of causal evidence presented in this report is low because the authors did not account for the outcomes of schooling and work at baseline. This means we are not confident that the estimated effects are attributable to the 4Ps program; other factors are likely to have contributed.","Pantawid Pamilya Pilipino Program","Child labor","Other, Low income",,International,2016,http://www.pp.u-tokyo.ac.jp/wp-content/uploads/2016/02/1.31-MB-1.pdf,"Child Labor Review Protocol" "Third party evaluation of MoManufacturingWINS: Implementation, outcomes, and impact","Cosgrove, J. J., Cosgrove, M. S., & Bragg, D. D. (2016). Third party evaluation of MoManufacturingWINs: Implementation, outcomes, and impact. St. Louis, MO: Cosgrove & Associates and Bragg & Associates.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Missouri’s Manufacturing Workforce Innovation Networks(MMW) program on student education and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were in MMW to a comparison group of students in other manufacturing-technology related programs. The study found that MMW participation was significantly associated with higher retention and employment rates. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention and they did not include sufficient controls. This means we are not confident that the estimated effects are attributable to MMW; other factors are likely to have contributed.","Missouri’s Manufacturing Workforce Innovation Networks (MMW)","Basic skills Capacity building programs Community college education and other classroom training","Adult, Unemployed, Other, Low-skilled, Veteran or military",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/10116/ThirdPartyFinalEva…,"Community College Review Protocol" "Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program","Glosser, A., Barden, B., Williams, S., & Anderson, C. (2016). Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program. (OPRE Report 2016-77). Washington, DC: Office of Planning, Research, and Evaluation. [Contrast 2: On-the-job training versus comparison]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Unfavorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of on-the-job training, part of Los Angeles’ Subsidized and Transitional Employment Demonstration, on employment, earnings, education, training, and public benefit receipt relative to no subsidized job opportunities. The authors also investigated related impacts, the profiles of which are available [here]. The authors used regression methods in a randomized controlled trial study to examine the impacts of participating in on-the-job training. The data sources included administrative wage records, subsidized employment payroll records, Temporary Assistance for Needy Families (TANF) benefit payment records, and survey data. The study found that on-the-job training had positive, statistically significant impacts on employment and earnings compared with the control condition of no subsidized job opportunities. There were mixed impacts on benefit receipt and negative impacts on earning a professional license or certification. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the on-the-job training program and not to other factors.","Los Angeles’ Subsidized and Transitional Employment Demonstration","Adult and Dislocated Worker programs Job search assistance and supportive services Other training and education","Low income",,"United States",2016,https://www.mdrc.org/publication/testing-two-subsidized-employment-approaches-r…,"Employment and Training Review Protocol" "Enhanced vocational rehabilitation for veterans with mild traumatic brain injury and mental illness: Pilot study","O’Connor, M. K., Mueller, L., Kwon, E., Drebing, C. E., O’Connor, A. A., Semiatin, A., & Daley, R. (2016). Enhanced vocational rehabilitation for veterans with mild traumatic brain injury and mental illness: Pilot study. Journal of Rehabilitation Research & Development, 53(3), 307-319.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of an embedded cognitive rehabilitation intervention on employment and earnings. The study was a randomized controlled trial with the authors using administrative data. The study found no statistically significant relationships between an embedded cognitive rehabilitation intervention and employment and earnings after one year. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to an embedded cognitive rehabilitation intervention; other factors are likely to have contributed.","the cognitive rehabilitation intervention","Substance abuse recovery Vocational rehabilitation","Other barriers, Male, Veteran or military",,"United States",2016,http://search.proquest.com/openview/ee479834dd8beedff02771b00bc95e0a/1?pq-origs…,"Employment and Training Review Protocol" "Vincennes University Logistics Training and Education Center: Final evaluation report.","Belville, J. Schoeph, K., Leger, R., Jenner, E., Maddox, D., Lass, K., & Beres, S. (2016). Vincennes University Logistics Training and Education Center: Final evaluation report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/9769/VU%20LTEC%20Final%20Evaluation%20Report%20TAACCCT%20R2_Sept%202016.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Vincennes University Logistics Training and Education Center (LTEC) initiative on employment and earnings outcomes. This summary focuses on the estimated outcomes of the Fork Lift Essentials (FLE) program. The authors used an interrupted time series design to examine employment and earnings outcomes associated with the completion of LTEC's FLE program. The study found FLE program completion was significantly associated with improved earnings in the first quarter immediately following program completion. The quality of causal evidence presented in this report is low because the authors did not observe outcomes for multiple periods after the intervention. This means we are not confident that the estimated effects are attributable to the Logistics Training and Education Center initiative; other factors are likely to have contributed.","Logistics Training and Education Center (LTEC) Initiative","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9679/VU%20LTEC%20Final%2…,"Community College Review Protocol" "To work for yourself, for others, or not at all? How disability benefits affect the employment decisions of older veterans","Coile, C., Duggan, M., & Guo, A. (2016). To work for yourself, for others, or not at all? How disability benefits affect the employment decisions of older veterans. Unpublished manuscript.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study examined the impact of a 2001 expansion in eligibility for Disability Compensation (DC) to cover type 2 diabetes for Vietnam-era veterans on their employment, earnings, and public benefit receipt. The authors estimated statistical models to compare outcomes among male Vietnam-era veterans who did and did not serve with on the ground using data from the Veterans Supplement to the Current Population Survey from 1995 to 2015. The study found that the expansion of eligibility for DC was associated with greater receipt of DC, a lower likelihood of working for others, and a greater likelihood of self-employment by on-the-ground veterans compared with those veterans who did not serve on the ground. The study did not find a relationship between the expansion and earnings. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to changes in eligibility for DC and not to other factors.",DC,"Other wages and benefits Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://www.nber.org/papers/w23006,"Employment and Training Review Protocol" "Spousal labor market effects from government health insurance: Evidence from a veterans affairs expansion.","Boyle, M. A. & Lahey, J. N. (2016). Spousal labor market effects from government health insurance: Evidence from a veterans affairs expansion. Journal of Health Economics, Elsevier, 45(C), 63-76.","Older Workers, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study examined the impact of the expansion of health insurance for veterans through the U.S. Department of Veterans Affairs (VA) in the mid-1990s (as a result of the implementation of the Veteran’s Health Care Eligibility Reform Act) on the employment and earnings of non-covered spouses. The authors used a statistical model and data from the Census Bureau’s March Current Population Survey and the Health and Retirement Study to compare the employment and earnings of wives of male veterans with wives of non-veterans of the same ages before and after the expansion of health insurance for veterans through the VA. The study found no statistically significant associations between the expansion of health insurance for veterans and the employment of their wives and mixed evidence on associations between the expansion of health insurance for veterans and the earnings of their wives. The quality of causal evidence presented in this report is moderate for the employment outcomes because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to the expansion of health insurance for veterans through the VA, but other factors might also have contributed. The quality of causal evidence presented in this report is low for earnings outcomes because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion of health insurance for veterans through the VA; other factors are likely to have contributed.","Veteran Health Insurance Expansion","Health Older workers' programs Veterans' reemployment","Adult, Older worker, Veteran or military",,"United States",2016,,"Older Workers, Veterans Review Protocol" "Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program","Glosser, A., Barden, B., Williams, S., & Anderson, C. (2016). Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program. (OPRE Report 2016-77). Washington, DC: Office of Planning, Research, and Evaluation. [Contrast 1: Paid work experience versus comparison]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of a paid work experience program, part of Los Angeles’ Subsidized and Transitional Employment Demonstration, on employment, earnings, education, training, and public benefit receipt relative to no subsidized job opportunities. The authors also investigated related impacts, the profiles of which are available [here]. The authors used regression methods in a randomized controlled trial study to examine the impacts of participating in paid work experience. The data sources included administrative wage records, subsidized employment payroll records, Temporary Assistance for Needy Families (TANF) benefit payment records, and survey data. The study found that the paid work experience program had positive, statistically significant impacts on employment, earnings, and benefit receipt compared with the control condition of no subsidized job opportunities. Paid work experience had no impacts on education and training outcomes. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the paid work experience program and not to other factors.","Los Angeles’ Subsidized and Transitional Employment Demonstration","Adult and Dislocated Worker programs Job search assistance and supportive services Other training and education","Low income",,"United States",2016,https://www.mdrc.org/publication/testing-two-subsidized-employment-approaches-r…,"Employment and Training Review Protocol" "Do conditional cash transfers reduce child labor?: Evidence from the Philippines","Galang, I. M. (2016). Do conditional cash transfers reduce child labor?: Evidence from the Philippines (Unpublished Master's thesis). Tokyo, Japan: The University of Tokyo.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of the study was to examine the impact of the Philippines conditional cash transfer program, Pantawid Pamilyang Pilipino Program (4Ps), on child labor and school attendance. The authors used a nonexperimental design to compare the outcomes of children ages 12-14 that received the conditional cash transfers with those who did not, based on data from the 2011 Annual Poverty Indicator Survey. Using several demographic characteristics, they created a matched comparison group of families who did not receive the benefit to assess the effectiveness of the cash transfer program. The study found that receipt of the cash transfer was significantly associated with increased school attendance but not significantly associated with child labor. The quality of causal evidence presented in this report is low because the authors did not account for the outcomes of schooling and work at baseline. This means we are not confident that the estimated effects are attributable to the 4Ps program; other factors are likely to have contributed.","Pantawid Pamilyang Pilipino Program (4Ps)","Child labor","Other, Low income",,International,2016,http://www.pp.u-tokyo.ac.jp/wp-content/uploads/2016/02/1.31-MB-1.pdf,"Child Labor Review Protocol" "The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program","Autor, D. H., Duggan, M., Greenberg, K., & Lyle, D. S. (2016). The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program. American Economic Journal: Applied Economics, 8(3), 31-68. http://www.aeaweb.org/aej-applied/ [Impact of eligibility expansion]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study examined the impact of a 2001 expansion in eligibility for Disability Compensation (DC) to type 2 diabetes for Vietnam-era veterans on labor force participation, earnings, and receipt of public benefits. The authors also examined the impact of receiving DC benefits and amount on labor force participation and earnings; see profile here . The authors estimated statistical models to compare outcomes for Vietnam-era Army veterans who served with “boots on the ground” (BOG) with those who served “not on the ground” (NOG) Veterans who did not fight directly in the conflict, from before and after the implementation of the type 2 diabetes policy change in 2001. The authors used administrative data from the U.S. Army Office of Economic and Manpower Analysis, the U.S. Department of Veterans Affairs (VA), and the Social Security Administration. The implementation of expanded DC coverage and benefits in 2001 resulted in reductions in labor force participation and earnings among impacted veterans as well as increases in the receipt of disability benefits. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion in eligibility for Disability Compensation (DC); other factors are likely to have contributed to the findings.",DC,"Disability insurance Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://pubs.aeaweb.org/doi/pdf/10.1257/app.20150158,"Employment and Training Review Protocol" "Do recent reforms of Mexico's nationwide cash transfer program affect children's work and school attendance?","Universita di Roma Tor Vergata, Centre for Economic and International Studies, the International Labour Organisation, UNICEF and the World Bank. (2016). Do recent reforms of Mexico's nationwide cash transfer program affect children's work and school attendance? Understanding Children's Work (UCW) Working Paper Series. Rome, Italy: UCW.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Unfavorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the reformed Prospera cash transfer program on child work and education outcomes. The study used a randomized controlled trial to compare outcomes between children in households that received the cash transfer with children in households that did not in two urban areas in Mexico. Outcomes were compared between the treatment and control groups at six months and 18 months post-intervention. The study found that for households with eligible primary and secondary school children, the rates of children working and working for pay were significantly higher in the treatment group than in the control group at six months post-intervention. The study also found that for households with only eligible secondary school children, the rates of school attendance were significantly lower among children in the treatment group than the control group at 18 months post-intervention. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to the reformed Prospera cash transfer program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2016,,"Child Labor Review Protocol" "Evidence from a randomized evaluation of the household welfare impacts of conditional and unconditional cash transfers given to mothers or fathers","Akresh, R., de Walque, D., & Kazianga, H. (2016). Evidence from a randomized evaluation of the household welfare impacts of conditional and unconditional cash transfers given to mothers or fathers (Development Research Group Human Development and Public Services Team Working Paper 7730). Washington, DC: World Bank.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impacts of conditional and unconditional cash transfers on child labor and education outcomes.   The study was a randomized controlled trial conducted in a rural province of Burkina Faso. Using household surveys and administrative data records, the authors conducted statistical models to examine differences in outcomes between the groups over two years. The study found that at the two-year follow-up, rates of school enrollment and attendance were significantly higher for children in households receiving conditional cash transfers relative to the control group. At the two-year follow-up, child labor rates were significantly higher when cash transfers (conditional or unconditional) were given to fathers rather than to mothers. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Nahouri Cash Transfer Pilot Project, and not to other factors.  ",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Child, Low income",,International,2016,https://documents1.worldbank.org/curated/en/944741467047531083/pdf/WPS7730.pdf,"Child Labor Review Protocol" "Encouraging evidence on a sector-focused advancement strategy","Hendra, R., Greenberg, D. H., Hamilton, G., Oppenheim, A. Pennington, A. Schaberg, K., and Tessler, B. L. (2016). Encouraging evidence on a sector-focused advancement strategy. New York: MDRC. [Madison Strategies Group]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the WorkAdvance sectoral training program at the Madison Strategies Group site on employment, earnings, education, and training from 2011 to 2015. The authors investigated similar research questions with three other sites, the profiles of which are available here. The study used a randomized controlled trial design to compare the treatment group, which was able to access the WorkAdvance program at the Madison Strategies Group site, and the control group, which was not eligible for WorkAdvance services but could access other services in the community. The authors collected data from two sources: a follow-up survey and unemployment insurance (UI) wage and employment data. Using survey data, the authors found that those in the treatment group were significantly more likely to complete education or training compared with those in the control group. The authors found no statistically significant impacts of the program on employment or earnings from either the UI data or survey data. The quality of the causal evidence is high for employment and earnings outcomes based on UI data because those outcomes were based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects for those outcomes are attributable to the WorkAdvance program at the Madison Strategies Group site and not to other factors. For education and training outcomes from the follow-up survey, the quality of the causal evidence is moderate because those outcomes were based on a randomized controlled trial in which many people did not complete the follow-up survey, but the authors did account for existing differences between the treatment and control groups. This means we are somewhat confident that the estimated effects for those outcomes are attributable to the WorkAdvance program at the Madison Strategies Group site, but other factors might also have contributed.","the WorkAdvance sectoral training program","Work based and other occupational training","Low income",,"United States",2016,https://files.eric.ed.gov/fulltext/ED568395.pdf,"Employment and Training Review Protocol" "Life after service for post-9/11 veterans: Data, methods, and policy impacts","Gardner, J. S. (2016). Life after service for post-9/11 veterans: Data, methods, and policy impacts (Doctoral dissertation). Retrieved from https://digitalscholarship.unlv.edu/cgi/viewcontent.cgi?article=3867&context=thesesdissertations",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the effects of the 2008 GI Bill on post-9/11 veterans’ employment and educational attainment. The study used a statistical model to compare outcomes between veterans from before and after the passing of the 2008 GI Bill using data from the American Community Survey. The study found statistically significant relationships between the 2008 GI Bill and the education or employment of veterans. The quality of causal evidence presented in this report is low because the author did not observe outcomes for multiple demonstrations of the intervention. This means we are not confident that the estimated effects are attributable to the post-9/11 GI Bill; other factors are likely to have contributed.","the 2008 GI Bill","Veterans' reemployment Other training and education","Veteran or military",,"United States",2016,https://digitalscholarship.unlv.edu/cgi/viewcontent.cgi?article=3867&context=th…,"Employment and Training Review Protocol" "Labor intensive public works and children's activities: The case of Malawi","de Hoop, J., & Rosati, F. C. (2016). Labor intensive public works and children's activities: The case of Malawi. Retrieved from http://ucw-project.org/attachment/11052017285Public_work_malawi_dehoop_rosati.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of Malawai’s Labour Intensive Public Works program (LIPW) on children’s school participation and involvement in paid work and household chores. The study was a randomized controlled trial where eligible villages were randomly assigned to a control group that would not receive any benefits, or to one of four treatment groups that differed by agricultural season (lean vs. post-harvest) and payment schedule (lump sum vs. installments). Using household survey data, the authors analyzed the impact of the treatment conditions on school attendance and work 3-months, 6-months, and 12-months after implementation. The study found that post-harvest program participation was significantly related to higher rates of paid work 6 months after participation for boys, whereas lean harvest program participation was significantly related to higher rates of household chores for girls one year after treatment. Lean program participation was also significantly related to school attendance 6 months after participation for all children. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Malawi’s LIPW program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2016,http://ucw-project.org/attachment/11052017285Public_work_malawi_dehoop_rosati.p…,"Child Labor Review Protocol" "The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program","Autor, D. H., Duggan, M., Greenberg, K., & Lyle, D. S. (2016). The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program. American Economic Journal: Applied Economics, 8(3), 31-68. http://www.aeaweb.org/aej-applied/ [Impact of DC enrollment and benefit amount]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined the impact of Disability Compensation (DC) enrollment and benefit amount on labor force participation and earnings. The authors also examined the impact of the expansion of eligibility for DC benefits on labor force participation and earnings; see profile here . The authors estimated statistical models to compare outcomes for Vietnam-era Army veterans who served with “boots on the ground” (BOG) with those who served “not on the ground” (NOG) who did not fight directly in the conflict, before and after the implementation of the Type 2 diabetes policy change in 2001. The authors used administrative data from the U.S. Army Office of Economic and Manpower Analysis, the U.S. Department of Veterans Affairs (VA), and the Social Security Administration (SSA). The increases in DC enrollment due to the expansion in eligibility for DC in 2001 were associated with reductions in labor force participation and earnings. Increases in DC benefit amounts due to the expansion in eligibility were also associated with reductions in labor force participation. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to DC enrollment and benefit amounts, but other factors might also have contributed to the findings.",DC,"Disability insurance Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://pubs.aeaweb.org/doi/pdf/10.1257/app.20150158,"Employment and Training Review Protocol" "Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe","Fenton, R., Nyamukapa, C., Gregson, S., Robertson, L., Mushati, P., Thomas, R., & Eaton, J.W. (2016). Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe. Psychology, Health & Medicine, 21(8), 909-917.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of conditional cash transfers (CCT) and unconditional cash transfers (UCT) on child labor and schooling outcomes. This summary focuses on the comparison between the CCT group and the UCT group. The study was a randomized controlled trial in which households were randomly assigned to receive one of two cash transfers (conditional or unconditional) or to participate in the control group that did not receive a cash transfer. Using household survey data, the authors analyzed the impact of the treatment conditions on child labor and schooling outcomes a year after the intervention began. The study found that the CCT group had significantly higher levels of school attendance than the UCT group for the least poor households. However, the study found no statistically significant difference in the number of hours worked between the two groups. The quality of causal evidence presented in this report is low because it based on a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before receiving the cash transfers. This means we are not confident that the estimated effects are attributable to the cash transfers; other factors are likely to have contributed.","Cash Transfer Program","Child labor","Other barriers, Other, Low income",,International,2016,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5044770/,"Child Labor Review Protocol" "Four-year degree and employment findings from a randomized controlled trial of a one-year performance-based scholarship program in Ohio","Mayer, A. K., Patel, R., & Gutierrez, M. (2016). Four-year degree and employment findings from a randomized controlled trial of a one-year performance-based scholarship program in Ohio. Journal of Research on Educational Effectiveness, 9(3), 283-306. doi: 10.1080/19345747.2015.1086914","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of a performance-based scholarship program on community college students’ credit accumulation, degree/certificate completion, employment, and earnings. The study was a randomized controlled trial conducted at three community colleges in Ohio. Eligible students were randomly assigned to either the treatment or control groups. The authors conducted statistical models to examine differences in outcomes between the groups four years post-random assignment. The study found that when compared to the control group, students in the performance-based scholarship program had significantly higher credit accumulation and rates of degree/ certificate completion. The quality of causal evidence presented in this study is high because it is based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to the one-year performance-based scholarship program and not to other factors.","the performance-based scholarship program","Community college education and other classroom training","Adult, Low income",,"United States",2016,https://doi.org/10.1080/19345747.2015.1086914,"Community College Review Protocol" "From the battlefield to the schoolyard: The short-term impact of the Post-9/11 GI Bill","Barr , A. (2015). From the battlefield to the schoolyard: The short-term impact of the Post-9/11 GI Bill. Journal of Human Resources, 50(3), 580-613.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of Post-9/11 GI Bill on veterans’ college enrollment. The author investigated similar research questions in another study, the profile of which is available [here]. The study used regression methods in a nonexperimental analysis, drawing on data from the American Community Survey and Current Population Survey. The study compared college enrollment of veterans eligible for the GI Bill benefits with civilians, who were not eligible to receive the benefits. The study found that veterans eligible for the Post-9/11 GI Bill benefits were significantly more likely to enroll in college after the introduction of the bill compared with civilians. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Post-9/11 GI Bill; other factors are likely to have contributed.","Post-9/11 GI Bill","Other training and education","Veteran or military",,"United States",2015,http://jhr.uwpress.org/content/50/3/580.full.pdf,"Employment and Training Review Protocol" "Doubling graduation rates: Three-year effects of CUNY’s Accelerated Study in Associate Programs (ASAP) for developmental education students","Scrivener, S., Weiss, M., Ratledge, A., Rudd, T., Sommo, C., & Fresques, H. (2015). Doubling graduation rates: Three-year effects of CUNY’s Accelerated Study in Associate Programs (ASAP) for developmental education students. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effectiveness of the Accelerated Study in Associate Programs (ASAP) at three City University of New York (CUNY) schools on credits earned and completion of a college degree. At the three participating schools, eligible students were randomly assigned to the treatment group, which could participate in ASAP, or to the control group, which could not participate in ASAP but could access existing services at the schools. The primary data sources were a baseline information form, the CUNY Institutional Research Database, and National Student Clearinghouse records. The study found that students in the ASAP group were significantly more likely to earn a degree from any college in the fourth, fifth, and sixth semesters following random assignment, compared with the control group. In addition, during the sixth semester following random assignment, the treatment group was significantly more likely to be enrolled in a four-year college than the control group. Over the six semesters of the study, students in the treatment group earned significantly more total credits, college-level credits, and developmental credits than the control group. The quality of causal evidence presented in this report is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to ASAP and not to other factors.","the Accelerated Study in Associate Program (ASAP)","Community college education and other classroom training","Adult, Low income",,"United States",2015,http://www.mdrc.org/sites/default/files/doubling_graduation_rates_fr.pdf,"Community College Review Protocol" "Fighting for Education: Financial Aid and Non-traditional Students","Barr, A. C. (2015). Fighting for Education: Financial Aid and Non-traditional Students. (Doctoral dissertation). Online Archive of University of Virginia Scholarship. https://doi.org/10.18130/V35Z6S.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of Post-9/11 GI Bill on veterans’ college enrollment and degree attainment. The author investigated similar research questions in another study, the profile of which is available [here]. The study used regression methods in a nonexperimental analysis, drawing on data from Defense Manpower Data Center, the National Student Clearinghouse, and the Integrated Postsecondary Education Data System. The author used two statistical models to compare veterans eligible for the benefits with veterans who were not eligible. The study found a statistically significant positive relationship between the Post-9/11 GI Bill benefits and education for veterans who were eligible for the benefits and likely to take them up compared with veterans who were not eligible for the benefits and with veterans who were eligible but unlikely to take up the benefits. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Post-9/11 GI Bill; other factors are likely to have contributed.","Post-9/11 GI Bill","Other training and education","Veteran or military",,"United States",2015,https://doi.org/10.18130/V35Z6S,"Employment and Training Review Protocol" "How do educational transfers affect child labor supply and expenditures? Evidence from Indonesia of impact and flypaper effects","De Silva, I., & Sumarto, S. (2015). How do educational transfers affect child labor supply and expenditures? Evidence from Indonesia of impact and flypaper effects. Oxford Development Studies, 43(4), 483-507. https://doi.org/10.1080/13600818.2015.1032232","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor","Summary: The objective of this study was to assess the impact of the Cash Transfer for the Poor Students Programme/Bantuan Siswa Miskin (BSM) program on child labor. The study used a nonexperimental design to assess the program’s impact. With data collected from a national survey, the authors compared the proportion of children that participated in work between those who received financial educational support in the past year before taking the survey, and matched comparison groups of children who had not received financial educational study. The study found that receipt of educational assistance was significantly associated with lower rates of child labor. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to BSM; other factors are likely to have contributed.","Cash Transfer for the Poor Students Programme/Bantuan Siswa Miskin (BSM)","Child labor","Other, Low income",,International,2015,https://mpra.ub.uni-muenchen.de/66767/,"Child Labor Review Protocol" "Veterans’ labor force participation: What role does the VA’s disability compensation program play?","Coile, C., Duggan, M., & Guo, A. (2015). Veterans’ labor force participation: What role does the VA’s disability compensation program play? American Economic Review, 105(5), 131-136.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of expanding eligibility for veterans’ Disability Compensation (DC) in 2001 and 2010 on labor force participation. The authors conducted a nonexperimental analysis to compare veteran and non-veteran labor force participation over time using the March Current Population Survey data from 1980 to 2014. The study found that veteran labor force participation was generally lower than that of non-veterans in the same 10-year age range during the periods following eligibility expansions. The quality of causal evidence presented in this report is low because there could be differences in external conditions that affected the treatment group and not the comparison group. This means we are not confident that the estimated effects are attributable to veterans’ receipt of DC; other factors are likely to have contributed to the findings.",DC,"Other wages and benefits Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2015,https://www.aeaweb.org/articles?id=10.1257/aer.p20151062,"Employment and Training Review Protocol" "What factors contributed to changes in employment during and after the great recession?","Farooq, A., & Kugler, A. D. (2015). What factors contributed to changes in employment during and after the great recession? IZA Journal of Labor Policy, 4(3), 1-28.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: This study examined the impact of the Work Opportunity Tax Credit (WOTC) on employment for veterans with disabilities and unemployed veterans. The study used a nonexperimental design to examine the effects of the WOTC on employment, based on data from the Annual Social and Economic (ASEC) supplement of the Current Population Survey from 2003 to 2013. The study showed no statistically significant relationships between the WOTC and employment for veterans with disabilities or for unemployed veterans. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that any estimated effects are attributable to the WOTC; other factors likely contributed to the outcomes. However, the study did not show any statistically significant effects.","the Work Opportunity Tax Credit","Veterans' reemployment Work Opportunity Tax Credit (WOTC)","Disability, Veteran or military",,"United States",2015,https://link.springer.com/article/10.1186/s40173-014-0029-y,"Employment and Training Review Protocol" "Veterans Homelessness Prevention Demonstration evaluation: Final report","Cunningham, M. K., Biess, J., Emam, D., & Burt., M. R. (2015). Veterans Homelessness Prevention Demonstration evaluation: Final report. Washington, DC: Urban Institute.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Mixed impacts Public benefit receipt","Summary: The study examined the effect of the Veterans Homelessness Prevention Demonstration (VHPD) program on the employment, earnings, public benefit receipt, and education and training outcomes of veterans at risk of homelessness. The study uses a nonexperimental design to examine whether there were changes in veterans’ outcomes from before the program began to six months after the program ended using self-reported data directly from the veterans. The study found statistically significant positive relationships between the VHPD program and veterans’ employment and earnings six months after the program ended compared with before the program. The study found mixed relationships between the VHPD program and public benefit receipt: significantly fewer veterans in the study received several types of public benefits, such as Temporary Assistance for Needy Families (TANF) or the Supplemental Nutrition Assistance Program (SNAP). Significantly more veterans in the study, however, received Veterans Pension benefits after the program compared with before it. The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects are attributable to the VHPD program; other factors are likely to have contributed.","the Veterans Homelessness Prevention Demonstration (VHPD) program","Job search assistance and supportive services Other training and education","Low income, Veteran or military, Homeless",,"United States",2015,http://apps.urban.org/features/homeless-veterans/,"Employment and Training Review Protocol" "Evaluation of MoHealthWINS outcomes and impact","Cosgrove, J. J., Cosgrove, M. S., & Bragg, D. D. (2015). Evaluation of MoHealthWINS outcomes and impact. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/5125/SEPTEMBER%202015%20FINAL%20VERSION%20OF%20MHW%20OUTCOME%20IMPACT%20EVALUATION%20REPORT.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to assess the relationship between the MoHealthWINS program and education and employment outcomes. The study used a nonexperimental design, where the program participants were compared to a matched comparison group. Using college administrative data, state employment data, and employer data, the authors compared the program completion and employment rates between the treatment and comparison group. The study found a significant relationship between program participation and the likelihood to complete the program and be employed post-program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention or include sufficient control variables. This means we are not confident that the estimated effects are attributable to MoHealthWINS program; other factors are likely to have contributed.",MoHealthWINS,"Capacity building programs Community college education and other classroom training","Adult, Unemployed, Low-skilled, Veteran or military",,"United States",2015,https://www.skillscommons.org/bitstream/handle/taaccct/5125/SEPTEMBER%202015%20…,"Community College Review Protocol" "The effect of health reform on retirement.","Levy, H., Buchmueller, T. C., & Nikpay, S. (2015). The effect of health reform on retirement (Research Paper 329). Ann Arbor, MI: Michigan Retirement Research Center.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the expansion of Medicaid to low-income adults in 2014 on retirement rates of workers ages 55 to 64. The authors used a nonexperimental analysis to compare those who lived in an expansion state to those who lived in other states. The study used data from the monthly Current Population Survey from January 2005 through July 2015. The study found no statistically significant relationships between Medicaid expansion and retirement. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion of Medicaid; other factors are likely to have contributed.","Medicaid expansion","Health insurance Older workers' programs","Adult, Older worker, Low income",,"United States",2015,https://deepblue.lib.umich.edu/handle/2027.42/116062,"Employment and Training Review Protocol" "Exploring the differential impact of public interventions on indigenous people: Lessons from Mexico's conditional cash transfer program","Lopez-Calva, L. F., & Patrinos, H. A. (2015). Exploring the differential impact of public interventions on indigenous people: Lessons from Mexico's conditional cash transfer program. Journal of Human Development and Capabilities, 16(3), 452-467. doi:10.1080/19452829.2015.1072378","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of the study was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on child labor and school attendance for children ages 8 to 17 across 3 indigenous, Spanish-speaking, and bilingual households. Using survey data from a cluster randomized controlled trial, the authors analyzed the average program impact of the PROGRESA/Oportunidades program on indigenous households versus individuals who were bilingual or Spanish-speaking. The study found that the PROGRESA/Oportunidades program was significantly related to a decrease in child labor and an increase in school attendance for indigenous speaking children. The quality of causal evidence presented in this study is low because it was based on a randomized controlled trial with unknown attrition and the authors did not control for the required variables. As a result, we are not confident that the estimated effects are attributable to PROGRESA/Oportunidades; other factors are likely to have contributed.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,"International, Rural",2015,https://www.researchgate.net/publication/242464961_Exploring_the_Differential_I…,"Child Labor Review Protocol" "A little help may be no help at all: Child labor and scholarships in Nepal","Datt, G., & Uhe, L. (2014). A little help may be no help at all: Child labor and scholarships in Nepal. Monash Business School Department of Economics Discussion Paper, 50/14.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Mixed impacts Child labor","Summary: The study’s objective was to examine the impact of school scholarships in Nepal on child labor. Using the 2010 Nepal Living Standards Survey III, the authors used a nonexperimental design to compare the labor outcomes of scholarship recipients to those who did not receive scholarships. The study found that scholarship receipt was significantly related to an increase in extended-economic work for girls. However, higher scholarship values were significantly related to a reduction in the number of hours spent in economic and extended-economic work for girls. The quality of causal evidence presented in the study is low because the authors did not control for pre-intervention outcomes. This means we are not confident that the estimated effects are attributable to the scholarship program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2014,https://www.monash.edu/business/economics/research/publications/2014/5014childl…,"Child Labor Review Protocol" "CogSMART compensatory cognitive training for traumatic brain injury: Effects over 1 year","Twamley, E. W., Thomas, K. R., Gregory, A. M., Jak, A. J., Bondi, M. W., Delias, D. C., & Lohr, J. B. (2014). CogSMART compensatory cognitive training for traumatic brain injury: Effects over 1 year. Journal of Head Trauma Rehabilitation, 30(6), 391-401.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) and enhanced supported employment (ESE) on employment, earnings, and health outcomes. The authors conducted a randomized controlled trial that randomly assigned participants to the intervention and comparison groups. Employment data came from weekly reports on job attainment, hours worked, and wages earned. The study did not find any statistically significant relationships between CogSMART plus ESE and employment, earnings, or health outcomes. The quality of causal evidence presented in this report is low because the study had a confounding factor. Specifically, one interventionist delivered CogSMART plus ESE and another interventionist implemented services to the comparison group, which makes it impossible to separate the effect of CogSMART plus ESE from the effect of the individual interventionists. This means we are not confident that the estimated effects are attributable to CogSMART plus ESE; other factors are likely to have contributed to the findings.","CogSMART Plus ESE","Health Job search assistance and supportive services Supported employment or other employment supports Veterans' reemployment","Disability, Veteran or military",,"United States",2014,https://doi.org/10.1097/HTR.0000000000000076,"Employment and Training Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute Technical Report No. 13-029). [WIA Youth]","Hollenbeck, K., & Huang, W-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute Technical Report No. 13-029). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. Retrieved from W.E. Upjohn Institute for Employment Research website: http://dx.doi.org/10.17848/tr13-029. [WIA Youth]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Youth Program, held on community and technical college campuses, on the employment rate and earnings of low-income youth in Washington State. The authors used a nonexperimental method to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment and earnings between those who took part in the WIA Youth program relative to those who registered for services at the Labor Exchange (Employment Services). The study found that, compared with those who registered for services at the Labor Exchange, WIA Youth participants had higher employment and earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Youth Program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Youth Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Youth programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Youth, Low-skilled, Low income",,"United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica…,"Employment and Training Review Protocol" "Work outcomes after benefits counseling among veterans applying for service connection for a psychiatric condition","Rosen, M. I., Ablondi, K., Black, A. C., Mueller, L., Serowik, K. L., Martino, S., . . . Rosenheck, R. A. (2014). Work outcomes after benefits counseling among veterans applying for service connection for a psychiatric condition. Psychiatric Services, 65(12), 1426-1432.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of benefits counseling on employment and earnings. The study was a randomized controlled trial and collected self-reported data directly from veterans. At one month, the study did not find a statistically significant relationship between benefits counseling and employment. Looking at data across all time periods, the study found a statistically significant relationship between benefits counseling and the number of days of paid work. For the outcomes at one month, the quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to benefits counseling and not to other factors. However, the study did not find statistically significant effects at one month. For all other outcomes, the quality of causal evidence presented in this study is low because the study had high attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to benefits counseling; other factors are likely to have contributed.","Benefits Counseling","Health Veterans' reemployment","Veteran or military",,"United States",2014,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4713007/,"Employment and Training Review Protocol" "The (surprising) efficacy of academic and behavioral intervention with disadvantaged youth: Results from a randomized experiment in Chicago","Cook, P., Dodge, K., Farkas, G., Fryer, R., Guryan, J., Ludwig, J. Mayer, S., Pollack, H., & Steinberg, L. (2014). The (surprising) efficacy of academic and behavioral intervention with disadvantaged youth: Results from a randomized experiment in Chicago. Cambridge, MA: National Bureau of Economic Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Becoming a Man (BAM) program on youths’ academic outcomes, including grade point averages (GPAs), course failures, and achievement test scores. BAM provided mentoring and socialization activities to enhance cognitive, decision-making, and social skills. The study was a randomized controlled trial conducted in one high school on the south side of Chicago, Illinois, in 2012–2013. Eligible youth were randomly assigned to one of three conditions: (1) a treatment group receiving BAM only, in which individuals could participate in the BAM program; (2) a treatment group receiving BAM plus tutoring, in which individuals could participate in the BAM program and received daily tutoring in math; or (3) the control group, which could not participate in BAM but could access existing services at their school. The authors estimated regressions to measure the impact of the BAM program on academic achievement using administrative data from Chicago Public Schools. The study found that youth offered the opportunity to participate in BAM—either with or without supplemental tutoring—had significantly higher math achievement test scores than youth in the control group. In addition, youth in the BAM program group and the BAM plus tutoring program group had significantly higher math GPAs than members of the control group. The quality of causal evidence presented in this report is high for the GPA and course failures outcomes because it was based on a randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to BAM and/or the tutoring sessions, and not to other factors. The quality of causal evidence is moderate for the math and reading achievement outcomes because these outcomes had high attrition but the authors included sufficient controls in their analysis. This means we are somewhat confident that the estimated effects are attributable to BAM and/or tutoring sessions, but other factors might also have contributed.","Becoming a Man","Mentoring Other training and education Youth programs Behavioral Interventions","Youth, Male, Low-skilled, Low income",,"United States, Urban",2014,http://www.nber.org/papers/w19862.pdf,"Opportunities for Youth Review Protocol" "Work-related CBT versus vocational services as usual for unemployed persons with social anxiety disorder: A randomized controlled pilot trial.","Himle, J., Bybee, D., Steinberger, E., Laviolette, W., Weaver, A., Vlnka, S., Golenberg, Z., Levine, D., Heimberg, R., & O’Donnell, L. (2014). Work-related CBT versus vocational services as usual for unemployed persons with social anxiety disorder: A randomized controlled pilot trial. Behaviour Research and Therapy, 63, 169-176.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of group-based, work-related cognitive-behavioral therapy (CBT) on work-related outcomes of unemployed, homeless people diagnosed with social anxiety disorder. The study was a randomized controlled trial. The authors randomly assigned eligible participants to either a treatment group, which received work-related CBT and vocational services, or to a control group, which received vocational services alone. Trained independent evaluators collected the self-reported data used in the study. The study found that participants assigned to the treatment group had higher job search self-efficacy and activity than participants assigned to the control group. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects on employment are attributable to work-based CBT; other factors are likely to have contributed.",,"Job search assistance and supportive services","Unemployed, Low income, Homeless",,"United States",2014,,"Employment and Training Review Protocol" "Gasper, J., & Henderson, K. (2014). Sector-focused career centers evaluation: Effects on employment and earnings after one year.","Gasper, J., & Henderson, K. (2014). Sector-focused career centers evaluation: Effects on employment and earnings after one year. New York: New York City Center for Economic Opportunity. Retrieved from http://www.nyc.gov/html/ceo/downloads/pdf/CEO-Sector_Based_Approaches_Evaluation_Report-2014_final.pdf.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of sector-focused career centers in New York City on employment and earnings. The authors estimated the effect of sector-focused career centers by comparing employment and earnings outcomes captured in New York State unemployment insurance data among participants in New York City sector-focused career centers against the outcomes for individuals served by New York City career centers without a specific sector focus who were deemed similar in terms of initial characteristics to the sector-focused group. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the authors did not demonstrate that the groups were similar at baseline or make statistical adjustments for differences between the two groups in the analyses. This means we are not confident that the estimated effects are attributable to sector-focused career centers; other factors are likely to have contributed.","New York City Sector-focused Career Centers","Job search assistance and supportive services Other employment and reemployment","Low income","Manufacturing, Health care and social assistance, Transportation and warehousing","Urban, United States",2014,http://www.nyc.gov/html/ceo/downloads/pdf/CEO-Sector_Based_Approaches_Evaluatio…,"Employment and Training Review Protocol" "The impact of earnings disregards on the behavior of low‐income families.","Matsudaira, J. D., & Blank, R. M. (2014). The impact of earnings disregards on the behavior of low‐income families. Journal of Policy Analysis and Management, 33(1), 7-35.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of earnings disregards—the amount of earned income that is not counted when calculating whether someone is eligible for public benefits—for welfare assistance on the employment, earnings, and public assistance receipt of low-skilled single mothers. The study used a difference-in-differences approach to compare the outcomes of women before and after changes in the disregard rate within their state relative to women in other states over the same time period. The study did not find any statistically significant effects of earnings disregards on the outcomes of interest. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design; this is the highest causal evidence rating possible for a nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to earnings disregards, but other factors might also have contributed. However, the study did not find statistically significant effects.","Earnings Disregards for Welfare Assistance","Other employment and reemployment","Female, Parent, Low income",,"United States",2014,,"Employment and Training Review Protocol" "You get what you pay for: Schooling incentives and child labor","Edmonds, E. V., & Shrestha, M. (2014). You get what you pay for: Schooling incentives and child labor. Journal of Development Economics, 111, 196-211. doi:10.1016/j.deveco.2014.09.005","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of financial schooling incentives (a scholarship and stipend) on school attendance and carpet weaving (a worst form of child labor) among youth ages 10-16 in Nepal. This summary focuses on the comparison between the scholarship treatment group and the stipend treatment group. The study was a randomized controlled trial (RCT) in which children were randomly assigned to receive one of two schooling incentives (a scholarship or stipend) or to participate in the control group that did not receive any incentives. Using administrative data from schools and survey data, the authors analyzed the impact of the treatment conditions on school attendance and child labor at the end of the school year and 16 months after the intervention ended. The study found that the stipend treatment group had significantly higher levels of school attendance than the scholarship treatment group at the end of the school year. However, the study found no statistically significant difference in rates of involvement in weaving carpets or the hours worked between the two groups. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Schooling Incentives Project, and not to other factors.","Schooling Incentives Project","Child labor Tuition assistance","Other, Low income",,International,2014,https://www.sciencedirect.com/science/article/pii/S0304387814001047,"Child Labor Review Protocol" "Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) for veterans with traumatic brain injury: Pilot randomized controlled trial","Twamley, E., Jak, A., Delis, D., Bondi, M., & Lohr, J. (2014). Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) for veterans with traumatic brain injury: Pilot randomized controlled trial. Journal of Rehabilitation Research and Development, 51(1), 59-70.","Disability Employment Policy, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of adding Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) to standard supported employment programming for veterans with a history of traumatic brain injury (TBI) and persistent related postconcussive symptoms. Veterans were referred to the program and completed a series of baseline neurocognitive and neuropsychological assessments to determine eligibility. Eligible veterans were randomly assigned to either the CogSMART treatment group, which received supported employment, enhanced by CogSMART sessions, or to a control group that did not participate in CogSMART sessions. The study found that veterans in the CogSMART group demonstrated statistically significant reductions in postconcussive symptoms and improvements in prospective memory functioning. Although a higher proportion of the treatment group entered competitive employment within 14 weeks of starting the program—50 percent compared to 26 percent in the control group—the difference was not statistically significant. The quality of causal evidence presented in this study is low because it is a randomized controlled trial with high or unknown attrition and no control variables included in the analysis. This means we are not confident that the estimated effects are attributable to CogSMART. Other factors are likely to have contributed.","Cognitive Symptom Management and Rehabilitation Therapy","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2014,,"Disability Employment Policy, Veterans Review Protocol" "Sustained gains: Year Up’s continued impacts on young adults’ earnings","Roder, A., & Elliott, M. (2014). Sustained gains: Year Up’s continued impacts on young adults’ earnings. New York: Economic Mobility Corporation.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of the Year Up program on employment, earnings, and education outcomes. Year Up is an intensive, yearlong program that provides training and internships in financial operations and information technology for young adults from low-income urban communities. About 200 students in three cities were randomly assigned to the treatment group, which was eligible to participate in Year Up beginning in September 2007, or the control group, which was not eligible to participate in Year Up in 2007. Members of the control group were eligible to reapply to the program after 10 months, and many did. The authors compared the outcomes of the treatment and control groups using data collected through telephone interviews with participants four years after random assignment. The authors reported a positive, statistically significant impact of Year Up on earnings measured three years after random assignment, but these impacts did not extend to the fourth year after random assignment. Cumulatively, treatment group members earned $13,645 more than the control group over years 2 through 4 after random assignment, and they were more likely to have been employed in a field targeted by the program. The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to Year Up, although other factors could also have contributed.","Year Up","Basic skills Other training and education Work based and other occupational training Youth programs","Youth, Black or African American, Hispanic of any race, Low-skilled, Low income",,"United States, Urban",2014,http://economicmobilitycorp.org/uploads/sustained-gains-economic-mobility-corp…,"Opportunities for Youth Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). [WIA Adult]","Hollenbeck, K., & Huang, W.-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). Retrieved from W.E. Upjohn Institute for Employment Research website: http://dx.doi.org/10.17848/tr13-029 [WIA Adult]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program on the employment rate, earnings, and benefit receipt of low-income adults in Washington State. The authors used a nonexperimental method to compare short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and Unemployment Insurance benefits between those who took part in the WIA Adult Program with those who registered for services at the Labor Exchange Employment Services. The study found that, compared with those who registered for services at the Labor Exchange, participants in the WIA Adult Program had higher employment rates and average quarterly earnings and lower receipt of unemployment insurance benefits. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Adult Program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Adult Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Low-skilled, Low income",,"United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica…,"Employment and Training Review Protocol" "The impact of the Kenya CT-OVC programme on children's activities","de Hoop, J., Ranzani, M., Rosati, F. C. (2014). The impact of the Kenya CT-OVC programme on children’s activities (Working Paper). Retrieved from http://www.ucw-project.org/attachment/The_impact_of_the_Kenya_CT-OVC20140423_144552.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of the Kenya Cash Transfer for Orphans and Vulnerable Children Program on child labor and school participation. The study used a randomized controlled trial to assess the intervention. Child outcomes were compared between the treatment and control group households, using data from follow-up surveys administered two years after the start of the intervention. The study found a 5 percent reduction in the proportion of children in the treatment group who were working in unpaid labor or conducting household chores compared to the control group. The quality of causal evidence presented in this report is low because randomization was compromised and the authors did not ensure that the groups being compared were similar before the intervention. This means that if there were significant effects, we would not be confident that they were attributable to Kenya CT-OVC; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2014,http://www.ucw-project.org/attachment/The_impact_of_the_Kenya_CT-OVC20140423_14…,"Child Labor Review Protocol" "You get what you pay for: Schooling incentives and child labor","Edmonds, E. V., & Shrestha, M. (2014). You get what you pay for: Schooling incentives and child labor. Journal of Development Economics, 111, 196-211. doi:10.1016/j.jdeveco.2014.09.005","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of financial schooling incentives (a scholarship and stipend) on school attendance and carpet weaving (a worst form of child labor) among youth ages 10-16 in Nepal. This summary focuses on the comparison between the stipend treatment group and the control group. The study was a randomized controlled trial (RCT) in which children were randomly assigned to receive one of two schooling incentives (a scholarship or stipend) or to participate in the control group that did not receive any incentives. Using administrative data from schools and survey data, the authors analyzed the impact of the treatment conditions on school attendance and child labor at the end of the school year and 16 months after the intervention ended. The study found that the stipend treatment group had significantly higher levels of school attendance and lower rates of carpet weaving than the control group at the end of the school year. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Schooling Incentives Project Stipend, and not to other factors.","Schooling Incentives Project","Child labor Tuition assistance","Other, Low income",,International,2014,https://www.sciencedirect.com/science/article/pii/S0304387814001047,"Child Labor Review Protocol" "Evaluation of the NYC Business Solutions Customized Training Program","Hamilton, J., & Chen, E. (2014). Evaluation of the NYC Business Solutions Customized Training Program. New York: New York City Center for Economic Opportunity.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the New York City Business Solutions Customized Training program on earnings. The authors used administrative data on training and payroll to compare the earnings of participants in the customized training program to those of three different matched comparison groups. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the authors did not show that the groups were similar before the intervention, and they did not sufficiently account for potential differences in their analysis. This means we are not confident that the estimated effects are attributable to the customized training program; other factors are likely to have contributed.","the New York City Business Solutions Customized Training Program","Other training and education Work based and other occupational training","Low income",,"United States",2014,http://www.nyc.gov/html/ceo/downloads/pdf/CEO_CT_final_report_2014.pdf,"Employment and Training Review Protocol" "You get what you pay for: Schooling incentives and child labor","Edmonds, E. V., & Shrestha, M. (2014). You get what you pay for: Schooling incentives and child labor. Journal of Development Economics, 111, 196-211. doi:10.1016/j.jdeveco.2014.09.005","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of financial schooling incentives (a scholarship and stipend) on school attendance and carpet weaving (a worst form of child labor) among youth ages 10-16 in Nepal. This summary focuses on the comparison between the scholarship treatment group and the control group. The study was a randomized controlled trial (RCT) in which children were randomly assigned to receive one of two schooling incentives (a scholarship or stipend) or to participate in the control group that did not receive any incentives. Using administrative data from schools and survey data, the authors analyzed the impact of the treatment conditions on school attendance and child labor at the end of the school year and 16 months after the intervention ended. The study found no statistically significant difference in rates of involvement in weaving carpets or the hours worked between the scholarship treatment and control groups. There was also no statistically significant difference in rates of school attendance or school enrollment between the two groups. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Schooling Incentives Project Scholarship, and not to other factors. However, the study did not find statistically significant effects.","Schooling Incentives Project","Child labor Tuition assistance","Other, Low income",,International,2014,https://www.sciencedirect.com/science/article/pii/S0304387814001047,"Child Labor Review Protocol" "The impact of Brazil's Bolsa Familia Program on school attendance, age-grade discrepancy, and child labor","de Lima Amaral, E. F., Goncalves, G. Q., & Weiss, C. (2014). The impact of Brazil's Bolsa Familia Program on school attendance, age-grade discrepancy, and child labor. Journal of Social Science for Policy Implications, 2, 101-125","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Unfavorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of the Brazilian conditional cash transfer program, Bolsa Familia, on child labor and school enrollment. The authors used a nonexperimental design to compare the outcomes of children ages 7 to 14 who resided in families who met the income threshold for the Bolsa Familia program compared with those who had not, based on data from the 2010 Brazilian Census. The study found that receipt of the cash transfer was significantly associated with an increase in school enrollment. However, receipt of the transfer was also associated with significantly higher rates of work. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to Bolsa Familia program; other factors are likely to have contributed.","Bolsa Familia","Child labor","Other, Low income",,International,2014,,"Child Labor Review Protocol" "A random assignment evaluation of learning communities at Kingsborough Community College: Seven years later","Weiss, M. J., Mayer, A., Cullinan, D., Ratledge, A., Sommo, C., & Diamond, J. (2014). A random assignment evaluation of learning communities at Kingsborough Community College: Seven years later. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study aimed to examine the impact of the Opening Doors learning communities at Kingsborough Community College in New York on progress toward completing a degree, actual completion of a degree, employment, and earnings. It measured impacts seven years after random assignment. Students in the Opening Doors learning communities took three linked courses during one semester and received tutoring and case management services. The study was a randomized controlled trial. Eligible students were randomly assigned to either the treatment group, which was offered the opportunity to participate in one of the learning communities, or the control group, which was not allowed to enroll in a learning community. The primary data sources were a baseline survey on the background characteristics of students, student transcripts, degree attainment information from the National Student Clearinghouse, and employment and earnings information from Unemployment Insurance (UI) wage records in New York. The study found no significant impacts on the number of credits earned or attempted, completion of any college degree, or employment or earnings in the seventh year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects would be attributable to the learning communities, and not to other factors.","Opening Doors Learning Communities at Kingsborough Community College","Community college education and other classroom training","Adult, Low income",,"United States",2014,http://www.mdrc.org/sites/default/files/A_Random_Assignment_Evaluation_of_Learn…,"Community College Review Protocol" "Cash transfer programme, productive activities and labour supply: Evidence from a randomised experiment in Kenya","Asfaw, S., Davis, B., Dewbre, J., Handa, S., & Winters, P. (2014). Cash transfer programme, productive activities and labour supply: Evidence from a randomised experiment in Kenya. The Journal of Development Studies, 50(8), 1172-1196. doi: 10.1080/00220388.2014.919383","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of a monthly cash transfer program on household food consumption, resources, and work, including child labor. The study used survey data from a clustered randomized controlled trial. Households from seven districts in Kenya were randomly assigned to either the treatment or control group. Within those locations, 20 percent of the poorest households were recruited if they had one or more children 17 years old or younger who was an orphan or had a chronically ill parent or caregiver.  The study found a statistically significant relationship between the program and a reduction in farm labor for children ages 10-15. This relationship was significant for boys but not for girls. There was also a statistically significant relationship between the program and an increase in school enrollment for children ages 12-18. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition and the authors did not demonstrate that groups were similar at baseline. This means we are not confident that the estimated effects are attributable to the Kenya Cash Transfer Programme for Orphans and Vulnerable Children; other factors are likely to have contributed.","Kenya Cash Transfer Programme for Orphans and Vulnerable Children (CT-OVC) Experiment","Child labor","Other barriers, Other, Low income",,International,2014,,"Child Labor Review Protocol" "Does federally-funded job training work? Nonexperimental estimates of WIA training impacts using longitudinal data on workers and firms","Andersson, F., Holzer, H. J., Lane, J. I., Rosenblum, D., & Smith, J. (2013). Does federally-funded job training work? Nonexperimental estimates of WIA training impacts using longitudinal data on workers and firms (Discussion paper no. 7621). Bonn, Germany: IZA. [Adult Program ONLY]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Employment-Mod/high-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) adult program’s training services on the employment and earnings of low-income adults. The authors investigated similar research questions in another study, whose profile can be found [here]. The other study examined the effects of WIA’s dislocated worker program’s training services on the employment and earnings of dislocated workers. The authors used statistical analysis to compare the earnings and employment outcomes of WIA-registered low-income adults who received training services to the outcomes of those who were registered in WIA, but did not receive training services. The study found that employment was significantly lower for the treatment group than it was for the comparison group in the first quarters after WIA registration (Quarters 1 and 2 in State A and Quarters 1–4 in State B), but later became and generally stayed significantly higher in Quarters 6 through 12 in both states. Total earnings in the third year after WIA registration were significantly higher for the treatment group than the comparison group. People in the treatment group earned $1,257 and $1,703 more than those in the comparison group in State A and State B, respectively. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design; this is the highest causal evidence rating possible for a nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WIA adult program training services, but other factors might also have contributed to the effects.","Workforce Investment Act (WIA) Program Training Services","Adult and Dislocated Worker programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Unemployed, Low income",,"United States",2013,https://www.nber.org/papers/w19446.pdf,"Employment and Training Review Protocol" "A randomized controlled trial to improve health among women receiving welfare in the U.S.: The relationship between employment outcomes and the economic recession.","Kneipp, S., Kairalla, J. & Sheely, A. (2013). A randomized controlled trial to improve health among women receiving welfare in the U.S.: The relationship between employment outcomes and the economic recession. Social Science & Medicine, 80, 130-140.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Public Health Nurse (PHN) intervention on employment outcomes. The authors conducted a randomized controlled trial. Researchers used self-reported job beginning and ending dates to determine whether a participant was employed over a nine-month period. The authors found no statistically significant effect of PHN on any employment in the first nine months after random assignment. The quality of causal evidence presented in this study is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to PHN and not to other factors. However, the study did not find statistically significant effects.","Public Health Nurse Intervention","Other employment and reemployment","Disability, Low income",,"United States",2013,,"Employment and Training Review Protocol" "Stimulating opportunity: An evaluation of ARRA-funded subsidized employment programs","Roder, A. & Elliott, M. (2013). Stimulating opportunity: An evaluation of ARRA-funded subsidized employment programs. New York: Economic Mobility Corporation. Retrieved from http://economicmobilitycorp.org/uploads/stimulating-opportunity-full-report.pdf.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of subsidized employment programs in five states on the employment and earnings outcomes of unemployed people. The focus of this profile is Florida’s Back to Work program, which placed participants in partially subsidized jobs in which employers were expected to cover 5 to 20 percent of the employee’s wages for up to one year. For the evaluation of the Florida Back to Work program, the authors used administrative wage data to compare the employment and earnings outcomes of program participants with the employment and earnings outcomes of a similar group of people who were not placed in subsidized employment. The study found that participants in Florida Back to Work were more likely to be employed and earned $1,921 more in the year following the program than those in the comparison group. The quality of causal evidence presented in this report is low because the authors did not include sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the subsidized employment program. Other factors are likely to have contributed.","Florida's Back to Work Program","Other employment and reemployment","Unemployed, Low income",,"United States",2013,http://economicmobilitycorp.org/uploads/stimulating-opportunity-full-report.pdf,"Employment and Training Review Protocol" "Impact evaluation: Combating worst forms of child labor by reinforcing policy response and promoting sustainable livelihoods and educational opportunities in Egypt, 2011-2012","ICF International. (2013). Impact evaluation: Combating worst forms of child labor by reinforcing policy response and promoting sustainable livelihoods and educational opportunities in Egypt, 2011-2012. Calverton, MD: Author.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of Combating Worst Forms of Child Labor by Reinforcing Policy Response and Promoting Sustainable Livelihoods and Educational Opportunities in Egypt (CWCLP) on schooling and work for children ages 6 to 11 (at the time of the baseline survey). Using survey data from a randomized controlled trial, the authors analyzed the impact of the CWCLP program on schooling and work after approximately 12-16 months of implementation (the timing of implementation varied). When compared to control group children, the study found that CWCLP participating children spent significantly less time in economic activities and unpaid household services and significantly more time in school-related activities. Participating children also had significantly higher school enrollment and significantly higher school attendance than children in the control group. The quality of causal evidence presented in this report is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the CWCLP program, but other factors might also have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2013,,"Child Labor Review Protocol" "Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up","LePage, J. P., Lewis, A. A., Washington, E. L., Davis, B., & Glasgow, A. (2013). Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up. Journal of Rehabilitation Research & Development, 50(2), 183-191. doi:10.1682/JRRD.2011.09.0163 [Self-study vs. VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study examined the impact of self-study of the About Face (AF) manual on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who had access to the AF manual to study on their own (self-study program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected monthly data from participants in person or over the phone. The study showed no significant differences in competitive employment between the self-study condition (11.9 percent hired) and the VERC-only condition (16.7 percent hired). The study also showed no significant differences in average months employed (0.16 months for the self-study condition and 0.35 months for the VERC-only condition). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF manual; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://www.rehab.research.va.gov/JOUR/2013/502/pdf/lepage502.pdf,"Reentry, Veterans Review Protocol" "Enhancing GED instruction to prepare students for college and careers: Early success in LaGuardia Community College’s Bridge to Health and Business program","Martin, V. & Broadus, J. (2013). Enhancing GED instruction to prepare students for college and careers: Early success in LaGuardia Community College’s Bridge to Health and Business program. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of LaGuardia Community College’s general educational development (GED) Bridge to Health and Business program on GED completion, college enrollment, and college persistence. The study was a randomized controlled trial. Eligible students (369 in total) were randomly assigned to either the treatment group, which could participate in the GED Bridge program, or the control group, which could not participate in the GED Bridge program but could participate in a traditional GED preparation course. The study found that, compared with students randomly assigned to the traditional GED Prep course, those offered enrollment in the GED Bridge to Health and Business program were more likely to complete the GED course, pass the GED exam within a year, enroll in a City University of New York (CUNY) community college by the end of the study, and reenroll for a second semester at a CUNY community college by the end of the study. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the GED Bridge to Health and Business program, and not to other factors.","the GED Bridge to Health and Business Program","Basic skills Community college education and other classroom training","Adult, Other barriers, Low income",,"United States",2013,http://www.mdrc.org/sites/default/files/Enhancing_GED_Instruction_brief.pdf,"Community College Review Protocol" "Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up","LePage, J. P., Lewis, A. A., Washington, E. L., Davis, B., & Glasgow, A. (2013). Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up. Journal of Rehabilitation Research & Development, 50(2), 183-191. doi:10.1682/JRRD.2011.09.0163 [Full About Face vs. VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of About Face (AF) vocational classes on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of veterans: (1) those who participated in the AF classes (full AF program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected monthly data from participants in person or over the phone. The study revealed significantly higher competitive employment in the full AF program (40.7 percent hired) than in the VERC-only condition (16.7 percent hired). The study also showed that veterans in the full AF program worked more months on average than veterans in the VERC-only condition (1.37 months vs. 0.35 months). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://www.rehab.research.va.gov/JOUR/2013/502/pdf/lepage502.pdf,"Reentry, Veterans Review Protocol" "Initial impacts of the Ticket to Work program for young new Social Security disability awardees: Estimates based on randomly assigned mail months","Stapleton, D., Mamun, A., & Page, J. (2013). Initial impacts of the Ticket to Work program for young new Social Security disability awardees: Estimates based on randomly assigned mail months. Princeton, NJ: Mathematica Policy Research, Center for Studying Disability Policy.","Disability Employment Policy, Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: This study examined impacts of the Ticket to Work (TTW) program, a work incentive program for Social Security disability recipients, on achieving Social Security Disability Insurance (SSDI) return-to-work earnings benchmarks and SSDI benefit suspension or termination for work. The study sample included SSDI recipients who entered the rolls from July 1999 to October 2003, were ages 18 to 39, and were not concurrently receiving Supplemental Security Income (SSI). The authors used data from the Ticket Research File (TRF), a Social Security administrative data file, for the analysis. The study found that TTW did not have a statistically significant impact on SSDI return to work earnings benchmarks or the number of SSDI recipients who had their benefits suspended or terminated due to work. The quality of the causal evidence presented in this report is moderate, the highest possible rating for a nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to TTW, but other factors might have contributed.","Ticket to Work","Disability insurance Supplemental security income (SSI) Supported employment or other employment supports","Disability, Low income",,"United States",2013,http://www.mathematica-mpr.com/~/media/publications/pdfs/disability/ttw_initial…,"Disability Employment Policy, Low-Income Adults Review Protocol" "Can post-employment services combined with financial incentives improve employment retention for welfare recipients?","Dorsett, R., Hendra, R., Robins, P. K., & Williams, S. (2013). Can post-employment services combined with financial incentives improve employment retention for welfare recipients? Evidence from the Texas Employment Retention and Advancement evaluation. (No. 1413-13). Madison, WI: Institute for Research on Poverty.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Texas Employment Retention and Advancement (ERA) program on employment entry and retention in two sites: Corpus Christi and Fort Worth. The authors conducted a non-experimental study using data originally collected for a randomized controlled trial. They analyzed survey data and state Unemployment Insurance records to estimate the effects of the ERA program on employment entry and retention. The study found a positive and statistically significant relationship between participation in the ERA program and the likelihood of transitioning into employment and between ERA and employment retention at the Corpus Christi site. The quality of causal evidence presented in this report is low because the authors did not account for differences in wages or employment between the ERA and comparison groups before the beginning of the ERA program. This means we are not confident that the estimated effects are attributable to the Texas ERA program; other factors are likely to have contributed.","Texas Employment Retention and Advancement (ERA)","Job search assistance and supportive services Other wages and benefits","Unemployed, Low income, Female",,"United States",2013,http://www.niesr.ac.uk/sites/default/files/publications/dp409_0.pdf,"Review Protocol" "Evaluating the impact of dental care on housing intervention program outcomes among homeless veterans","Nunez, E., Gibson, G., Jones, J. A., & Schinka, J. A. (2013). Evaluating the impact of dental care on housing intervention program outcomes among homeless veterans. American Journal of Public Health, 103(S2), S368-S373.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of the Veterans Affairs (VA) Homeless Veteran Dental Program on employment outcomes of homeless veterans. The authors used VA administrative data to compare the employment outcomes of veterans who received dental care through the VA Homeless Veteran Dental Program with those of veterans who did not. The study found that participating in the VA Homeless Veteran Dental Program was associated with greater employment and financial stability. The quality of causal evidence presented in this report is low because the authors did not ensure the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the VA Homeless Veteran Dental Program; other factors are likely to have contributed.","VA Homeless Veteran Dental Program","Health Veterans' reemployment","Veteran or military, Homeless",,"United States",2013,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3969121/,"Employment and Training Review Protocol" "Does Pantawid foster dependence or encourage work? Evidence from a randomized experiment","Orbeta, A., & Paqueo, V. (2013). Does Pantawid foster dependence or encourage work? Evidence from a randomized experiment. Philippine institute for Development Studies. Retrieved from http://nap.psa.gov.ph/ncs/12thncs/papers/INVITED/IPS-09%20Social%20Protection%20Statistics/IPS-09_2%20Impact_of_4Ps_on_Labor_Market_Outcomes%20AO-VP-new.pdf  ","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor","Summary: The study’s objective was to examine the impact of a conditional cash transfer program, called Pantawid Pamilya Pilipino Program (Pantawid) on child work participation and hours children worked per week. Using household survey data from a randomized controlled trial, the authors analyzed the impact of the Pantawid program on child work participation almost 24-months after implementation. The study found that there were no significant relationships between participation in the program and child work participation or hours worked per week. The quality of causal evidence presented in this report is low because it based on a randomized controlled trial with unknown attrition and the authors did not control for pre-existing differences. This means we are not confident that the estimated effects are attributable to Pantawid; other factors are likely to have contributed. However, the study did not find statistically significant effects.","Pantawid Pamilya Pilipino Program","Child labor","Other, Low income",,International,2013,http://nap.psa.gov.ph/ncs/12thncs/papers/INVITED/IPS-09%20Social%20Protection%2…,"Child Labor Review Protocol" "Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up","LePage, J. P., Lewis, A. A., Washington, E. L., Davis, B., & Glasgow, A. (2013). Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up. Journal of Rehabilitation Research & Development, 50(2), 183-191. doi:10.1682/JRRD.2011.09.0163 [Full About Face vs. self-study]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: This study examined the impact of About Face (AF) vocational classes on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who participated in the AF classes (full AF program) and (2) those who did not take the classes but had access to the AF manual to study on their own (self-study program). The authors collected monthly data from participants in person or over the phone. The study revealed significantly higher competitive employment among justice-involved veterans in the full AF program (40.7 percent hired) than in the self-study condition (11.9 percent hired). The study also showed that justice-involved veterans in the full AF program worked more months on average than justice-involved veterans in the self-study condition (1.37 months vs. 0.16 months). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://www.rehab.research.va.gov/JOUR/2013/502/pdf/lepage502.pdf,"Reentry, Veterans Review Protocol" "Conditional cash transfers in New York City: The continuing story of the Opportunity NYC—Family Rewards demonstration","Riccio, J., Dechausay, N., Miller, C., Nunez, S., Verma, N., & Yang E. (2013). Conditional cash transfers in New York City: The continuing story of the Opportunity NYC—Family Rewards demonstration. New York, NY: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employer benefits receipt-Mod/high-Favorable impacts Employer benefits receipt Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Family Rewards, an experimental privately funded conditional cash transfer program in New York City, on earnings, employment, public benefits receipt, and education. The study was based on a randomized controlled trial and estimated the effect of the Family Rewards program on low-income families. The authors used New York City and New York State administrative data to compare average outcomes between families offered access to the program and families excluded from the program, after adjusting for chance initial differences between the groups. The authors found that, on average, the Family Rewards program decreased the likelihood of ever being employed at an Unemployment Insurance (UI)-covered job in the first year by 2 percentage points, but increased monthly earnings by $353 and decreased the share of families receiving income from Supplemental Security Income (SSI) or disability benefits by 3.9 percentage points. The authors also found that parents in the Family Rewards program group were 4.2 percentage points more likely to have achieved any trade license training certification. The quality of causal evidence presented in this report is high for most outcomes because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Family Rewards program, and not to other factors. However, some outcomes in the study receive a moderate or low causal evidence rating, meaning that we are less confident that the estimated effects are attributable to the Family Rewards program; other factors may have contributed.","the Family Rewards Program","Other employment and reemployment Other training and education","Low income, Parent",,"United States, Urban",2013,http://files.eric.ed.gov/fulltext/ED545453.pdf,"Employment and Training Review Protocol" "The impact of veterans’ preference on the composition and quality of the federal civil service","Lewis, G. B. (2013). The impact of veterans’ preference on the composition and quality of the federal civil service. Journal of Public Administration Research & Theory, 23(2), 247-265.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to examine the impact the federal practice of giving preference to veterans during the federal employment hiring process had on federal employment. The author used a nonexperimental design to compare federal employment outcomes of veterans and non-veterans, drawing on data from the 1990 and 2000 U.S. Census, the American Community Surveys from 2006–2009, and federal employee personnel records from the Central Personnel Data File from 2000–2009. The study found that the odds of federal employment compared to private-sector employment were 2.7 to 4.4 times greater for veterans than non-veterans. The study also found that veterans advanced slower than non-veterans after 5 and 10 years of employment. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the veterans’ preference policy in federal hiring; other factors are likely to have contributed.","Veterans’ Preference Policy in Hiring for Federal Government Positions","Veterans' reemployment","Veteran or military",,"United States",2013,https://academic.oup.com/jpart/article-abstract/23/2/247/1000440,"Employment and Training Review Protocol" "Veterans Health Administration vocational services for Operation Iraqi Freedom/Operation Enduring Freedom Veterans with mental health conditions","Twamley, E., Baker, D., Norman, S., Pittman, J., Lohr, J., & Resnick, S. (2013). Veterans Health Administration vocational services for Operation Iraqi Freedom/Operation Enduring Freedom Veterans with mental health conditions. Journal of Rehabilitation Research & Development, 50(5), 663-670.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: This study examined the impact of supported employment encounters on competitive employment for Operation Iraqi Freedom/Operation Enduring Freedom (OIF/OEF) veterans with mental health conditions. The study used statistical tests to examine differences between groups of OIF/OEF veterans with specified mental health conditions who had at least one supported employment encounter versus those who did not. The data for this study came from two nationwide Veterans Health Administration (VHA) databases for fiscal years 2008 and 2009. The study showed that having at least one supported employment encounter was associated with obtaining competitive employment. The quality of causal evidence presented in this report is low because the authors were not able to establish that the treatment and comparison groups were similar before the intervention. This means we are not confident that the estimated effects are attributable to VHA-supported employment encounters; other factors likely contributed to the effects.",,"Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://doi.org/10.1682/jrrd.2012.08.0137,"Employment and Training Review Protocol" "Preventing youth violence and dropout: A randomized field experiment (No. w19014)","Heller, S., Pollack, H. A., Ander, R., & Ludwig, J. (2013). Preventing youth violence and dropout: A randomized field experiment (No. w19014). Cambridge, MA: National Bureau of Economic Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Becoming a Man program on arrest and educational outcomes. The study was a randomized controlled trial. Eligible male youth from 18 public schools in disadvantaged neighborhoods were screened for eligibility. The 2,740 who met requirements were randomly assigned to one of three treatment groups or a control group. The study found that being offered the opportunity to participate in the program reduced violent crime arrests during the program year and improved schooling outcomes in both the program and follow-up years. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Becoming a Man program, and not to other factors.","Becoming a Man","Other training and education Safety Youth programs Behavioral Interventions","Youth, Disconnected youth, Male, Low income",,"United States, Urban",2013,http://faculty.chicagobooth.edu/workshops/AppliedEcon/past/pdf/jensludwigyouthv…,"Opportunities for Youth Review Protocol" "Educational and child labour impacts of two food-for-education schemes: Evidence from a randomised trial in rural Burkina Faso","Kazianga, H., De Walque, D., & Alderman, H. (2012). Educational and child labour impacts of two food-for-education schemes: Evidence from a randomised trial in rural Burkina Faso. Journal of African Economies, 21(5), 723-760. doi:10.1093/jae/ejs010.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two food-for-education programs (a school meals program and a take home rations program) on education and labor outcomes for children. This summary focuses on the comparison between the take home rations treatment group and the control group. The study was a randomized controlled trial (RCT) conducted in low-income villages in northern rural Burkina Faso, West Africa. Villages were randomly assigned to one of two treatment groups or a control group. Survey data were collected from randomly selected households located close to the schools in the villages. Outcomes were analyzed using difference-in-differences models. The study found that the take home rations program significantly decreased productive labor for all children, with a larger decrease for girls than boys. For children enrolled in school at the time of the survey, the program significantly decreased productive labor for all children. The study also found that the take home rations program significantly increased school enrollment for all children. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the take home rations program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2012,https://doi.org/10.1093/jae/ejs010,"Child Labor Review Protocol" "From protection to production: Productive impacts of the Malawi Social Cash Transfer scheme","Covarrubias, K., Davis, B. & Winters, P. (2012). From protection to production: Productive impacts of the Malawi Social Cash Transfer scheme, Journal of Development Effectiveness, 4(1), 50-77.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of the Malawi Social Cash Transfer Scheme (SCTS) on household work activities, including child labor. The study used household survey data from a randomized controlled trial. Due to pre-existing baseline differences between the original treatment and control groups, the authors used a matched comparison group design to compare child schooling and labor outcomes between children in the treatment group and those in the control group. The study found that the SCTS program significantly decreased the proportion of children in paid domestic work outside of the household and the proportion of children pulled from school to work for food or money. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Malawi Social Cash Transfer Scheme (SCTS); however, other factors might have also contributed.","Malawi Social Cash Transfer Scheme","Child labor","Other, Low income",,International,2012,http://www.fao.org/fileadmin/user_upload/p2p/Publications/MalawiSCT_ProductiveI…,"Child Labor Review Protocol" "What strategies work for the hard-to-employ? Final results of the Hard-to-Employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. [NYC PRIDE]","Butler, D., Alson, J., Bloom, D., Deitch, V., Hill, A., Hsueh, J., Jacobs, E., Kim, S., McRoberts, R., & Redcross, C. (2012). What strategies work for the hard-to-employ? Final results of the Hard-to-Employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. (OPRE Report 2012-08). Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [NYC PRIDE]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Personal Roads to Individual Development and Employment (PRIDE) program on employment, earnings, and public assistance receipt. The study was a randomized controlled trial. The authors estimated the impact of PRIDE by comparing the outcomes of the treatment and control groups four years after random assignment using data from public assistance records and Unemployment Insurance wage records. The study found that those assigned to the PRIDE group were more likely to be employed and received less in cash assistance in the four years following random assignment than those in the control group. The quality of causal evidence presented in this report is low because the study had a shift in the probability of assignment and did not sufficiently demonstrate that the treatment and control groups were similar. This means we are not confident that the estimated effects are attributable to PRIDE; other factors are likely to have contributed.","the Personal Roads to Individual Development and Employment (PRIDE) Program","Other employment and reemployment Unemployment Insurance","Low income",,"United States",2012,http://www.acf.hhs.gov/sites/default/files/opre/strategies_work.pdf,"Employment and Training Review Protocol" "Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study","Ottomanelli, L., Goetz, L. L., Suris, A., McGeough, C., Sinnott, P. L., Toscano, R., … Thomas, F. P. (2012). Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study. Archives of Physical Medicine and Rehabilitation, 93(5), 740-747.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study aimed to examine the impact of supported employment on the employment outcomes of veterans with spinal cord injuries. The study included a randomized controlled trial and collected self-reported data directly from veterans and chart review data from the spinal cord injury centers in six Veterans Affairs Medical Centers (VAMCs) to obtain demographic information. The study found statistically significant positive impacts on employment as a result of supported employment compared to treatment as usual. The quality of causal evidence presented in the report is high because it used a well-implemented experimental design. This means that we are confident that the estimated effects are attributable to supported employment and not to other factors.","Individual Placement and Support (IPS) model of supported employment","Veterans' reemployment","Disability, Veteran or military",,"United States",2012,https://doi.org/10.1016/j.apmr.2012.01.002,"Employment and Training Review Protocol" "What strategies work for the hard-to-employ? Final results of the hard-to-employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. [NYC SACM]","Butler, D., Alson, J., Bloom, D., Deitch, V., Hill, A., Hsueh, J., Jacobs, E., Kim, S., McRoberts, R., & Redcross, C. (2012). What strategies work for the hard-to-employ? Final results of the hard-to-employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. (OPRE Report 2012-08.) Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [NYC SACM]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Substance Abuse Case Management (SACM) program on employment, earnings, and public assistance receipt after two years. The authors attempted to implement a randomized controlled trial, but they used a process that resulted in nonrandom assignment. The study estimated impacts by comparing the regression-adjusted outcomes of the treatment and control groups, using data collected from New York City public assistance records and Unemployment Insurance wage records for New York State. The study found no statistically significant relationships between SACM and employment, earnings, or public assistance receipt. The quality of causal evidence presented in this report is low because the assignment mechanism was nonrandom and the authors did not demonstrate that the treatment and control groups were similar. This means we would not be confident that any estimated effects would be attributable to the Substance Abuse Case Management program; other factors are likely to have contributed. However, the study did not find statistically siginificant effects.","the Substance Abuse Case Management (SACM) Program","Other employment and reemployment Substance abuse recovery","Low income",,"United States, Urban",2012,http://www.acf.hhs.gov/sites/default/files/opre/strategies_work.pdf,"Employment and Training Review Protocol" "Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study","Ottomanelli, L., Goetz, L. L., Suris, A., McGeough, C., Sinnott, P. L., Toscano, R., … Thomas, F. P. (2012). Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study. Archives of Physical Medicine and Rehabilitation, 93(5), 740-747. [CONTRAST 1: Non-experimental study]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of supported employment on the employment outcomes for veterans with spinal cord injuries. The authors used statistical comparisons in a non-experimental analysis to estimate the relationship between supported employment services and employment, drawing on self-reported data for employment information and chart review data from the spinal cord injury centers in six Veterans Affairs Medical Centers to obtain demographic information . The study found statistically significant positive relationships between supported employment and veterans’ employment outcomes compared to treatment as usual. The quality of causal evidence presented in the report is low because there are preexisting differences between the intervention and comparison groups. This means we are not confident that the estimated effects are attributable to supported employment; other factors are likely to have contributed.","Individual Placement and Support (IPS) model of supported employment","Veterans' reemployment","Disability, Veteran or military",,"United States",2012,https://doi.org/10.1016/j.apmr.2012.01.002,"Employment and Training Review Protocol" "Cash transfers and children's education and labour among Malawi's poor","Miller, C., & Tsoka, M. (2012). Cash transfers and children's education and labour among Malawi's poor. Development Policy Review, 30(4), 499-522. doi:10.1111/j.1467-7679.2012.00586.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to assess the effects of an unconditional cash transfer program, the Malawi Social Cash Transfer Scheme (SCTS), on child school participation and child labor. To assess the program’s effects, the authors used a randomized controlled trial in which villages were randomly assigned to the treatment group, which would receive the intervention, and the control group, which would not. Child labor was assessed using household surveys, and schooling outcomes were assessed using household surveys and school records. To understand the program’s impact on child school and work participation, the authors compared change in these outcomes over the first year of the program. The study found that children participating in the intervention had significantly greater decreases in school absences over one year, relative to the comparison group. In addition, over one year there was a significantly lower increase in the percent of both boys and girls who worked for income if they were in the intervention group rather than the comparison group. The quality of causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Malawi Social Cash Transfer Scheme, but other factors might also have contributed.","Malawi Social Cash Transfer Scheme","Child labor","Other barriers, Other, Low income",,International,2012,http://interactions.eldis.org/sites/interactions.eldis.org/files/database_sp/Ma…,"Child Labor Review Protocol" "Helping parents to motivate adolescents in mathematics and science: An experimental test of a utility-value intervention","Harackiewicz, J., Rozek, C., Hulleman, C., & Hyde, J. (2012). Helping parents to motivate adolescents in mathematics and science: An experimental test of a utility-value intervention. Psychological Science, 23(8), 899-906.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of providing information to parents about the importance of STEM on their children’s decisions to enroll in advanced high school math and science courses. The study was based on a subsample of 188 students and their parents included in the Wisconsin Study of Families and Work (WSFW) 1990–1991 birth cohort. Students were randomly assigned at the end of 9th grade to either a treatment group that was given brochures and access to a website that promoted STEM at the beginning of 10th grade, or to the control group, to which no materials were provided. The authors measured STEM course enrollment using students’ self-reported responses to the WSFW surveys and the students’ high school transcripts. The study found that students in the treatment group took significantly more math and science classes than students in the control group (predicted means of 8.31 versus 7.50 semesters), but outcomes did not vary by gender. The quality of causal evidence provided in this study is high. This means we are confident that the estimated effects are attributable to the information provided to parents about the importance of STEM, and not to other factors.",,"Science, Technology, Engineering, and Math (STEM) programs Youth programs","Adult, Parent",,"United States",2012,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "The effects of hiring tax credits on employment of disabled veterans","Heaton, P. (2012). The effects of hiring tax credits on employment of disabled veterans. Santa Monica, CA: Rand Corporation. Occasional Paper. Retrieved from https://www.rand.org/content/dam/rand/pubs/occassional papers/2012/RAND_OP 366.pdf.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of the 2007 Work Opportunity Tax Credit (WOTC) on the employment and earnings outcomes among veterans with disabilities. The authors used a nonexperimental approach and data from the American Community Survey Public Use Microdata Sample to compare the employment and earnings outcomes of veterans who were eligible for the WOTC with those of veterans who were not. The study found an approximately 2 percentage point increase in employment, a 0.58 hour increase in weekly hours, and a 40 percent increase in wage income among veterans with disabilities who were eligible for WOTC compared to veterans and nonveterans with other characteristics. The quality of causal evidence presented in this report is moderate because it relied on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WOTC program, but other factors might also have contributed to the findings.","Work Opportunity Tax Credit","Veterans' reemployment Work Opportunity Tax Credit (WOTC)","Disability, Veteran or military",,"United States",2012,https://www.rand.org/pubs/occasional_papers/OP366.html,"Employment and Training Review Protocol" "A study of the impact of a first-year experience initiative on first-year developmental education student success and persistence","Spencer, K. (2012). A study of the impact of a first-year experience initiative on first-year developmental education student success and persistence (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 3542047)","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Achieving the Dream learning community program on students’ retention and completion of developmental English and math courses at a community college in Michigan. The study used students’ records to compare outcomes of developmental education students who enrolled in the Achieving the Dream program to outcomes of those who took standard developmental courses. The study found no significant differences between the treatment and comparison groups in retention rates or in completion of English or math developmental courses. The quality of causal evidence presented in this study is low because the author did not include sufficient controls in the analysis. This means we are not confident that the estimated effects are attributable to Achieving the Dream. Other factors are likely to have contributed.","Achieving the Dream","Community college education and other classroom training","Adult, Low income, Other",,"United States",2012,,"Community College Review Protocol" "Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. [Academy for Career Advancement—Bridgeport]","Miller, C., Tessler B. L., & Van Dok, M. (2012). Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. New York: MDRC. [Academy for Career Advancement—Bridgeport]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of participation in the Academy for Career Advancement—Bridgeport, a Work Advancement and Support Center (WASC) on participants’ earnings, employment, educational attainment, and benefit receipt. This study was a randomized controlled trial and used administrative data from the Department of Labor, the Department of Social Services in Connecticut, and the National Student Clearinghouse to measure outcomes. The authors also used a 12-month follow-up survey with a random subset of participants to measure receipt of work supports and job characteristics. The study found that members of the treatment group were 3.9 percentage points less likely than the control group to have ever been employed in a Unemployment Insurance-covered job one year after the program began, and that members of the treatment group were 8.9 percentage points more likely to obtain a license or certificate one year after the program began than members of the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Academy for Career Advancement—Bridgeport and not to other factors.","Work Advancement and Support Center Demonstration, Academy for Career Advancement—Bridgeport","Job search assistance and supportive services Other employment and reemployment Other training and education Unemployment Insurance","Low income",,"United States",2012,http://www.mdrc.org/sites/default/files/full_627.pdf,"Employment and Training Review Protocol" "What can a multifaceted program do for community college students? Early results from an evaluation of Accelerated Study in Associate Programs (ASAP) for developmental education students","Scrivener, S., Weiss, M., & Sommo, C. (2012). What can a multifaceted program do for community college students? Early results from an evaluation of Accelerated Study in Associate Programs (ASAP) for developmental education students. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Accelerated Study in Associate Programs (ASAP) on full-time enrollment, credits attempted, and credits earned.  The study was a randomized controlled trial. Data sources included a baseline information form (BIF), which collected demographic and background characteristics and students’ records from the City University of New York (CUNY), including students’ transcripts and CUNY assessment test data. The study found that ASAP had significant impacts on full-time enrollment, credits attempted, and credits earned during the first, second, and third semesters following random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to ASAP, and not to other factors.","the Accelerated Study in Associate Program (ASAP)","Basic skills Community college education and other classroom training","Adult, Other barriers, Low income",,"United States",2012,http://files.eric.ed.gov/fulltext/ED532840.pdf,"Community College Review Protocol" "A randomized controlled trial of supported employment among veterans with posttraumatic stress disorder","Davis, L., Leon, A., Toscano, R., Drebing, C., Ward, L., Parker, P., ..., & Drake, R. (2012). A randomized controlled trial of supported employment among veterans with posttraumatic stress disorder. Psychiatric Services, 63(5), 464-470.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of individual placement and support (IPS) on competitive employment, earnings, and income for U.S. military veterans with posttraumatic stress disorder (PTSD). The study was a randomized controlled trial conducted at the Tuscaloosa Veterans Affairs (VA) Medical Center. Treatment group members received IPS services, whereas the control group received standard Vocational Rehabilitation Program (VRP) services. Data sources included patients’ records from the clinical research coordinator and daily logs completed by participants. The study found that IPS had positive impacts on competitive employment and gross income. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to IPS, and not other factors.","Individual Placement and Support and Vocational Rehabilitation Program","Vocational rehabilitation Veterans' reemployment Supported employment or other employment supports","Disability, Veteran or military",,"United States",2012,,"Disability Employment Policy Review Protocol" "Are conditional cash transfers effective in urban areas? Evidence from Mexico","Behrman, J. R., Gallardo-Garcıa, J., Parker, S. W., Todd, P. E., & Velez-Grajales, V. (2012). Are conditional cash transfers effective in urban areas? Evidence from Mexico. Education Economics, 20(3), 233-259.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on school enrollment and employment in paid activities for children ages 6 to 18 in urban areas. The study used a nonexperimental design to evaluate schooling and work outcomes from PROGRESA/Oportunidades program 1 and 2 years after implementation in urban areas. The study found that PROGRESA/Oportunidades was significantly related to reduced labor rates for boys who were 12-14 in the first and second year, and girls ages 15 to 18 in the first year. The program was also significantly related to an increase in school enrollment for boys and girls. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups were similar before program participation. This means we are not confident that the estimated effects are attributable to PROGRESA/Oportunidades; other factors are likely to have contributed.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,"International, Urban",2012,,"Child Labor Review Protocol" "Effect of the Mchinji Social Cash Transfer Pilot Scheme on children's schooling, work and health outcomes: A multilevel study using experimental data","Luseno, W. K. (2012). Effect of the Mchinji Social Cash Transfer Pilot Scheme on children's schooling, work and health outcomes: A multilevel study using experimental data (Doctoral dissertation). University of North Carolina at Chapel Hill, Chapel Hill, North Carolina. Retrieved from ProQuest Dissertations & Theses A&I (Accession No. 1240627043).","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Mixed impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The objective of the study was to examine the impact of the Mchinji Social Cash Transfer Pilot Scheme (SCTPS) on child labor and school outcomes.  The study was a randomized controlled trial conducted in the Mchinji district of Malawi. Within the district, eight villages were randomly assigned to either the treatment or control groups. Using survey data, the author compared the child labor and school outcomes of children ages 6-17 in households that received the cash transfer with those that did not receive the cash transfer. The study found that when compared to the control group, children in the Mchinji SCTPS program had significantly: 1) increased school enrollment; 2) fewer school absences; and 3) worked fewer hours outside of the home. An unexpected finding was that children participating in the Mchinji SCTPS also had significantly higher rates of domestic work when compared to children in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Mchinji Social Cash Transfer Pilot Scheme and not to other factors.","Mchinji Social Cash Transfer Pilot Scheme (SCTPS)","Child labor","Other barriers, Other, Low income",,International,2012,https://cdr.lib.unc.edu/indexablecontent/uuid:7052544c-df44-46b5-aa01-500991b72…,"Child Labor Review Protocol" "Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. [San Diego—EARN!]","Miller, C., Tessler, B. L., & Van Dok, M. (2012). Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. New York: MDRC. [San Diego—EARN!]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of participation in San Diego—EARN!, a Work Advancement and Support Center (WASC), on participants’ earnings, employment, educational attainment and benefit receipt. This study was a randomized controlled trial and used administrative data from the Employment Development Department in California, the San Diego County Health and Human Service Agency, and the National Student Clearinghouse to measure outcomes. The authors used a 12-month follow-up survey with a random subset of participants to measure receipt of work supports and job characteristics. The study found that members of the treatment group were 5.7 percentage points more likely than the control group to have ever received Food Stamps one year after the program began. The study also found that members of the treatment group received an average of $155 more in Food Stamps than the control group one year after the program began and an average of $320 more in Food Stamps than the control group three years after the program began. The quality of causal evidence presented in this report is high for outcomes measured with administrative data. This means we are confident that the estimated effects on these outcomes are attributable to San Diego—EARN! and not to other factors. However, outcomes measured with survey data receive a low causal evidence rating, meaning that we are not confident that the estimated effects are attributable to San Diego—EARN!; other factors may have contributed.","Work Advancement and Support Center Demonstration (WASC), San Diego—EARN!","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States, Urban",2012,http://www.mdrc.org/sites/default/files/full_627.pdf,"Employment and Training Review Protocol" "Poverty alleviation and child labor","Edmonds, E. V., & Schady, N. (2012). Poverty alleviation and child labor. American Economic Journal: Economic Policy, 4(4), 100-124.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of unconditional cash transfers on child labor, within the Bono de Desarrollo Humano (BDH) program. The study was a randomized controlled trial, where households within each local parish were randomly assigned to either the treatment group, who are eligible for the cash transfers, or the control group, who are not. The authors compared child labor and school enrollment outcomes, using a follow-up survey administered over a year after the program began. The study found that children were significantly less likely to participate in child labor and more likely to be enrolled in school if they were assigned to the treatment group than if they were assigned to the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Bono de Desarrollo Humano program, and not to other factors.","Bono de Desarrollo Humano (BDH) program","Child labor","Other, Low income",,International,2012,https://www.aeaweb.org/articles?id=10.1257/pol.4.4.100,"Child Labor Review Protocol" "Educational and child labour impacts of two food-for-education schemes: Evidence from a randomised trial in rural Burkina Faso","Kazianga, H., De Walque, D., & Alderman, H. (2012). Educational and child labour impacts of two food-for-education schemes: Evidence from a randomised trial in rural Burkina Faso. Journal of African Economies, 21(5), 723-760. doi:10.1093/jae/ejs010.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Compliance-Mod/high-Unfavorable impacts Compliance Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two food-for-education programs (a school meals program and a take home rations program) on education and labor outcomes for children. This summary focuses on the comparison between the school meals treatment group and the control group. The study was a randomized controlled trial (RCT) conducted in low-income villages in northern rural Burkina Faso, West Africa. Villages were randomly assigned to one of two treatment groups or a control group. Survey data were collected from randomly selected households located close to the schools in the villages. Outcomes were analyzed using difference-in-differences models. The study found that the school meals program significantly increased all labor (productive labor plus domestic labor/household chores) for boys enrolled at the time of survey. However, the study also found that the school meals program significantly increased school enrollment for all children. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the school meals program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2012,https://doi.org/10.1093/jae/ejs010,"Child Labor Review Protocol" "Enhanced Early Head Start with employment services: 42-month impacts from the Kansas and Missouri sites of the Enhanced Services for the Hard-to-Employ Demonstration and Research Project","Hsueh, J., and Farrell, M. (2012). Enhanced Early Head Start with employment services: 42-month impacts from the Kansas and Missouri sites of the Enhanced Services for the Hard-to-Employ Demonstration and Research Project. OPRE Report 2012-05. Washington DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Enhanced Early Head Start (EHS) participation on employment, earnings, and public assistance receipt for low-income families with young children. The study used a randomized controlled trial design, assigning eligible families to either the Enhanced EHS program or existing services. To estimate the program’s impacts, the authors used administrative employment and earnings data, as well as a 42-month follow-up survey emphasizing respondents’ employment, income, and public assistance receipt. Outcomes were adjusted for characteristics before random assignment. The study found that the longest period of continuous employment during the 3.5-year follow-up period was, on average, 2.5 months shorter for mothers in the Enhanced EHS group than mothers in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Enhanced EHS services, and not to other factors.","Enhanced Early Head Start","Other employment and reemployment","Low income, Parent",,"United States, Rural",2012,http://www.acf.hhs.gov/sites/default/files/opre/kansas_missouri.pdf,"Employment and Training Review Protocol" "What strategies work for the hard-to-employ? Final results of the Hard-to-Employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. [Minnesota Tier 2]","Butler, D., Alson, J., Bloom, D., Deitch, V., Hill, A., Hsueh, J., Jacobs, E., Kim, S., McRoberts, R., & Redcross, C. (2012). What strategies work for the hard-to-employ? Final results of the Hard-to-Employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. (OPRE report 2012-08). Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Minnesota Tier 2]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study examined the impact of the Minnesota Tier 2 program on employment, earnings, and receipt of public assistance for unemployed single parents. The study was a randomized controlled trial. The authors estimated the impact of the Tier 2 program by comparing the outcomes of the treatment and control groups four years after random assignment using data from Minnesota public assistance records and Unemployment Insurance wage records. The study found no statistically significant relationships between the Minnesota Tier 2 program and employment, earnings, or receipt of public assistance. The quality of causal evidence presented in this report is high for the employment and earnings outcomes because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects on earnings and employment would be attributable to the Minnesota Tier 2 program, and not to other factors. The public assistance outcomes receive a low rating, which means we would not be confident that any estimated effects on public assistance would be attributable to the Minnesota Tier 2 program; other factors are likely to have contributed. However, the study did not find any statistically significant effects on employment, earnings, or benefit receipt.","the Minnesota Tier 2 Program","Other employment and reemployment Substance abuse recovery","Low income, Parent",,"United States",2012,http://www.acf.hhs.gov/sites/default/files/opre/strategies_work.pdf,"Employment and Training Review Protocol" "Changes in social adjustment with cognitive processing effects of treatment and association with PTSD symptoms","Monson, C. M., Macdonald, A., Vorstenbosch, V., Schnaider, P., Goldstein, E. S. R., Ferrier-Auerbach, A. G., & Mocciola, K. E. (2012). Changes in social adjustment with cognitive processing effects of treatment and association with PTSD symptoms. Journal of Traumatic Stress, 25, 519-526.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages","Summary: The study’s objective was to examine the impact of cognitive processing therapy on earnings. The study is a randomized controlled trial that collected self-reported data directly from veterans. There were no statistically significant relationships between cognitive processing therapy and earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to cognitive processing therapy; other factors are likely to have contributed.","Cognitive Processing Therapy",Health,"Veteran or military",,"United States",2012,https://cptforptsd.com/wp-content/uploads/2016/11/Monson-Macdonald_2012_JTS-soc…,"Employment and Training Review Protocol" "Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. [Dayton—Move Up]","Miller, C., Tessler, B. L., & Van Dok, M. (2012). Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. New York: MDRC. [Dayton—Move Up]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of participation in Dayton—Move Up, a Work Advancement and Support Center (WASC), on participants’ earnings, employment, educational attainment, and benefit receipt. This study was a randomized controlled trial and used administrative data from the Ohio Department of Job and Family Services and the National Student Clearinghouse to measure outcomes. The authors used a 12-month follow-up survey with a random subset of participants to measure receipt of work supports and job characteristics. The study found that the treatment group was 6.4 percentage points more likely to obtain a license or certificate than the control group and 6.2 percentage points more likely to have ever received Food Stamps one year after the program began. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Dayton—Move Up and not to other factors.","Work Advancement and Support Center (WASC), Dayton—Move Up","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States",2012,http://www.mdrc.org/sites/default/files/full_627.pdf,"Employment and Training Review Protocol" "Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up","LePage, J. P., Washington, E. L., Lewis, A. A., Johnson, K. E., & Garcia-Rea, E. (2011). Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up. Journal of Rehabilitation Research & Development, 48(3), 277-286. [Full About Face vs. self-study]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: This study examined the impact of About Face (AF) vocational classes on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of veterans: (1) those who took the AF classes (full AF program) and (2) those who did not take the classes but had access to the manual to study on their own (self-study program). The authors collected biweekly data from participants in person or over the phone. The study revealed significantly higher competitive employment among veterans in the full AF program (23.8 percent hired) than in the self-study condition (3 percent hired). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2011,https://www.rehab.research.va.gov/jour/11/483/pdf/page277.pdf,"Reentry, Veterans Review Protocol" "Program Keluarga Harapan: Main findings from the impact evaluation of Indonesia’s pilot household conditional cash transfer program","World Bank. (2011). Program Keluarga Harapan: Main findings from the impact evaluation of Indonesia’s pilot household conditional cash transfer program. Retrieved from http://documents.worldbank.org/curated/en/589171468266179965/Program-Keluarga-Harapan-impact-evaluation-of-Indonesias-Pilot-Household-Conditional-Cash-Transfer-Program","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a conditional cash transfer program, Program Keluarga Harapan (PKH), on child school and work participation. The study was a randomized controlled trial (RCT) that compared outcomes between the treatment and control groups using household surveys conducted before and two years after initial program implementation. The study found a significant increase in time spent working in family enterprises for children 13-15 and children 7-12 in the treatment group compared to the control group. The study found that relative to the control group, children aged 13-15 who participated in the program had significantly larger increases in the hours attending school two years after program implementation began. However, school enrollment rates significantly decreased for children aged 7-12 who participated in the program. The quality of causal evidence presented in this report is moderate because randomization was compromised but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to Program Keluarga Harapan, but other factors might also have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2011,http://documents.worldbank.org/curated/en/589171468266179965/Program-Keluarga-H…,"Child Labor Review Protocol" "Schooling and the Vietnam-era GI bill: Evidence from the draft lottery","Angrist, J. D., & Chen, S. H. (2011). Schooling and the Vietnam-era GI bill: Evidence from the draft lottery. American Economic Journal: Applied Economics, 3(2), 96-118.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the G.I. Bill on education, employment, earnings. The authors used a nonexperimental comparison group analysis to estimate the impact of the Vietnam-era G.I. Bill on outcomes. The approach compared the outcomes of Vietnam-era veterans and non-veterans in 1999 using the 1-in-6 long form sample of the 2000 U.S. Census. The authors found that, compared with White male non-veterans, Vietnam-era White male veterans eligible for the draft and the G.I. Bill had significantly more years of schooling and were significantly more likely to have earned secondary and postsecondary degrees. The study found no statistically significant relationships between veteran status and employment or earnings. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the G.I. Bill and not to other factors.","the WWII G.I. Bill","Veterans' reemployment Community college education and other classroom training","Veteran or military",,"United States",2011,https://www.aeaweb.org/articles?id=10.1257/app.3.2.96,"Employment and Training Review Protocol" "Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up","LePage, J. P., Washington, E. L., Lewis, A. A., Johnson, K. E., & Garcia-Rea, E. (2011). Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up. Journal of Rehabilitation Research & Development, 48(3), 277-286. [Full About Face vs VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of About Face (AF) vocational classes on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who participated in the AF classes (full AF program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected biweekly data from participants in person or over the phone. The study revealed significantly higher competitive employment among justice-involved veterans in the full AF program (23.8 percent hired) than in the VERC condition (0 percent hired). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"Urban, United States",2011,https://www.rehab.research.va.gov/jour/11/483/pdf/page277.pdf,"Reentry, Veterans Review Protocol" "Participation in the transition assistance program and job placement outcomes of U.S. veterans","Silva, E. (2011). Participation in the transition assistance program and job placement outcomes of U.S. veterans. (Publication No. AAI1491543) [Master’s dissertation, University of Rhode Island]. ProQuest.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Transition Assistance Program (TAP) on employment success—an outcome that reflects both employment and the desired number of work hours. The study involved a nonexperimental comparison group analysis that compared veterans who participated in TAP to those who did not, using data from the Current Population Survey and Veterans Supplement. The study showed no statistically significant relationship between TAP and veterans’ employment success. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we could not be confident that any estimated effects would be attributable to TAP and not to other factors. However, the study did not show any statistically significant effects.","the Transition Assistance Program","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2011,https://digitalcommons.uri.edu/dissertations/AAI1491543/,"Employment and Training Review Protocol" "A promising start: Initial impacts of Year Up on low-income young adults’ careers.","Roder, A., & Elliott, M. (2011). A promising start: Initial impacts of Year Up on low-income young adults' careers. Economic Mobility Corporation.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: This report presents preliminary findings for the impacts of the Year Up program, which provides technical skills training and internships to low-income adults ages 18 to 24. The authors randomly assigned eligible applicants to either be invited to participate in the program immediately (treatment group) or gain entry after 10 months (control group). They compared the outcomes of treatment and control group members for approximately two years after random assignment. The authors reported many statistically significant and positive impacts of the program in the second year after random assignment. These included impacts on annual earnings and hourly wages. The quality of causal evidence is low because the randomized controlled trial had high attrition and the study did not show that the groups being compared were equivalent prior to the program. This means we are not confident that the estimated effects are attributable to Year Up. Other factors are likely to have contributed.","Year Up","Mentoring Work based and other occupational training Youth programs","Youth, Low income","Finance and insurance","United States, Urban",2011,,"Opportunities for Youth Review Protocol" "Do conditional cash transfers for schooling generate lasting benefits? A five-year followup of PROGRESA/Oportunidades","Behrman, J. R., Parker, S. W., & Todd, P. E. (2011). Do conditional cash transfers for schooling generate lasting benefits? A five-year followup of PROGRESA/Oportunidades. Journal of Human Resources, 46(1), 93-122. doi:10.3368/jhr.46.1.93","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Child labor-Low-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on long-term schooling and work for children ages 9 to 15 (during the time of the intervention). Using survey data from a randomized controlled trial, the authors analyzed the impact of the PROGRESA/Oportunidades program on schooling and work 18-months after implementation. The authors also used a nonexperimental design to evaluate schooling and work outcomes five-and-a-half years post-implementation. The study found that 18 months of program exposure significantly increased the school grade completion by 2.4 percent for boys and 2.7 percent for girls. The 18-month program exposure significantly decreased participation in work by 4.1 percent for boys but had no significant effect for girls. The study found a statistically significant relationship between the program and increased school grade completion five-and-a-half years post-implementation for all groups except for girls aged 17-19. It also found a statistically significant relationship between the program and a reduction in child labor for boys aged 15-16 in 2003 but did not find a significant relationship between the program for girls or for any other age groups of boys. The quality of causal evidence presented in this report is high for short-term outcomes (18 months) because they are based on a well-implemented randomized controlled trial but low for longer-term outcomes (five-and-a-half years) because the authors did not account for the outcomes of schooling and work at baseline.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,International,2011,https://www.mcgill.ca/isid/files/isid/behrman_et_al_2011.pdf,"Child Labor Review Protocol" "Long-term findings from an experimental evaluation of three service delivery models.","Perez-Johnson, I., Moore, Q., & Santillano, R. (2011). Long-term findings from an experimental evaluation of three service delivery models. Series: ETAOP 2012-06. Washington, DC: Employment and Training Administration, U.S. Department of Labor.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of individual training account (ITA) programs on employment, earnings, education and training, and benefit receipt. The authors conducted a randomized controlled trial. They used Unemployment Insurance (UI) records of the full sample and a follow-up survey conducted on average seven years after random assignment for a random subsample of the full sample (4,800 of 7,920) to determine education and training, employment, and earnings outcomes. The study found that a significantly higher percentage of the maximum customer choice group (59 percent) had earned a certificate or degree from a training program within 3 years of random assignment compared with the guided customer choice group (53 percent). The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the ITA models, and not to other factors.","The Individual Training Accounts (ITA) models","Other employment and reemployment Other training and education Unemployment Insurance","Low income, Dislocated or displaced worker",,"United States",2011,https://wdr.doleta.gov/research/FullText_Documents/ETAOP_2012_06.pdf,"Employment and Training Review Protocol" "A two-generational child-focused program enhanced with employment services: Eighteen-month impacts from the Kansas and Missouri sites of the enhanced services for the Hard-to-Employ Demonstration and Evaluation project","Hsueh, J., Jacobs, E., & Farrell, M. (2011). A two-generational child-focused program enhanced with employment services: Eighteen-month impacts from the Kansas and Missouri sites of the enhanced services for the Hard-to-Employ Demonstration and Evaluation project. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Enhanced Early Head Start (EHS) participation on employment, earnings, public assistance receipt, and education for low-income families with young children. The study used a randomized controlled trial design, assigning eligible families to either the Enhanced EHS program or existing services. To estimate the program’s impacts, the authors used administrative employment and earnings data, as well as an 18-month follow-up survey emphasizing respondents’ employment, income, and other outcomes. Outcomes were adjusted for characteristics before random assignment. The study did not find any statistically significant effects on employment, earnings, public assistance receipt, or education. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to Enhanced EHS services and not to other factors. However, the study did not find statistically significant effects.","Enhanced Early Head Start (EHS)","Other employment and reemployment Other training and education","Low income, Parent",,"United States",2011,http://www.acf.hhs.gov/sites/default/files/opre/two_generational.pdf,"Employment and Training Review Protocol" "Earnings progression among workforce development participants: Evidence from Washington State.","Chrisinger, C.K. (2011). Earnings progression among workforce development participants: Evidence from Washington State. Washington, DC: U.S. Department of Labor, Employment and Training Administration.","Job Search Assistance, Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program on the earnings of low-income adults ages 18 to 64 in Washington State. The author assigned workers to the treatment group if they received employment-related services through the WIA Adult Program from January 2002 to June 2008. Workers who participated in the Labor Exchange program during this time comprised the comparison group. The study found no statistically significant relationships between receiving services through the WIA Adult Program and quarterly earnings. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before program participation. This means we would not be confident that the estimated effects would be attributable to the WIA Adult Program; however, the study did not find statistically significant effects.","the Workforce Investment Act (WIA) Adult Program","Adult and Dislocated Worker programs Job search assistance and supportive services Labor Exchange Other employment and reemployment Other training and education Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Unemployed, Low income",,"United States",2011,https://wdr.doleta.gov/research/FullText_Documents/ETAOP_2011-11.pdf,"Job Search Assistance, Low-Income Adults Review Protocol" "Same bureaucracy, different outcomes in human capital? How indigenous and rural non-indigenous areas in Panama responded to the CCT","Arriaz, I., & Rozo, S. (2011). Same bureaucracy, different outcomes in human capital? How indigenous and rural non-indigenous areas in Panama responded to the CCT. Inter-American Development Bank, Office of Evaluation & Oversight.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Red de Oportunidades (RdO), a conditional cash transfer program in Panama, on child labor and school enrollment. The authors used cross-sectional data to compare the treatment group to the comparison group on several outcomes, including child labor (if the child worked in the previous week) and school enrollment (if the child was enrolled in formal schooling). In the analyses for rural areas, the study found that the receipt of the RdO was significantly associated with a decrease in child labor by 6.2 percentage points and an increase in school enrollment by 8.8 percentage points. In the analyses for the indigenous areas, the receipt of RdO was significantly associated with an increase in school enrollment by 6.3 percentage points, but not related to child labor. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Red de Oportunidades (RdO) program; other factors are likely to have contributed.","Red de Oportunidades (RdO)","Child labor","Other, Low income",,"International, Rural",2011,https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1847124,"Child Labor Review Protocol" "Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up","LePage, J. P., Washington, E. L., Lewis, A. A., Johnson, K. E., & Garcia-Rea, E. (2011). Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up. Journal of Rehabilitation Research & Development, 48(3), 277-286. [Self-study vs. VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study examined the impact of self-studying the About Face (AF) manual on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who had access to the AF manual to study on their own (self-study program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected biweekly data from participants in person or over the phone. The study showed no significant differences in competitive employment between the self-study condition (3 percent hired) and the VERC-only condition (0 percent hired). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF manual; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2011,https://www.rehab.research.va.gov/jour/11/483/pdf/page277.pdf,"Reentry, Veterans Review Protocol" "After-school programs for high school students: An evaluation of after-school matters.","Hirsch, B., Hedges, L., Stawicki, J., & Mekinda, M. (2011). After-school programs for high school students: An evaluation of after-school matters. Evanston, IL: Northwestern University.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The report’s objective was to evaluate the impact of the After School Matters (ASM) apprenticeship program on academic outcomes in high school and on the likelihood of being hired for a summer or permanent entry-level position in the labor market. For this evaluation, 535 students from 10 high schools in Chicago were randomly assigned to the treatment group, which could enroll in ASM, or the control group, which could not. Outcome data were derived from high school records from both semesters of the academic year of study participation and a mock job interview at the end of the spring semester of the same year. The study reported no statistically significant impacts of participation in ASM on high school grade point average (GPA), number of classes failed, school absences, or likelihood of being hired for a permanent or summer entry-level position. The quality of the causal evidence presented in this report is high for all academic outcomes. This means we are confident that estimated impacts for these outcomes would be solely attributable to ASM, and not other factors. For the likelihood of employment outcomes, the quality of evidence is moderate. This means we have confidence that the effects estimated in this study would be attributable at least in part to the ASM program, though other factors could also have contributed.","After School Matters","Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States, Urban",2011,,"Opportunities for Youth Review Protocol" "Residential treatment for homeless female veterans with psychiatric and substance use disorders: Effect on 1-year clinical outcomes","Harpaz-Rotem, I., Rosenheck, R. A., & Desai, R. (2011). Residential treatment for homeless female veterans with psychiatric and substance use disorders: Effect on 1-year clinical outcomes. Journal of Rehabilitation Research & Development, 48(8), 891-899.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of community residential treatment on female veterans’ employment and health outcomes. The study team used statistical tests to examine the differences between two groups: (1) people who were offered at least 30 or more days of residential treatment (RT) services at Veterans Affairs (VA) medical centers and (2) people who were not offered these services or were offered these services for less than 30 days. The data for this study came from case managers, discharge summaries, interviews, and standardized self-reported measures. The study showed that receiving RT services was associated with a greater number of days worked but with mixed results on health outcomes. The quality of causal evidence presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the RT program, but other factors might also have contributed to the effects.","Residential Treatment","Health Veterans' reemployment","Female, Veteran or military",,"United States",2011,https://www.researchgate.net/profile/Ilan_Harpaz-Rotem/publication/51784250_Res…,"Employment and Training Review Protocol" "Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders","Penk, W., Drebing, C.E., Rosenheck, R.A., Krebs, C., Van Ormer, A., & Mueller, L. (2010). Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders. Psychiatric Rehabilitation Journal, 33(4), 297-307.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study ’s objective was to examine the impact of a transitional work experience (TWE) program, within the Veterans Health Administration’s (VHA’s) Compensated Work Therapy (CWT) program, on outcomes related to employment and earnings for veterans with certain psychiatric diagnoses and substance use disorders. The study used a randomized controlled trial design and compared treatment and control groups on self-reported employment and earnings outcomes, which were collected 6 and 12 months after enrollment in the study. The study found that those who participated in TWE (the treatment group) worked more total hours and more weeks, and earned more income, over the 12-month period than the control group. The quality of causal evidence presented in this report is low for employment and earnings outcomes because the randomized controlled trial design was compromised and authors did not account for existing differences between the treatment and control groups. This means we are not confident that the estimated effects are attributable to the transitional work experience program; other factors are likely to have contributed.","the Compensated Work Therapy transitional work experience program","Other health and safety Substance abuse recovery Veterans' reemployment","Other barriers, Veteran or military",,"United States",2010,https://psycnet.apa.org/record/2010-08280-008,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [VISION—Salem, OR]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [VISION—Salem, OR]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on Temporary Assistance for Needy Families (TANF) recipients’ employment and benefits receipt outcomes after three years. The Salem site was one of several across the United States that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,504 single parents eligible for welfare-to-work programs to either a treatment group that received Valuing Individual Success and Increasing Opportunities Now (VISION) services or to a control group that received the state’s typical welfare-to-work program. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those in the VISION group were 6.7 percentage points more likely than those in the control group to have received TANF benefits at any point during the first follow-up year. The VISION group also received, on average, $298 more in annual TANF benefits during the first three follow-up years, compared with the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Salem ERA program and not to other factors.","the Salem Valuing Individual Success and Increasing Opportunities Now (VISION) Program","Other employment and reemployment Unemployment Insurance Job search assistance and supportive services","Low income, Parent",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [PROGRESS—Eugene]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [PROGRESS—Eugene]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports on former welfare recipients’ employment and benefits receipt outcomes after three years. The Eugene site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,179 employed single parents who were former Temporary Assistance for Needy Families (TANF) program participants to either a treatment group that received employment retention services from Eugene’s Progress Towards Retention, Opportunities, Growth, Enhancement and Self-Sufficiency (PROGRESS) program or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those in the PROGRESS group were 7 percentage points less likely than control group members to be employed in the third year after random assignment and 6.6 percentage points less likely to have been employed in every quarter of that year. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Eugene ERA program and not to other factors.","the Employment Retention and Advancement Project, Eugene","Other employment and reemployment Unemployment Insurance","Employed, Low income, Parent",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Reducing child labour through conditional cash transfers: Evidence from Nicaragua's Red de Protección Social","Gee, K.A. (2010). Reducing child labour through conditional cash transfers: Evidence from Nicaragua's Red de Protección Social. Development Policy Review, 28(6), 711-732.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of a conditional cash transfer program, Red de Protección Social (RPS), in Nicaragua on child labor outcomes for children who are working. The study was an expansion of an earlier randomized controlled trial (RCT). The author used survey data from the RCT taken before the program started (2000) and two years after (2002) to examine the probability and duration of child work. The study found that the receipt of the cash transfer significantly reduced the probability that a child would work by approximately 10.6 percent and, for a child that was working, significantly reduced the hours worked per week by approximately 3.65 hours, on average. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Red de Protección Social program, and not to other factors.","Red de Protección Social (RPS)","Child labor","Other, Low income",,"International, Rural",2010,,"Child Labor Review Protocol" "Tuning in to local labor markets: Findings from the Sectoral Employment Impact Study. [Per Scholas]","Maguire, S., Freely, J., Clymer, C., Conway, M., & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment Impact Study. Philadelphia, PA: Public/Private Ventures. [Per Scholas]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Per Scholas sectoral employment program on participants’ earnings and employment. The study was a randomized controlled trial and used survey data to estimate the effect of Per Scholas by comparing average outcomes among applicants offered access to the program with average outcomes of those excluded from the program, after adjusting for differences between the groups. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, this CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the study was a randomized controlled trial with high attrition, and the authors did not demonstrate that the groups that remained in the study were similar before the intervention began. This means we would not be confident that the estimated effects would be attributable to Per Scholas; other factors are likely to have contributed. However, the study did not find statistically significant effects.","Per Scholas","Work based and other occupational training","Low income","Professional, scientific, and technical services","United States",2010,http://ppv.issuelab.org/resources/5101/5101.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [Texas ERA—Houston]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Texas ERA—Houston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Houston site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,032 unemployed single-parent participants in Houston’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those in the Houston ERA group received on average $56 more per year in TANF benefits across the first four years after random assignment, compared with the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program and not to other factors.","the Employment Retention and Advancement project, Houston","Other employment and reemployment Unemployment Insurance","Parent, Low income",,"Urban, United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Leveling the intra-household playing field: Compensation and specialization in child labor allocation","Del Carpio, X. V., & Macours, K. (2010). Leveling the intra-household playing field: Compensation and specialization in child labor allocation. In R. K. Akee, E. V. Edmonds, & K. Tatsiramos (Eds.), Child Labor and the Transition Between School and Work (pp. 259-295). Bingley, UK: Emerald Publishing Limited.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of Atención a Crisis (""Attention to the Crisis”), a conditional cash transfer program, on the allocation of child labor within poor households with two or more children. This summary focuses on the comparison between all treatment groups and the control group. The study was a randomized controlled trial (RCT) in northwest Nicaragua. The authors analyzed data from a household survey given at baseline and nine months into the program. The authors compared household allocation of child labor by age and gender of children in households with two or more children. The study found that in treatment households, economic labor significantly decreased for boys but not girls. Boys significantly decreased their hours per week in economic work (including agricultural, livestock, and non-agricultural economic activity) by 1.3 hours compared to girls. Older boys aged, 10-15, showed a larger, significant reduction in economic work by 2.8 hours a week compared to their siblings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to Atención a Crisis, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://openknowledge.worldbank.org/bitstream/handle/10986/4020/WPS4822.pdf?seq…,"Child Labor Review Protocol" "Toward reduced poverty across generations: Early findings from New York City’s conditional cash transfer program","Riccio, J., Dechausay, N., Greenberg, D., Miller, C., Rucks, Z., and Verma, N. (2010). Toward reduced poverty across generations: Early findings from New York City’s conditional cash transfer program. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Family Rewards, an experimental privately funded conditional cash transfer program in New York City, on earnings, employment, public benefits receipt, and education. The study was based on a randomized controlled trial and estimated the effect of the Family Rewards program on low-income families. The authors used New York City and New York State administrative data to compare average outcomes among those offered access to the program against the average outcomes of those excluded, after adjusting for chance initial differences between the groups. The study found that, on average, the Family Rewards program decreased the likelihood of ever being employed at a job covered by unemployment insurance (UI) in the first year. However, the Family Rewards program increased the likelihood of being employed at a job not covered by UI after 18 months, total monthly income after 18 months, and the likelihood that adult recipients had received an associate’s degree after 18 months. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Family Rewards program, and not to other factors.","the Family Rewards Program","Other employment and reemployment Other training and education Unemployment Insurance","Unemployed, Low income, Parent",,"United States",2010,http://www.mdrc.org/sites/default/files/FamRewards2010ONYC%20FULL%20Report%20RE…,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [PASS - Riverside]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [PASS - Riverside]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports and supportive services on recent welfare recipients’ employment and benefits receipt outcomes after four years. The Riverside Post-Assistance Self-Sufficiency (PASS) site was one of two in Riverside, California, that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,770 employed single parents who had recently left the Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and surveys administered 12 and 42 months after random assignment. The study found that individuals assigned to the Riverside PASS ERA program had significantly higher earnings in the first and fourth years after random assignment and were more likely to be employed in every quarter of the fourth year, compared with those in the control group. The quality of causal evidence provided in this study is high for most outcomes because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Riverside PASS ERA program and not to other factors. However, the study receives a moderate causal evidence rating for outcomes from the 12-month survey because that data source had high attrition, yet the analysis included adequate statistical controls to correct for resulting imbalance.","the Employment Retention and Advancement Project, Riverside Post-Assistance Self-Sufficiency (PASS) Program","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2010,http://www.acf.hhs.gov/sites/default/files/opre/era_core.pdf,"Employment and Training Review Protocol" "Sustained earnings gains for residents in a public housing jobs program: Seven-year findings from the Jobs-Plus demonstration.","Riccio, J. (2010). Sustained earnings gains for residents in a public housing jobs program: Seven-year findings from the Jobs-Plus demonstration. MDRC policy brief. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Jobs-Plus program on the long-term earnings of residents in housing developments in three cities in the United States. The study was a randomized controlled trial that used data from administrative records to compare outcomes between treatment and control group members seven years after random assignment. The study did not find any statistically significant effects of Jobs-Plus on earnings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to Jobs-Plus and not to other factors. However, the study did not find statistically significant effects.","the Jobs-Plus Community Revitalization Initiative for Public Housing Families (Jobs-Plus) Program","Other employment and reemployment","Low income",,"United States",2010,http://www.mdrc.org/sites/default/files/policybrief_33.pdf,"Employment and Training Review Protocol" "Productive safety net program and children’s time use between work and schooling in Ethiopia","Woldehanna T. (2010). Productive safety net program and children’s time use between work and schooling in Ethiopia. In J. Cockburn & J. Kabubo-Mariara (Eds.). Child Welfare in Developing Countries (pp. 157-209). New York, NY: Springer.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Public Work Program (PWP) on child labor and schooling outcomes in rural Ethiopia. The study used a matched-comparison group design. Using data from a household survey, the author compared time spent in child labor and schooling among PWP participants and non-participants. The study found that participation in PWP was significantly associated with a lower amount of time spent on child care and household chores. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Public Work Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://rd.springer.com/chapter/10.1007/978-1-4419-6275-1_6,"Child Labor Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [RFS-Los Angeles]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [RFS-Los Angeles]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of individualized and flexible post-employment job supports on employed welfare recipients’ employment and benefits receipt outcomes after three years. The Los Angeles Reach for Success (RFS) site was one of two in Los Angeles that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 5,700 employed single-parent participants in Los Angeles’s Temporary Assistance for Needy Families (TANF) program who were working full-time to either a treatment group that received RFS services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and surveys administered 12 and 42 months after random assignment. The study found that, 12 to 42 months after random assignment, RFS group members’ employment, earnings, and benefits receipt did not differ significantly from those of control group members. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that any estimated effects would be attributable to Los Angeles’ RFS and not to other factors. However, the study did not find statistically significant effects.","Reach for Success (RFS)","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [Texas ERA—Forth Worth]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Texas ERA—Forth Worth]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Fort Worth site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,572 unemployed single-parent participants in Fort Worth’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that, compared with the control group, those in the Fort Worth ERA group received on average $162 more per year in Food Stamps across the first four years after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program and not to other factors.","the Employment Retention and Advancement project, Fort Worth","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Leveling the intra-household playing field: Compensation and specialization in child labor allocation","Del Carpio, X. V., & Macours, K. (2010). Leveling the intra-household playing field: Compensation and specialization in child labor allocation. In R. K. Akee, E. V. Edmonds, & K. Tatsiramos (Eds.), Child Labor and the Transition Between School and Work (pp. 259-295). Bingley, UK: Emerald Publishing Limited.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Mixed impacts Child labor","Summary: The study’s objective was to examine the impact of Atención a Crisis (""Attention to the Crisis”), a conditional cash transfer (CCT) program, on the allocation of child labor within poor households with two or more children. This summary focuses on the comparison between the treatment group receiving the basic CCT plus the business grant and the control group. The study was a randomized controlled trial (RCT) in northwest Nicaragua. The authors analyzed data from a household survey given at baseline and nine months into the program. The authors compared household allocation of child labor by age and gender of children in households with two or more children. The study found that in households receiving the basic CCT plus the business grant, economic labor significantly decreased for boys but not girls. Boys decreased their hours per week in economic work (including agricultural, livestock, and non-agricultural economic activity) by 1.8 hours compared to girls. Older boys, aged 10-15, showed a larger reduction in economic work by 3.3 hours a week compared to their siblings. However, older girls, aged 10-15, showed an increase in economic work by 1.5 hours a week and domestic work of an hour a week compared to their siblings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to Atención a Crisis, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://openknowledge.worldbank.org/bitstream/handle/10986/4020/WPS4822.pdf?seq…,"Child Labor Review Protocol" "Tuning in to local labor markets: Findings from the Sectoral Employment impact study","Maguire, S., Freely, J., Clymer, C., Conway, M. & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment impact study. Philadelphia: Public/Private Ventures. [Wisconsin Regional Training Partnership]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Wisconsin Regional Training Partnership’s (WRTP) sectoral employment program on earnings and employment. The study was based on a randomized controlled trial and it estimated the effect of offering eligible WRTP applicants the program by using survey data to compare average outcomes among those offered access to the program against the average outcomes of those excluded, after adjusting for differences between the groups. The study found that being offered access to the WRTP’s sectoral employment program increased earnings by $6,255, on average, over the two years after acceptance to the program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the WRTP’s sectoral employment program, and not to other factors.","Wisconsin Regional Training Partnership’s (WRTP) Sectoral Employment Program","Job search assistance and supportive services Other employment and reemployment","Low income","Professional, scientific, and technical services","United States",2010,http://ppv.issuelab.org/resources/5101/5101.pdf,"Employment and Training Review Protocol" "Working toward Wellness: Telephone care management for Medicaid recipients with depression, eighteen months after random assignment.","Kim, S., LeBlanc, A., Morris, P., Simon, G., & Walter, J. (2010). Working toward Wellness: Telephone care management for Medicaid recipients with depression, eighteen months after random assignment. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impacts of a telephone care management program, Working toward Wellness (WtW), on low-income depressed parents’ employment and earnings. The study used a randomized controlled trial design, assigning eligible parents to either the WtW program or existing services. Authors used data from an 18-month follow-up survey to estimate program impacts, adjusting for sample members’ characteristics before random assignment. The study did not find any statistically significant effects of the WtW program on employment or earnings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to WtW and not to other factors. However, the study did not find statistically significant effects.","Working toward Wellness (WtW)","Other employment and reemployment","Low income, Parent",,"United States",2010,http://www.acf.hhs.gov/sites/default/files/opre/telephone_care.pdf,"Employment and Training Review Protocol" "Productive safety net program and children’s time use between work and schooling in Ethiopia","Woldehanna T. (2010). Productive safety net program and children’s time use between work and schooling in Ethiopia. In J. Cockburn & J. Kabubo-Mariara (Eds.). Child Welfare in Developing Countries (pp. 157-209). New York, NY: Springer.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Direct Support Program (DSP) on child labor and schooling outcomes in Ethiopia. The study used a matched-comparison group design. Using data from a household survey, the author compared time spent in child labor and schooling among DSP participants and non-participants. The study found that participation in the DSP was significantly associated with a lower amount of total time spent in work outside home, time spent in unpaid work outside the home and a composite measure of total work (paid and unpaid outside the home plus child care and household chores). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Direct Support Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://rd.springer.com/chapter/10.1007/978-1-4419-6275-1_6,"Child Labor Review Protocol" "Work after prison: One-year findings from the Transitional Jobs Reentry Demonstration","Redcross, C., Bloom, D., Jacobs, E., Manno, M., Muller-Ravett, S., Seefeldt, D., Yahner, J., Young Jr., A., & Zweig, J. (2010). Work after prison: One-year findings from the Transitional Jobs Reentry Demonstration. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Transitional Jobs Reentry Demonstration (TJRD) on ex-offenders’ employment and wages. The study used a randomized controlled trial to assign former prisoners to either the transitional jobs program or to a control group that was offered job search assistance. The authors compared the two groups’ employment and earnings outcomes one year after random assignment, controlling for participants’ characteristics before random assignment. The study found that members of the transitional jobs group were 8.6 percentage points more likely than control group members to be employed during all four quarters of the year after random assignment, but 8.9 percentage points less likely to have unsubsidized employment during the year after random assignment. Transitional jobs group members’ total earnings from all jobs were $1,419 higher, on average, than those of control group members during the year after random assignment, but their total earnings from unsubsidized jobs were $625 lower. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the TJRD, and not to other factors.","the Transitional Jobs Reentry Demonstration (TJRD)","Job search assistance and supportive services Other employment and reemployment Reentry","Justice-involved, Male, Low income",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514698.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [Texas ERA—Corpus Christi]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Texas ERA—Corpus Christi]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Corpus Christi site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,727 unemployed single-parent participants in Corpus Christi’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that, compared with the control group, those in the Corpus Christi ERA group were more likely to be employed at all or for four consecutive quarters in the fourth year after random assignment. Corpus Christi ERA group members also had higher earnings and received lower Food Stamps benefits. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program and not to other factors.","the Employment Retention and Advancement project, Corpus Christi","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Leveling the intra-household playing field: Compensation and specialization in child labor allocation","Del Carpio, X. V., & Macours, K. (2010). Leveling the intra-household playing field: Compensation and specialization in child labor allocation. In R. K. Akee, E. V. Edmonds, & K. Tatsiramos (Eds.), Child Labor and the Transition Between School and Work (pp. 259-295). Bingley, UK: Emerald Publishing Limited.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of Atención a Crisis (""Attention to the Crisis”), a conditional cash transfer (CCT) program, on the allocation of child labor within poor households with two or more children. This summary focuses on the comparison between the treatment group receiving the basic CCT and the control group. The study was a randomized controlled trial (RCT) in northwest Nicaragua. The authors analyzed data from a household survey given at baseline and nine months into the program. The authors compared household allocation of child labor by age and gender of children in households with two or more children. The study found that in households receiving the basic CCT, economic labor significantly decreased for boys but not girls. Boys decreased their hours per week in economic work (including agricultural, livestock, and non-agricultural economic activity) by 1.1 hours compared to girls. Older boys aged, 10-15, also showed a larger, significant reduction in economic work of 3.0 hours a week compared to their siblings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to Atención a Crisis, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://openknowledge.worldbank.org/bitstream/handle/10986/4020/WPS4822.pdf?seq…,"Child Labor Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Los Angeles EJC]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Los Angeles EJC]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to gauge how a Los Angeles job club focused on participants’ career interests affected employment, earnings, and benefits receipt outcomes after about 36 months. The Los Angeles site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. (See the CLEAR review of the interim report here.) The authors randomly assigned nearly 1,200 single-parent recipients of Temporary Assistance for Needy Families (TANF) to either a treatment group, which received Enhanced Job Club (EJC) services, or a control group, which received traditional job club (TJC) services. The authors collected employment and earnings data from Unemployment Insurance (UI) records and used automated TANF and food stamp databases to obtain benefits receipt information. Thirty-six months after random assignment, the study found no statistically significant differences between treatment and control group members’ employment, earnings, or benefits receipt. The quality of causal evidence provided in this study is high because it is based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the EJC and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Los Angeles’s Enhanced Job Club","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "The impact of conditional cash transfer programs on household work decisions in Brazil","Ferro, A. R., Lúcia Kassouf, A., & Levison, D. (2010). The impact of conditional cash transfer programs on household work decisions in Brazil. In R. K. Akee, E. V. Edmonds, & K. Tatsiramos (Eds.), Child Labor and the Transition between School and Work (pp. 193-218). Bingley, UK: Emerald Publishing Limited.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of the Bolsa Escola program, which provided conditional cash transfers to families in Brazil, on child labor and school enrollment. The authors used a nonexperimental matched comparison group design to compare the outcomes of children ages 6-15 that received the conditional cash transfers with those who had applied but who had not received it (waitlisted families), based on data from Brazil’s national household survey. The study found that receipt of the Bolsa Escola benefit was significantly related to higher rates of school enrollment and lower rates of child labor. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Bolsa Escola program; other factors are likely to have contributed.","Bolsa Escola","Child labor","Other, Low income",,International,2010,http://www.anpec.org.br/encontro2009/inscricao.on/arquivos/000-dde4869521f17def…,"Child Labor Review Protocol" "Rapid employment model evaluation: Update #2","Smith, T. C., King, C. T., & Schroeder, D. G. (2010). Rapid employment model evaluation: Update #2. Austin, TX: Ray Marshall Center for the Study of Human Resources.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Rapid Employment Model (REM) program on participants’ employment, earnings, and Unemployment Insurance (UI) benefit claims. (See the CLEAR review of the 2008 report here.) Using program data and state UI records, the authors matched treatment to comparison group cases and conducted regression analyses to estimate the effect of the intervention. The study found that participation in the REM program was associated with an increase in the likelihood that jobseekers were employed in the 10 quarters following program participation among the 2006 cohort. Participation in the REM program was also associated with an increase in the likelihood that jobseekers were employed, a decrease in quarterly earnings, and an increase in the likelihood jobseekers filed UI claims in the six quarters following program participation among the 2007 cohort. The quality of causal evidence presented in this report is moderate for earnings outcomes in both cohorts and for employment outcomes for the 2006 cohort because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects on employment and earnings are attributable to the REM program, but other factors might also have contributed. The quality of causal evidence presented for the UI benefit claiming outcome for both cohorts and the employment outcome for the 2007 cohort is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects on UI benefit claiming outcome are attributable to the REM program; other factors are likely to have contributed.","Rapid Employment Model (REM) Program","Job search assistance and supportive services Other training and education Unemployment Insurance","Justice-involved, Low-skilled, Low income",,"United States",2010,http://raymarshallcenter.org/files/2006/01/REM_eval_update_Jan2010.pdf,"Review Protocol" "Tuning in to local labor markets: Findings from the Sectoral Employment impact study.","Maguire, S., J. Freely, C. Clymer, M. Conway, & D. Schwartz. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment impact study. Philadelphia: Public/Private Ventures. [JVS-Boston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Jewish Vocational Service (JVS)-Boston sectoral employment program on earnings and employment. The study was based on a randomized controlled trial and used survey data to estimate the effect of offering eligible JVS-Boston applicants the program by comparing average outcomes among those offered access to the program with the average outcomes of those excluded from the program, after adjusting for differences between the groups. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition and the authors did not demonstrate that the groups were similar at or account for differences between the two groups in the analyses. This means we are not confident that the estimated effects are attributable to the JVS-Boston program; other factors are likely to have contributed.","the Jewish Vocational Service (JVS)-Boston Sectoral Employment Program","Other employment and reemployment Other training and education","Low income","Health care and social assistance","United States",2010,http://www.aspenwsi.org/wordpress/wp-content/uploads/TuningIntoLocalLaborMarket…,"Employment and Training Review Protocol" "Productive safety net program and children’s time use between work and schooling in Ethiopia","Woldehanna T. (2010). Productive safety net program and children’s time use between work and schooling in Ethiopia. In J. Cockburn & J. Kabubo-Mariara (Eds.). Child Welfare in Developing Countries (pp. 157-209). New York, NY: Springer.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Agricultural Extension Support Program (AEP) on child labor and schooling outcomes in rural Ethiopia. The study used a matched-comparison group design. Using data from a household survey, the author compared time spent in child labor and schooling among AEP participants and non-participants. The study found that AEP participation was significantly related to lower amounts of time spent in paid work and in a combined measure of all work, as well as greater amounts of time spent in school. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Agricultural Extension Support Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://rd.springer.com/chapter/10.1007/978-1-4419-6275-1_6,"Child Labor Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Moving Up—South Carolina]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Moving Up—South Carolina]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on former welfare recipients’ employment and benefits receipt outcomes after four years. The South Carolina site was one of 16 sites nationwide that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,776 single parents who had left the Temporary Assistance for Needy Families (TANF) program in the past three years to either a treatment group that received ERA services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study did not find any statistically significant effects on earnings, employment, or benefits receipt one to four years after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that any estimated effects would be attributable to the South Carolina ERA project and not to other factors. However, the study did not find statistically significant effects.","the Employment Retention and Advancement Project, South Carolina","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Training Focused and Work Plus—Riverside, California]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Training Focused and Work Plus—Riverside, California]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Riverside Phase 2 site was one of two in Riverside, California, that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 3,029 employed single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups (Work Plus and Training Focused) that received differing ERA services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that, compared with the control group, those in the Riverside Work Plus group were 3.2 percentage points more likely to have received Food Stamps in the first year after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Riverside Work Plus program and not to other factors.","the Employment Retention and Advancement Project—Work Plus and Training Focused (Phase 2), Riverside","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Do temporary-help jobs improve labor market outcomes for low-skilled workers? Evidence from “Work First”.","Autor, D. H., & Houseman, S. N. (2010). Do temporary-help jobs improve labor market outcomes for low-skilled workers? Evidence from “Work First”. American Economic Journal: Applied Economics, 2(3), 96–128.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of temporary-help and direct-hire jobs through the Work First program (a welfare-to-work program) on the earnings and employment of low-skilled workers in Detroit. The authors use a nonexperimental design that uses key features of the Work First program to compare the employment and earnings of participants placed in temporary- or permanent-hire positions. Work First program participants are assigned to different local contractors in their district on a rotating basis. The contractors assist participants with job placement, but vary the emphasis they place on temporary-hire or direct-hire positions; the authors use this variation across contractors to compare the employment and earnings of participants in different types of job placement. The study found that the average employment probability and quarterly earnings of those who found a direct-hire job increased significantly in the eight quarters following program participation compared with that of those who found a temporary-help job. The quality of causal evidence presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to temporary-hire and direct-hire job placements, but other factors might also have contributed.","the Work First Program","Job search assistance and supportive services Unemployment Insurance","Low income",,"United States",2010,,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Chicago ERA]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Chicago ERA]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to determine the effectiveness of a Chicago program to increase the earnings of Temporary Assistance for Needy Families (TANF) recipients. The Chicago site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,728 TANF recipients to either a treatment group, which received enhanced employment services, or a control group, which received benefits as usual. The authors collected employment and earnings data from Illinois Unemployment Insurance (UI) records over four follow-up years and Food Stamps and TANF receipt data from administrative records over three follow-up years. The study found that members of the treatment group received significantly less in average annual TANF benefits ($778 compared with $1,010 among control group members) but more in average annual Food Stamps ($4,111 compared with $3,959 among control group members). People in the ERA group were also more likely to be employed in the first year (69.7 percent) than people in the control group (66.2 percent). The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable to the Chicago ERA program, and not to other factors.","the Employment Retention and Advancement project, Chicago","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Child education and work choices in the presence of a conditional cash transfer programme in rural Colombia","Attanasio, O., Fitzsimons, E., Gomez, A., Gutierrez, M. I., Meghir, C., & Mesnard, A. (2010). Child education and work choices in the presence of a conditional cash transfer programme in rural Colombia. Economic Development and Cultural Change, 58(2), 181-210. doi:10.1086/648188.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of this study was to examine the impact of the conditional cash transfer program, Familias en Acción, on children’s work and school participation in Columbia. The study used a nonexperimental design to compare labor and schooling outcomes of children who received the conditional cash transfer with a comparison group of children who did not, based on data from a survey. The study found that receipt of the cash transfer was significantly associated with a decrease in the likelihood of participating in domestic work for urban children aged 10 to 17, a decrease in the hours spent in income-generating work for urban children aged 14 to 17, and a decrease in the hours spent in domestic work for all but rural children aged 14 to 17. Receipt of the cash transfer was also significantly related to an increase in the hours spent in school for all children in urban and rural areas. The quality of causal evidence presented in the study is low because the authors did not control for pre-intervention outcomes. This means we are not confident that the estimated effects are attributable to the Familias en Acción program; other factors are likely to have contributed.","Familias en Acción","Child labor","Other, Low income",,"International, Rural",2010,http://openaccess.city.ac.uk/5381/1/Child_Education.pdf,"Child Labor Review Protocol" "Tuning in to local labor markets: Findings from the Sectoral Employment impact study","Maguire, S., Freely, J., Clymer, C., Conway, M. & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment impact study. Philadelphia: Public/Private Ventures. [Wisconsin Regional Training Partnership]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Wisconsin Regional Training Partnership’s (WRTP) sectoral employment program on earnings and employment. The authors investigated similar research questions with two other programs, the profiles of which are available through the study search. The study was based on a randomized controlled trial, with the authors estimating the effect of offering eligible WRTP applicants the program by using survey data to compare average outcomes among those offered access to the program against the average outcomes of those not offered access, after adjusting for differences between the groups. The study found that being offered access to the WRTP’s sectoral employment program increased earnings by $6,255, on average, over the two years after acceptance to the program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the WRTP’s sectoral employment program, and not to other factors.","the WRTP Sectoral Employment Program","Job search assistance and supportive services Other training and education","Low income","Construction, Manufacturing, Health care and social assistance","United States",2010,https://www.explorevr.org/sites/explorevr.org/files/files/Tuning%20In%20to%20Lo…,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [TAAG—Medford]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [TAAG—Medford]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports on former and current public assistance recipients’ employment and benefits receipt outcomes after three years. The Medford site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,164 employed single parents who were former or current public assistance recipients to either a treatment group that received services from Medford’s ERA project (Transition, Advancement, and Growth, or TAAG), or a control group that could participate in other programs in the community. The authors analyzed data from Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those assigned to the Medford ERA project earned, on average, $41 more per week when surveyed one year after random assignment than those in the control group. However, treatment group members were also 6.7 percentage points more likely to have ever received Food Stamps at the three-year follow-up than those in the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Medford ERA project and not to other factors.","the Employment Retention and Advancement Project, Medford","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent, Employed",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "The impact of conditional cash transfer program on human capital formation in Brazil","Helfand, S.M., & Souza, A.P. (2010). The impact of conditional cash transfer program on human capital formation in Brazil. University of California, Riverside, CA: Sao Paulo School of Economics.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to analyze the impact of Brazil’s Bolsa Escola program on school enrollment, school progression, and child labor for children ages 6 to 15 in rural areas. Using data from the 2001 and 2003 Brazilian Census, the authors used a structural model to examine the average program impact of the Bolsa Escola program. The study found that the Bolsa Escola program was significantly associated with an increase in school enrollment and school progression. However, the study did not find a statistically significant relationship between program participation and child labor. The quality of causal evidence presented in the study is low because the authors did not control for pre-intervention outcomes. This means we are not confident that the estimated effects are attributable to the Bolsa Escola program; other factors are likely to have contributed.","Bolsa Escola","Child labor","Other, Low income",,International,2010,,"Child Labor Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Achieve—Cleveland]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Achieve—Cleveland]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to determine the impact of a Cleveland, Ohio, program designed to increase employment retention among low-wage workers in the long-term nursing care industry. Cleveland was one of 16 sites nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 44 firms to either a treatment group, whose employees could receive employment retention services through Cleveland Achieve, or a control group. The authors collected employment and earnings data from state Unemployment Insurance (UI) records. Three years after random assignment, the study found no statistically significant differences between the earnings and employment outcomes of employees in Achieve firms compared with employees in firms that did not have access to Achieve services. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the Achieve program, and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Cleveland","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders","Penk, W., Drebing, C. E., Rosenheck, R, A., Krebs, C., Van Ormer, A., & Mueller, L. (2010). Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders. Psychiatric Rehabilitation Journal, 33(4), 297-307.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Veterans Health Administration (VHA) Transitional Work Experience (TWE) program on employment and income for veterans with substance abuse and non-psychotic psychiatric disorders, compared with job placement (JP) services only. The study was a randomized controlled trial carried out at one VHA medical center site over four years. Eligible veterans were randomly assigned to either the treatment group, which could participate in the TWE program, or to the control group, which could not participate in TWE but could receive JP services. The authors used data from participant surveys to measure impacts. The study found that members of the treatment group worked significantly more hours in paid employment (including employment sponsored by the TWE program itself) and significantly more total weeks in paid employment, compared with the control group. The study also found that the treatment group earned significantly higher total income for the year (including noncompetitive TWE employment income) than the control group. The quality of causal evidence presented in this report is low because the authors did not provide enough information to calculate attrition and did not include sufficient controls in their analysis to establish that treatment and control groups were similar on observable characteristics at baseline for the analytic sample. This means we are not confident that the estimated effects are attributable to TWE. Other factors are likely to have contributed.","the Transitional Work Experience (TWE) Program","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2010,,"Disability Employment Policy Review Protocol" "Elderly immigrants’ labor supply response to supplemental security income.","Kaushal, N. (2010). Elderly immigrants’ labor supply response to supplemental security income. Journal of Policy Analysis and Management, 29(1), 137-162.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study objective is to examine the impact of the Personal Responsibility and Work Opportunity Reconciliation Act (PRWORA) of 1996 on employment outcomes of foreign-born people and noncitizens ages 60 to 74 The study used a statistical model and the data from the Current Population Survey’s monthly outgoing rotation group and the March Current Population Survey from 1994 to 2005 to estimate the impact. The study found that the PRWORA is associated with increased employment and decreased retirement for foreign-born men compared with U.S.-born men, but it found no statistically significant association with the employment for foreign-born women. The quality of the causal evidence presented in this report is low because the study is a nonexperimental analysis that does not demonstrate that the groups were similar before the policy change. This means we are not confident that the estimated effects are attributable to PRWORA; other factors are likely to have contributed.","Personal Responsibility and Work Opportunity Reconciliation Act of 1996","Federal retirement benefits Foreign and temporary workers","Adult, Older worker, Immigrant",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4222576/,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Findings for the Eugene and Medford, Oregon, models: Implementation and early impacts for two programs that sought to encourage advancement among low-income workers. [PROGRESS—Eugene]","Molina, F., van Dok, M., Hendra, R., Hamilton, G., & Cheng, W. (2009). The Employment Retention and Advancement project: Findings for the Eugene and Medford, Oregon, models: Implementation and early impacts for two programs that sought to encourage advancement among low-income workers. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [PROGRESS—Eugene]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports on former welfare recipients’ employment and benefits receipt outcomes after 1.5 years. The Eugene site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,137 employed people who were recent Temporary Assistance for Needy Families (TANF) program participants to either a treatment group that received ERA services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study did not find any statistically significant effects on earnings, employment, or benefits receipt 1.5 years after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we would be confident that any estimated effects would be attributable to the Eugene ERA program and not to other factors. However, the study did not find statistically significant effects.","the Employment Retention and Advancement Project, Eugene","Other employment and reemployment Unemployment Insurance","Low income",,"United States",2009,http://www.acf.hhs.gov/sites/default/files/opre/era_eug_medi.pdf,"Employment and Training Review Protocol" "Strategies to help low-wage workers advance: Implementation and early impacts of the Work Advancement and Support Center (WASC) demonstration. [Dayton]","Miller, C., Tessler, B., & Van Dok, M. (2009). Strategies to help low-wage workers advance: Implementation and early impacts of the Work Advancement and Support Center (WASC) demonstration. New York City: MDRC. [Dayton]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the early impacts of participation in the Work Advancement and Support Center (WASC) demonstration on employment, earnings, education and training, and receipt of public benefits outcomes. The authors randomly assigned eligible individuals to either a treatment group that received WASC services or to a control group that received existing job placement services focused on employment. The authors analyzed data from Unemployment Insurance records, Ohio state administrative records, and a survey administered 12 months after random assignment. In the Dayton site’s first year, the study found that WASC increased participants’ receipt of Food Stamps by about 10 percent. The study also found that WASC participants were more likely to obtain a license or training certificate than control group members (18.1 percent compared with 11.3 percent, respectively). The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to WASC and not to other factors.","the Work Advancement and Support Center (WASC) Demonstration","Other employment and reemployment Other training and education","Low income",,"United States",2009,http://www.mdrc.org/sites/default/files/full_516.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the Los Angeles Reach For Success program","Anderson, J., Freedman, S., and Hamilton, G. (2009). The Employment Retention and Advancement project: Results from the Los Angeles Reach For Success program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Mixed impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of an individualized case management program called Reach for Success (RFS) on employment, earnings, and public assistance receipt for recipients of Temporary Assistance for Needy Families (TANF) cash assistance benefits. The study used a randomized controlled trial design, assigning eligible people over a two-year period to either the RFS program or existing services. To estimate the program’s impacts, the authors used administrative employment, earnings, and public benefits data, as well as a 12-month follow-up survey emphasizing respondents’ employment, income, and other outcomes. Outcomes were adjusted for prerandom assignment characteristics. The study found that RFS participants were significantly more likely to receive TANF and Food Stamps benefits at the end of the two-year follow-up period. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the RFS program and not to other factors.","Reach for Success (RFS)","Other employment and reemployment","Parent, Low income",,"United States",2009,http://www.acf.hhs.gov/sites/default/files/opre/era_la_rfs_embed.pdf,"Employment and Training Review Protocol" "Working toward Wellness: Early results from a telephone care management program for Medicaid recipients with depression.","Kim, S., LeBlanc, A. and Michalopoulos, C. (2009). Working toward Wellness: Early results from a telephone care management program for Medicaid recipients with depression. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impacts of a telephone care management program, Working toward Wellness (WtW), on low-income depressed parents’ employment and earnings. The study used a randomized controlled trial design, assigning eligible parents to either the WtW program or existing services. Authors used data from a six-month follow-up survey to estimate program impacts, accounting for parents’ characteristics before random assignment. The study did not find any statistically significant effects of the WtW program on employment or earnings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to WtW and not to other factors. However, the study did not find statistically significant effects.","Working toward Wellness (WtW)","Other employment and reemployment","Low income, Parent",,"United States",2009,http://www.acf.hhs.gov/sites/default/files/opre/working_wellness.pdf,"Employment and Training Review Protocol" "Improving 24-month abstinence and employment outcomes for substance-dependent women receiving Temporary Assistance for Needy Families with intensive case management.","Morgenstern, J., Neighbors, C., Kuerbis, A., Riordan, A., Blanchard, K., McVeigh, K., Morgan, T., & McCrady, B. (2009). Improving 24-month abstinence and employment outcomes for substance-dependent women receiving Temporary Assistance for Needy Families with intensive case management. American Journal of Public Health, 99(2), 328-333.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact on employment of an intensive case management (ICM) program for substance-dependent women receiving Temporary Assistance for Needy Families (TANF). Women identified as substance-dependent were randomly assigned to either the ICM or usual care treatment programs. The primary data sources were daily self-reports and follow-up interviews conducted 3, 9, 15, and 24 months after random assignment. The study found that women in the ICM group were generally significantly more likely than women in the usual care group to be employed full-time, particularly at the 24-month follow-up period. In addition, the study found a significantly higher rate of improvement in employment outcomes for the ICM group compared with the usual care group. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition and the authors did not account for differences between the two groups in their analysis. This means we are not confident that the estimated effects are attributable to the ICM or usual care program; other factors are likely to have contributed.","Intensive Case Management (ICM) and Usual Care Programs","Other employment and reemployment Substance abuse recovery","Female, Low income",,"United States",2009,,"Employment and Training Review Protocol" "Return on investment analysis of a selected set of workforce system programs in Indiana. [WIA Adult]","Hollenbeck, K. (2009). Return on investment analysis of a selected set of workforce system programs in Indiana. Indianapolis, IN: Indiana Chamber of Commerce Foundation. [WIA Adult]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program on the employment, earnings, and benefit receipt of low-income adults in Indiana. The author used a nonexperimental method to compare the short-term (three quarters after program exit) and long-term (seven quarters after program exit) employment, earnings, and Unemployment Insurance benefits between those who took part in the WIA Adult Program and those who participated in the WorkOne program. The study found that, compared with those who participated in the WorkOne program, WIA Adult Program participants had higher employment and earnings. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Adult Program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Adult Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Adult, Low-skilled, Low income",,"United States",2009,http://www.indianachamber.com/images/media/studies/ROIanalysisWorkforceDevelopm…,"Review Protocol" "Impact of the Uruguayan conditional cash transfer program","Borraz, F., & González, N. (2009). Impact of the Uruguayan conditional cash transfer program. Cuadernos de economia, 46(134), 243-271. doi:10.4067/S0717-68212009000200006","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to analyze the impact of a conditional cash transfer program (Ingreso Ciudadano) on school attendance (ages 8 to 14) and child labor (ages 6 to 14) among children in Uruguay from 2005 to 2007. Using the annual Uruguayan National Household Survey with cross sectional data from 2006 and 2007, the authors compared school attendance and child labor for households who received the conditional cash transfer to a group of non-participating households who had similar characteristics. The study found no statistically significant relationship between the conditional cash transfer program and school attendance. However, the study found a statistically significant relationship between the program and a reduction in child labor for females in the Montevideo region, but not for males in any region or females in the rest of the country. The quality of causal evidence presented in this report is low because the authors did not demonstrate that groups were similar at baseline. This means we are not confident that the estimated effects are attributable to Ingreso Ciudadano; other factors are likely to have contributed.","Ingreso Ciudadano","Child labor","Other, Low income",,International,2009,https://scielo.conicyt.cl/pdf/cecon/v46n134/art06.pdf,"Child Labor Review Protocol" "Opening Doors: More guidance, better results? Three-year effects of an enhanced student services program at two community colleges","Scrivener, S., & Weiss, M.J. (2009). Opening Doors: More guidance, better results? Three-year effects of an enhanced student services program at two community colleges. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Opening Doors program at Lorain County Community College and Owens Community College in Ohio. The Opening Doors program at these schools provided students with enhanced counseling services and a modest stipend for two semesters. The study was a randomized controlled trial. Eligible students were randomly assigned to either the treatment group, which was eligible to receive Opening Doors counseling services and a stipend, or the control group, which was not offered these services. The primary data sources were a baseline survey on the background characteristics of students, students’ transcripts from the two colleges, and degree attainment information from the National Student Clearinghouse. The study reported outcomes for the two program semesters and four post-program follow-up semesters. The study found that cumulatively from the first program semester to the third follow-up semester, the treatment group registered for significantly more semesters and earned significantly more developmental credits than the control group. There was no significant difference in the proportion of treatment group students who completed a degree or certificate relative to the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects would be attributable to the Opening Doors program, and not to other factors.","Opening Doors Program at Lorain County Community College and Owens Community College","Community college education and other classroom training","Adult, Low income",,"United States",2009,http://www.mdrc.org/sites/default/files/More%20Guidance%20ES_1.pdf,"Community College Review Protocol" "Growing America through entrepreneurship: Final evaluation of Project GATE","Benus, J., Shen, T., Zhang, S., Chan, M., & Hansen, B. (2009). Growing America through entrepreneurship: Final evaluation of Project GATE. Washington, DC: IMPAQ International.","Entrepreneurship and Self-Employment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Growing America Through Entrepreneurship (Project GATE) demonstration project, which offered entrepreneurship training and business counseling to low-income individuals, on participants’ employment and earnings. The authors randomly assigned study participants to a treatment group, which could participate in Project GATE, or a control group, which could not participate. The authors collected information from all participants through follow-up surveys 6, 18, and 60 months after random assignment. The study found that Project GATE increased the likelihood of business ownership in the second and third quarters after random assignment. The study found few statistically significant impacts on employment or earnings over the 60-month follow-up period, though generally the Project GATE participants were slightly less likely than the control group members to be employed in later follow-up periods. The quality of causal evidence presented in this report is high for outcomes measured in the first two quarters after assignment because these outcomes were based on a well-implemented randomized controlled trial. However, outcomes measured at other follow-up points present low causal evidence because of high attrition and insufficient adjustment for differences in previous employment and earnings history.","the Project Growing America Through Entrepreneurship (GATE) Demonstration","Job search assistance and supportive services Other training and education","Low income",,"United States",2009,https://www.impaqint.com/sites/default/files/project-reports/Project%20GATE%20F…,"Employment and Training Review Protocol" "The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor","Hoddinott, J., Gilligan, D. O., & Taffesse, A. S. (2009). The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor. Retrieved from http://ssrn.com/abstract=1412291","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Unfavorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of Ethiopia’s Productive Safety Net Program (PSNP) on child labor and school attendance, along with the potential added benefit of participation in the Other Food Security Program (OFSP). This summary focuses on the comparison between the group receiving both the PSNP and OFSP benefit and the comparison group. The study used a nonexperimental design to compare the outcomes of children ages 6-16 that received the cash transfers with those who did not, based on data from the Food Security Program Survey. Using several demographic characteristics, the authors created a matched comparison group of households who did not receive the benefit to assess the effectiveness of the cash transfer program. The study found a significant relationship between receipt of benefits from both PSNP and OFSP and an increase in domestic chores for girls. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the Productive Safety Net Program or the Other Food Security Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2009,http://ssrn.com/abstract=1412291,"Child Labor Review Protocol" "The impact of cash transfers on child labor and school enrollment in Brazil","Cardoso, E., & de Souza, A. F. (2009). The impact of cash transfers on child labor and school enrollment in Brazil. In P. F. Orazem, G. Sedlacek, & Z. Tzannatos (Eds.), Child labor and education in Latin America: An Economic perspective. Houndmills, U.K. and New York: Palgrave Macmillan.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two Brazilian income transfer programs (Minimum Income and Bolsa Escola) on child labor and school enrollment. The authors used a nonexperimental design to compare the outcomes of children ages 10 to 15 that received the conditional cash transfers with those who had not, based on data from the 2000 Brazilian Census. Using several demographic characteristics, they created a matched comparison group of families who had not received the transfers but who had similar characteristics to the treatment group to assess the effectiveness of the cash transfer program. The study found that the income transfer programs were significantly associated with an increase in school enrollment but not significantly associated with child labor. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the income transfer programs; other factors are likely to have contributed.","Income Transfer Programs (Minimum Income Program and Bolsa Escola)","Child labor","Other, Low income",,International,2009,https://ideas.repec.org/p/van/wpaper/0407.html,"Child Labor Review Protocol" "Education and child labor: Experimental evidence from a Nicaraguan conditional cash transfer program","Maluccio, J. A. (2009). Education and child labor: Experimental evidence from a Nicaraguan conditional cash transfer program. In P. F. Orazem, G. Sedlacek, & Z. Tzannatos (Eds.), Child labor and education in Latin America: An economic perspective (pp. 187-204). New York, NY: Palgrave Macmillan. doi.org/10.1057/9780230620100_12","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Red de Proteccion Social (RPS) cash transfer program on school attendance and enrollment and on child labor for children aged 7-13 in rural Nicaragua. Using panel survey data collected before and one year after program implementation, the author measured the impact of RPS using a randomized controlled trial (RCT). The study found that participation in RPS was significantly related to a reduction in child labor and a significant increase in school enrollment and attendance. The quality of the causal evidence presented in this report is low because, while it was based on an RCT, attrition was high and the authors did not demonstrate that the groups were similar at baseline. This means we are not confident that the estimated effects are attributable to the Red de Proteccion Social; other factors are likely to have contributed.","Red de Protección Social (RPS)","Child labor","Other, Low income",,"International, Rural",2009,,"Child Labor Review Protocol" "Return on investment analysis of a selected set of workforce system programs in Indiana. [WIA Dislocated Worker]","Hollenbeck, K. (2009). Return on investment analysis of a selected set of workforce system programs in Indiana. Indianapolis, IN: Indiana Chamber of Commerce Foundation. [WIA Dislocated Worker]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Dislocated Worker program on the employment rate, earnings, and benefit receipt of low-income adults who are dislocated workers. The author used a nonexperimental method to compare the short-term (three quarters after program exit) and long-term (seven quarters after program exit) employment, earnings, and Unemployment Insurance benefits between those who took part in the WIA Dislocated Worker Program relative to those who participated in the WorkOne program. The study found that, compared with those who participated in the WorkOne program, WIA Dislocated Worker Program participants had higher employment and earnings and lower benefit receipt. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Dislocated Worker program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Dislocated Worker Program","Job search assistance and supportive services Other employment and reemployment Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Dislocated or displaced worker, Low income",,"United States",2009,http://www.indianachamber.com/images/media/studies/ROIanalysisWorkforceDevelopm…,"Review Protocol" "The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor","Hoddinott, J., Gilligan, D. O., & Taffesse, A. S. (2009). The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor. Retrieved from http://ssrn.com/abstract=1412291","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of Ethiopia’s Productive Safety Net Program (PSNP) on child labor and school attendance, along with the potential added benefit of participation in the Other Food Security Program (OFSP). This summary focuses on the comparison between the group receiving a certain amount of the PSNP benefit and the comparison group. The study used a nonexperimental design to compare the outcomes of children ages 6-16 that received the cash transfers with those who did not, based on data from the Food Security Program Survey. Using several demographic characteristics, the authors created a matched comparison group of households who did not receive the benefit to assess the effectiveness of the cash transfer program. The study found that for boys ages 6-16, there was a significant relationship between households receiving a certain amount of cash transfer and increased school attendance rates. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Productive Safety Net Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2009,http://ssrn.com/abstract=1412291,"Child Labor Review Protocol" "Evaluating the direct and indirect effects of a conditional income support program: The case of Progresa","Badillo Bautista, C. (2009). Evaluating the direct and indirect effects of a conditional income support program: The case of Progresa (Doctoral dissertation). Retrieved from ProQuest Dissertations & Theses A&I. (Accession No. 1314572898)","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The objective of the study was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on child labor for children ages 8 to 17. Using survey data from a cluster randomized controlled trial, the authors analyzed the average program impact of the PROGRESA/Oportunidades program using a difference-in- differences (DID) regression model for the child labor outcome and cross-sectional models to estimate spillover effects on child labor. The study found the number of children aged 12-16 who worked significantly decreased in cash transfer participating households compared to control households. The quality of causal evidence presented in this study is high because it is based on a well-implemented, low attrition randomized controlled trial. This means we are confident that the estimated effects are attributable to PROGRESA/Oportunidades and not to other factors.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,"Rural, International",2009,,"Child Labor Review Protocol" "The Employment Retention and Advancement project: Results from the Substance Abuse Case Management program in New York City.","Martinez, J., Azurdia, G., Bloom, D., and Miller, C. (2009). The Employment Retention and Advancement project: Results from the Substance Abuse Case Management program in New York City. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the New York City Substance Abuse Case Management (SACM) program on employment, earnings, and public assistance receipt. The SACM program is part of the Employment Retention and Advancement (ERA) project. The authors assigned 8,831 low-income adults with substance abuse issues to either the SACM program or existing services. The authors analyzed data from Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), and Food Stamps administrative records. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because assignment to the program was not random, the treatment and control groups differed at baseline, and the authors did not appropriately account for differences in pre-intervention measures. This means we are not confident that the estimated effects are attributable to the SACM program; other factors are likely to have contributed.","the Employment Retention and Advancement (ERA) Project, New York City","Other employment and reemployment Substance abuse recovery","Low income",,"United States, Urban",2009,http://www.mdrc.org/sites/default/files/full_551.pdf,"Employment and Training Review Protocol" "Rewarding Persistence: Effects of a performance-based scholarship program for low-income parents","Richburg-Hayes, L., Brock, T., LeBlanc, A., Paxson, C., Rouse, C.E., & Barrow, L. (2009). Rewarding persistence: Effects of a performance-based scholarship program for low-income parents. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Opening Doors program at Delgado Community College and Louisiana Technical College-West Jefferson in New Orleans, Louisiana, on progress toward completing a college degree. The Opening Doors program offered students with dependent children a performance-based $1,000 scholarship in each of two semesters. The study examined both the shorter- and longer-term impacts of the Opening Doors program using different cohorts of students. The study was a randomized controlled trial. Eligible students were randomly assigned to either the treatment group, which was offered the opportunity to receive the scholarship, or the control group, which was not eligible for the scholarship. The primary data sources were a baseline survey on the background characteristics of students, student transcripts, and degree attainment information from the National Student Clearinghouse. The study found that for all four cohorts of students, the treatment group was significantly more likely to have registered for any course and have enrolled full-time in college, and to have attempted and earned significantly more credits in both the first and second program semesters, compared with the control group. The study found that for the first two cohorts of students, the treatment group registered for classes at a higher rate, enrolled in more semesters of college, and earned more credits than the control group cumulatively through the fourth semester after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Opening Doors program, and not to other factors.","the Opening Doors Program at Delgado Community College and Louisiana Technical College-West Jefferson","Tuition assistance Community college education and other classroom training","Adult, Low income, Parent",,"United States",2009,http://www.mdrc.org/sites/default/files/rewarding_persistence_fr.pdf,"Community College Review Protocol" "The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor","Hoddinott, J., Gilligan, D. O., & Taffesse, A. S. (2009). The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor. Retrieved from http://ssrn.com/abstract=1412291","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of Ethiopia’s Productive Safety Net Program (PSNP) on child labor and school attendance, along with the potential added benefit of participation in the Other Food Security Program (OFSP). This summary focuses on the comparison between the group receiving the PSNP benefit and the comparison group. The study used a nonexperimental design to compare the outcomes of children ages 6-16 that received the cash transfers with those who did not, based on data from the Food Security Program Survey. Using several demographic characteristics, the authors created a matched comparison group of households who did not receive the benefit to assess the effectiveness of the cash transfer program. The study did not find a significant relationship between receipt of benefits from PSNP and the number of hours worked (in domestic labor, agricultural labor, or total labor hours) or school attendance rates. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the Productive Safety Net Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2009,http://ssrn.com/abstract=1412291,"Child Labor Review Protocol" "Limiting child labor through behavior-based income transfers: An experimental evaluation of the PETI program in rural Brazil","Yap, Y. T., Sedlacek, G., & Orazem, P. F. (2009). Limiting child labor through behavior-based income transfers: An experimental evaluation of the PETI program in rural Brazil. In P. F. Orazem, G. Sedlacek, & Z. Tzannatos (Eds.), Child Labor and Education in Latin America (pp. 147-165). New York, NY: Palgrave Macmillan. doi.org/10.1057/9780230620100_10","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Programa de Erradicacao do Trabalho Infantil (PETI) or Program to Eradicate Child Labor on child labor and hours in school. The authors used an experimental design to compare the outcomes of children ages 7 to 14 residing in municipalities who received income transfers with those residing in municipalities who did not receive income transfers. Based on data from Brazil’s national household survey, the authors used statistical models to assess the impact of the program in each group. The PETI program was significantly associated with an increase in time in school and less time in work for participating children. The quality of causal evidence presented in this report is low because it is a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the PETI program; other factors are likely to have contributed.","Programa de Erradicacao do Trabalho Infantil (PETI) or Program to Eradicate Child Labor","Child labor","Other, Low income",,"International, Rural",2009,,"Child Labor Review Protocol" "Strategies to help low-wage workers advance: Implementation and early impacts of the Work Advancement and Support Center (WASC) demonstration. [San Diego]","Miller, C., Tessler, B., & Van Dok, M. (2009). Strategies to help low-wage workers advance: Implementation and early impacts of the Work Advancement and Support Center (WASC) demonstration. New York City: MDRC. [San Diego]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the early impacts of participation in the Work Advancement and Support Center (WASC) demonstration on employment, earnings, education and training, and receipt of public benefits outcomes. The authors randomly assigned eligible individuals to either a treatment group that received WASC services or to a control group that received existing job placement services focused on employment. The authors analyzed data from Unemployment Insurance records, San Diego county administrative records, and a survey administered 12 months after random assignment In the San Diego site’s first year, the study found that WASC increased participant’s receipt of Food Stamps by about 23 percent. It also found that 63.2 percent of WASC participants were employed for four consecutive quarters compared with 69.7 percent of control group members For outcomes measured with administrative data, the quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects on those outcomes are attributable to WASC and not to other factors. For employment and earnings outcomes measured with survey data, the quality of evidence is low because the authors did not account for preexisting differences between the groups being compared in their analysis. This means we are not confident that the estimated effects on those outcomes are attributable to WASC; other factors are likely to have contributed.","the Work Advancement and Support Center (WASC) Demonstration","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States",2009,http://www.mdrc.org/sites/default/files/full_516.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Findings for the Eugene and Medford, Oregon, models: Implementation and early impacts for two programs that sought to encourage advancement among low-income workers.","Molina, F., van Dok, M., Hendra, R., Hamilton, G., and Cheng, W. (2009). The Employment Retention and Advancement project: Findings for the Eugene and Medford, Oregon, models: Implementation and early impacts for two programs that sought to encourage advancement among low-income workers. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [TAAG - Medford]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports on former and current welfare recipients’ employment and benefits receipt outcomes after 1.5 years. The Medford site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,164 single parents to either a treatment group that received ERA services or a control group that could participate in other programs in the community. People in the study were current or recent Temporary Assistance for Needy Families (TANF) program participants or people enrolled in other benefit programs that required clients to participate in employment or training. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that participants assigned to the Medford ERA program earned, on average, $40 more per week in the first year after random assignment than those in the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Medford ERA program and not to other factors.","the Employment Retention and Advancement Project, Medford","Other employment and reemployment Other training and education Unemployment Insurance","Low income",,"United States",2009,http://www.mdrc.org/sites/default/files/full_367.pdf,"Employment and Training Review Protocol" "Essays on welfare, children, and families","Zhu, Yi. (2009.) Essays on welfare, children, and families. (Unpublished dissertation, Michigan State University.)","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of child care subsidies through the Child Care and Development Fund (CCDF) program on the employment of low-income single mothers. The author used data from the 2001–2007 Current Population Survey (CPS). The treatment condition was defined as the amount of the state child care subsidy for single mothers with children younger than 13. The study found a statistically significant relationship between the amount of child care subsidies and single mothers’ full-time employment. The study did not find relationships between child care subsidies and other employment outcomes examined. The quality of causal evidence presented in this report is low because the author did not account for existing differences between the mothers who did and did not receive the child care assistance. This means we are not confident that the estimated effects are attributable to the child care subsidies; other factors are likely to have contributed.","Child Care Subsidies","Other employment and reemployment","Low income, Parent",,"United States",2009,,"Employment and Training Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [DBVI]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [DBVI]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Vocational Rehabilitation program administered by the Department for Blind and Vision Impaired (DBVI) on participants’ employment and credential completion. The study used administrative records to compare the outcomes of low-income adults who took part in the DBVI program with outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that DBVI participants had higher employment and credential completion rates compared with those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to DBVI; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Vocational Rehabilitation (VOC) Programs","Supported employment or other employment supports Vocational rehabilitation","Disability, Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Review Protocol" "Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia","Barrera-Osorio, F., Bertrand, M., Linden, L.L., & Perze-Calle, F. (2008). Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia (World Bank Policy Research Working Paper 4580). Washington, DC: World Bank.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Subsidios Condicionados a la Asistencia Escolar, a conditional cash transfer program (CCT), on school participation and child labor. This summary focuses on the comparison between the treatment group receiving the basic CCT and the control group in Suba. The study was a randomized controlled trial in two districts in Columbia (San Cristobal and Suba). The authors compared the differential effects of receiving the cash transfer on outcomes for those in the treatment group versus those in the control group. The study found that students in the basic treatment group had a significant increase in self-reported school attendance compared to students in the control group. The study did not find any significant differences in child labor or school enrollment between students receiving the basic treatment and the control group. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Subsidios Condicionados a la Asistencia Escolar, but other factors might also have contributed.","Subsidios Condicionados a la Asistencia Escolar (Conditional Subsidies for School Attendance)","Child labor","Other, Low income",,International,2008,http://siteresources.worldbank.org/EDUCATION/Resources/278200-1099079877269/547…,"Child Labor Review Protocol" "Teaching self-sufficiency: An impact and benefit-cost analysis of a home visitation and life skills education program. Findings from the rural welfare-to-work strategies demonstration evaluation","Meckstroth, A., Burwick, A., & Moore, Q. (2008). Teaching self-sufficiency: An impact and benefit-cost analysis of a home visitation and life skills education program. Findings from the rural welfare-to-work strategies demonstration evaluation. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employer benefits receipt-Mod/high-Favorable impacts Employer benefits receipt Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Building Nebraska Families (BNF) rural welfare-to-work program on employment, earnings, and public benefit receipt. The authors randomly assigned Nebraska Temporary Assistance for Needy Families (TANF) recipients identified as hard-to-employ to either a treatment group, which received in-home life skills and family management training, or a control group, which did not. The authors evaluated the treatment’s impact using Nebraska state administrative data and follow-up surveys. The study found that BNF increased the average likelihood of ever being employed in the first year after enrollment by 10.8 percentage points and that of ever being employed in the first 30 months after enrollment by 6.3 percentage points. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the BNF rural welfare-to-work program and not to other factors.","Building Nebraska Families (BNF)","Other employment and reemployment","Low income",,"United States",2008,http://www.acf.hhs.gov/sites/default/files/opre/teaching_self.pdf,"Employment and Training Review Protocol" "A good start: Two-year effects of a freshman learning community program at Kingsborough Community College","Scrivener, S., Bloom, D., LeBlanc, A., Paxson, C., Rouse, C.E., & Sommo, C. (2008). A good start: Two-year effects of a freshman learning community program at Kingsborough Community College. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Opening Doors learning communities at Kingsborough Community College in New York on progress toward completing a degree and enrollment in a four-year college in the program semester and three follow-up semesters. Students in the Opening Doors learning communities took three linked courses during one semester and were provided tutoring and case management services. The study was a randomized controlled trial. Eligible students were randomly assigned to either the treatment group, which was offered the opportunity to participate in a learning community, or the control group, which was not allowed to enroll in a learning community. The primary data sources were a baseline survey on the background characteristics of students, student transcripts, and degree attainment information from the National Student Clearinghouse. The study found that the treatment group earned significantly more credits than the control group, cumulatively across the program semester and the three follow-up semesters,. However, during that time, there were no significant cumulative differences between the two groups on registration for any courses, the number of semesters registered, or enrollment in either a two- or four-year college. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects would be attributable to the learning communities, and not to other factors.","Opening Doors Learning Communities at Kingsborough Community College","Community college education and other classroom training","Adult, Low income",,"United States",2008,http://www.mdrc.org/sites/default/files/A%20Good%20Start.pdf,"Community College Review Protocol" "Learning better together: The impact of learning communities on the persistence of low-income students","Engstrom, C., & Tinto, V. (2008). Learning better together: The impact of learning communities on the persistence of low-income students. Opportunity Matters: A Journal of Research Informing Educational Opportunity Practice and Programs, 1(1), 5-21.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of learning communities on community college students’ persistence from freshman to sophomore year, an outcome in the progress toward degree completion domain. The authors used a nonrandom approach to select treatment and comparison students to include in their analysis. To measure the relationship between participation in a learning community and persistence, the authors used survey and administrative data from 13 community colleges to estimate a logistic regression. The study found that 62 percent of learning community students persisted from freshman to sophomore year, compared with 57 percent of comparison group students. This difference was statistically significant. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to learning communities. Other factors are likely to have contributed.","Learning Communities","Community college education and other classroom training Basic skills","Adult, Other barriers, Low income",,"United States",2008,,"Community College Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [DRS]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [DRS]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Vocational Rehabilitation program administered by Department of Rehabilitative Services (DRS) on participants’ employment and credential completion. The study used administrative records to compare the outcomes of low-income adults who took part in the DRS program with outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that DRS participants had higher employment and credential completion rates compared with those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to DRS; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies","the Vocational Rehabilitation (VOC) Programs","Job search assistance and supportive services Vocational rehabilitation","Disability, Low-skilled, Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Review Protocol" "Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia","Barrera-Osorio, F., Bertrand, M., Linden, L.L., & Perze-Calle, F. (2008). Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia (World Bank Policy Research Working Paper 4580). Washington, DC: World Bank.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Subsidios Condicionados a la Asistencia Escolar, a conditional cash transfer program (CCT), on school participation and child labor. This summary focuses on the comparison between the savings treatment group and the control group in San Cristobal. The study was a randomized controlled trial in two districts in Columbia (San Cristobal and Suba). The authors compared the differential effects of receiving the cash transfer on outcomes for those in the treatment group versus those in the control group. The study did not find any significant differences in child labor, school attendance, or school enrollment between students receiving the savings treatment and the control group. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Subsidios Condicionados a la Asistencia Escolar, but other factors might also have contributed. However, the study did not find statistically significant effects.","Subsidios Condicionados a la Asistencia Escolar (Conditional Subsidies for School Attendance)","Child labor","Other, Low income",,International,2008,http://siteresources.worldbank.org/EDUCATION/Resources/278200-1099079877269/547…,"Child Labor Review Protocol" "The Employment Retention and Advancement project: Results from the Valuing Individual Success and Increasing Opportunities Now (VISION) program in Salem, Oregon","Molina, F., Cheng, W., and Hendra, R. (2008). The Employment Retention and Advancement project: Results from the Valuing Individual Success and Increasing Opportunities Now (VISION) program in Salem, Oregon. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Salem, Oregon, Valuing Individual Success and Increasing Opportunities Now (VISION) program on employment, earnings, and public benefits receipt among eligible single parents. VISION provided job search assistance and post-employment services to unemployed Temporary Assistance for Needy Families (TANF) applicants. The study used a randomized controlled trial to assign TANF applicants eligible for welfare-to-work programs to either VISION or the state’s typical welfare-to-work program, Job Opportunities and Basic Skills Training (JOBS), from May 2002 to May 2004. To estimate differences in outcomes between the two study groups, the authors retrieved data from unemployment insurance wage records, TANF and Food Stamps administrative records, and a 12-month follow-up survey. The study found that people in the VISION group received, on average, $365 more in TANF benefits and $160 more in Food Stamps than those in the JOBS group during the first year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to VISION, and not to other factors.","the Salem Valuing Individual Success and Increasing Opportunities Now (VISION) Program","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2008,http://files.eric.ed.gov/fulltext/ED501587.pdf,"Employment and Training Review Protocol" "Testing case management in a rural context: An impact analysis of the Illinois Future Steps program: Findings from the Rural Welfare-to-Work Strategies Demonstration evaluation.","Meckstroth, A., Person, A., Moore, Q., Burwick, A., McGuirk, A., Ponza, M., Marsh, S., Novak, T., Zhao, Z., & Wheeler, J. (2008). Testing case management in a rural context: An impact analysis of the Illinois Future Steps program: Findings from the Rural Welfare-to-Work Strategies Demonstration evaluation. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Future Steps rural welfare-to-work program on employment, earnings, and public benefit receipt. The authors randomly assigned Temporary Assistance for Needy Families (TANF) and Food Stamps recipients required to work to either a treatment group, which received job search and other services, or a control group, which did not. The authors evaluated the treatment’s impact using Illinois administrative data and follow-up surveys. The authors found that the Future Steps program increased the likelihood of being employed 30 months after enrollment by 8.6 percentage points. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Future Steps rural welfare-to-work program and not to other factors.","the Future Steps Rural Welfare-to-Work Program","Job search assistance and supportive services Other employment and reemployment","Low income",,"Rural, United States",2008,http://www.acf.hhs.gov/sites/default/files/opre/testing_case.pdf,"Employment and Training Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [TAA]","Hollenbeck, K., & Huang, W.-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [TAA]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Training Adjustment Assistance (TAA) program on employment and credential completion. The study used administrative records to compare outcomes of low-income adults who took part in the TAA program with outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that TAA participants had a lower employment rate but were more likely to have obtained a training certificate compared with those who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to TAA; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Trade Adjustment Assistance (TAA) Program","Job search assistance and supportive services Other training and education","Low-skilled, Low income, Dislocated or displaced worker",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [AEL]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [AEL]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Adult Education and Literacy (AEL) program on participants’ employment and credential completion. The study used administrative records to compare outcomes of low-income adults who took part in the AEL program with outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that AEL participants had a lower employment rate but were more likely to have earned a GED compared with those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to AEL; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Adult Education and Literacy (AEL) Program","Other training and education","Low-skilled, Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Review Protocol" "Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia","Barrera-Osorio, F., Bertrand, M., Linden, L.L., & Perze-Calle, F. (2008). Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia (World Bank Policy Research Working Paper 4580). Washington, DC: World Bank.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Subsidios Condicionados a la Asistencia Escolar, a conditional cash transfer program (CCT), on school participation and child labor. This summary focuses on the comparison between the treatment group receiving the basic CCT and the control group in San Cristobal. The study was a randomized controlled trial in two districts in Columbia (San Cristobal and Suba). The authors compared the differential effects of receiving the cash transfer on outcomes for those in the treatment group versus those in the control group. The study found that students in grades 6-10 who received the basic treatment worked significantly fewer hours in the last week than students in the control group. The study did not find any significant differences in school attendance or school enrollment between students receiving the basic treatment and the control group. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Subsidios Condicionados a la Asistencia Escolar, but other factors might also have contributed.","Subsidios Condicionados a la Asistencia Escolar (Conditional Subsidies for School Attendance)","Child labor","Other, Low income",,International,2008,http://siteresources.worldbank.org/EDUCATION/Resources/278200-1099079877269/547…,"Child Labor Review Protocol" "New Hope’s eight-year impacts on employment and family income.","Miller, C., Duncan, G., Classens, A., Engel, M., Hill, H., & Lindsay, C. (2008). New Hope’s eight-year impacts on employment and family income. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the New Hope program on employment, earnings, and public benefit receipt. The authors estimated the impact of the New Hope program by comparing average outcomes among a treatment group randomly selected to have access to the program with those of a randomly selected control group that did not have access to the program. The study found no statistically significant effects on employment, earnings, or public benefit receipt eight years after the program began. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to the New Hope program and not to other factors. However, the study did not find statistically significant effects.","The New Hope Program","Other employment and reemployment","Low income",,"United States",2008,http://www.mdrc.org/sites/default/files/full_458.pdf,"Employment and Training Review Protocol" "Growing America Through Entrepreneurship: Findings from the evaluation of Project GATE","Benus, J., McConnell, S., Bellotti, J., Shen, T., Fortson, K., & Kahvecioglu, D. (2008). Growing America Through Entrepreneurship: Findings from the evaluation of Project GATE. Columbia, MD: IMPAQ International.","Entrepreneurship and Self-Employment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impacts of the Growing America Through Entrepreneurship (Project GATE) demonstration project, which offered entrepreneurship training and business counseling to low-income individuals, on participants’ employment, earnings, and public assistance benefit receipt. The authors randomly assigned study participants to a treatment group, which could participate in Project GATE, or a control group, which could not participate. The authors used Unemployment Insurance (UI) wage records and survey data in their analyses. The study did not find any statistically significant effects of Project GATE on employment, earnings, or UI benefit receipt in any of the four quarters after random assignment, using UI wage record data. The quality of causal evidence presented in this report is high for outcomes measured using UI wage record data because they were based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to Project GATE and not to other factors. However, the study did not find statistically significant effects. Outcomes measured with survey data received a low evidence rating because there is high attrition and insufficient adjustment for differences in previous employment and earnings history.","the Project Growing America Through Entrepreneurship (GATE) Demonstration","Job search assistance and supportive services Other training and education Unemployment Insurance","Low income",,"United States",2008,https://wdr.doleta.gov/research/FullText_Documents/Findings%20from%20the%20Eval…,"Employment and Training Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. Upjohn Institute technical report no. 08-024. [TANF/VIEW]","Hollenbeck, K., Huang, W.-J., and WE Upjohn Institute for Employment Research (2008). Workforce program performance indicators for the Commonwealth of Virginia. Upjohn Institute technical report no. 08-024. Kalamazoo, MI: W. E. Upjohn Institute for Employment Research. [TANF/VIEW]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Virginia Initiative for Employment Not Welfare (TANF/VIEW) program on employment and credential completion rates. The authors used administrative records to compare outcomes for low-income adults who took part in the TANF/VIEW program to a nonexperimental matched group of adults who did not take part in the program. The study found that, compared with those who did not take part in the program, the employment rate was significantly lower for those who took part in the TANF/VIEW program, but the TANF/VIEW group earned significantly more educational or training credentials. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the TANF/VIEW program; other factors are likely to have contributed.","the Virginia Initiative for Employment Not Welfare (TANF/VIEW) Program","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Employment and Training Review Protocol" "The heterogeneous impact of CCT programmes on child labor: The case of Tekoporã in Paraguay","Hirata, G. I. (2008). The heterogeneous impact of CCT programmes on child labor: The case of Tekoporã in Paraguay. Brazil: International Poverty Centre/UNDP.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Tekoporã conditional cash transfer program on children’s participation in non-domestic labor and school attendance. The author used a nonexperimental design to compare the outcomes of children ages 4 to 14 that received the conditional cash transfers with those who did not, based on data from a program eligibility questionnaire and a follow-up survey. The author used statistical models to estimate the effects of the program. The study found no significant relationship between the Tekoporã program and the number of children in the household who participated in non-domestic labor. However, the program was significantly related to decisions between school and work, with a decrease in the probability that children would “only work” or “neither work nor attend school.” The quality of causal evidence presented in this report is low because the author did not account for trends in outcomes before the intervention or adequately control for time-varying characteristics that might influence the outcome. This means we are not confident that the estimated effects are attributable to Tekoporã; other factors are likely to have contributed.",Tekoporã,"Child labor","Other, Low income",,International,2008,http://www.ucw-project.org/attachment/hirata.pdf,"Child Labor Review Protocol" "The Employment Retention and Advancement project: Impacts for Portland’s Career Builders program.","Azurdia, G., & Barnes, Z. (2008). The Employment Retention and Advancement project: Impacts for Portland’s Career Builders program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of the Portland Career Builders program on welfare recipients’ employment, earnings, and public benefits receipt outcomes after two years. The Portland site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 634 Temporary Assistance for Needy Families (TANF) applicants and recipients to either a treatment group that received Career Builder services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects on employment, earnings, and public benefits receipt outcomes one and two years after program entry. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that the estimated effects would be attributable to the Career Builders program, and not to other factors. However, the study did not find any statistically significant effects.","The Employment Retention and Advancement Project, Portland Career Builders Program","Other employment and reemployment Unemployment Insurance Other training and education","Low income",,"United States",2008,http://www.mdrc.org/sites/default/files/full_550.pdf,"Employment and Training Review Protocol" "Workforce Investment Act non-experimental net impact evaluation. [Adult sample]","Heinrich, C., Mueser, P., & Troske, K. (2008). Workforce Investment Act non-experimental net impact evaluation. Columbia, MD: IMPAQ International. [Adult sample]","Apprenticeship and Work-Based Training, Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the Workforce Investment Act (WIA) Adult Program’s impact on workers’ employment and earnings in 12 states. The authors analyzed administrative data to compare the employment and earnings outcomes of people receiving different tiers of WIA Adult Program services with two different matched comparison groups for 16 quarters after program entry. The study found that WIA Adult Program services had positive impacts on earnings and employment in most quarters examined. Those WIA Adult Program participants who received training earned more and were more likely to be employed than those who received only core and intensive services. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WIA Adult Program services, but other factors might also have contributed. The report also examined the impacts of WIA Dislocated Worker services; that profile is available here.","the Workforce Investment Act (WIA) Adult Program","Adult and Dislocated Worker programs Job search assistance and supportive services Other employment and reemployment Wagner-Peyser Act Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Other training and education","Unemployed, Low income",,"United States",2008,https://wdr.doleta.gov/research/FullText_Documents/Workforce%20Investment%20Act…,"Apprenticeship and Work-Based Training, Job Search Assistance Review Protocol" "Rapid employment model evaluation: Update","Smith, T. C., King, C. T., & Schroeder, D. G. (2008). Rapid employment model evaluation: Update. Austin, TX: Ray Marshall Center for the Study of Human Resources.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Rapid Employment Model (REM) program on participants’ employment, earnings, and Unemployment Insurance (UI) benefit claims. (See the CLEAR review of the 2010 report here.) Using program data and state UI records, the authors matched treatment group cases to comparison group cases and conducted regression analyses to estimate the effect of the intervention. The study found that participation in the REM program was associated with an increase in the likelihood that jobseekers were employed in quarters following program participation. The quality of causal evidence presented in this report is moderate for employment and earnings outcomes because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects on employment and earnings are attributable to the REM program, but other factors might also have contributed. The quality of causal evidence presented for the UI benefit claiming outcome is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects on UI benefit claiming outcome are attributable to REM program; other factors are likely to have contributed.","Rapid Employment Model (REM) Program","Job search assistance and supportive services Other training and education Unemployment Insurance","Justice-involved, Low-skilled, Low income",,"United States",2008,http://sites.utexas.edu/raymarshallcenter/files/2008/12/REM_eval_update_01-28-0…,"Review Protocol" "The Employment Retention and Advancement project: Findings for the Cleveland Achieve model: Implementation and early impacts of an employer-based approach to encourage employment retention among low-wage workers","Miller, C., Martin, V., Hamilton, G., Cates, L., and Deitch, V. (2008). The Employment Retention and Advancement project: Findings for the Cleveland Achieve model: Implementation and early impacts of an employer-based approach to encourage employment retention among low-wage workers. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to determine the impact of a program designed to increase employment retention among low-wage workers in the long-term nursing care industry in Cleveland, Ohio. Cleveland was one of 16 sites nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 44 firms to either a treatment group, whose employees could receive employment retention services through Cleveland Achieve, or a control group. The authors collected data on employee turnover directly from firms and employment and earnings data from state Unemployment Insurance (UI) records. Two years after random assignment, the study did not find statistically significant differences in the turnover rates, employment rates, or earnings of employees in Achieve firms compared with employees in firms that did not have access to Achieve services. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the Achieve program, and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Cleveland","Other employment and reemployment Unemployment Insurance","Low income","Health care and social assistance","United States, Urban",2008,http://www.acf.hhs.gov/sites/default/files/opre/cleveland.pdf,"Employment and Training Review Protocol" "Rehabilitation of traumatic brain injury in active duty military personnel and veterans: Defense and Veterans Brain Injury Center randomized controlled trial of two rehabilitation approaches","Vanderploeg, R., Schwab, K., Walker, W., Fraser, J., Sigford, B., Date, E., . . . Warden, D. (2008). Rehabilitation of traumatic brain injury in active duty military personnel and veterans: Defense and Veterans Brain Injury Center randomized controlled trial of two rehabilitation approaches. Archives of Physical Medicine and Rehabilitation, 89(12), 2227-2237.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two treatments—cognitive-didactic rehabilitation and functional-experiential rehabilitation—on return to work/school and functional independence among veterans and active military with traumatic brain injury (TBI). The study used a randomized controlled trial design in which 366 active duty military service members or veterans with moderate-to-severe TBI were randomly assigned to receive either cognitive-didactic rehabilitation, which focuses on addressing cognitive deficits, or functional-experiential rehabilitation, which emphasizes performance of real-life tasks. Primary outcomes were measured using in-person evaluations or structured telephone interviews. The study found no significant differences in return to work or school or functional independence between the two types of rehabilitation. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the difference between the cognitive-didactic and functional-experiential treatments and not to other factors. However, the study did not find statistically significant effects between the two treatments.","Cognitive-Didactic and Functional-experiential rehabilitation","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2008,,"Disability Employment Policy Review Protocol" "Cognitive and non-cognitive predictors of success in adult education programs: Evidence from experimental data with low-income welfare recipients","Leininger, L. J., & Kalil, A. (2008). Cognitive and non-cognitive predictors of success in adult education programs: Evidence from experimental data with low-income welfare recipients. Journal of Policy Analysis and Management, 27, 521-535. doi: 10.1002/pam.20357","Literacy, Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of an education-focused intervention and an employment-focused intervention on education outcomes. The authors used data from a randomized controlled trial, the National Evaluation of Welfare-to-Work Strategies (NEWWS). The NEWWS study randomly assigned individuals within seven geographic locations to one of three conditions: an education-focused intervention, an employment-focused intervention, or the control group. The current study used a subsample to examine participants’ completion of a high school diploma or equivalent two years after being assigned to one of the conditions. The study found that participation in the education-focused intervention was significantly associated with a higher likelihood of receiving a high school diploma or equivalent relative to the control group. The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with unknown attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to the education-focused or employment-focused interventions, although other factors could also have contributed.","the Education-Focused and Employment-Focused Interventions","Basic skills Other training and education","Adult, Low income",,"United States",2008,https://onlinelibrary.wiley.com/doi/abs/10.1002/pam.20357,"Literacy, Low-Income Adults Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [CTE]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [CTE]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Carl Perkins Postsecondary Career and Technical Education (CTE) program on employment and credential completion. The authors used administrative records to compare the outcomes of low-income adults who took part in the CTE program with the outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that CTE participants had higher employment and credential completion rates compared with those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to CTE; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Carl Perkins Postsecondary Career and Technical Education (CTE) Program","Other training and education Job search assistance and supportive services","Low income, Low-skilled",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Review Protocol" "Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia","Barrera-Osorio, F., Bertrand, M., Linden, L.L., & Perze-Calle, F. (2008). Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia (World Bank Policy Research Working Paper 4580). Washington, DC: World Bank.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Subsidios Condicionados a la Asistencia Escolar, a conditional cash transfer program (CCT), on school participation and child labor. This summary focuses on the comparison between the tertiary treatment group and the control group in Suba. The study was a randomized controlled trial in two districts in Columbia (San Cristobal and Suba). The authors compared the differential effects of receiving the cash transfer on outcomes for those in the treatment group versus those in the control group. The study found that students in the tertiary treatment group worked significantly less in the past week than students in the control group. They were also significantly more likely to report their primary activity as studying and less likely to report their primary activity as work or home versus students in the control group. The study did not find any significant differences in school attendance or school enrollment between students receiving the tertiary treatment and the control group. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Subsidios Condicionados a la Asistencia Escolar, but other factors might also have contributed.","Subsidios Condicionados a la Asistencia Escolar (Conditional Subsidies for School Attendance)","Child labor","Other, Low income",,International,2008,http://siteresources.worldbank.org/EDUCATION/Resources/278200-1099079877269/547…,"Child Labor Review Protocol" "Workforce program performance indicators for the commonwealth of Virginia. Upjohn Institute technical report no. 08-024 [FSET]","Hollenbeck, K., Huang, W.-J., and WE Upjohn Institute for Employment Research. (2008). Workforce program performance indicators for the commonwealth of Virginia. Upjohn Institute technical report no. 08-024, Kalamazoo, MI: W. E. Upjohn Institute for Employment Research. [FSET]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Food Stamp Employment and Training Program (FSET) on employment and credential completion rates. The authors used administrative records to compare outcomes for low-income adults who took part in the FSET program to a nonexperimental matched group of adults who did not take part in the program. The study found that, compared to those who did not take part in the program, the employment rate was significantly lower. The FSET group also earned significantly fewer educational or training credentials. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to FSET; other factors are likely to have contributed.","the Food Stamp Employment and Training Program (FSET)","Job search assistance and supportive services Other employment and reemployment","Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: A comparison of two job club strategies: The effects of enhanced versus traditional job clubs in Los Angeles","Navarro, D., Azurdia, G., & Hamilton, G. (2008). The Employment Retention and Advancement project: A comparison of two job club strategies: The effects of enhanced versus traditional job clubs in Los Angeles. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to gauge the effect of a Los Angeles job club focused on participants’ career interests on employment, earnings, and benefits receipt outcomes after about 18 months. The Los Angeles site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. (See the CLEAR review of the final report here.) The authors randomly assigned almost 1,200 single-parent Temporary Assistance for Needy Families (TANF) recipients to either a treatment group, which received Enhanced Job Club (EJC) services, or a control group, which received Traditional Job Club (TJC) services. The authors collected employment and earnings data from Unemployment Insurance (UI) records and used automated TANF and Food Stamps databases to obtain benefits receipt information. The study found that, 18 months after random assignment, there were no statistically significant differences between EJC and control group members’ employment, earnings, or public benefits receipt. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the EJC and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Los Angeles’s Enhanced Job Club","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2008,http://www.acf.hhs.gov/sites/default/files/opre/era_la.pdf,"Employment and Training Review Protocol" "Temporary help service firms’ use of employer tax credits: Implications for disadvantaged workers’ labor market outcomes","Hamersma, S., & Heinrich, C. (2008). Temporary help service firms’ use of employer tax credits: Implications for disadvantaged workers’ labor market outcomes. Southern Economic Journal, 74(4), 1123-1148.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the effect of subsidies paid to employers for hiring disadvantaged workers—specifically, the Work Opportunity Tax Credit and Welfare-to-Work Tax Credit—on workers’ earnings and employment. It also examined the interaction of the employment subsidies and being employed through a temporary help service. The study compared total earnings and total quarters employed in the first and second years after starting a job for certified workers—those workers for whom employers could receive subsidies—with those of eligible but uncertified workers. In addition, the study compared outcomes of certified workers employed through temporary help services with those of certified workers hired directly by an employer. The authors matched the groups being compared on observable characteristics using administrative data. The study found no statistically significant relationships between employer subsidies and workers’ earnings or employment. The quality of causal evidence presented in this report is low because the study did not adequately account for existing differences between the study groups. This means we are not confident that any estimated effects would be attributable to employer subsidies.","the Work Opportunity Tax Credit and Welfare-to-Work Tax Credit","Other employment and reemployment","Low income",,"United States",2008,,"Employment and Training Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [WIA-Adult]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [WIA-Adult]","Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Title I program for adults (including dislocated workers) on participants’ employment and credential completion rates. The study used administrative records to compare the outcomes for low-income adults who took part in the WIA program with a nonexperimental-matched group of adults who did not take part in the program. The study found that the WIA program participants had higher employment and credential completion rates than those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Title I program for adults (including dislocated workers); other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Title I Program for Adults","Adult and Dislocated Worker programs Job search assistance and supportive services Other employment and reemployment Other training and education Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Unemployed, Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Employment and Training Review Protocol" "Protecting education for the poor in times of crisis: An evaluation of a scholarship programme in Indonesia","Sparrow, R. (2007). Protecting education for the poor in times of crisis: An evaluation of a scholarship programme in Indonesia. Oxford Bulletin of Economics and Statistics, 69, 99-122. doi: 10.1111/j.1468-0084.2006.00438.x","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Jaring Prengaman Sosial (JPS), a scholarship program in Indonesia, on child labor and school enrollment. The author used data from an annual Indonesian national survey to estimate an instrumental variable (IV) regression model to examine if scholarship receipt affected school enrollment, and probit models to examine the effects on child labor and school attendance. The study found that the receipt of a scholarship was significantly associated with a decrease in child labor and an increase in school attendance. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before receiving the JPS in the probit model and no evidence was provided on the strength of the instrument used in the IV model. This means we are not confident that the estimated effects are attributable to the Jaring Pengaman Sosial (JPS) scholarship program; other factors are likely to have contributed.","Jaring Prengaman Sosial","Child labor Tuition assistance","Other, Low income",,International,2007,https://pdfs.semanticscholar.org/8f79/add16372936ea1e388e3a9c82e320435a87d.pdf,"Child Labor Review Protocol" "Compensation of veterans with psychiatric or substance abuse disorders and employment and earnings","Greenberg, G. A., & Rosenheck, R. A. (2007). Compensation of veterans with psychiatric or substance abuse disorders and employment and earnings. Military Medicine, 172(2), 162-168.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Veterans Affairs (VA) Compensation Program on employment for veterans with service-connected disabilities. This study compared employment outcomes for two groups of veterans: (1) disabled veterans receiving VA compensation and (2) nondisabled veterans not receiving disability compensation. To do this, the study team combined data from two national surveys: the Survey of Disabled Veterans and the National Survey of Veterans. Veterans receiving benefits of more than $800 per month from the VA Compensation Program were significantly less likely to be employed than were nondisabled veterans. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the VA Compensation Program; other factors likely contributed to the findings.","the VA Compensation Program","Disability insurance Veterans' reemployment","Disability, Veteran or military",,"United States",2007,https://academic.oup.com/milmed/article/172/2/162/4578021,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from Minnesota’s Tier 2 program","LeBlanc, A., Miller, C., Martinson, K., & Azurdia, G. (2007). The Employment Retention and Advancement project: Results from Minnesota’s Tier 2 program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to determine the 18-month impact of Minnesota’s Tier 2 welfare-to-work program compared with existing Tier 1 services. Minnesota’s Tier 2 program was part of the nationwide Employment Retention and Advancement (ERA) project. The authors randomly assigned approximately 1,700 long-term Temporary Assistance for Needy Families (TANF) recipients to either a treatment group, which received Tier 2 services including intensive assessments and case management, or a control group, which received Minnesota’s existing Tier 1 TANF services. The authors analyzed data from Minnesota Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study found that, 12 months after random assignment, more people in the Tier 2 group (79.2 percent) reported that they received Food Stamps than in the control group (70.0 percent). After 18 months however, there were no statistically significant differences between treatment and control group members’ employment, earnings, or benefits receipt. The quality of causal evidence provided in this study is high because it is based on a well-conducted randomized controlled trial. This means we are confident that any estimated effects are attributable to Minnesota’s Tier 2 program and not to other factors.","the Employment Retention and Advancement project, Minnesota’s Tier 2 Program","Job search assistance and supportive services Other employment and reemployment","Unemployed, Low income, Parent",,"United States",2007,http://www.acf.hhs.gov/sites/default/files/opre/minnesota_tier2.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the Post-Assistance Self-Sufficiency (PASS) program in Riverside, California","Navarro, D., van Dok, M., & Hendra, R. (2007). The Employment Retention and Advancement project: Results from the Post-Assistance Self-Sufficiency (PASS) program in Riverside, California. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Riverside Post-Assistance Self-Sufficiency (PASS) program on employment, earnings, and public benefits receipt after two years. The Riverside PASS site was one of two in Riverside, California, that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,770 employed single-parent participants who had recently left the Temporary Assistance for Needy Families (TANF) program to a treatment group that received ERA services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that Riverside PASS had positive impacts on earnings and employment in the first and second years after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Riverside PASS, and not to other factors.","the Riverside Post-Assistance Self-Sufficiency (PASS) Program","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2007,http://www.acf.hhs.gov/sites/default/files/opre/riverside_pass.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from two education and training models for employed welfare recipients in Riverside, California.","Navarro, D., Freedman, S., & Hamilton, G. (2007). The Employment Retention and Advancement project: Results from two education and training models for employed welfare recipients in Riverside, California. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of post-employment job supports and intensive case management on welfare recipients’ employment, earnings, and benefit receipt outcomes after two years. The Riverside Phase 2 site was one of two in Riverside, California, that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,907 employed single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups that received differing ERA services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that the households of participants in the Work Plus program were 10.5 percentage points less likely to receive TANF benefits relative to those in the control group 12 months after random assignment. The study found no statistically significant effects associated with the Training Focused program. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Riverside Work Plus program and not to other factors. It also means that we would be confident that any estimated effects would be attributable to Riverside Training Focused program and not to other factors. However, the study did not find statistically significant effects of the Training Focused program.","the Employment Retention and Advancement Project—Work Plus and Training Focused (Phase 2), Riverside","Other employment and reemployment","Parent, Low income",,"United States",2007,http://www.acf.hhs.gov/sites/default/files/opre/riverside_phase2.pdf,"Employment and Training Review Protocol" "Adding contingency management intervention to vocational rehabilitation: Outcomes for dually diagnosed veterans","Drebing, C. E., Van Ormer, E. A., Mueller, L., Hebert, M., Penk, W. E., Petry, N. M., . . . Rounsaville, B. (2007). Adding contingency management intervention to vocational rehabilitation: Outcomes for dually diagnosed veterans. Journal of Rehabilitation Research & Development, 44(6), 851-865.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Health and safety-Mod/high-Favorable impacts Health and safety","Summary: The study examined the impact of contingency management (CM) on employment and health outcomes. The authors conducted a randomized controlled trial, using a work history form and drug and alcohol screenings to collect participant data. At nine months, 50 percent of the individuals in the treatment group had obtained competitive employment compared with only 28 percent of those in the control group. Treatment group participants remained abstinent from drugs and alcohol longer than control group participants (11.8 weeks versus 9.4 weeks). Treatment group participants were also less likely to relapse by week 16 (50 percent versus 72 percent). The quality of causal evidence presented in this report is high for employment outcomes because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the CM program, and not to other factors.","Contingency Management","Veterans' reemployment","Veteran or military",,"United States",2007,https://www.rehab.research.va.gov/jour/07/44/6/drebing.html,"Employment and Training Review Protocol" "Youth Opportunity Grant Initiative: Impact and synthesis report","Jackson, R., Dixon, R., McCoy, A., Pistorino, C., Zador, P., Thomas, C., … Bruno, L. (2007). Youth Opportunity Grant Initiative: Impact and synthesis report. Houston, TX: Decision Information Resources, Inc.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: This report’s objective was to examine the effectiveness of the Youth Opportunity (YO) Grant Initiative, which sought to improve job prospects and education outcomes for youth in high-poverty areas by providing them with a mix of 15 youth development activities. Companion reports describe the initiative’s implementation. The initiative’s effectiveness was evaluated using two separate comparison group designs. In general, the study found positive and statistically significant relationships between the YO initiative and educational enrollment outcomes. However, there were few statistically significant effects on employment-related outcomes and educational attainment. The quality of the causal evidence presented in this study is low. This means we are not confident that the estimated impacts were caused by the YO Grant Initiative, and not other factors.","Youth Opportunity Grant Initiative","Basic skills Community college education and other classroom training Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2007,http://wdr.doleta.gov/research/FullText_Documents/YO%20Impact%20and%20Synthesis…,"Opportunities for Youth Review Protocol" "Evaluating the impacts of Washington State repeated job search services on the earnings of prime‐age female TANF recipients.","Hsiao, C., Shen, Y., Wang, B., & Weeks, G. (2007). Evaluating the impacts of Washington State repeated job search services on the earnings of prime‐age female TANF recipients. Journal of Applied Econometrics, 22(2), 453-475.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impacts of Job Search Services (JSS) on employment and earnings outcomes of women ages 25 to 35 who participated in the WorkFirst program in Washington State. The authors used a nonexperimental study design to examine the earnings and employment outcomes of women who took part in JSS. Women were categorized as being in the treatment group if they participated in JSS at least once from the second quarter of 1998 to the fourth quarter of 2000. Women who did not participate in JSS during this time made up the comparison group. The study found that the first instance of participation in JSS increased the likelihood of employment by 4 percent for women seeking employment. The study also found a positive and statistically significant relationship between quarterly earnings and participation in JSS one or more times for employed women. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared exhibited similar employment or earnings outcomes before the intervention. This means we are not confident that the estimated effects are attributable to JSS; other factors are likely to have contributed.","Job Search Services (JSS)","Community college education and other classroom training Job search assistance and supportive services Other training and education","Low income",,"United States",2007,,"Employment and Training Review Protocol" "Evaluation of LA’s HOPE: Ending chronic homelessness through employment and housing—Final report.","Burt, M. (2007). Evaluation of LA’s HOPE: Ending chronic homelessness through employment and housing—Final report. Washington, DC: U.S. Department of Housing and Urban Development and U.S. Department of Labor.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of Los Angeles’ Homeless Opportunity Providing Employment (HOPE) program on employment, housing, and income. The study used a quasi-experimental design in which the authors compared participants in the HOPE program with participants in other programs that provided many of the same services but not its specialized housing and employment resources. The authors presented direct comparisons, as well as comparisons that adjusted for the groups’ differences in age, race, mental health diagnoses, and recent experience of homelessness and incarceration. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the author did not account for differences between members of the program and comparisons groups or show that they were similar when they joined the study. This means we are not confident that the estimated effects are attributable to Los Angeles’ HOPE program; other factors are likely to have contributed.","Los Angeles’ Homeless Opportunity Providing Employment (HOPE)","Other employment and reemployment","Low income, Homeless, Disability",,"United States",2007,http://www.urban.org/sites/default/files/alfresco/publication-pdfs/411631-Evalu…,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the Personal Roads to Individual Development and Employment (PRIDE) program in New York City","Bloom, D., Miller, C., and Azurdia, G. (2007). The Employment Retention and Advancement project: Results from the Personal Roads to Individual Development and Employment (PRIDE) program in New York City. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Personal Roads to Individual Development and Employment (PRIDE) welfare-to-work program in New York City on the employment, earnings, and public benefits receipt of low-income single parents with physical or mental health problems that limited their ability to work. The study was a randomized controlled trial that used data from administrative records for the two years following assignment and a survey conducted with a random subset of the sample to assess outcomes one year after assignment. The study found that treatment group participants were significantly more likely than control group participants to have had a job and had higher average earnings. The treatment group was significantly less likely to receive cash assistance and received lower amounts of cash assistance benefits than the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to PRIDE and not to other factors.","Personal Roads to Individual Development and Employment (PRIDE)","Other employment and reemployment","Disability, Low income, Parent",,"United States, Urban",2007,http://www.acf.hhs.gov/sites/default/files/opre/era_pride.pdf,"Employment and Training Review Protocol" "Implementation of supported employment for homeless veterans with psychiatric or addiction disorders: Two-year outcomes","Rosenheck, R. A., & Mares, A. S. (2007). Implementation of supported employment for homeless veterans with psychiatric or addiction disorders: Two-year outcomes. Psychiatric Services, 58(3), 325-333.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact a newly implemented Individual Placement and Support (IPS) program had on employment and earnings outcomes of homeless veterans who were diagnosed with a psychiatric or substance abuse problem. The study team compared raw and adjusted outcome data for veterans who received IPS services and veterans who did not. The team used study participant interviews, activity logs, and employer contacts as data sources. The study found a statistically significant relationship between participation in the IPS program and competitive employment. The quality of causal evidence presented in this report is low because the data on the two groups were not collected at the same time. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support (IPS)","Substance abuse recovery Job search assistance and supportive services Veterans' reemployment","Other barriers, Veteran or military, Homeless",,"United States",2007,https://ps.psychiatryonline.org/doi/full/10.1176/ps.2007.58.3.325,"Employment and Training Review Protocol" "Evaluating multi-treatment programs: Theory and evidence from the U.S. Job Training Partnership Act experiment.","Plesca, M., & Smith, J. (2007). Evaluating multi-treatment programs: Theory and evidence from the U.S. Job Training Partnership Act experiment. Empirical Economics, 32, 491-528.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Job Training Partnership Act (JTPA) on earnings and employment for disadvantaged adults. The authors conducted a randomized controlled trial. They analyzed data from one baseline survey, two follow-up surveys, and earnings and employment records. The study found that men in the treatment group had earned more at the 30-month follow-up than men in the control group, and that women in the treatment group experienced significantly better earnings and employment outcomes at several points compared to the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to JTPA, and not to other factors.","Job Training Partnership Act","Other training and education Supported employment or other employment supports Job search assistance and supportive services","Adult, Female, Male, Low-skilled, Low income",,"United States",2007,,"Review Protocol" "A comparison of two Welfare-to-Work strategies among African American women in Atlanta, Georgia. (Unpublished doctoral dissertation).","Wilson-Brewster, V.L. (2006). A comparison of two Welfare-to-Work strategies among African American women in Atlanta, Georgia. (Unpublished doctoral dissertation). Capella University, Minneapolis, Minnesota.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the effectiveness of two welfare-to-work programs—the Labor Force Attachment (LFA) program and the Human Capital Development (HCD) program—on the employment and earnings of African American women 25, 35, and 45 years old in Atlanta. The author analyzed a subsample of participants in the National Evaluation of Welfare-to-Work Strategies (NEWWS) study. The study was a randomized controlled trial that assigned individuals within a geographic location to one of three groups: LFA, HCD, or a control group. The study found that women in the 35-year-old group who participated in LFA or HCD had higher earnings and needed less time to find a job than those in the other age cohorts. The quality of causal evidence presented in this report is low because the study was a randomized controlled trial with unknown attrition and the authors did not account for preexisting differences between the groups being compared in their analysis. This means we are not confident that the estimated effects are attributable to LFA or HCD programs; other factors are likely to have contributed.","Labor Force Attachment (LFA) and Human Capital Development (HCD)","Other employment and reemployment Other training and education","Female, Black or African American, Low income, Parent",,"United States, Urban",2006,,"Employment and Training Review Protocol" "National Job Corps study and longer-term follow-up study: Impact and benefit-cost findings using survey and summary earnings records data","Schochet, P., Burghardt, J., & McConnell, S. (2006). National Job Corps study and longer-term follow-up study: Impact and benefit-cost findings using survey and summary earnings records data. Washington, DC: Employment and Training Administration, U.S. Department of Labor.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The National Job Corps Study included several reports, including this longer-term impact report. The report’s objective was to examine the impact of the Job Corps program on participants’ long-term earnings, employment, and other outcomes. Job Corps offered intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. Its effectiveness was evaluated using a randomized controlled trial conducted in 48 states and the District of Columbia. The study found a number of statistically significant, positive impacts of Job Corps on earnings and employment in the first four follow-up years. However, there were no significant differences between the youth who were offered Job Corps and the control group on employment rate or earnings in the fifth through ninth follow-up years, as measured by administrative data. The quality of causal evidence presented in this report is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the effects estimated in the study are solely attributable to Job Corps, and not to other factors.","Job Corps","Job search assistance and supportive services Work based and other occupational training","Youth, Low-skilled, Low income",,"United States",2006,https://www.mathematica-mpr.com/-/media/publications/pdfs/jobcorpimpactbenefit…,"Opportunities for Youth Review Protocol" "Paths to work in rural places: Key findings and lessons from the impact evaluation of the Future Steps rural welfare-to-work program.","Meckstroth, A., Burwick, A., Ponza, M., Marsh, S., Novak, T., Phillips, S., Diaz-Tena, N., & Ng, J. (2006). Paths to work in rural places: Key findings and lessons from the impact evaluation of the Future Steps rural welfare-to-work program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Future Steps rural welfare-to-work program on earnings and public benefit receipt. The authors randomly assigned Temporary Assistance for Needy Families (TANF) and Food Stamps recipients required to work to either a treatment group, which received earnings-focused case management, job search, and other services, or to a control group, which did not receive services. The authors evaluated the treatment’s impact using Illinois administrative data and follow-up surveys. The study did not find any statistically significant effects on earnings or public benefit receipt in the first 18 months after participants were offered access to the program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to the Future Steps rural welfare-to-work program and not to other factors. However, the study did not find statistically significant effects.","the Future Steps Rural Welfare-to-Work Program","Job search assistance and supportive services Other employment and reemployment","Low income",,"United States",2006,http://www.acf.hhs.gov/sites/default/files/opre/paths_to_work.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the Texas ERA site [Texas ERA—Houston]","Martinson, K., & Hendra, R. (2006). The Employment Retention and Advancement project: Results from the Texas ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Houston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after 18 to 24 months. The Houston site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,800 single-parent participants in Houston’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program (SNAP) administrative records. The study did not find any statistically significant effects on employment or earnings. However, the study found that treatment group members received, on average, $33 more in TANF benefits in the ninth quarter after random assignment than those in the control group. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program, and not to other factors.","the Employment Retention and Advancement project, Houston","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2006,http://www.acf.hhs.gov/sites/default/files/opre/results_texas.pdf,"Employment and Training Review Protocol" "Effects of housing vouchers on welfare families: Final report","Mills, G., Gubits, D., Orr, L., Long, D., Feins, J., Kaul, B., & Wood, M. (2006). Effects of housing vouchers on welfare families: Final report. Washington, DC: U.S. Department of Housing and Urban Development.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Welfare-to-Work housing voucher on employment, earnings, and public benefit receipt. The authors allocated the available vouchers by lottery to eligible families who were willing to participate in the study. Using Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), housing assistance administrative data, and baseline and follow-up surveys, the authors compared the outcomes of those randomly assigned to receive a voucher with outcomes of those who were not, adjusting for chance preintervention differences between the groups. The study found that the Welfare-to-Work vouchers increased the likelihood of receiving TANF benefits in the third half-year (months 12–18) after random assignment by 2.1 percentage points and the likelihood of receiving Food Stamps in the same period by 2.5 percentage points. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Welfare-to-Work voucher and not to other factors.","the Welfare-to-Work Voucher Program","Other employment and reemployment","Low income",,"Urban, United States",2006,https://www.huduser.gov/publications/pdf/hsgvouchers_1_2011.pdf,"Employment and Training Review Protocol" "Cash transfers, conditions, school enrollment, and child work: Evidence from a randomized experiment in Ecuador","Schady, N. & Araujo, M. C. (2006). Cash transfers, conditions, school enrollment, and child work: Evidence from a randomized experiment in Ecuador. Policy Research Working Paper No. 3930. Washington, DC: The World Bank. Retrieved from https://openknowledge.worldbank.org/handle/10986/8452  ","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of the Bono de Desarrollo Humano (BDH) program on child labor and school enrollment for children 6-17 years old. The study used a randomized controlled trial to compare the outcomes of children in households assigned to participate in the program to outcomes of those who did not participate. The study found a significant relationship between being selected for the BDH program and whether children worked and hours per week children worked; both were significantly lower for those in the treatment group than those in the control group. The study also found that children selected into the BDH program had significantly higher rates of school enrollment and significantly lower rates of having dropped out since the program began. The quality of causal evidence presented in this report is low because it is a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Bono de Desarrollo Humano program; other factors are likely to have contributed.","Bono de Desarrollo Humano (BDH) program","Child labor","Other, Low income",,International,2006,https://openknowledge.worldbank.org/handle/10986/8452,"Child Labor Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). [WIA Adult]","Hollenbeck, K., & Huang, W-J. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [WIA Adult]","Apprenticeship and Work-Based Training, Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program on the employment rate, earnings, and public benefit receipt of low-income adults in Washington State. The authors used a nonexperimental design to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and public benefit receipt between those who took part in the WIA Adult Program and those who registered for employment services at the state Labor Exchange. The study found that, compared with those who registered for services at the Labor Exchange, participants in the WIA Adult Program had higher employment, earnings, and public benefit receipt. The quality of causal evidence presented in this report is low because the authors compared the treatment and comparison groups at different follow-up points and the groups were therefore not equivalent. This means we are not confident that the estimated effects are attributable to the WIA Adult Program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Adult Program","Adult and Dislocated Worker programs Job search assistance and supportive services Labor Exchange Other employment and reemployment Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Other training and education","Unemployed, Low income",,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica…,"Apprenticeship and Work-Based Training, Job Search Assistance Review Protocol" "College as a job advancement strategy: Final report on the New Visions Self-Sufficiency and Lifelong Learning Project","Fein, D., & Beecroft, E. (2006). College as a job advancement strategy: Final report on the New Visions Self-Sufficiency and Lifelong Learning Project. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Riverside Community College’s New Visions Self-Sufficiency and Lifelong Learning Project on welfare recipients’ employment, earnings, welfare receipt, and educational achievement. The study was based on a randomized controlled trial and estimated the effect of offering welfare recipients the New Visions Project services compared with encouraging recipients to participate in other employment services. The authors used California public benefits and community college administrative data to compare average outcomes among those offered access to New Visions with the average outcomes of those excluded, after adjusting for differences in demographic and pre-intervention characteristics between the groups. The study found that participants in the New Visions program received $456 more in Temporary Assistance for Needy Families (TANF) payments than control group participants in the third year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Visions Project, and not to other factors.","the New Visions Self-Sufficiency and Lifelong Learning Project","Community college education and other classroom training Other employment and reemployment","Low income, Parent",,"United States",2006,http://www.acf.hhs.gov/sites/default/files/opre/nv_final_pdf.pdf,"Employment and Training Review Protocol" "Evaluating the effectiveness of the Massachusetts workforce development system using no-shows as a nonexperimental comparison group.","Raphael, S., & Stoll, M. A. (2006). Evaluating the effectiveness of the Massachusetts workforce development system using no-shows as a nonexperimental comparison group. Evaluation Review, 30(4), 379-429.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Job Training Partnership Act (JTPA) workforce development program in Massachusetts on the earnings of disadvantaged adults. The study used a nonexperimental design to compare the earnings of program participants before and after the intervention, relative to the earnings of nonparticipants who were eligible and offered services but chose not to participate in a training program. The authors used administrative records from the Commonwealth Corporation of Massachusetts for their analysis. The study found that, although the participants in the Massachusetts JTPA program earned significantly less than nonparticipants during the year of the program, participants earned significantly more one year ($1,876) and two years ($2,285) after the program, compared with nonparticipants. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to JTPA, but other factors might also have contributed.","the Massachusetts JTPA Workforce Development Program","Job search assistance and supportive services Other training and education","Low-skilled, Low income",,"United States",2006,,"Review Protocol" "The Employment Retention and Advancement project: Results from the Texas ERA site [Texas ERA—Forth Worth]","Martinson, K., & Hendra, R. (2006). The Employment Retention and Advancement project: Results from the Texas ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Forth Worth]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after 18 to 24 months. The Fort Worth site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,200 single-parent participants in Fort Worth’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program (SNAP) administrative records. The study found that treatment group members were 6.1 percentage points more likely to have been employed at any time in the second year after random assignment than those in the control group. Treatment group members were also 4.2 percentage points more likely to be employed during the last quarter of that second year. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program, and not to other factors.","the Employment Retention and Advancement project, Fort Worth","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2006,http://www.acf.hhs.gov/sites/default/files/opre/results_texas.pdf,"Employment and Training Review Protocol" "Paying for persistence: Early results of a Louisiana scholarship program for low-income parents attending community college","Brock, T., & Richburg-Hayes, L. (2006). Paying for persistence: Early results of a Louisiana scholarship program for low-income parents attending community college. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Louisiana Opening Doors, a scholarship program, on semester-to-semester retention and course completion at two community colleges in Louisiana. The study was a randomized controlled trial that compared the outcomes of treatment and control groups over three semesters. The primary data sources were students’ transcripts from the colleges and a baseline survey on students’ background characteristics. The study found that students who participated in the Opening Doors program attempted and passed a greater number of courses, registered for and earned more credits, and were enrolled for more semesters than students in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Louisiana Opening Doors program, and not to other factors.","Opening Doors in Louisiana","Community college education and other classroom training Tuition assistance","Adult, Low income, Parent",,"United States",2006,http://www.mdrc.org/sites/default/files/full_472.pdf,"Community College Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). [WIA Youth]","Hollenbeck, K., & Huang, W-J. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [WIA Youth]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Youth program on the employment rate and earnings of low-income youth. The authors used a nonexperimental method to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and public benefits receipt between those who took part in the WIA Youth program relative to those who registered for services at the Labor Exchange. The study found that, compared with those who registered for Labor Exchange services, WIA Youth program participants had lower employment, with mixed findings for earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Youth program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Youth Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Youth programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Youth, Low income",,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica…,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the Chicago ERA site","Bloom, D., Hendra, R., & Page, J. (2006). The Employment Retention and Advancement project: Results from the Chicago ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to determine the effectiveness of a Chicago program to increase the earnings of Temporary Assistance for Needy Families (TANF) recipients after two years. The Chicago site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,615 TANF recipients to either a treatment group, which received enhanced employment services, or a control group, which received benefits as usual. The authors collected employment and earnings data from Illinois Unemployment Insurance (UI) records and Food Stamps and TANF receipt data from Illinois administrative records. The study found that members of the ERA group were more likely to be employed (70 versus 66 percent) in the first year after random assignment and received significantly less in TANF benefits ($1,307, compared with $1,586 among control group members). Effects on employment and benefits receipt persisted into the second year after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable to the Chicago ERA program, and not to other factors.","the Employment Retention and Advancement project, Chicago","Other employment and reemployment Unemployment Insurance","Low income",,"United States, Urban",2006,http://www.acf.hhs.gov/sites/default/files/opre/chicago_era.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the Texas ERA site [Texas ERA—Corpus Christi]","Martinson, K., & Hendra, R. (2006). The Employment Retention and Advancement project: Results from the Texas ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Corpus Christi]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after 18 to 24 months. The Corpus Christi site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,300 single-parent participants in Corpus Christi’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program (SNAP) administrative records. The study did not find statistically significant effects 18 to 24 months after random assignment on employment, earnings, and public benefit receipt. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the ERA program and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Corpus Christi","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2006,http://www.acf.hhs.gov/sites/default/files/opre/results_texas.pdf,"Employment and Training Review Protocol" "Entrepreneurial discovery by the working poor","Fiet, J., Nixon, R., Gupta, M., & Patel, P. (2006). Entrepreneurial discovery by the working poor. Journal of Developmental Entrepreneurship, 11(3), 255-273.","Entrepreneurship and Self-Employment","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of systematic search training on the number of business ideas participants generated, particularly business ideas inspired by occupational experience and ideas likely to create wealth. The authors randomly assigned sample members into a treatment group, which could participate in a series of training sessions on systematic search, and a control group, which could not participate in that training. They then compared the number of ideas each group produced, overall and in categories defined by type of idea. The study found that members of the treatment group produced significantly more wealth-creating ideas and developed more ideas based on occupational experience than members of the control group. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition and the authors did not adequately control for differences in background characteristics between the groups. This means we are not confident that the estimated effects are attributable to systematic search training; other factors are likely to have contributed.",,"Other training and education","Low income",,"United States",2006,,"Employment and Training Review Protocol" "Effects of housing vouchers on welfare families: Final report","Mills, G., Gubits, D., Orr, L., Long, D., Feins, J., Kaul, B., Wood, M., Jones, A., Cloudburst Consulting Associates, & the QED Group. (2006). Effects of housing vouchers on welfare families: Final report. Prepared for the U.S. Department of Housing and Urban Development, Office of Policy Development and Research. Cambridge, MA: Abt Associates Inc.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of providing low-income families with private market housing vouchers on employment, earnings, receipt of public assistance, and receipt of education and training. It also examined impacts on several measures of housing security, which are not included in this review. The authors implemented a randomized controlled trial and estimated regression models to compare outcomes of treatment and comparison families. The study found that treatment group members received more Temporary Assistance for Needy Families (TANF) cash benefits and food stamps than control group members. There were no statistically significant effects of the program on employment, earnings, or receiving education or training. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the housing voucher, and not to other factors.","the Welfare-to-Work Voucher Program","Other wages and benefits","Low-skilled, Low income",,"United States",2006,http://www.huduser.gov/publications/pdf/hsgvouchers_1_2011.pdf,"Review Protocol" "Managing customers’ training choices: Findings from the Individual Training Account experiment","McConnell, S., Stuart, E., Fortson, K., Decker, P., Perez-Johnson, I., Harris, B., & Salzman, J. (2006). Managing customers’ training choices: Findings from the Individual Training Account experiment. Final report, Series: ETAOP 2007-01. Washington, DC: Employment and Training Administration, U.S. Department of Labor.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Training-Mod/high-Favorable impacts Training","Summary: The study’s objective was to compare the impacts of individual training account (ITA) approaches on customers’ training completion, employment, earnings, and benefits receipt outcomes after 15 months. The authors randomly assigned about 8,000 adults and dislocated workers from eight workforce investment agencies across the United States to three ITA approaches: structured customer choice, maximum customer choice, or guided customer choice. The authors analyzed data from Unemployment Insurance (UI) records and from a survey conducted on a random subsample of study participants. The study found the customers in the structured customer choice approach received significantly higher amounts of public assistance benefits than did customers in the guided customer choice group. The study also found that the structured customer choice group had higher earnings and lower education and training compared with the maximum customer choice group, whereas the maximum customer choice group had lower earnings and higher public assistance benefits compared with the guided customer choice group. The quality of causal evidence provided in this study is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to differences in the ITA approaches, and not to other factors.","the Individual Training Accounts (ITA) Approaches","Other employment and reemployment Other training and education","Dislocated or displaced worker, Low income",,"United States",2006,http://scholar.google.com/scholar_url?url=http%3A//cire.mathematica-mpr.com/~/m…,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Chicago]","Bloom, D, Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Chicago]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to determine the effectiveness of a Chicago program to increase the earnings of Temporary Assistance for Needy Families (TANF) recipients after one year. The Chicago site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 990 TANF recipients to either a treatment group, which received enhanced employment services, or a control group, which received benefits as usual. The authors collected employment and earnings data from Illinois Unemployment Insurance (UI) records and Food Stamps and TANF receipt data from Illinois administrative records. The study found that those in the Chicago ERA program received, on average, $193 less in TANF benefits in the first year after random assignment than those in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Chicago ERA project, and not to other factors.","the Employment Retention and Advancement project, Chicago","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Texas ERA—Houston]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Houston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after one year. The Houston site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,816 unemployed single-parent participants in Houston’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of the Houston ERA program on employment, earnings, and benefits receipt one year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to the Houston ERA program and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement project, Houston","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "Net impact estimates for services provided through the Workforce Investment Act. ETA Occasional Paper 2005-06. [WIA Adult]","Hollenbeck, K., Schroeder, D., King, C., & Huang, W. (2005). Net impact estimates for services provided through the Workforce Investment Act. ETA Occasional Paper 2005-06. Washington, DC: U.S. Department of Labor, Employment and Training Administration. [WIA Adult]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program’s core, intensive, and training services on the employment rate, earnings, and benefits receipt of low-income adults ages 22 to 64. The authors established three treatment groups based on the level of WIA services used and matched them to three comparison groups that participated in Employment Services (ES) and/or the core WIA services. The study found that the employment rate and average quarterly earnings were significantly higher for those in each of the treatment groups compared with their matched comparison groups. Benefits receipt was also significantly lower for those in the treatment groups than in their comparison groups. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Adult Program; other factors are likely to have contributed.","the Workforce Investment Act (WIA) Adult Program","Job search assistance and supportive services Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Low-skilled, Low income",,"United States",2005,https://wdr.doleta.gov/research/FullText_Documents/Net%20Impact%20Estimates%20f…,"Employment and Training Review Protocol" "Promoting work in public housing: The effectiveness of Jobs-Plus","Bloom, H., Riccio, J., Verma, N., & Walter, J. (2005). Promoting work in public housing: The effectiveness of Jobs-Plus. New York City: MDRC","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Jobs-Plus Community Revitalization Initiative for Public Housing Families (Jobs-Plus) program on the employment and earnings of residents in housing developments in six cities in the United States. The study was a randomized controlled trial that used data from administrative records to compare outcomes between treatment and control group members from one to five years after random assignment. The study found that residents in the Jobs-Plus housing developments had higher long-term earnings than residents in the control group developments. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Jobs-Plus program and not to other factors.","the Jobs-Plus Community Revitalization Initiative for Public Housing Families (Jobs-Plus) Program","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States, Urban",2005,http://www.mdrc.org/sites/default/files/full_485.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Texas ERA—Fort Worth]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [Texas ERA—Fort Worth]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after one year. The Fort Worth site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,163 unemployed single-parent participants in Fort Worth’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of the Texas ERA program in Fort Worth on employment, earnings, and benefits receipt one year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to Texas ERA and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement project, Fort Worth","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The impact of enhanced incentives on vocational rehabilitation outcomes for dually diagnosed veterans.","Drebing, C. E., Van Ormer, E. A., Krebs, C., Rosenheck, R., & Rounsaville, B. (2005). The impact of enhanced incentives on vocational rehabilitation outcomes for dually diagnosed veterans. Journal of Applied Behavioral Analysis, 38(3), 359-372.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-No impacts Employment Health and safety-Low-Favorable impacts Health and safety","Summary: The study examined the impact of enhanced incentives within an existing Veteran’s Administration (VA) Compensated Work Therapy (CWT) program on sustained abstinence from substances, transitioning to competitive employment, retention in competitive employment, and wages. The study was a randomized controlled trial that compared outcomes for the intervention and control groups over 16 weeks. The CWT program’s clinical and financial records were used to assess employment and wage outcomes. Urine screens and participant reports were used to measure substance use outcomes. The study found that total wages for the enhanced incentives group were significantly higher than for the control group. The study also found that the intervention group abstained from substance use for a significantly longer time than the control group. The quality of causal evidence presented in this report is low for the employment and earnings outcomes because the authors did not establish that the intervention and control groups were equivalent one year before the intervention in terms of earnings or employment. This means we are not confident the estimated effects on these outcomes are attributable to the enhanced incentives in the CWT program; other factors are likely to have contributed.","Veterans’ Administration’s Compensated Work Therapy Program with Enhanced Incentives","Health Substance abuse recovery Veterans' reemployment","Veteran or military","Health care and social assistance","United States",2005,https://files.eric.ed.gov/fulltext/EJ725227.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Riverside, CA – Training Focused]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Riverside, CA – Training Focused]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the effectiveness of a Riverside, California, program to increase the earnings of welfare recipients after one year. The Riverside Phase 2 site was one of two in Riverside that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,912 employed single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups (Work Plus or Training Focused) that received differing ERA services, or to a control group (Work Focused) that received standard public benefits and some limited case management. This review compared between the Training Focused program and the control group. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects on employment, earnings, or benefit receipt. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means that we would be confident that any estimated effects would be attributable to Riverside Training Focused program and not to other factors. However, the study did not find statistically significant effects.","the Employment Retention and Advancement (ERA) Project—Training Focused (Phase 2), Riverside","Other employment and reemployment","Low income",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Texas ERA—Corpus Christi]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [Texas ERA—Corpus Christi]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after one year. The Corpus Christi site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,300 single-parent participants in Corpus Christi’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program administrative records. The study did not find any statistically significant effects one year after random assignment on employment, earnings, and public benefits receipt. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the Corpus Christi ERA program and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Corpus Christi","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "Work rehabilitation for middle-aged and older people with schizophrenia: A comparison of three approaches.","Twamley, E. W., Padin, D. S., Bayne, K. S., Narvaez, J. M., Williams, R. E., & Jeste, D. V. (2005). Work rehabilitation for middle-aged and older people with schizophrenia: A comparison of three approaches. Journal of Nervous and Mental Disease, 193(9), 596-601.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study examined the impact of the Wellness and Vocational Enrichment Clinic (WAVE), a conventional vocational rehabilitation program with some elements of supported employment, on veterans’ employment outcomes. The study used statistical tests to examine differences between veterans who were offered WAVE and individuals who were offered the Department of Rehabilitation’s Employment Services (DOR), a conventional vocational rehabilitation program. The data from this study come from program records. The study found no statistically significant relationships between participation in WAVE and volunteer or paid work, or between participation in WAVE and competitive work or compensated work therapy. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the WAVE program; other factors are likely to have contributed.","Wellness and Vocational Enrichment Clinic (WAVE)","Veterans' reemployment","Veteran or military",,"United States",2005,,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Riverside, CA – Work Plus]","Bloom, D., Hendra, R., Martinson, K. & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Riverside, CA – Work Plus]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the effectiveness of a Riverside, California, program to increase the earnings of welfare recipients after one year. The Riverside Phase 2 site was one of two in Riverside that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,912 employed single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups (Work Plus or Training Focused) that received different ERA services, or to a control group (Work Focused) that received standard public benefits and some limited case management. This review compared the Work Plus program and the control group. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study found that those in the Work Plus group were 5 percentage points more likely to receive Food Stamps in the year after random assignment than those in the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Riverside Work Plus program and not to other factors.","the Employment Retention and Advancement (ERA) Project—Work Plus (Phase 2), Riverside","Other employment and reemployment","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [South Carolina] (Bloom et al. 2005)","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [South Carolina]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on former welfare recipients’ employment and benefits receipt outcomes after one year. The South Carolina site was one of 16 sites nationwide that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,839 people who had recently left the Temporary Assistance for Needy Families (TANF) to either a treatment group (Moving Up) that received ERA services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of Moving Up on employment, earnings, or benefits receipt one year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to Moving Up and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement Project, South Carolina","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The challenge of repeating success in a changing world: Final report on the Center for Employment Training replication sites","Miller, C., Bos, J., Porter, K., Tseng, F., & Abe, Y. (2005). The challenge of repeating success in a changing world: Final report on the Center for Employment Training replication sites. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Mixed impacts Education and skills gains Employment-Mod/high-Mixed impacts Employment Training-Mod/high-Favorable impacts Training","Summary: This report’s objective was to examine the effectiveness of the Center for Employment Training (CET) model. Under this model, local employers help design training programs and provide them in a work-like environment to economically disadvantaged youth who are not in school or employed. A separate report examined CET implementation. The effectiveness of the CET model in improving employment, earnings, and participation in education and training programs was evaluated using a randomized controlled trial (RCT) conducted in 12 sites in seven states. The study found few statistically significant impacts on outcomes measured over a 54-month follow-up period. The quality of the causal evidence presented in this study is moderate. This means we have confidence that the effects estimated in this study are attributable at least in part to the CET program. However, other factors not accounted for in the study might also have contributed to the estimated effect.","the Center for Employment Training (CET) Replication","Basic skills Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2005,http://www.mdrc.org/sites/default/files/full_530.pdf,"Opportunities for Youth Review Protocol" "Building learning communities: Early results from the Opening Doors Demonstration at Kingsborough Community College","Bloom, D., & Sommo, C. (2005). Building learning communities: Early results from the Opening Doors Demonstration at Kingsborough Community College. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Opening Doors learning community program at Kingsborough Community College in Brooklyn, New York, on students’ persistence, course completion, and credits earned during the 2003–2004 academic year. The study was a randomized controlled trial in which students were randomly assigned to the Opening Doors learning community treatment group or the control group. Data sources included students’ transcript data provided by Kingsborough and data from a baseline survey completed by students at the time of random assignment. This study found that the Opening Doors learning community program at Kingsborough had positive impacts on developmental course enrollment and passage rates, percentage and number of courses passed, equated credits earned in the program semester, and developmental course enrollment in the first postprogram semester. During the first academic year, Opening Doors students earned significantly more equated credits and made significantly more progress in required English courses than the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Opening Doors learning communities, and not to other factors.","Opening Doors Learning Communities at Kingsborough Community College","Community college education and other classroom training","Adult, Low income",,"United States",2005,http://files.eric.ed.gov/fulltext/ED485506.pdf,"Community College Review Protocol" "Improving success in a veterans homeless domiciliary vocational program: Model development and evaluation","LePage, J. P., Bluitt, M., House-Hatfield, T., McAdams, H., Burdick, M., Dudley, D., …& Gaston, C. (2005). Improving success in a veterans homeless domiciliary vocational program: Model development and evaluation. Rehabilitation Psychology, 50(3), 297-304. doi: 10.1037/0090-5550.50.3.297",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the relationship between the risk factor-based decision making (RFBDM) program and employment attainment. The study used a non-experimental comparison-group analysis. The study’s relied on data collected from the Risk Factor Scale and through data from the Veterans Affairs (VA) North Texas Health Care System. The authors used Pearson’s chi-squared test, a statistical model, to examine the relationship between the RFBDM program and employment. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the RFBDM program; other factors are likely to have contributed to the study findings.","Risk factor-based decision making intervention.","Veterans' reemployment","Veteran or military",,"United States",2005,https://utsouthwestern.pure.elsevier.com/en/publications/improving-success-in-a…,"Employment and Training Review Protocol" "The effects of welfare-to-work program activities on labor market outcomes","Dyke, A., Heinrich, C., Mueser, P., & Troske, K. (2005). The effects of welfare-to-work program activities on labor market outcomes. Institute for Research on Poverty, 1295(5). [North Carolina]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of North Carolina’s welfare-to-work program training activities on the quarterly earnings of women ages 18 to 65 years in single-parent households who were cash recipients of Temporary Assistance for Needy Families (TANF). Using data from the state’s administrative records and unemployment insurance program, the authors compared the quarterly earnings of women who took part in the training activities with those who enrolled in the welfare-to-work program but never took part in any of the training. The study found that those taking part in any of the training activities experienced an initial (quarter 1) reduction in their quarterly earnings, compared with those who did not take part in the training activities. However, those who took part in the assessment or intensive training activities experienced an increase in both their cumulative (based on 16 quarters of follow-up) and average (based on quarters 11 to 15 of follow-up) quarterly earnings, compared with those who did not take part in any training activities. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the welfare-to-work program, but other factors might also have contributed.","the Welfare-to-Work Program","Job search assistance and supportive services","Female, Low income, Parent",,"United States",2005,http://repec.iza.org/dp1520.pdf,"Employment and Training Review Protocol" "Work rehabilitation for middle-aged and older people with schizophrenia: A comparison of three approaches","Twamley, E. W., Padin, D. S., Bayne, K. S., Narvaez, J. M., Williams, R. E., & Jeste, D. V. (2005). Work rehabilitation for middle-aged and older people with schizophrenia: A comparison of three approaches. Journal of Nervous and Mental Disease, 193(9), 596-601.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study examined the impact of the Wellness and Vocational Enrichment Clinic (WAVE), a conventional vocational rehabilitation program with some elements of supported employment, on veterans’ employment outcomes. The study used statistical tests to examine differences between veterans who were offered WAVE and individuals who were offered Individual Placement and Support (IPS), a supported employment program. The data from this study come from program records. The study found that participation in the WAVE program is associated with lower rates of volunteer or paid work, and lower rates of competitive work or compensated work therapy participation compared with participation in the IPS program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the WAVE program; other factors are likely to have contributed.","Wellness and Vocational Enrichment Clinic (WAVE)","Veterans' reemployment","Veteran or military",,"United States",2005,,"Employment and Training Review Protocol" "Turning welfare into a work support: Six-year impacts on parents and children from the Minnesota Family Investment Program.","Gennetian, L., Miller, C., & Smith, J. (2005). Turning welfare into a work support: Six-year impacts on parents and children from the Minnesota Family Investment Program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Mixed impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Minnesota Family Investment Program (MFIP), a precursor to the national Temporary Assistance for Needy Families program, on employment, earnings, and public benefit receipt. The study was a randomized controlled trial: Families newly applying to Aid to Families with Dependent Children (AFDC) or families that were recertifying their eligibility were randomly assigned to MFIP or AFDC. Evaluators analyzed outcomes using a 36-month follow-up survey and administrative data from the six years after the intervention. The study found that, among single parents in the year after MFIP began, the MFIP group experienced higher rates of short-term employment and higher rates and levels of cash assistance than the AFDC group. For two-parent households, the study found that, in the first year after the study began, the MFIP group had lower rates of employment, lower levels of earnings, and higher rates and levels of benefits receipt than the AFDC group. In both family types, higher receipt of cash assistance for the MFIP group persisted through six years after the study began. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to MFIP, and not to other factors.","the Minnesota Family Investment Program (MFIP)","Other employment and reemployment Other training and education","Parent, Low income",,"United States",2005,http://www.mdrc.org/sites/default/files/full_594.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Riverside, CA – Work Plus versus Training Focused]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [Riverside, CA – Work Plus versus Training Focused]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the effectiveness of a Riverside, California, program to increase the earnings of welfare recipients after one year. The Riverside Phase 2 site was one of two in Riverside that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned eligible single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups (Work Plus and Training Focused) that received differing ERA services or to a control group that received standard TANF services. This review focuses on the comparison between the Work Plus program and the Training Focused program. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of the Work Plus program on employment, earnings, and benefits receipt compared with the Training Focused program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to the Riverside Work Plus program and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement Project—Work Plus and Training Focused (Phase 2), Riverside","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The effects of welfare-to-work program activities on labor marker outcomes","Dyke, A., Heinrich, C., Mueser, P., & Troske, K. (2005). The effects of welfare-to-work program activities on labor marker outcomes. Institute for Research on Poverty, 1295(5). [Missouri]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of Missouri’s welfare-to-work program training activities on the quarterly earnings of women ages 18 to 65 years in single-parent households who were cash recipients of Temporary Assistance for Needy Families (TANF). Using data from the state’s administrative records and unemployment insurance program, the authors compared the quarterly earnings of women who took part in the training activities with those who enrolled in the welfare-to-work program but never took part in any of the training. The study found that those taking part in the training activities experienced an initial (quarter 1) reduction in their quarterly earnings, compared with those who did not take part in the training activities. However, both cumulative (based on all 16 quarters of follow-up) and average (based on quarters 11 to 15) quarterly earnings increased for those who took part in the training activities compared with those who did not. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the welfare-to-work program training activities, but other factors might also have contributed.","the Welfare-to-Work Program","Job search assistance and supportive services","Female, Low income, Parent",,"United States",2005,http://repec.iza.org/dp1520.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the South Carolina ERA site","Scrivener, S., Azurdia, G., & Page, J. (2005). The Employment Retention and Advancement project: Results from the South Carolina ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of South Carolina’s Moving Up program on former welfare recipients’ employment, earnings and public benefits receipt outcomes after one year. The South Carolina site was one of 16 sites nationwide that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,864 people who had recently left Temporary Assistance for Needy Families (TANF) to either a treatment group that received Moving Up services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamp administrative records for the entire sample and a survey administered to a subsample of study participants 12 months after random assignment. The study did not find any statistically significant effects on employment, earnings, and public benefits receipt one year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the South Carolina Moving Up program and not to other factors. However, the study did not find statistically significant effects.","the Employment Retention and Advancement Project, South Carolina","Job search assistance and supportive services Other employment and reemployment","Low income",,"United States",2005,http://files.eric.ed.gov/fulltext/ED490879.pdf,"Employment and Training Review Protocol" "Enriching summer work: An evaluation of the Summer Career Exploration Program.","McClanahan, W., Sipe, C., & Smith, T. (2004). Enriching summer work: An evaluation of the Summer Career Exploration Program. Philadelphia, PA: Public/Private Ventures.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The evaluation’s objective was to examine the effects of the Summer Career Exploration Program (SCEP) on short-term earnings, employment, and other outcomes. SCEP offers youth job-related counseling, places them in career-related jobs, and supports them through mentoring. The report also describes program implementation and ways of improving SCEP. The program’s effectiveness was evaluated using a randomized control ed trial.  The study found statistically significant, positive impacts of SCEP on participants’ employment and earnings over the summer that the evaluation occurred; however, these were not sustained over the one-year follow-up period.  The quality of the causal evidence presented in this study is high for most outcomes and moderate for the remaining outcomes examined. For the outcomes with high causal evidence, this means we are confident that the estimated impacts are attributable to SCEP, and not other factors. For those with moderate causal evidence, other factors besides SCEP might have contributed to the estimated effects.","Summer Career Exploration Program","Basic skills Job search assistance and supportive services Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2004,http://www.cityofmadison.com/dpced/communitydevelopment/funding/documents/AreaI…,"Opportunities for Youth Review Protocol" "Evaluation of the Welfare to Work Voucher program: Report to Congress","Patterson, R., Wood, M., Lam, K., Patrabansh, S., Mills, G., Sullivan, S., . . . Zandniapour, L. (2004). Evaluation of the Welfare to Work Voucher program: Report to Congress. Washington, DC: U.S. Department of Housing and Urban Development.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Welfare-to-Work housing voucher on employment, earnings, and public benefit receipt. The authors allocated the available vouchers by lottery to eligible families who were willing to participate in the study. Using Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), and housing assistance administrative data, as well as baseline and follow-up surveys, the authors compared the outcomes of those randomly assigned to receive a voucher to outcomes of those who were not, adjusting for chance pre-intervention differences between the groups. The authors found that the Welfare-to-Work vouchers reduced the total number of quarters employed in the first five quarters after random assignment by 0.165 quarters, on average. In the first five quarters, the program reduced total earnings by $325, on average. At the same time, the voucher program decreased the average likelihood of receiving TANF by 1.8 percentage points. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Welfare-to-Work Voucher program and not to other factors.","the Welfare-to-Work Voucher Program","Unemployment Insurance","Low income",,"United States",2004,https://www.huduser.gov/portal/publications/pdf/welfrwrkVchrPrg.pdf,"Employment and Training Review Protocol" "Family Independence Initiative (FII): Follow-up study final report","Tao, F., & Alamprese, J. A. (2003). Family Independence Initiative (FII): Follow-up study final report. Retrieved from http://abtassociates.com/reports/2003/family-independence-initiative-%28fii%29-follow-up-stu.aspx.","Literacy, Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Family Independence Initiative (FII) on education, earnings, employment, and public benefit receipt outcomes of low-income adults. The authors used a pre-post study design to compare outcomes before and after participating in a work-focused family literacy program. The study found that program participation was associated with increased employment, earnings, and receipt of a high school diploma or GED, and a reduction in government cash assistance. However, the study did not include tests of statistical significance. The quality of causal evidence presented in this report is low because the authors did not observe outcomes for multiple periods before and after the intervention. This means we are not confident that the estimated effects are attributable to the Family Independence Initiative; other factors are likely to have contributed.","the Family Independence Initiative","Basic skills Other training and education","Adult, Low income",,"United States",2003,http://abtassociates.com/reports/2003/family-independence-initiative-%28fii%29-…,"Literacy, Low-Income Adults Review Protocol" "Working with disadvantaged youth: Thirty-month findings from the evaluation of the Center for Employment Training replication sites","Miller, C., Bos, J., Porter, K., Tseng, M., Doolittle, F., Tanguage, D., & Vencill, M. (2003). Working with disadvantaged youth: Thirty-month findings from the evaluation of the Center for Employment Training replication sites. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This report’s objective was to examine the effectiveness of the Center for Employment Training (CET) model. Under this model, local employers helped to design training programs and provide them in a work-like environment to economically disadvantaged youth who were not in school or employed. The effectiveness of the CET model in improving employment, earnings, and participation in education and training programs was evaluated using a randomized controlled trial (RCT) conducted in 12 sites in seven states. The study found few statistically significant impacts on outcomes measured over a 30-month follow-up period. The quality of causal evidence presented in this report is high because it was based on a well-implemented RCT. This means we are confident that any estimated effects would be attributable to the CET program and not to other factors. However, the study did not generally find statistically significant effects.","the Center for Employment Training (CET) Replication","Other employment and reemployment Other training and education Youth programs","Youth, Low-skilled, Low income",,"United States",2003,https://www.doleta.gov/reports/searcheta/occ/papers/cet_full_report.pdf,"Opportunities for Youth Review Protocol" "Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness","Resnick, S., Neale, M., & Rosenheck, R. (2003). Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness. The Journal of Nervous and Mental Disease, 191(3), 139-144.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Unfavorable impacts Employment","Summary: The study evaluated the one-year impacts of a U.S. Department of Veterans Affairs (VA) model of assertive community treatment for veterans with serious mental illnesses known as Intensive Psychiatric Community Care (IPCC) on employment. The study conducted a randomized controlled trial (RCT); those randomly assigned to the treatment group were eligible to receive the IPCC services, whereas those randomly assigned to the control group could not access IPCC services but could use other available health- and workforce-related services from the VA. The authors analyzed outcomes based on self-reported employment data collected from participants one year after random assignment. The study found that 7 percent of veterans in the IPCC group were employed one year after random assignment compared to 11 percent of veterans in the control group. The authors did not report the statistical significance of this difference. The quality of the causal evidence presented in this report is high because it was based on a well-conducted RCT. This means we have confidence that the estimated effects are attributable to the IPCC program and not other factors.","Intensive Psychiatric Community Care (IPCC)","Health Job search assistance and supportive services Veterans' reemployment Basic skills","Disability, Veteran or military",,"United States",2003,https://journals.lww.com/jonmd/Abstract/2003/03000/IMPACT_OF_PUBLIC_SUPPORT_PAY…,"Employment and Training Review Protocol" "College as a job advancement strategy: An interim report on the New Visions Self-Sufficiency and Lifelong Learning Project","Fein, D., Beecroft, E., Long, D., & Robertson A. (2003). College as a job advancement strategy: An interim report on the New Visions Self-Sufficiency and Lifelong Learning Project. Cambridge, MA: Abt Associates Inc.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Riverside Community College’s New Visions Self-Sufficiency and Lifelong Learning Project on welfare recipients’ employment, earnings, and welfare receipt. The study is based on a randomized controlled trial and estimated the effect of offering welfare recipients the New Visions program by using California and community college administrative data to compare average outcomes among those offered access to the program to the average outcomes of those excluded, after adjusting for differences between the groups. The authors found that access to the New Visions program increased the average number of quarters during which participants received Temporary Assistance for Needy Families (TANF) benefits and increased the average amount of TANF benefits received in the first two years. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Visions program, and not to other factors.","the New Visions Self-Sufficiency and Lifelong Learning Project","Community college education and other classroom training Other employment and reemployment","Low income, Parent",,"United States",2003,,"Employment and Training Review Protocol" "New Hope for families and children: Five-year results of a program to reduce poverty and reform welfare.","Huston, A., Miller, C., Richburg-Hayes, C., Duncan, G., Eldred, C., Weisner, T., Lowe, T., McLoyd, V., Crosby, D., Ripke, M., & Redcross, C., (2003). New Hope for families and children: Five-year results of a program to reduce poverty and reform welfare. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the New Hope program on employment, earnings, and public benefit receipt. The authors estimated the impact of the New Hope program by comparing average outcomes among a treatment group randomly selected to have access to the program with those of a randomly selected control group that did not have access to the program. The study found that receiving access to New Hope services increased average earnings as determined through unemployment insurance data during the first year of the program by $1,088 and the average likelihood of ever being employed during the first year of the program by 8.2 percentage points. The authors also found that the program increased the likelihood of treatment group members reporting being employed in 12 consecutive quarters of the five years after the program began by 6.9 percentage points, on average. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Hope program, and not to other factors.","The New Hope Program","Health insurance Other employment and reemployment","Low income",,"United States",2003,http://www.mdrc.org/sites/default/files/full_457.pdf,"Employment and Training Review Protocol" "National Job Corps Study: Findings using administrative earnings records data","Schochet, P., McConnell, S., & Burghardt, J. (2003). National Job Corps Study: Findings using administrative earnings records data. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Training-Mod/high-No impacts Training","Summary: The study’s objective was to estimate the impact on long-term earnings and employment of the Job Corps program, which offers intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. The program’s effectiveness was evaluated using a randomized controlled trial conducted in 48 states and the District of Columbia. The study found statistically significant, positive impacts of Job Corps on participants’ earnings within the first three years and employment within the first four years of follow-up, but no impacts of Job Corps on these outcomes in the fifth and sixth years. The quality of the causal evidence presented in this study is high. This means we are confident that the Job Corps program—not other factors—caused the estimated impacts. ","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2003,http://www.mathematica-mpr.com/publications/pdfs/jobcorpsadmin.pdf,"Opportunities for Youth Review Protocol" "Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness","Resnick, S., Neale, M., & Rosenheck, R. (2003). Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness. The Journal of Nervous and Mental Disease, 191(3), 139-144.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to evaluate the one-year impacts of a Department of Veterans Affairs (VA) model of assertive community treatment for veterans with serious mental illnesses known as Intensive Psychiatric Community Care (IPCC). The study was based on a randomized controlled trial. Roughly half of the 528 veterans participating in the study were randomly assigned to receive the IPCC treatment while the other half received standard VA services. The authors analyzed self-reported employment data collected from participants one year after random assignment. The study found that veterans in the IPCC group were three times more likely to be employed one year after random assignment than veterans in the control group. The quality of the causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we have confidence that the estimated effects are attributable to the IPCC program, and not other factors.","Intensive Psychiatric Community Care (IPCC)","Veterans' reemployment Vocational rehabilitation","Disability, Veteran or military",,"United States",2003,,"Disability Employment Policy Review Protocol" "The heterogeneous impact of conditional cash transfers","Galiani, S., & McEwan, P. J. (2013). The heterogeneous impact of conditional cash transfers. Journal of Public Economics, 103, 85-96. doi:10.1016/j.jpubeco.2013.04.004","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Honduran Programa de Asignación Familiar (PRAF-II) conditional cash transfer program on child labor and school enrollment. The authors used census data from a randomized sample of municipalities to compare the outcomes of children who received the conditional cash transfer to those who did not. The authors used statistical models to estimate program effects. The study found a significant relationship between the PRAF-II and child labor, with work outside the home decreasing by 3 percentage points and work inside the home decreasing by 4 percentage points. Program participation was also significantly related to an 8-percentage point increase in school enrollment. The quality of causal evidence presented in this report is low because it is a randomized controlled trial with unknown attrition and the authors did not account for preexisting differences between the groups before program participation. This means we are not confident that the estimated effects are attributable to the Programa de Asignación Familiar; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2003,https://doi.org/10.1016/j.jpubeco.2013.04.004,"Child Labor Review Protocol" "Improving basic skills: The effects of adult education in welfare-to-work programs","Bos, J. M., Scrivener, S., Snipes, J., Hamilton, G., Schwartz, C., & Walter, J. (2002). Improving basic skills: The effects of adult education in welfare-to-work programs. New York: Manpower Demonstration Research Corporation.","Literacy, Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of both education- and employment-focused welfare-to-work programs on earnings and public benefit receipt. The study was a randomized controlled trial conducted in seven geographic areas. The authors randomly assigned welfare recipients to the treatment condition (an education-focused intervention or an employment-focused intervention) or the control group. The study sample included a subset of welfare recipients who lacked a high school diploma or GED. The study found that participation in the welfare-to-work programs significantly increased earnings and reduced public benefit receipt and that participation in the employment-focused programs had a greater impact on earnings. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with unknown attrition, and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the effects are attributable the education-focused or employment-focused interventions; other factors are likely to have contributed.","the Education-Focused and Employment-Focused Interventions","Basic skills Other training and education","Adult, Low income",,"United States",2002,https://www.govinfo.gov/content/pkg/ERIC-ED464267/pdf/ERIC-ED464267.pdf,"Literacy, Low-Income Adults Review Protocol" "Going to war and going to college: Did World War II and the G.I. Bill increase educational attainment for returning veterans?","Bound, J., & Turner, S. (2002). Going to war and going to college: Did World War II and the G.I. Bill increase educational attainment for returning veterans? Journal of Labor Economics, 20(4), 784-815.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the World War II (WWII) G.I. Bill on years of college completed and college completion. The authors used nonexperimental analyses to compare education outcomes for those eligible and not eligible for the WWII G.I. Bill benefits using data from the 1970 U.S. Census. The study found that being eligible for WWII G.I. Bill benefits was associated with completing more years of college and a greater likelihood of completing college. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the WWII G.I. Bill; other factors are likely to have contributed to the findings.","the WWII G.I. Bill","Veterans' reemployment Community college education and other classroom training","Veteran or military",,"United States",2002,https://www.journals.uchicago.edu/doi/abs/10.1086/342012,"Employment and Training Review Protocol" "National Job Corps Study: The impacts of Job Corps on participants’ employment and related outcomes","Schochet, P., Burghardt, J., & Glazerman, S. (2001). National Job Corps Study: The impacts of Job Corps on participants’ employment and related outcomes. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Training-Mod/high-Favorable impacts Training","Summary: The National Job Corps Study included several reports, including this final impact report. The report’s objective was to examine the impact of the Job Corps program on participants’ long-term earnings, employment, and other outcomes. It also described the participants’ Job Corps experiences. Job Corps offers intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. Its effectiveness was evaluated using a randomized controlled trial conducted in 48 states and the District of Columbia. This report found statistically significant, positive impacts of Job Corps on participants’ employment, earnings, and education and training outcomes measured after four years. The quality of the causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the Job Corps program—not other factors—caused the estimated impacts.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2001,http://wdr.doleta.gov/research/FullText_Documents/01-jcimpacts.pdf,"Opportunities for Youth Review Protocol" "National Job Corps Study: Assessing program effects on earnings for students achieving key program milestones","Gritz, R. M., and Johnson, T. (2001). National Job Corps Study: Assessing program effects on earnings for students achieving key program milestones. Report Prepared for the U.S. Department of Labor, Employment and Training Administration.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to estimate the impact of Job Corps on the employment and earnings of participants who obtained a general education development (GED) certificate or vocational training certificate during the course of the program. Job Corps offers intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. Job Corps’ overall effectiveness was evaluated using a randomized controlled trial—the National Job Corps Study (NJCS)—conducted in 48 states and the District of Columbia (see the Clearinghouse for Labor Evaluation and Research [CLEAR] profile of Schochet et al. 20011 for full results). For this report, the authors used data from the NJCS 48-month follow-up survey to match Job Corps participants to control group members who had similar propensities to obtain a GED or vocational certificate. The study found that Jobs Corps participants who completed a vocational certificate during the course of the program earned $40 to $50 per week more than their control group counterparts, and those who completed a GED earned $60 to $70 per week more. The quality of causal evidence presented in this study is moderate, the highest possible rating for a nonexperimental study. This means that we have some confidence that the estimated impacts are attributable to achieving programmatic milestones in the Job Corps program, although other factors might also have contributed.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2001,http://wdr.doleta.gov/opr/fulltext/MilestoneImpactReport-Final.pdf,"Opportunities for Youth Review Protocol" "Cognitive rehabilitation for traumatic brain injury: A randomized trial","Salazar, A., Warden, D., Schwab, K., Spector, J., Braverman, S., Walter, J., . . . Ellenbogen, R. (2000). Cognitive rehabilitation for traumatic brain injury: A randomized trial. Journal of American Medical Association, 283(23), 3075-3081.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of in-hospital and home rehabilitation programs on the employment and health status of active duty military members with severe traumatic brain injuries (TBIs). The study was a randomized controlled trial conducted at the Walter Reed Army Medical Center, where 120 active duty military members with TBI were randomly assigned to receive either in-hospital rehabilitation or home rehabilitation. Researchers collected outcome data 8 weeks and 6, 12, and 24 months after randomization. Although the study authors originally hypothesized that in-hospital rehabilitation would increase the rates of patients who were able to return to work or able to return to active duty, the study found no statistically significant difference between the two groups on these outcomes. The quality of the causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any differences in outcomes would be attributable to the more effective program; however, there were no statistically significant differences between the programs.","the In-hospital and Home Rehabilitation Programs Studied","Vocational rehabilitation","Disability, Veteran or military",,"United States",2000,,"Disability Employment Policy Review Protocol" "Final report on the implementation and impacts of the Minnesota Family Investment Program in Ramsey County. [MFIP-R versus AFDC, single parents in the early cohort]","Auspos, P., Miller, C., & Hunter, J. A. (2000). Final report on the implementation and impacts of the Minnesota Family Investment Program in Ramsey County. Washington, DC: U.S. Department of Health and Human Services, Administration for Children and Families, Office of Planning, Research and Evaluation. [MFIP-R versus AFDC, single parents in the early cohort]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Minnesota Family Investment Program of Ramsey County (MFIP-R), a precursor to the national Temporary Assistance for Needy Families program, on participants’ employment, earnings, and benefit receipt. The authors used a randomized controlled trial design, assigning eligible families to either MFIP-R or existing services. Employment, earnings, and benefit receipt data were collected quarterly from Minnesota’s Unemployment Insurance earnings and public assistance benefit records. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, this CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because assignment to condition was not fully random, and the authors did not account for potential pre-existing differences in group characteristics in their analysis. This means we are not confident that the estimated effects are attributable to MFIP-R; other factors are likely to have contributed.","the Minnesota Family Investment Program of Ramsey County (MFIP-R)","Job search assistance and supportive services Other employment and reemployment","Low income, Parent",,"United States",2000,http://www.mdrc.org/sites/default/files/full_364.pdf,"Employment and Training Review Protocol" "College as a job advancement strategy: An early report of the New Visions Self-Sufficiency and Lifelong Learning Project","Fein, D., Beecroft, E., Long, D., & Catalfamo, A. (2000). College as a job advancement strategy: An early report of the New Visions Self-Sufficiency and Lifelong Learning Project. Bethesda, MD: Abt Associates Inc.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of a pilot for Riverside Community College’s New Visions Self-Sufficiency and Lifelong Learning Project on welfare recipients’ welfare receipt. The study was based on a randomized controlled trial and estimated the effect of offering welfare recipients the New Visions program compared with encouraging recipients to participate in other employment services. The authors used California Temporary Assistance for Needy Families (TANF) records to compare average outcomes among those offered access to the program against the average outcomes of those excluded, after adjusting for differences in demographic and pre-intervention characteristics between the groups. The authors did not find any statistically significant effect of the New Visions program on the likelihood of receiving TANF or the amount of TANF benefits received. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Visions Project, and not to other factors.","the New Visions Self-Sufficiency and Lifelong Learning Project","Community college education and other classroom training Other employment and reemployment","Low income, Parent",,"United States",2000,http://files.eric.ed.gov/fulltext/ED466834.pdf,"Employment and Training Review Protocol" "An evaluation of an urban community college Single Parent and Displaced Homemaker Program (Doctoral dissertation)","Rice, L. M. (1999). An evaluation of an urban community college Single Parent and Displaced Homemaker Program (Doctoral dissertation). Old Dominion University. DOI: 10.25777/tqh7-3c76","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study's objective was to examine the impact of the Single Parent and Displaced Homemaker Program on education outcomes by students at an urban community college. The study used a nonexperimental design to compare the outcomes of program participants to those on the waiting list. Using data from the community college’s Students Information System, the author conducted statistical tests to examine the differences between groups. The study found that participation in the Single Parent and Displaced Homemaker Program was significantly related to increased retention rates and number of credits taken. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Single Parent and Displaced Homemaker Program; other factors are likely to have contributed.","the Single Parent and Displaced Homemaker Program","Employment and Training Services Training and Education Capacity building programs Community college education and other classroom training Other training and education","Adult, Other barriers, Female, Parent",,"Urban, United States",1999,https://digitalcommons.odu.edu/urbanservices_education_etds/50/,"Community College Review Protocol" "The employment and training outcomes of a job training partnership act program in a community college setting","Carter, D. L. (1999). The employment and training outcomes of a job training partnership act program in a community college setting (Unpublished doctoral dissertation). University of Florida.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The study's objective was to examine the impact of a Job Training Partnership Act (JTPA) funded vocational training program at a community college in North Florida on earnings outcomes. The author used an interrupted time series design to compare outcomes of participants before and after they participated in the JTPA program. Data for the study were compiled from the community college's existing JTPA records. The study found that participation in JTPA funded training was significantly related to higher post-training wages. The quality of causal evidence presented in this report is low because the author did not observe outcomes for multiple periods before or after the program nor account for selection into the intervention. This means we are not confident that the estimated effects are attributable to the JTPA funded vocational training program; other factors are likely to have contributed.","Job Training Partnership Act","Employment and Training Services Training and Education Basic skills Capacity building programs Community college education and other classroom training","Youth, Adult, Other barriers, Dislocated or displaced worker, Low income",,"Rural, United States",1999,,"Community College Review Protocol" "New Hope for people with low incomes: Two-year results of a program to reduce poverty and reform welfare","Bos, J., Huston, A., Granger, R., Duncan, G., Brock, T., & McLoyd, V. (1999). New Hope for people with low incomes: Two-year results of a program to reduce poverty and reform welfare. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the New Hope program on employment, earnings, public benefits receipt, and educational attainment. The authors estimated the impact of the New Hope program by comparing average outcomes among a treatment group randomly selected to have access to the program with those of a randomly selected control group that did not have access to the program. The study found that receiving access to New Hope services increased average earnings in the first year of the program by $583 and the average likelihood of ever being employed in the first and second year of the program by 7.8 percentage points and 5.5 percentage points, respectively. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Hope program, and not to other factors.","The New Hope Program","Other employment and reemployment Other training and education","Low income, Parent",,"United States",1999,http://files.eric.ed.gov/fulltext/ED433455.pdf,"Employment and Training Review Protocol" "Enhancing substance abuse treatment with case management: Its impact on employment","Siegal, H. A., Fisher, J. H., Rapp, R. C., & Kelliher, C. W. (1996). Enhancing substance abuse treatment with case management: Its impact on employment. Journal of Substance Abuse Treatment, 13(2), 93-98.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study aimed to examine the impact of a strengths-based case management intervention on veterans’ employment and earnings. Even though the treatment and control groups were randomly assigned, the study used a pre/post analysis design to compare all participants before the study to all participants six months after the study began. The study collected data using the Addiction Severity Index (ASI-5) and study-created measures including levels of drug use, substance abuse treatment history, health and psychiatric status, occupational and education functioning, living situation, relationship with family and peers, and HIV risk status. The study found all study participants, including those in the intervention and control groups, increased earnings and days employed at the six-month follow-up. The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects are attributable to strengths-based case management; other factors are likely to have contributed.","the strengths-based case management","Substance abuse recovery Job search assistance and supportive services Veterans' reemployment","Other barriers, Veteran or military",,"United States",1996,https://doi.org/10.1016/0740-5472(96)00029-3,"Employment and Training Review Protocol" "Outcome evaluation of the Army Career and Alumni Program’s Job Assistance Centers (Study Report 96-04)","Sadacca, R., Laurence, J. H., DiFazio, A. S., Rauch, H. J., & Hintz, D. W. (1995) Outcome evaluation of the Army Career and Alumni Program’s Job Assistance Centers (Study Report 96-04). Alexandria, VA: Human Resources Research Organization.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts Earnings and wages Public benefits receipt-Low-Mixed impacts Public benefit receipt","Summary: The study’s objective was to examine the impact Job Assistance Centers (JACs) and the Transition Assistance Program (TAP) offered to ex-servicemembers had on their earnings and public benefits receipt. The study used a nonexperimental analysis to compare the outcomes of ex-servicemembers transitioning from military to civilian jobs who received various JAC or TAP services to the outcomes of those who did not receive JAC or TAP services. The authors used administrative records from the U.S. Department of Defense, the U.S. Army, and JACs, as well as data from a follow-up survey. The study showed mixed findings on the relationships between receipt of JAC and TAP services and earnings, as well as on the relationships between receipt of JAC and TAP services and receipt of unemployment compensation. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to JACs and TAP; other factors are likely to have contributed.","Job Assistance Centers and the Transition Assistance Program","Job search assistance and supportive services Other employment and reemployment Veterans' reemployment","Dislocated or displaced worker, Veteran or military",,"United States",1995,,"Employment and Training Review Protocol" "Pay and participation in work activity: Clinical benefits for clients with schizophrenia","Bell, M.D., & Milstein, R.M. (1993). Pay and participation in work activity: Clinical benefits for clients with schizophrenia. Psychosocial Rehabilitation Journal, 17(2), 173-176.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of a paid supported work program for veterans diagnosed with schizophrenia or schizoaffective disorder on their employment, earnings, wages, and health outcomes. The authors used a randomized controlled trial to compare outcomes of veterans assigned to the paid supported work condition with those assigned to the unpaid work condition using data collected through interviews at baseline and five months later. The authors found that the paid group had higher employment and earnings and fewer depressive symptoms five months after random assignment compared with the unpaid group. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial in which the analytic sample sizes are unknown, and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to paid supported work; other factors are likely to have contributed to the findings.","the Paid Supported Work Program","Health Veterans' reemployment","Disability, Veteran or military",,"United States",1993,https://psycnet.apa.org/doi/10.1037/h0095590,"Employment and Training Review Protocol" "The effect of veterans benefits on education and earnings","Angrist, J. D. (1993). The effect of veterans benefits on education and earnings. Industrial and Labor Relations Review, 46(4), 637-652.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of veteran benefits on the post-service education and earnings of soldiers who served in the Vietnam era and in the first years of the All-Volunteer Forces (AVF). The study used statistical tests in a nonexperimental analysis to evaluate the effects of veteran benefits. The data came from the U.S. Census Bureau’s 1987 Survey of Veterans. The study found a statistically significant positive relationship between veteran benefits and education and earnings outcomes. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to veteran benefits; other factors are likely to have contributed.","the veteran benefits","Other wages and benefits Other training and education","Veteran or military",,"United States",1993,https://doi.org/10.1177%2F001979399304600404,"Employment and Training Review Protocol" "JOBSTART: Final report on a program for school dropouts.","Cave, G., Bos, H., Doolittle, F. & Toussaint, C. (1993). JOBSTART: Final report on a program for school dropouts. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the JOBSTART program on employment, earnings, and education and training outcomes over a four-year follow-up period. About 2,300 youth were randomly assigned to either the treatment group, which was eligible to participate in JOBSTART, or the control group, which could not participate in JOBSTART but could access other services in the community. The authors compared the outcomes of the treatment and control groups using data collected through follow-up surveys 12, 24, and 48 months after random assignment. The study found that, 48 months after random assignment, members of the treatment group were significantly more likely to have participated in education or training, and completed significantly more hours of it, compared with the control group. The treatment group was significantly less likely to be employed and earned significantly less than the control group in the first year after random assignment. There were no significant impacts on earnings or employment outcomes in later follow-up years. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the JOBSTART program, and not to other factors.","the JOBSTART Program","Basic skills Job search assistance and supportive services Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",1993,http://www.mdrc.org/sites/default/files/full_416.pdf,"Opportunities for Youth Review Protocol" "Schizophrenic symptoms, work adjustment, and behavioral family therapy","Glynn, S. M., Randolph, E. T., Eth, S., Paz, G. G., Leong, G. B., Shaner, A. L., & Vort, W. V. (1992). Schizophrenic symptoms, work adjustment, and behavioral family therapy. Rehabilitation Psychology, 37(4), 323-338.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: This study examined the impact of behavioral family therapy on male veterans’ employment. The study conducted a randomized controlled trial using data from self-reported responses to the Social Adjustment Scale, Version I. The study showed that behavioral family therapy did not have statistically significant effects on employment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to behavioral family therapy and not to other factors. However, the study did not show any statistically significant effects.","Behavioral Family Therapy","Health Veterans' reemployment","Disability, Veteran or military",,"United States",1992,,"Employment and Training Review Protocol" "Impacts of transitional employment for mentally retarded young adults: Results of the STETS demonstration","Kerachsky, S., Thornton, C., Bloomenthal, A., Maynard, R. & Stephens, S. (1985). Impacts of transitional employment for mentally retarded young adults: Results of the STETS demonstration. New York: Manpower Demonstration Research Corporation.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Structured Training and Employment Transitional Services (STETS) program on employment rates, earnings, and Social Security Disability Income (SSDI) and Supplemental Security Income (SSI) receipt. The STETS program included a suite of work-readiness training, transitional jobs, and postplacement support services for young adults with intellectual disabilities. The study was a randomized controlled trial that randomly assigned young adults to the treatment group, which could participate in the STETS program, or to the control group, which could not. The study drew on data from in-person interviews conducted 6, 15, and 22 months after the start of the program. The study found that young adults in the treatment group were employed at significantly higher rates and, on average, earned more than the control group 15 and 22 months after the program began. The study also found that 15 months after random assignment, the young adults in the treatment group were significantly less likely than those in the control group to receive SSI or SSDI benefits. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the STETS program, and not to other factors.","Structured Training and Employment Transitional Services","Job search assistance and supportive services Other employment and reemployment","Disability, Low income",,"United States",1985,http://www.mdrc.org/sites/default/files/impacts_of_transitional_employment_fr.p…,"Employment and Training Review Protocol"