Title,Citation,Topic_area,Study_type,Study_evidence_rating,Outcome_effectiveness,Findings,Intervention_program,Topics,Target_population,Firm_characteristics,Geographic_setting,Original_publication_date,Original_publication_link,"Review Protocol" "Synthesis Report: Behavioral Finance Synthesis: Findings",,"Behavioral Finance: Retirement",,,,"Findings: People have relatively limited knowledge about saving for retirement and can be induced to save more when provided with additional information. Making retirement more salient, by having people think of themselves in retirement or providing a target retirement date, can increase intentions to save and alter investment choices. People can become overwhelmed by the number of investment options they face; when this occurs, they tend to use simple rules to make decisions.",,"Employer provided retirement benefits","Adult, Older worker",,"United States",,,"Behavioral Finance: Retirement Review Protocol" "Encouraging evidence on a sector-focused advancement strategy","Hendra, R., Greenberg, D. H., Hamilton, G., Oppenheim, A. Pennington, A. Schaberg, K., and Tessler, B. L. (2016). Encouraging evidence on a sector-focused advancement strategy. New York: MDRC. [Towards Employment]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the WorkAdvance sectoral training program at the Towards Employment site on employment, earnings, education, and training from 2011 to 2015. The authors investigated similar research questions with three other sites, the profiles of which are available here. The study used a randomized controlled trial design to compare the treatment group, which was able to access the WorkAdvance program at the Towards Employment site, and the control group, which was not eligible for WorkAdvance services but could access other services in the community. The authors collected data from two sources: a follow-up survey and unemployment insurance (UI) wage and employment data. Using survey data, the authors found that those in the treatment group were significantly more likely to complete education or training compared with those in the control group. The authors found no statistically significant impacts of the program on employment or earnings from either the UI data or survey data. The quality of the causal evidence is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the WorkAdvance program at the Towards Employment site and not to other factors.","the WorkAdvance sectoral training program","Work based and other occupational training","Low income",,"Urban, United States",2020,https://files.eric.ed.gov/fulltext/ED568395.pdf,"Employment and Training Review Protocol" "WIOA impacts on community college student success (Doctoral dissertation).","Crumpton, J. A. (2019). WIOA impacts on community college student success (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 13861007).","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a workforce development program administered by a community college under the Workforce Innovation and Opportunity Act (WIOA) on education outcomes. This summary focuses on the comparison between the community college WIOA program participants and the state workforce WIOA program participants. The author used a nonexperimental design to compare WIOA program student education outcomes (measured by degree or certificate attainment) to the outcomes of participants in WIOA programs administered by entities other than community colleges (throughout the state). Data from the community college and the State Board for Workforce Development were used to examine education success rates over the course of three years (2014-2017). The study found that WIOA program participants were significantly more likely to attain a degree or certificate than participants who entered the WIOA program through a state workforce development board. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the WIOA program; other factors are likely to have contributed","Workforce Innovation and Opportunity Act (WIOA) program","Basic skills Capacity building programs Community college education and other classroom training Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Adult, Low income",,"Rural, United States",2019,https://search.proquest.com/openview/f270d29734cd670349c3aed2866ce41a/1?pq-orig…,"Community College Review Protocol" "WIOA impacts on community college student success (Doctoral dissertation).","Crumpton, J. A. (2019). WIOA impacts on community college student success (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 13861007).","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a workforce development program administered by a community college under the Workforce Innovation and Opportunity Act (WIOA) on education outcomes. This summary focuses on the comparison between WIOA program participants and non-participants. The author used a nonexperimental design to compare WIOA program student education outcomes (measured by degree or certificate attainment) to the outcomes of students with similar backgrounds (Pell Grant recipients) who were not enrolled in WIOA. Data from the community college were used to examine education success rates over the course of three years (2014-2017). The study found that WIOA program participants were significantly more likely to attain a degree or certificate than students who were not enrolled in the WIOA program. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the WIOA Program; other factors are likely to have contributed","Workforce Innovation and Opportunity Act (WIOA) program","Basic skills Capacity building programs Community college education and other classroom training Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Adult, Low income",,"Rural, United States",2019,https://search.proquest.com/openview/f270d29734cd670349c3aed2866ce41a/1?pq-orig…,"Community College Review Protocol" "Effects of a two-generation human capital program on low-income parents' education, employment, and psychological wellbeing.","Chase-Lansdale, P. L., Sabol, T. J., Eckrich Sommer, T., Chor, E., Cooperman, A. W., Brooks-Gunn, J., Yoshikawa, H., King, C., & Morris, A. (2019). Effects of a two-generation human capital program on low-income parents’ education, employment, and psychological wellbeing. Journal of Family Psychology, 33(4), 433-443.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of CareerAdvance on education, employment, and earnings outcomes. The study used a nonexperimental design to compare the outcomes of parents who participated in CareerAdvance to outcomes of parents who did not participate. The study found that parents in the treatment group had significantly higher rates of certification, more years of education, and higher rates of enrollment in education and training programs than parents in the comparison group. The treatment group also had significantly higher rates of employment in the healthcare sector, higher rates of part-time employment, and worked more irregular hours than the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the CareerAdvance program, but other factors might also have contributed.","CareerAdvance Program","Capacity building programs Community college education and other classroom training","Adult, Parent, Low income",,"United States",2019,https://www.semanticscholar.org/paper/Effects-of-a-two-generation-human-capital…,"Community College Review Protocol" "Doubling graduation rates in a new state: Two-year findings from the ASAP Ohio demonstration","Sommo, C., Cullinan, D., Manno, M., Blake, S., & Alonzo, E. (2018). Doubling graduation rates in a new state: Two-year findings from the ASAP Ohio demonstration. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Ohio’s Accelerated Study in Associate Programs (ASAP) on community college students’ persistence, credit accumulation, and degree completion rates. The study was a randomized controlled trial conducted at three community colleges in Ohio. Eligible students were randomly assigned to either the treatment or control groups. The authors conducted statistical tests to examine differences in outcomes between the groups over four semesters. The study found that when compared to the control group, ASAP students had significantly higher enrollment rates and credit accumulation over the two-year period, and also had significantly higher degree completion rates. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to the Ohio Accelerated Study in Associate Programs, and not to other factors.","the Ohio Accelerated Study in Associate Programs (ASAP)","Community college education and other classroom training","Adult, Low income",,"United States",2018,https://files.eric.ed.gov/fulltext/ED592008.pdf,"Community College Review Protocol" "Mali Speed School Program: Long term impact","Dillon, A., Porreca, E., & Rosati, F. (2018). Mali Speed School Program: Long term impact. Understanding Children's Work (UCW) Working Paper Series. Rome, Italy: UCW","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Mali Speed School Program on child labor and education outcomes. The study used a randomized controlled trial to compare outcomes between children who participated in the Mali Speed School Program with children who did not. Using survey data, the authors conducted difference-in-differences models to examine long-term program outcomes between the groups. The study found that the percentage of children who worked in agriculture in the last seven days or wage employment in the previous 12 months was significantly lower in the treatment group than the control group. The study also found that the percentage of children enrolled in school five years after program implementation was significantly higher in the treatment group than the control group. The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Mali Speed School Program, but other factors might also have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2018,,"Child Labor Review Protocol" "New Jersey Health Professions Pathways to Regional Excellence project TAACCCT evaluation: Final report: Implementation and impact","Van Noy, M., Edwards, R., Haviland, S. B, McKay, H., Douglas, D., Mabe, W., Coty, V., Javed, S., Pardalis, N., Hubbard-Mattix, L., & Seith, D. (2018). New Jersey Health Professions Pathways to Regional Excellence project TAACCCT evaluation: Final report: Implementation and impact. Piscataway, NJ: Rutgers Education and Employment Research Center.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the New Jersey Health Professions Pathways to Regional Excellence Project (NJ-PREP) on earnings and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who participated in the Nj-PREP program to those that did not. The authors examined data from Unemployment Insurance records, state higher education records, and the New Jersey Consumer Report Card of Training Providers. The study did not find any statistically significant effects on employment or earnings. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the NJ-PREP, but other factors might also have contributed.","New Jersey Health Professions Pathways to Regional Excellence Project (NJ-PREP)","Capacity building programs Community college education and other classroom training","Adult, Low income",,"United States",2018,https://smlr.rutgers.edu/sites/default/files/nj_prep_taaccct_evaluation_finalre…,"Community College Review Protocol" "Integrating economic strengthening and family coaching to reduce work-related health hazards among children of poor households: Burkina Faso","Karimli, L., Rost, L., & Ismayilova, L. (2018). Integrating economic strengthening and family coaching to reduce work-related health hazards among children of poor households: Burkina Faso. Journal of Adolescent Health, 62, S6-S14.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Health and safety-Low-No impacts Health and safety","Summary: The study’s objective was to examine the impact of the Trickle Up and Trickle Up Plus programs on children’s exposure to work-related hazards and abuse, and children’s work-related health outcomes. This summary focuses on the comparison between the Trickle Up intervention group and the control group. The study was a randomized controlled trial in the Nord Region of Burkina Faso, West Africa. Using three waves of survey data administered to children and adults separately, the authors conducted statistical models to compare the outcomes of treatment and control group members. The study found that Trickle Up program participation was significantly related to a reduction of hazardous work and abuse, compared with the control group. However, the study found no statistically significant relationship between the Trickle Up program and work-related health outcomes. The quality of causal evidence presented in this report is low because it was a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Trickle Up program; other factors are likely to have contributed.","Trickle Up Program","Child labor Health","Female, Other, Low income",,International,2018,https://www.researchgate.net/publication/322086777_Integrating_Economic_Strengt…,"Child Labor Review Protocol" "Tanzania Youth Study of the Productive Social Safety Net (PSSN) impact evaluation: Endline report.","The Tanzania Cash Plus Evaluation Team (2018). Tanzania Youth Study of the Productive Social Safety Net (PSSN) impact evaluation: Endline report. Retrieved from: https://www.unicef-irc.org/publications/942-.html","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Mixed impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Productive Social Safety Net (PSSN) program on child labor and school participation outcomes. This summary focuses on the comparison of the PSSN group (both treatment groups) versus the control group. The study was a randomized controlled trial where villages were randomly assigned to one of three study arms: conditional cash transfer (CCT) only, CCT with a supplemental public works program (PWP), and the control condition. The authors used difference-in-differences models to compare the changes in outcomes between the groups. The study found that the probability of participation in paid work outside the household significantly decreased for children in PSSN households compared to children in control households. However, the probability of participation in livestock herding significantly increased for children in PSSN households compared to children in control households. Also, the probability of attending school significantly increased for children in PSSN households compared to children in control households. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable to the Productive Social Safety Net program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2018,https://www.unicef-irc.org/publications/942-.html,"Child Labor Review Protocol" "Integrating economic strengthening and family coaching to reduce work-related health hazards among children of poor households: Burkina Faso","Karimli, L., Rost, L., & Ismayilova, L. (2018). Integrating economic strengthening and family coaching to reduce work-related health hazards among children of poor households: Burkina Faso. Journal of Adolescent Health, 62, S6-S14.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Health and safety-Low-No impacts Health and safety","Summary: The study’s objective was to examine the impact of the Trickle Up and Trickle Up Plus programs on children’s exposure to work-related hazards and abuse, and children’s work-related health outcomes. This summary focuses on the comparison between the Trickle Up Plus intervention group and the control group. The study was a randomized controlled trial in the Nord Region of Burkina Faso, West Africa. Using three waves of survey data administered to children and adults separately, the authors conducted statistical models to compare the outcomes of treatment and control group members. The study found that Trickle Up Plus program participation was significantly related to a reduction of hazardous work and abuse, compared with the control group. However, the study found no statistically significant relationship between the Trickle Up program and work-related health outcomes. The quality of causal evidence presented in this report is low because it was a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Trickle Up Plus program; other factors are likely to have contributed.","Trickle Up Plus Program","Child labor Health","Female, Other, Low income",,International,2018,https://www.researchgate.net/publication/322086777_Integrating_Economic_Strengt…,"Child Labor Review Protocol" "Tanzania Youth Study of the Productive Social Safety Net (PSSN) impact evaluation: Endline report","The Tanzania Cash Plus Evaluation Team (2018). Tanzania Youth Study of the Productive Social Safety Net (PSSN) impact evaluation: Endline report. Retrieved from: https://www.unicef-irc.org/publications/942-.html","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Mixed impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Productive Social Safety Net (PSSN) program on child labor and school participation outcomes. This summary focuses on the comparison of the conditional cash transfers with Public Works Program component treatment group versus the control group. The study was a randomized controlled trial where villages were randomly assigned to one of three study arms: conditional cash transfer (CCT) only, CCT with a supplemental public works program (PWP), and the control condition. The authors used difference-in-differences models to compare the changes in outcomes between the groups. The study found that the probability of participation in paid work outside the household significantly decreased for children in PWP households compared to children in control group households. However, the probability of participation in livestock herding significantly increased for children in PSSN households compared to children in control households. Also, the likelihood of dropping out of school significantly decreased for children in PSSN households compared to children in control households. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable to the Productive Social Safety Net program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2018,https://www.unicef-irc.org/publications/942-.html,"Child Labor Review Protocol" "Tanzania Youth Study of the Productive Social Safety Net (PSSN) impact evaluation: Endline report.","The Tanzania Cash Plus Evaluation Team (2018). Tanzania Youth Study of the Productive Social Safety Net (PSSN) impact evaluation: Endline report. Retrieved from: https://www.unicef-irc.org/publications/942-.html","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Productive Social Safety Net (PSSN) program on child labor and school participation outcomes. This summary focuses on the comparison of the conditional cash transfers (CCT) only treatment group versus the control group. The study was a randomized controlled trial where villages were randomly assigned to one of three study arms: conditional cash transfer (CCT) only, CCT with a supplemental public works program (PWP), and the control condition. The authors used difference-in-differences models to compare the changes in outcomes between the groups. The study found that the probability of participation in paid work outside the household significantly decreased for children in households receiving the CCT only compared to children in control households. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable to the Productive Social Safety Net program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2018,https://www.unicef-irc.org/publications/942-.html,"Child Labor Review Protocol" "Health Profession Opportunity Grants (HPOG 1.0) impact study interim report: Program implementation and short-term impacts. (Report No. 2018-16a)","Peck, L. R., Werner, A., Harvill, E., Litwok, D., Moulton, S., Fountain, A. R., & Locke, G. (2018). Health Profession Opportunity Grants (HPOG 1.0) impact study interim report: Program implementation and short-term impacts. (Report No. 2018-16a). Washington, DC: Office of Planning. Research, and Evaluation, Administration for Children and Families, US Department of Health and Human Services.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Health Profession Opportunity Grant (HPOG) program on educational progress, earnings, and employment. The authors used a randomized controlled trial to analyze the effects of the program between a treatment group, an enhanced treatment group, and a control group. The study found that HPOG participants had significantly higher rates of educational progress, significantly higher earnings in the fifth quarter, and a significantly higher likelihood to be employed in healthcare than the control group. The quality of causal evidence presented in the study is high for the employment and earnings outcomes because they are based on a well-implemented randomized controlled trial with low attrition. However, the quality of causal evidence is moderate for the educational progress and employment in healthcare outcomes because sample attrition for these outcomes was high, but the authors controlled for key differences between the treatment and control groups at baseline. This means we are somewhat confident that estimated effects on these outcomes would be attributable to HPOG, but other factors might have also contributed.","the Health Profession Opportunity Grant (HPOG)","Capacity building programs Community college education and other classroom training","Adult, Low income",,"United States",2018,https://www.acf.hhs.gov/sites/default/files/opre/hpog_interim_appendices_final_…,"Community College Review Protocol" "The impact of Medicare Part D on self-employment.","Moulton, J. G., Diebold, J. C., & Scott, J. C. (2017). The impact of Medicare Part D on self-employment. Research on Aging, 39(1), 64-85.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the effect of the introduction of Medicare Part D on self-employment. The authors used a nonexperimental approach and data from the American Community Survey to estimate the impact. The authors found that self-employment significantly increased by 0.5 percentage points after the program began. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects on self-employment are attributable to the introduction of Medicare Part D, although other factors might also have contributed.","Medicare Part D","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2017,,"Employment and Training Review Protocol" "Does protecting older workers from discrimination make it harder to get hired? Evidence from disability discrimination laws.","Neumark, D., Song, J., & Button, P. (2017). Does protecting older workers from discrimination make it harder to get hired? Evidence from disability discrimination laws. Research on Aging, 39(1), 29-63.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study examined the impact of the strength of state disability discrimination laws on hiring rates of older men. The study used statistical models and data from the Health and Retirement Study and the Survey of Income and Program Participation to estimate the impacts. The study found no relationship between the strength of disability discrimination laws and the hiring rate for older unemployed disabled and nondisabled men. The quality of casual evidence presented in this report is low because the study is a nonexperimental analysis that did not demonstrate that the groups being compared were similar and did not account for possible differences in the analysis. This means we are not confident that the estimated effects are attributable to state disability discrimination laws; other factors are likely to have contributed.","Disability discrimination laws","Health Older workers' programs","Adult, Older worker, Male",,"United States",2017,https://journals.sagepub.com/doi/full/10.1177/0164027516656142,"Employment and Training Review Protocol" "Child schooling and child work in the presence of a partial education subsidy","de Hoop, J., Friedman, J., Kandpal, E., & Rosati, F. (2017). Child schooling and child work in the presence of a partial education subsidy. Retrieved from http://documents.worldbank.org/curated/en/501961504719564270/pdf/WPS8182.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of a conditional cash transfer program, the Pantawid Pamilya Pilipino Program, on children’s school attendance and participation and their participation in work inside and outside of their households. The study was a randomized controlled trial. The researchers used household surveys, administered at baseline and two and half years after the intervention began, to assess program impact on schooling and child labor outcomes between the treatment and control groups. The study found that, two and a half years after the program began, a significantly higher proportion of children participating in the program worked for pay outside of their household than children not participating in the program. However, there was a significantly greater proportion of children in the treatment group than the control group who attended school and attended school regularly. Similarly, children in the treatment group attended a significantly greater number of days of school than those in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the the Pantawid Pamilya Pilipino Program, and not to other factors.","Pantawid Pamilya Pilipino Program","Child labor","Other, Low income",,International,2017,http://documents.worldbank.org/curated/en/501961504719564270/pdf/WPS8182.pdf,"Child Labor Review Protocol" "The effect of the Affordable Care Act on labor transitions among older workers.","Camilleri, S. E. (2017). The effect of the Affordable Care Act on labor transitions among older workers. In Three papers on the Affordable Care Act (Doctoral dissertation). North Carolina State University, Raleigh, NC.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: The study examined the impact of the Affordable Care Act (ACA) on the employment outcomes of older workers. The author used data from the Current Population Survey for 2011–2016 and regression analyses to estimate impacts. The study found that the ACA was not associated with employment outcomes among older workers. The quality of causal evidence presented in this report is moderate because the study is based on a well-implemented nonexperimental design. This means we are somewhat confident that any estimated effects are attributable to the ACA, but other factors might also have contributed.","Affordable Care Act (ACA)","Older workers' programs Health insurance","Adult, Older worker",,"United States",2017,,"Employment and Training Review Protocol" "Household micro-entrepreneurial activity and child work: Evidence from two African unconditional cash transfer programs","de Hoop, J., Groppo, V., & Handa, S. (2017). Household micro-entrepreneurial activity and child work: Evidence from two African unconditional cash transfer programs. Retrieved from https://sites.tufts.edu/neudc2017/files/2017/10/paper_303.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of unconditional cash transfers on child labor and school attendance in Malawi and Zambia. This summary focuses on the Zambia Multiple Categorical Targeting Group (MCTG) program. The study used a randomized controlled trial to compare outcomes between children in households that received the cash transfer with children in households that did not. The study found that children in the treatment group were significantly more likely than children in the control group to participate in livestock herding and collect water or firewood. However, program participants were significantly more likely to attend school than those in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to Zambia's Multiple Categorical Targeting Group program and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2017,,"Child Labor Review Protocol" "The influence of Bolsa Familia conditional cash transfer program on child labor in Brazil","Pais, P. S. M., Silva, F. D. F., & Teixeira, E. C. (2017). The influence of Bolsa Familia conditional cash transfer program on child labor in Brazil. International Journal of Social Economics, 44(2), 206-221.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Unfavorable impacts Child labor","Summary: The objective of the study was to examine the impact of the Bolsa Familia conditional cash transfer program on child labor in Brazil. The study used a nonexperimental design to compare labor outcomes of children who received the conditional cash transfer with a matched comparison group of children who did not, based on data from a national household survey. The study found that the program was significantly related to an increase in child labor, with a 52.5 percent increase in hours spent on child labor for those receiving Bolsa Familia. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to Bolsa Familia; other factors are likely to have contributed.","Bolsa Familia","Child labor","Other, Low income",,International,2017,,"Child Labor Review Protocol" "Essays on the economics of higher education: The academic and labor market outcomes to four to two-year transfer, summer enrollment, and year-round Pell","Liu, Y. T. (2017). Essays on the economics of higher education: The academic and labor market outcomes to four to two-year transfer, summer enrollment, and year-round Pell (Unpublished doctoral dissertation). Columbia University, New York, NY. doi: 10.7916/D8M90N11","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of receiving year-round Pell (YRP) funding on community college students’ enrollment, credit accumulation, degree completion, employment, and earnings. The study used a nonexperimental design to compare the effects of receiving the YRP funding on outcomes for those in the treatment group versus those in the comparison group. The study found that students who received YRP were significantly more likely to enroll in summer courses that year, earn more credits during the semester, and earn more money three years later. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the YRP, but other factors might also have contributed.","Year-Round Pell (YRP) funding","Community college education and other classroom training","Adult, Low income",,"United States",2017,https://academiccommons.columbia.edu/doi/10.7916/D8M90N11,"Community College Review Protocol" "Household micro-entrepreneurial activity and child work: Evidence from two African unconditional cash transfer programs","de Hoop, J., Groppo, V., & Handa, S. (2017). Household micro-entrepreneurial activity and child work: Evidence from two African unconditional cash transfer programs. Retrieved from https://sites.tufts.edu/neudc2017/files/2017/10/paper_303.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Mixed impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of unconditional cash transfers on child labor and school attendance in Malawi and Zambia. This summary focuses on the Malawi Social Cash Transfer Program. The study used a randomized controlled trial to compare outcomes between children in households that received the cash transfer with children in households that did not. The study found children in the treatment group were less likely to work for pay outside of the household, had less time spent in paid work, were more likely to attend school, but had an increase in hazardous work than children in the control group; these findings were statistically significant. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to the Malawi Social Cash Transfer Program and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2017,,"Child Labor Review Protocol" "Quantitative analysis of an urban community college S-STEM program","Chapman, A. (2017). Quantitative analysis of an urban community college S-STEM program. (Unpublished doctoral dissertation). University of Phoenix, Phoenix, AZ.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Scholarships in Science, Technology, Engineering, and Mathematics (S-STEM) program on community college students’ success and progress. The study used a nonexperimental design to compare the outcomes of S-STEM program participants to a matched comparison group. Using administrative data from the community college, the author tested for group differences in student success and progress rate. The study found that participation in the S-STEM program was associated with significantly higher rates of student success and progress. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the S-STEM program, but other factors might also have contributed.","the Scholarships in Science, Technology, Engineering, and Mathematics (S-STEM) program","Community college education and other classroom training Mentoring Science, Technology, Engineering, and Math (STEM) programs","Adult, Low income",,"United States",2017,https://search.proquest.com/openview/0549b8ce7f3331a8abe04827df253116/1?pq-orig…,"Community College Review Protocol" "Pima Community College Pathways to Healthcare Program: Implementation and early impact report (Report No. 2017-10)","Gardiner, K., Rolston, H., Fein, D., & Cho, S-W. (2017). Pima Community College Pathways to Healthcare Program: Implementation and early impact report (Report No. 2017-10). Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to assess the impact of the Pathways to Healthcare program on students’ education and employment outcomes. The study used a randomized controlled trial to compare outcomes of students enrolled in the Pathways to Healthcare program with non-participants. The study found that Pathways to Healthcare program participants had significantly higher average total hours of college occupational training, higher rates of certification receipt, and higher rates of credential receipt from a college than the control group. The quality of causal evidence presented in this study is high because it is based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to the Pathways to Healthcare program and not to other factors.","the Pathways to Healthcare Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Low-skilled, Low income","Health care and social assistance","United States",2017,https://www.acf.hhs.gov/sites/default/files/opre/pathways_to_healthcare_impleme…,"Community College Review Protocol" "The impact of the Child Grant Programme on child labour and education in Lesotho","Universita di Roma Tor Vergata, Centre for Economic and International Studies, the International Labour Organisation, UNICEF and the World Bank. (2017). The impact of the Child Grant Programme on child labour and education in Lesotho. Understanding Children's Work (UCW) Working Paper Series. Rome, Italy: UCW.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Child Grant Programme (CGP) on child labor and education outcomes in Lesotho. The study used a randomized controlled trial to compare outcomes between children in households that received the cash transfer with children in households that did not. The study found that participation in the CGP was significantly associated with increased school enrollment two years after the introduction of the program. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition and the treatment group received a second grant payment, the Food Emergency Grant, which presents a confound. This means we are not confident that the estimated effects are attributable to Child Grant Programme (CGP); other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2017,,"Child Labor Review Protocol" "Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe","Fenton, R., Nyamukapa, C., Gregson, S., Robertson, L., Mushati, P., Thomas, R., & Eaton, J.W. (2016). Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe. Psychology, Health & Medicine, 21(8), 909-917.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of conditional cash transfers (CCT) and unconditional cash transfers (UCT) on child labor and schooling outcomes. This summary focuses on the comparison between the CCT group and the UCT group. The study was a randomized controlled trial in which households were randomly assigned to receive one of two cash transfers (conditional or unconditional) or to participate in the control group that did not receive a cash transfer. Using household survey data, the authors analyzed the impact of the treatment conditions on child labor and schooling outcomes a year after the intervention began. The study found that the CCT group had significantly higher levels of school attendance than the UCT group for the least poor households. However, the study found no statistically significant difference in the number of hours worked between the two groups. The quality of causal evidence presented in this report is low because it based on a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before receiving the cash transfers. This means we are not confident that the estimated effects are attributable to the cash transfers; other factors are likely to have contributed.","Cash Transfer Program","Child labor","Other barriers, Other, Low income",,International,2016,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5044770/,"Child Labor Review Protocol" "Labor intensive public works and children's activities: The case of Malawi","de Hoop, J., & Rosati, F. C. (2016). Labor intensive public works and children's activities: The case of Malawi. Retrieved from http://ucw-project.org/attachment/11052017285Public_work_malawi_dehoop_rosati.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of Malawai’s Labour Intensive Public Works program (LIPW) on children’s school participation and involvement in paid work and household chores. The study was a randomized controlled trial where eligible villages were randomly assigned to a control group that would not receive any benefits, or to one of four treatment groups that differed by agricultural season (lean vs. post-harvest) and payment schedule (lump sum vs. installments). Using household survey data, the authors analyzed the impact of the treatment conditions on school attendance and work 3-months, 6-months, and 12-months after implementation. The study found that post-harvest program participation was significantly related to higher rates of paid work 6 months after participation for boys, whereas lean harvest program participation was significantly related to higher rates of household chores for girls one year after treatment. Lean program participation was also significantly related to school attendance 6 months after participation for all children. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Malawi’s LIPW program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2016,http://ucw-project.org/attachment/11052017285Public_work_malawi_dehoop_rosati.p…,"Child Labor Review Protocol" "The impact of conditional cash transfers on the amount and type of child labor","Del Carpio, X. V., Loayza, N. V., & Wada T. (2016). The impact of conditional cash transfers on the amount and type of child labor. World Development, 80, 33-47. doi:10.1016/j.worlddev.2015.11.013","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of a conditional cash transfer (CCT) program on the amount and type of child labor conducted by children ages 8 to15. Types of child labor included household chores, farm labor (both at home and outside the home), and skill-forming activities defined as work in commerce, sales, or manufacturing activities outside the home. The study was a randomized controlled trial conducted in six municipalities in Nicaragua. Households from each community were randomly assigned into treatment and control groups. Treatment households received either the basic CCT or the basic CCT plus an additional a household grant for the creation of a micro business. Survey data were collected and child labor outcomes were analyzed using two statistical models. The study found that the program significantly reduced overall child labor, household chore labor, and farm labor for both treatment groups compared to the control group. The program had no effect on skill-forming labor for the treatment group that received the basic CCT but increased skill-forming labor for the children in the households that received the basic CCT plus the business grant. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to the Atención a Crisis program and not to other factors.","Atención a Crisis (“Attention to the Crisis”)","Child labor","Other, Low income",,International,2016,https://www.sciencedirect.com/science/article/pii/S0305750X15002934,"Child Labor Review Protocol" "Do recent reforms of Mexico's nationwide cash transfer program affect children's work and school attendance?","Universita di Roma Tor Vergata, Centre for Economic and International Studies, the International Labour Organisation, UNICEF and the World Bank. (2016). Do recent reforms of Mexico's nationwide cash transfer program affect children's work and school attendance? Understanding Children's Work (UCW) Working Paper Series. Rome, Italy: UCW.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Unfavorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the reformed Prospera cash transfer program on child work and education outcomes. The study used a randomized controlled trial to compare outcomes between children in households that received the cash transfer with children in households that did not in two urban areas in Mexico. Outcomes were compared between the treatment and control groups at six months and 18 months post-intervention. The study found that for households with eligible primary and secondary school children, the rates of children working and working for pay were significantly higher in the treatment group than in the control group at six months post-intervention. The study also found that for households with only eligible secondary school children, the rates of school attendance were significantly lower among children in the treatment group than the control group at 18 months post-intervention. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to the reformed Prospera cash transfer program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2016,,"Child Labor Review Protocol" "Evidence from a randomized evaluation of the household welfare impacts of conditional and unconditional cash transfers given to mothers or fathers","Akresh, R., de Walque, D., & Kazianga, H. (2016). Evidence from a randomized evaluation of the household welfare impacts of conditional and unconditional cash transfers given to mothers or fathers (Development Research Group Human Development and Public Services Team Working Paper 7730). Washington, DC: World Bank.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impacts of conditional and unconditional cash transfers on child labor and education outcomes.   The study was a randomized controlled trial conducted in a rural province of Burkina Faso. Using household surveys and administrative data records, the authors conducted statistical models to examine differences in outcomes between the groups over two years. The study found that at the two-year follow-up, rates of school enrollment and attendance were significantly higher for children in households receiving conditional cash transfers relative to the control group. At the two-year follow-up, child labor rates were significantly higher when cash transfers (conditional or unconditional) were given to fathers rather than to mothers. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Nahouri Cash Transfer Pilot Project, and not to other factors.  ",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Child, Low income",,International,2016,https://documents1.worldbank.org/curated/en/944741467047531083/pdf/WPS7730.pdf,"Child Labor Review Protocol" "The influence of conditional cash transfers on eligible children and their siblings","Lincove, J. A., & Parker, A. (2016). The influence of conditional cash transfers on eligible children and their siblings. Education Economics, 24(4), 352-373.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of Nicaragua’s Red de Proteccion Social (RPS) conditional cash transfer (CCT) program on attending school, working, and hours worked for children ages 6 to 16. The authors used data from an experimental design where communities were randomly assigned to participate in the program. The authors used difference-in-differences to estimate the effects of the program, controlling for child and family demographics separately by child gender and child age groups. The CCT was not associated with the probability of attending school and working for boys, but was associated with a statistically significant decrease in hours worked for boys ages 6-11 (2.8 hours) and for boys as 12-13 (8.7 hours). The program was also associated with a statistically significant 15.8 percent increase in the probability of school enrollment for girls ages 6-11. The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to the RPS conditional cash transfer program, although other factors could also have contributed.","Red de Protección Social (RPS)","Child labor","Other, Low income",,International,2016,http://www.janelincove.com/uploads/3/7/2/0/37205101/educaton_economics_2015.pdf,"Child Labor Review Protocol" "Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program","Glosser, A., Barden, B., Williams, S., Anderson, C. (2016). Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program. (OPRE Report 2016-77). Washington, DC: Office of Planning, Research, and Evaluation. [Contrast 3: Paid work experience versus on-the-job training]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of paid work experience, part of Los Angeles’ Subsidized and Transitional Employment Demonstration, on employment, earnings, and public benefit receipt relative to on-the-job training. The authors also investigated related impacts, the profiles of which are available [here]. The authors used regression methods in a randomized controlled trial study to examine the impacts of participating in paid work experience. The data sources included administrative wage records, subsidized employment payroll records, Temporary Assistance for Needy Families (TANF) benefit payment records, and survey data. The study found that paid work experience had positive, statistically significant impacts on employment, earnings, and benefit receipt compared with on-the-job training. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the paid work experience program and not to other factors.","Los Angeles’ Subsidized and Transitional Employment Demonstration","Adult and Dislocated Worker programs Job search assistance and supportive services Other training and education","Low income",,"Urban, United States",2016,https://www.mdrc.org/publication/testing-two-subsidized-employment-approaches-r…,"Employment and Training Review Protocol" "Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe","Fenton, R, Nyamukapa, C., Gregson, S., Robertson, L., Mushati, P., Thomas, R., & Eaton, J.W. (2016). Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe. Psychology, Health & Medicine, 21(8), 909-917","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of conditional cash transfers (CCT) and unconditional cash transfers (UCT) on child labor and schooling outcomes. This summary focuses on the comparison between the UCT group and the control group. The study was a randomized controlled trial in which households were randomly assigned to receive one of two cash transfers (conditional or unconditional) or to participate in the control group that did not receive a cash transfer. Using household survey data, the authors analyzed the impact of the treatment conditions on child labor and schooling outcomes a year after the intervention began. The study found that receipt of an unconditional cash transfer was significantly associated with an increases in school attendance for the poorest households, but not significantly related to child labor outcomes. The quality of causal evidence presented in this report is low because it based on a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before receiving the cash transfers. This means we are not confident that the estimated effects are attributable to the unconditional cash transfers; other factors are likely to have contributed.","Cash Transfer Program","Child labor","Other barriers, Other, Low income",,International,2016,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5044770/,"Child Labor Review Protocol" "Do education and health conditions matter in a large cash transfer? Evidence from a Honduran experiment","Benedetti, F., Ibarrarán, P., & McEwan, P. J. (2016). Do education and health conditions matter in a large cash transfer? Evidence from a Honduran experiment. Economic Development and Cultural Change, 64(4), 759-793. doi:10.1086/686583","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a conditional cash transfer on school enrollment and child labor. The study was a randomized controlled trial conducted in in low-income villages in Honduras. Villages were randomly assigned to the treatment and control groups. Baseline and follow-up survey data were collected from randomly selected households and analyzed using regression. The Bono 10,000 program significantly increased school enrollment but did not significantly reduce child labor. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Bono 10,000 program and not to other factors.","Bono 10,000","Child labor","Other, Low income",,International,2016,http://academics.wellesley.edu/Economics/mcewan/PDF/bono.pdf,"Child Labor Review Protocol" "Four-year degree and employment findings from a randomized controlled trial of a one-year performance-based scholarship program in Ohio","Mayer, A. K., Patel, R., & Gutierrez, M. (2016). Four-year degree and employment findings from a randomized controlled trial of a one-year performance-based scholarship program in Ohio. Journal of Research on Educational Effectiveness, 9(3), 283-306. doi: 10.1080/19345747.2015.1086914","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of a performance-based scholarship program on community college students’ credit accumulation, degree/certificate completion, employment, and earnings. The study was a randomized controlled trial conducted at three community colleges in Ohio. Eligible students were randomly assigned to either the treatment or control groups. The authors conducted statistical models to examine differences in outcomes between the groups four years post-random assignment. The study found that when compared to the control group, students in the performance-based scholarship program had significantly higher credit accumulation and rates of degree/ certificate completion. The quality of causal evidence presented in this study is high because it is based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to the one-year performance-based scholarship program and not to other factors.","the performance-based scholarship program","Community college education and other classroom training","Adult, Low income",,"United States",2016,https://doi.org/10.1080/19345747.2015.1086914,"Community College Review Protocol" "Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program","Glosser, A., Barden, B., Williams, S., & Anderson, C. (2016). Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program. (OPRE Report 2016-77). Washington, DC: Office of Planning, Research, and Evaluation. [Contrast 2: On-the-job training versus comparison]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Unfavorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of on-the-job training, part of Los Angeles’ Subsidized and Transitional Employment Demonstration, on employment, earnings, education, training, and public benefit receipt relative to no subsidized job opportunities. The authors also investigated related impacts, the profiles of which are available [here]. The authors used regression methods in a randomized controlled trial study to examine the impacts of participating in on-the-job training. The data sources included administrative wage records, subsidized employment payroll records, Temporary Assistance for Needy Families (TANF) benefit payment records, and survey data. The study found that on-the-job training had positive, statistically significant impacts on employment and earnings compared with the control condition of no subsidized job opportunities. There were mixed impacts on benefit receipt and negative impacts on earning a professional license or certification. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the on-the-job training program and not to other factors.","Los Angeles’ Subsidized and Transitional Employment Demonstration","Adult and Dislocated Worker programs Job search assistance and supportive services Other training and education","Low income",,"United States",2016,https://www.mdrc.org/publication/testing-two-subsidized-employment-approaches-r…,"Employment and Training Review Protocol" "Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe","Fenton, R., Nyamukapa, C., Gregson, S., Robertson, L., Mushati, P., Thomas, R., & Eaton, J. W. (2016) Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomized controlled trial in Zimbabwe. Psychology, Health & Medicine, 21(8), 909-917","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of conditional cash transfers (CCT) and unconditional cash transfers (UCT) on child labor and schooling outcomes. This summary focuses on the comparison between the CCT group and the control group. The study was a randomized controlled trial in which households were randomly assigned to receive one of two cash transfers (conditional or unconditional) or to participate in the control group that did not receive a cash transfer. Using household survey data, the authors analyzed the impact of the treatment conditions on child labor and schooling outcomes a year after the intervention began. The study found that receipt of a conditional cash transfer was significantly associated with a reduction in child work and increases in school attendance for the poorest households. The quality of causal evidence presented in this report is low because it based on a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before receiving the cash transfer. This means we are not confident that the estimated effects are attributable to the conditional cash transfer; other factors are likely to have contributed.","Cash Transfer Program","Child labor","Other barriers, Other, Low income",,International,2016,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5044770/,"Child Labor Review Protocol" "Job insecurity, unemployment insurance and on-the-job search. Evidence from older American workers.","Gutierrez, I. A. (2016). Job insecurity, unemployment insurance and on-the-job search. Evidence from older American workers. Labour Economics, 41, 228-245. doi:10.1016/j.labeco.2016.05.011","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study examined the impact of the potential wage replacement rate through Unemployment Insurance (UI) on the probability of transitioning to non-employment. The study used a nonexperimental design and data from the Health and Retirement Study (HRS) from 1996–2006 and 2010–2012 to identify workers who expected job loss during the baseline survey and who experienced job transitions by the follow-up survey two years later. The study found no statistically significant relationships between potential wage replacement rates and transitions to non-employment. The quality of causal evidence presented in this report is low because the analyses do not sufficiently account for other factors that might contribute to the estimated effects. This means we are not confident that the estimated effects are attributable to the potential wage replacement rate through UI; other factors are likely to have contributed.","Unemployment Insurance (UI)","Older workers' programs Unemployment Insurance","Adult, Older worker, Employed",,"United States",2016,,"Employment and Training Review Protocol" "Do conditional cash transfers reduce child labor?: Evidence from the Philippines","Galang, I. M. (2016). Do conditional cash transfers reduce child labor?: Evidence from the Philippines (Unpublished Master's thesis). Tokyo, Japan: The University of Tokyo.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of the study was to examine the impact of the Philippines conditional cash transfer program, Pantawid Pamilyang Pilipino Program (4Ps), on child labor and school attendance. The authors used a nonexperimental design to compare the outcomes of children ages 12-14 that received the conditional cash transfers with those who did not, based on data from the 2011 Annual Poverty Indicator Survey. Using several demographic characteristics, they created a matched comparison group of families who did not receive the benefit to assess the effectiveness of the cash transfer program. The study found that receipt of the cash transfer was significantly associated with increased school attendance but not significantly associated with child labor. The quality of causal evidence presented in this report is low because the authors did not account for the outcomes of schooling and work at baseline. This means we are not confident that the estimated effects are attributable to the 4Ps program; other factors are likely to have contributed.","Pantawid Pamilya Pilipino Program","Child labor","Other, Low income",,International,2016,http://www.pp.u-tokyo.ac.jp/wp-content/uploads/2016/02/1.31-MB-1.pdf,"Child Labor Review Protocol" "Spousal labor market effects from government health insurance: Evidence from a veterans affairs expansion.","Boyle, M. A. & Lahey, J. N. (2016). Spousal labor market effects from government health insurance: Evidence from a veterans affairs expansion. Journal of Health Economics, Elsevier, 45(C), 63-76.","Older Workers, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study examined the impact of the expansion of health insurance for veterans through the U.S. Department of Veterans Affairs (VA) in the mid-1990s (as a result of the implementation of the Veteran’s Health Care Eligibility Reform Act) on the employment and earnings of non-covered spouses. The authors used a statistical model and data from the Census Bureau’s March Current Population Survey and the Health and Retirement Study to compare the employment and earnings of wives of male veterans with wives of non-veterans of the same ages before and after the expansion of health insurance for veterans through the VA. The study found no statistically significant associations between the expansion of health insurance for veterans and the employment of their wives and mixed evidence on associations between the expansion of health insurance for veterans and the earnings of their wives. The quality of causal evidence presented in this report is moderate for the employment outcomes because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to the expansion of health insurance for veterans through the VA, but other factors might also have contributed. The quality of causal evidence presented in this report is low for earnings outcomes because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion of health insurance for veterans through the VA; other factors are likely to have contributed.","Veteran Health Insurance Expansion","Health Older workers' programs Veterans' reemployment","Adult, Older worker, Veteran or military",,"United States",2016,,"Older Workers, Veterans Review Protocol" "Encouraging evidence on a sector-focused advancement strategy","Hendra, R., Greenberg, D. H., Hamilton, G., Oppenheim, A. Pennington, A. Schaberg, K., and Tessler, B. L. (2016). Encouraging evidence on a sector-focused advancement strategy. New York: MDRC. [Madison Strategies Group]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the WorkAdvance sectoral training program at the Madison Strategies Group site on employment, earnings, education, and training from 2011 to 2015. The authors investigated similar research questions with three other sites, the profiles of which are available here. The study used a randomized controlled trial design to compare the treatment group, which was able to access the WorkAdvance program at the Madison Strategies Group site, and the control group, which was not eligible for WorkAdvance services but could access other services in the community. The authors collected data from two sources: a follow-up survey and unemployment insurance (UI) wage and employment data. Using survey data, the authors found that those in the treatment group were significantly more likely to complete education or training compared with those in the control group. The authors found no statistically significant impacts of the program on employment or earnings from either the UI data or survey data. The quality of the causal evidence is high for employment and earnings outcomes based on UI data because those outcomes were based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects for those outcomes are attributable to the WorkAdvance program at the Madison Strategies Group site and not to other factors. For education and training outcomes from the follow-up survey, the quality of the causal evidence is moderate because those outcomes were based on a randomized controlled trial in which many people did not complete the follow-up survey, but the authors did account for existing differences between the treatment and control groups. This means we are somewhat confident that the estimated effects for those outcomes are attributable to the WorkAdvance program at the Madison Strategies Group site, but other factors might also have contributed.","the WorkAdvance sectoral training program","Work based and other occupational training","Low income",,"United States",2016,https://files.eric.ed.gov/fulltext/ED568395.pdf,"Employment and Training Review Protocol" "Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program","Glosser, A., Barden, B., Williams, S., & Anderson, C. (2016). Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program. (OPRE Report 2016-77). Washington, DC: Office of Planning, Research, and Evaluation. [Contrast 1: Paid work experience versus comparison]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of a paid work experience program, part of Los Angeles’ Subsidized and Transitional Employment Demonstration, on employment, earnings, education, training, and public benefit receipt relative to no subsidized job opportunities. The authors also investigated related impacts, the profiles of which are available [here]. The authors used regression methods in a randomized controlled trial study to examine the impacts of participating in paid work experience. The data sources included administrative wage records, subsidized employment payroll records, Temporary Assistance for Needy Families (TANF) benefit payment records, and survey data. The study found that the paid work experience program had positive, statistically significant impacts on employment, earnings, and benefit receipt compared with the control condition of no subsidized job opportunities. Paid work experience had no impacts on education and training outcomes. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the paid work experience program and not to other factors.","Los Angeles’ Subsidized and Transitional Employment Demonstration","Adult and Dislocated Worker programs Job search assistance and supportive services Other training and education","Low income",,"United States",2016,https://www.mdrc.org/publication/testing-two-subsidized-employment-approaches-r…,"Employment and Training Review Protocol" "The Green Jobs and Health Care impact evaluation: Findings from the impact study of four training programs for unemployed and disadvantaged workers","Martinson, K., Williams, J., Needels, K., Peck, L., Moulton, S., Paxton, N., Mastri, A., Copson, E., Comfort, A., & Brown-Lyons, M. (2016). The Green Jobs and Health Care impact evaluation: Findings from the impact study of four training programs for unemployed and disadvantaged workers. Retrieved from https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2017-07%20Findings%20from%20the%20Impact%20Study.pdf","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Grand Rapids Community College (GRCC) Pathways to Prosperity program on education, earnings, and employment outcomes. The study was a randomized controlled trial. The authors used a baseline information form, the National Directory of New Hires (NDNH), a follow-up survey, and administrative program data to compare the outcomes between the treatment and control groups over an 18-month follow-up period. The study found that the GRCC Pathways to Prosperity program had a significant positive impact on completion rates for vocational training and life skills classes, and receipt of a vocational credential. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the GRCC Pathways to Prosperity program and not to other factors.","the Grand Rapids Community College (GRCC) Pathways to Prosperity Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Justice-involved, Other barriers, Unemployed, Low income",,"United States",2016,https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2017-07%20Findings%20f…,"Community College Review Protocol" "Do conditional cash transfers reduce child labor?: Evidence from the Philippines","Galang, I. M. (2016). Do conditional cash transfers reduce child labor?: Evidence from the Philippines (Unpublished Master's thesis). Tokyo, Japan: The University of Tokyo.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of the study was to examine the impact of the Philippines conditional cash transfer program, Pantawid Pamilyang Pilipino Program (4Ps), on child labor and school attendance. The authors used a nonexperimental design to compare the outcomes of children ages 12-14 that received the conditional cash transfers with those who did not, based on data from the 2011 Annual Poverty Indicator Survey. Using several demographic characteristics, they created a matched comparison group of families who did not receive the benefit to assess the effectiveness of the cash transfer program. The study found that receipt of the cash transfer was significantly associated with increased school attendance but not significantly associated with child labor. The quality of causal evidence presented in this report is low because the authors did not account for the outcomes of schooling and work at baseline. This means we are not confident that the estimated effects are attributable to the 4Ps program; other factors are likely to have contributed.","Pantawid Pamilyang Pilipino Program (4Ps)","Child labor","Other, Low income",,International,2016,http://www.pp.u-tokyo.ac.jp/wp-content/uploads/2016/02/1.31-MB-1.pdf,"Child Labor Review Protocol" "Encouraging evidence on a sector-focused advancement strategy","Hendra, R., Greenberg, D. H., Hamilton, G., Oppenheim, A. Pennington, A. Schaberg, K., and Tessler, B. L. (2016). Encouraging evidence on a sector-focused advancement strategy. New York: MDRC. [Per Scholas]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the WorkAdvance sectoral training program at the Per Scholas site on employment, earnings, and education and training from 2011 to 2015. The authors investigated similar research questions with three other sites, the profiles of which are available here. The study used a randomized controlled trial design to compare the treatment group, which was able to access the WorkAdvance program at the Per Scholas site, and the control group, which was not eligible for WorkAdvance services but could access other services in the community. The authors collected data from two sources: a follow-up survey and unemployment insurance (UI) wage and employment data. The study found that the program had a statistically significant impact on quarterly earnings in the second and third years after random assignment (based on UI data) and average weekly earnings in the second year after random assignment (based on survey data). The study also found that the program did not have a significant impact on most employment outcomes. Using survey data, the authors found that members of the WorkAdvance group were significantly more likely to have obtained a degree or credential and to have completed a skills training program two years after random assignment. The quality of the causal evidence is moderate for employment and earnings outcomes based on UI data because those outcomes were based on a randomized controlled trial in which the authors did not demonstrate that they accounted for change in the probability of random assignment, but the authors did account for existing differences between the treatment and control groups. The quality of the causal evidence is moderate for education and training outcomes from the follow-up survey because those outcomes were based on a randomized controlled trial in which many people did not complete the follow-up survey, but the authors did account for existing differences between the treatment and control groups. This means we are somewhat confident that the estimated effects are attributable to the WorkAdvance program at the Per Scholas site, but other factors might also have contributed.","the WorkAdvance sectoral training program","Work based and other occupational training","STEM professional, Low income",,"Urban, United States",2016,https://files.eric.ed.gov/fulltext/ED568395.pdf,"Employment and Training Review Protocol" "Eliminating child labour in El Salvador through economic empowerment and social inclusion: Impact report","de Hoop, J., Kovrova, I., & Rosati, F. C. (2016). Eliminating child labour in El Salvador through economic empowerment and social inclusion: Impact report. Retrieved from http://www.ucw-project.org/attachment/07032017224El_Salvador_IE_07042016_web.pdf","Child Labor","Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to assess the effects of a women’s entrepreneurship training program on children’s participation in school and work. The study was a regression discontinuity design, using baseline and follow-up household surveys to measure program outcomes. Households were selected into the program if they had a wealth score below a cut-off point. The authors compared the outcomes of children in households above and below the cut-off score to understand the program’s effects. The study found that selection and participation in the program was significantly associated with a decrease in the percent of children working-only and not attending school, and the number of hours that children worked per week. Selection and participation in the program was also significantly related to an increase in school attendance. This study used a regression discontinuity design and therefore was reviewed using CLEAR’s descriptive study evidence review guidelines. As such, it does not receive a causal rating.","Eliminating Child Labour in El Salvador through Economic Empowerment and Social Inclusion","Child labor","Female, Parent, Low income",,International,2016,http://www.ucw-project.org/attachment/07032017224El_Salvador_IE_07042016_web.pdf,"Child Labor Review Protocol" "Men and women expecting to work longer: Do changing work conditions matter?","Moen, P., Kojola, E., Kelly, E.L., & Karakaya, Y. (2016). Men and women expecting to work longer: Do changing work conditions matter? Work, Aging and Retirement, 2(3), 321-344.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of a work flexibility intervention called STAR (Support. Transform. Achieve. Results) on workers’ expectations of retirement age and bridge jobs. The study is a randomized controlled trial that uses surveys of workers before the intervention and five years post-intervention. The study found that receiving STAR was associated with higher expectations of working at age 65 and retiring at age 67 or older. The quality of causal evidence presented in this report is low because, although it was based on a randomized controlled trial, it had unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to STAR; other factors are likely to have contributed.","STAR (Support. Transform. Achieve. Results.)","Work based and other occupational training Other employer services","Adult, Older worker",,"United States",2016,https://experts.umn.edu/en/publications/men-and-women-expecting-to-work-longer-…,"Employment and Training Review Protocol" "The effect of Social Security information on the labor supply and savings of older Americans.","Armour, P., & Lovenheim, M. F. (2016). The effect of Social Security information on the labor supply and savings of older Americans. (Working paper no. 361). Ann Arbor, MI: University of Michigan, Michigan Retirement Research Center.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Mixed impacts Employment","Summary: The study examined the impact of the Social Security statements issued by the Social Security Administration (SSA) on older men’s annual hours worked. The authors used a nonexperimental design and data from Health and Retirement Study surveys and Social Security administrative records to estimate the impacts. The study found that receiving the first Social Security Statement is associated with a decrease in self-reported annual hours worked and receiving the second Social Security Statement is associated with an increase in self-reported annual hours worked. The quality of casual evidence presented in this report is moderate because that the study was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to Social Security statements, but other factors might also have contributed.","Social Security statements","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2016,,"Employment and Training Review Protocol" "Encouraging evidence on a sector-focused advancement strategy","Hendra, R., Greenberg, D. H., Hamilton, G., Oppenheim, A. Pennington, A. Schaberg, K., and Tessler, B. L. (2016). Encouraging evidence on a sector-focused advancement strategy. New York: MDRC. [St. Nicks Alliance]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the WorkAdvance sectoral training program at the St. Nicks Alliance site on employment, earnings, education, and training from 2011 to 2015. The authors investigated similar research questions with three other sites, the profiles of which are available here. The study used a randomized controlled trial design to compare the treatment group, which was able to access the WorkAdvance program at the St. Nicks Alliance site, and the control group, which was not eligible for WorkAdvance services but could access other services in the community. The authors collected data from two sources: a follow-up survey and unemployment insurance (UI) wage and employment data. Using UI data, the authors found that those assigned to the treatment group were significantly more likely to be ever employed in Quarters 2 to 5 after random assignment than those in the control group. Using survey data, the authors also found that those in the treatment group were significantly more likely to complete education or training than the control group. The quality of the causal evidence is high for employment and earnings outcomes based on UI data because those outcomes were based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects for those outcomes are attributable to the WorkAdvance program at the St. Nicks Alliance site and not to other factors. For education and training outcomes from the follow-up survey, the quality of the causal evidence is moderate because those outcomes were based on a randomized controlled trial in which many people did not complete the follow-up survey, but the authors did account for existing differences between the treatment and control groups. This means we are somewhat confident that the estimated effects for those outcomes are attributable to the WorkAdvance program at the St. Nicks Alliance site, but other factors might also have contributed.","the WorkAdvance sectoral training program","Work based and other occupational training","Low income",,"Urban, United States",2016,https://files.eric.ed.gov/fulltext/ED568395.pdf,"Employment and Training Review Protocol" "Doubling graduation rates: Three-year effects of CUNY’s Accelerated Study in Associate Programs (ASAP) for developmental education students","Scrivener, S., Weiss, M., Ratledge, A., Rudd, T., Sommo, C., & Fresques, H. (2015). Doubling graduation rates: Three-year effects of CUNY’s Accelerated Study in Associate Programs (ASAP) for developmental education students. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effectiveness of the Accelerated Study in Associate Programs (ASAP) at three City University of New York (CUNY) schools on credits earned and completion of a college degree. At the three participating schools, eligible students were randomly assigned to the treatment group, which could participate in ASAP, or to the control group, which could not participate in ASAP but could access existing services at the schools. The primary data sources were a baseline information form, the CUNY Institutional Research Database, and National Student Clearinghouse records. The study found that students in the ASAP group were significantly more likely to earn a degree from any college in the fourth, fifth, and sixth semesters following random assignment, compared with the control group. In addition, during the sixth semester following random assignment, the treatment group was significantly more likely to be enrolled in a four-year college than the control group. Over the six semesters of the study, students in the treatment group earned significantly more total credits, college-level credits, and developmental credits than the control group. The quality of causal evidence presented in this report is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to ASAP and not to other factors.","the Accelerated Study in Associate Program (ASAP)","Community college education and other classroom training","Adult, Low income",,"United States",2015,http://www.mdrc.org/sites/default/files/doubling_graduation_rates_fr.pdf,"Community College Review Protocol" "Veterans Homelessness Prevention Demonstration evaluation: Final report","Cunningham, M. K., Biess, J., Emam, D., & Burt., M. R. (2015). Veterans Homelessness Prevention Demonstration evaluation: Final report. Washington, DC: Urban Institute.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Mixed impacts Public benefit receipt","Summary: The study examined the effect of the Veterans Homelessness Prevention Demonstration (VHPD) program on the employment, earnings, public benefit receipt, and education and training outcomes of veterans at risk of homelessness. The study uses a nonexperimental design to examine whether there were changes in veterans’ outcomes from before the program began to six months after the program ended using self-reported data directly from the veterans. The study found statistically significant positive relationships between the VHPD program and veterans’ employment and earnings six months after the program ended compared with before the program. The study found mixed relationships between the VHPD program and public benefit receipt: significantly fewer veterans in the study received several types of public benefits, such as Temporary Assistance for Needy Families (TANF) or the Supplemental Nutrition Assistance Program (SNAP). Significantly more veterans in the study, however, received Veterans Pension benefits after the program compared with before it. The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects are attributable to the VHPD program; other factors are likely to have contributed.","the Veterans Homelessness Prevention Demonstration (VHPD) program","Job search assistance and supportive services Other training and education","Low income, Veteran or military, Homeless",,"United States",2015,http://apps.urban.org/features/homeless-veterans/,"Employment and Training Review Protocol" "Exploring the differential impact of public interventions on indigenous people: Lessons from Mexico's conditional cash transfer program","Lopez-Calva, L. F., & Patrinos, H. A. (2015). Exploring the differential impact of public interventions on indigenous people: Lessons from Mexico's conditional cash transfer program. Journal of Human Development and Capabilities, 16(3), 452-467. doi:10.1080/19452829.2015.1072378","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of the study was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on child labor and school attendance for children ages 8 to 17 across 3 indigenous, Spanish-speaking, and bilingual households. Using survey data from a cluster randomized controlled trial, the authors analyzed the average program impact of the PROGRESA/Oportunidades program on indigenous households versus individuals who were bilingual or Spanish-speaking. The study found that the PROGRESA/Oportunidades program was significantly related to a decrease in child labor and an increase in school attendance for indigenous speaking children. The quality of causal evidence presented in this study is low because it was based on a randomized controlled trial with unknown attrition and the authors did not control for the required variables. As a result, we are not confident that the estimated effects are attributable to PROGRESA/Oportunidades; other factors are likely to have contributed.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,"International, Rural",2015,https://www.researchgate.net/publication/242464961_Exploring_the_Differential_I…,"Child Labor Review Protocol" "The effect of health reform on retirement.","Levy, H., Buchmueller, T. C., & Nikpay, S. (2015). The effect of health reform on retirement (Research Paper 329). Ann Arbor, MI: Michigan Retirement Research Center.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the expansion of Medicaid to low-income adults in 2014 on retirement rates of workers ages 55 to 64. The authors used a nonexperimental analysis to compare those who lived in an expansion state to those who lived in other states. The study used data from the monthly Current Population Survey from January 2005 through July 2015. The study found no statistically significant relationships between Medicaid expansion and retirement. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion of Medicaid; other factors are likely to have contributed.","Medicaid expansion","Health insurance Older workers' programs","Adult, Older worker, Low income",,"United States",2015,https://deepblue.lib.umich.edu/handle/2027.42/116062,"Employment and Training Review Protocol" "The impact of a randomly assigned time and place management initiative on work and retirement expectations.","Cahill, K. E., James, J. B., & Pitt-Catsouphes, M. (2015). The impact of a randomly assigned time and place management initiative on work and retirement expectations. Work, Aging and Retirement, 1(4), 350-368.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined the impact of a time and place management (TPM) initiative at a medical provider on retirement expectations among workers ages 50 and older. The study was a randomized control trial and used a series of surveys and administrative data to estimate the impact. The study found that, when surveyed 12 months after randomization, employees in the treatment group were statistically significantly more likely to expect to directly exit their job as opposed to staying in their current job within the next five years. The quality of causal evidence presented in this report is moderate because the study was a randomized controlled trial with high attrition, but the authors did demonstrate that the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to TPM, but other factors might also have contributed.","Time and Placement Management (TPM)","Older workers' programs","Older worker","Health care and social assistance",,2015,https://hrs.isr.umich.edu/publications/biblio/8231,"Employment and Training Review Protocol" "Employment outcomes among African American and white women with disabilities: Examining the inequalities.","Balcazar, F. E., & Suarez-Balcazar, Y. (2015). Employment outcomes among African American and white women with disabilities: Examining the inequalities. Women, Gender, and Families of Color, 3(2), 144-164.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study examined the impact of adult vocational rehabilitation (VR) services on employment outcomes for African American and white women. The authors used a statistical model and data from a Midwestern state VR system to compare the odds of employment after completing VR services for older versus younger women. The study found no significant difference in employment outcomes between older and younger women who completed VR services. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before receiving VR services. This means we are not confident that the estimated effects are attributable to participation in VR services; other factors are likely to have contributed.","Vocational Rehabilitation (VR) Services","Vocational rehabilitation","Adult, Older worker, Female, Black or African American, White, Disability",,"United States",2015,,"Employment and Training Review Protocol" "How do educational transfers affect child labor supply and expenditures? Evidence from Indonesia of impact and flypaper effects","De Silva, I., & Sumarto, S. (2015). How do educational transfers affect child labor supply and expenditures? Evidence from Indonesia of impact and flypaper effects. Oxford Development Studies, 43(4), 483-507. https://doi.org/10.1080/13600818.2015.1032232","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor","Summary: The objective of this study was to assess the impact of the Cash Transfer for the Poor Students Programme/Bantuan Siswa Miskin (BSM) program on child labor. The study used a nonexperimental design to assess the program’s impact. With data collected from a national survey, the authors compared the proportion of children that participated in work between those who received financial educational support in the past year before taking the survey, and matched comparison groups of children who had not received financial educational study. The study found that receipt of educational assistance was significantly associated with lower rates of child labor. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to BSM; other factors are likely to have contributed.","Cash Transfer for the Poor Students Programme/Bantuan Siswa Miskin (BSM)","Child labor","Other, Low income",,International,2015,https://mpra.ub.uni-muenchen.de/66767/,"Child Labor Review Protocol" "The effect of a severe health shock on work behavior: Evidence from different health care regimes.","Datta Gupta, N., Kleinjans, K. J., & Larsen, M. (2015). The effect of a severe health shock on work behavior: Evidence from different health care regimes. Social Science and Medicine, 136-137, 44-51.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the national health policies of the United States and Denmark on employment of older workers after a health shock, defined as a new cancer or cardiovascular disease diagnosis. The authors used a nonexperimental approach to compare the impact of a health shock on the likelihood of nonemployment in the United States’ private multipayer system with Denmark’s nationalized universal health care model. The authors used the data from the RAND Health and Retirement Study survey from 1994 to 2002 and Danish population registers for 1993 to 2001. The study found no differences between the United States and Denmark in the relationship between a health shock and employment for older workers. The quality of causal evidence presented in this report is low because the authors did not account for unobserved differences between the countries. This means we are not confident that differences in the association between health shocks and employment in the United States and Denmark are attributable to the national health care policies; other factors are likely to have contributed.","National Healthcare Policy","Health Older workers' programs","Adult, Older worker",,"International, United States",2015,https://www.sciencedirect.com/science/article/pii/S0277953615002816,"Employment and Training Review Protocol" "How much does access to health insurance influence the timing of retirement?","Coe, N. B., & Goda, G. S. (2015). How much does access to health insurance influence the timing of retirement? (SIEPR Discussion Paper No. 14-007). Stanford, CA: Stanford Institute for Economic Policy Research. City, ST: Publisher.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study examined the impact of state-level reforms of health insurance on early retirement and Social Security retirement benefit claims. The authors used 1996–2010 data from the Health and Retirement Study (HRS) and statistical models to compare the outcomes of individuals in states with state-level reforms of health insurance with those in non-reform states. The study found that employed individuals in states with non-group health insurance reform were significantly more likely to retire at age 63. The quality of causal evidence presented in this report is low because the authors did not demonstrate that individuals in states with state-level reforms of health insurance were similar to those in non-reform states. This means we are not confident that the estimated effects are attributable to the non-group health insurance reform; other factors are likely to have contributed.","Retiree Health Insurance","Health insurance Older workers' programs","Adult, Older worker",,"United States",2015,,"Employment and Training Review Protocol" "Evaluation of the social cash transfer pilot programme, Tigray region, Ethiopia-endline report","Berhane, G., Devereux, S., Hoddinott, J., Hoel, J., Roelen, K., Abay, K. Kimmel, M., Ledlie, N., & Woldu, T. (2015). Evaluation of the social cash transfer pilot programme, Tigray region, Ethiopia-endline report. New York, NY: UNICEF","Child Labor",,,"Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a conditional cash transfer program on child labor and school enrollment in two districts in Ethiopia (Abi Adi and Hintalo Wajirat). The study used a nonexperimental design to compare the outcomes of children who received the cash transfer to those who did not. Outcomes were measured using baseline and follow-up household surveys and analyzed using regression. The study found that the number of days that girls were engaged in household business (non-farm activities) significantly decreased in Abi Adi; no significant impacts were found for boys in Abi Adi or any children in the Hintalo Wajirat. The study also found that the rates of school enrollment significantly increased for girls aged 6-11 in Hintalo Wajirat; there were no significant impacts for boys in Hintalo Wajirat or any children in Abi Adi. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the conditional cash transfer program and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2015,,"Child Labor Review Protocol" "Who pays the high health costs of older workers? Evidence from prostate cancer screening mandates.","Bailey, J. (2014). Who pays the high health costs of older workers? Evidence from prostate cancer screening mandates. Applied Economics, 46(32), 3931-3941. doi:10.1080/00036846.2014.948673","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined the impact of state mandates that health insurance plans cover prostate cancer screenings on the earnings and employment of men older than age 50 The study used nonexperimental regression analyses to compare older men in states that had enacted a mandate with women, younger men, and older men living in states without a mandate. The author used data from the Current Population Survey(CPS) between 1990 and 2009. The study found that older men in states with mandates had lower wages and were less likely than the comparison group to be employed. The quality of causal evidence presented in this study is moderate, because it is a well-implemented nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to the prostrate screening mandate, but other factors might also have contributed.","Prostate cancer screening mandates","Health insurance Older workers' programs","Adult, Older worker, Male",,"United States",2014,https://sites.temple.edu/jamesbailey/files/2013/08/Who-Pays-the-High-Health-Cos…,"Employment and Training Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). [WIA Adult]","Hollenbeck, K., & Huang, W.-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). Retrieved from W.E. Upjohn Institute for Employment Research website: http://dx.doi.org/10.17848/tr13-029 [WIA Adult]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program on the employment rate, earnings, and benefit receipt of low-income adults in Washington State. The authors used a nonexperimental method to compare short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and Unemployment Insurance benefits between those who took part in the WIA Adult Program with those who registered for services at the Labor Exchange Employment Services. The study found that, compared with those who registered for services at the Labor Exchange, participants in the WIA Adult Program had higher employment rates and average quarterly earnings and lower receipt of unemployment insurance benefits. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Adult Program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Adult Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Low-skilled, Low income",,"United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica…,"Employment and Training Review Protocol" "You get what you pay for: Schooling incentives and child labor","Edmonds, E. V., & Shrestha, M. (2014). You get what you pay for: Schooling incentives and child labor. Journal of Development Economics, 111, 196-211. doi:10.1016/j.jdeveco.2014.09.005","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of financial schooling incentives (a scholarship and stipend) on school attendance and carpet weaving (a worst form of child labor) among youth ages 10-16 in Nepal. This summary focuses on the comparison between the scholarship treatment group and the control group. The study was a randomized controlled trial (RCT) in which children were randomly assigned to receive one of two schooling incentives (a scholarship or stipend) or to participate in the control group that did not receive any incentives. Using administrative data from schools and survey data, the authors analyzed the impact of the treatment conditions on school attendance and child labor at the end of the school year and 16 months after the intervention ended. The study found no statistically significant difference in rates of involvement in weaving carpets or the hours worked between the scholarship treatment and control groups. There was also no statistically significant difference in rates of school attendance or school enrollment between the two groups. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Schooling Incentives Project Scholarship, and not to other factors. However, the study did not find statistically significant effects.","Schooling Incentives Project","Child labor Tuition assistance","Other, Low income",,International,2014,https://www.sciencedirect.com/science/article/pii/S0304387814001047,"Child Labor Review Protocol" "Cash transfer programme, productive activities and labour supply: Evidence from a randomised experiment in Kenya","Asfaw, S., Davis, B., Dewbre, J., Handa, S., & Winters, P. (2014). Cash transfer programme, productive activities and labour supply: Evidence from a randomised experiment in Kenya. The Journal of Development Studies, 50(8), 1172-1196. doi: 10.1080/00220388.2014.919383","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of a monthly cash transfer program on household food consumption, resources, and work, including child labor. The study used survey data from a clustered randomized controlled trial. Households from seven districts in Kenya were randomly assigned to either the treatment or control group. Within those locations, 20 percent of the poorest households were recruited if they had one or more children 17 years old or younger who was an orphan or had a chronically ill parent or caregiver.  The study found a statistically significant relationship between the program and a reduction in farm labor for children ages 10-15. This relationship was significant for boys but not for girls. There was also a statistically significant relationship between the program and an increase in school enrollment for children ages 12-18. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition and the authors did not demonstrate that groups were similar at baseline. This means we are not confident that the estimated effects are attributable to the Kenya Cash Transfer Programme for Orphans and Vulnerable Children; other factors are likely to have contributed.","Kenya Cash Transfer Programme for Orphans and Vulnerable Children (CT-OVC) Experiment","Child labor","Other barriers, Other, Low income",,International,2014,,"Child Labor Review Protocol" "Evaluation of the NYC Business Solutions Customized Training Program","Hamilton, J., & Chen, E. (2014). Evaluation of the NYC Business Solutions Customized Training Program. New York: New York City Center for Economic Opportunity.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the New York City Business Solutions Customized Training program on earnings. The authors used administrative data on training and payroll to compare the earnings of participants in the customized training program to those of three different matched comparison groups. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the authors did not show that the groups were similar before the intervention, and they did not sufficiently account for potential differences in their analysis. This means we are not confident that the estimated effects are attributable to the customized training program; other factors are likely to have contributed.","the New York City Business Solutions Customized Training Program","Other training and education Work based and other occupational training","Low income",,"United States",2014,http://www.nyc.gov/html/ceo/downloads/pdf/CEO_CT_final_report_2014.pdf,"Employment and Training Review Protocol" "The impact of Brazil's Bolsa Familia Program on school attendance, age-grade discrepancy, and child labor","de Lima Amaral, E. F., Goncalves, G. Q., & Weiss, C. (2014). The impact of Brazil's Bolsa Familia Program on school attendance, age-grade discrepancy, and child labor. Journal of Social Science for Policy Implications, 2, 101-125","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Unfavorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of the Brazilian conditional cash transfer program, Bolsa Familia, on child labor and school enrollment. The authors used a nonexperimental design to compare the outcomes of children ages 7 to 14 who resided in families who met the income threshold for the Bolsa Familia program compared with those who had not, based on data from the 2010 Brazilian Census. The study found that receipt of the cash transfer was significantly associated with an increase in school enrollment. However, receipt of the transfer was also associated with significantly higher rates of work. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to Bolsa Familia program; other factors are likely to have contributed.","Bolsa Familia","Child labor","Other, Low income",,International,2014,,"Child Labor Review Protocol" "The (surprising) efficacy of academic and behavioral intervention with disadvantaged youth: Results from a randomized experiment in Chicago","Cook, P., Dodge, K., Farkas, G., Fryer, R., Guryan, J., Ludwig, J. Mayer, S., Pollack, H., & Steinberg, L. (2014). The (surprising) efficacy of academic and behavioral intervention with disadvantaged youth: Results from a randomized experiment in Chicago. Cambridge, MA: National Bureau of Economic Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Becoming a Man (BAM) program on youths’ academic outcomes, including grade point averages (GPAs), course failures, and achievement test scores. BAM provided mentoring and socialization activities to enhance cognitive, decision-making, and social skills. The study was a randomized controlled trial conducted in one high school on the south side of Chicago, Illinois, in 2012–2013. Eligible youth were randomly assigned to one of three conditions: (1) a treatment group receiving BAM only, in which individuals could participate in the BAM program; (2) a treatment group receiving BAM plus tutoring, in which individuals could participate in the BAM program and received daily tutoring in math; or (3) the control group, which could not participate in BAM but could access existing services at their school. The authors estimated regressions to measure the impact of the BAM program on academic achievement using administrative data from Chicago Public Schools. The study found that youth offered the opportunity to participate in BAM—either with or without supplemental tutoring—had significantly higher math achievement test scores than youth in the control group. In addition, youth in the BAM program group and the BAM plus tutoring program group had significantly higher math GPAs than members of the control group. The quality of causal evidence presented in this report is high for the GPA and course failures outcomes because it was based on a randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to BAM and/or the tutoring sessions, and not to other factors. The quality of causal evidence is moderate for the math and reading achievement outcomes because these outcomes had high attrition but the authors included sufficient controls in their analysis. This means we are somewhat confident that the estimated effects are attributable to BAM and/or tutoring sessions, but other factors might also have contributed.","Becoming a Man","Mentoring Other training and education Youth programs Behavioral Interventions","Youth, Male, Low-skilled, Low income",,"United States, Urban",2014,http://www.nber.org/papers/w19862.pdf,"Opportunities for Youth Review Protocol" "A little help may be no help at all: Child labor and scholarships in Nepal","Datt, G., & Uhe, L. (2014). A little help may be no help at all: Child labor and scholarships in Nepal. Monash Business School Department of Economics Discussion Paper, 50/14.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Mixed impacts Child labor","Summary: The study’s objective was to examine the impact of school scholarships in Nepal on child labor. Using the 2010 Nepal Living Standards Survey III, the authors used a nonexperimental design to compare the labor outcomes of scholarship recipients to those who did not receive scholarships. The study found that scholarship receipt was significantly related to an increase in extended-economic work for girls. However, higher scholarship values were significantly related to a reduction in the number of hours spent in economic and extended-economic work for girls. The quality of causal evidence presented in the study is low because the authors did not control for pre-intervention outcomes. This means we are not confident that the estimated effects are attributable to the scholarship program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2014,https://www.monash.edu/business/economics/research/publications/2014/5014childl…,"Child Labor Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute Technical Report No. 13-029). [WIA Youth]","Hollenbeck, K., & Huang, W-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute Technical Report No. 13-029). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. Retrieved from W.E. Upjohn Institute for Employment Research website: http://dx.doi.org/10.17848/tr13-029. [WIA Youth]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Youth Program, held on community and technical college campuses, on the employment rate and earnings of low-income youth in Washington State. The authors used a nonexperimental method to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment and earnings between those who took part in the WIA Youth program relative to those who registered for services at the Labor Exchange (Employment Services). The study found that, compared with those who registered for services at the Labor Exchange, WIA Youth participants had higher employment and earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Youth Program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Youth Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Youth programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Youth, Low-skilled, Low income",,"United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica…,"Employment and Training Review Protocol" "Sustained gains: Year Up’s continued impacts on young adults’ earnings","Roder, A., & Elliott, M. (2014). Sustained gains: Year Up’s continued impacts on young adults’ earnings. New York: Economic Mobility Corporation.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of the Year Up program on employment, earnings, and education outcomes. Year Up is an intensive, yearlong program that provides training and internships in financial operations and information technology for young adults from low-income urban communities. About 200 students in three cities were randomly assigned to the treatment group, which was eligible to participate in Year Up beginning in September 2007, or the control group, which was not eligible to participate in Year Up in 2007. Members of the control group were eligible to reapply to the program after 10 months, and many did. The authors compared the outcomes of the treatment and control groups using data collected through telephone interviews with participants four years after random assignment. The authors reported a positive, statistically significant impact of Year Up on earnings measured three years after random assignment, but these impacts did not extend to the fourth year after random assignment. Cumulatively, treatment group members earned $13,645 more than the control group over years 2 through 4 after random assignment, and they were more likely to have been employed in a field targeted by the program. The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to Year Up, although other factors could also have contributed.","Year Up","Basic skills Other training and education Work based and other occupational training Youth programs","Youth, Black or African American, Hispanic of any race, Low-skilled, Low income",,"United States, Urban",2014,http://economicmobilitycorp.org/uploads/sustained-gains-economic-mobility-corp…,"Opportunities for Youth Review Protocol" "You get what you pay for: Schooling incentives and child labor","Edmonds, E. V., & Shrestha, M. (2014). You get what you pay for: Schooling incentives and child labor. Journal of Development Economics, 111, 196-211. doi:10.1016/j.deveco.2014.09.005","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of financial schooling incentives (a scholarship and stipend) on school attendance and carpet weaving (a worst form of child labor) among youth ages 10-16 in Nepal. This summary focuses on the comparison between the scholarship treatment group and the stipend treatment group. The study was a randomized controlled trial (RCT) in which children were randomly assigned to receive one of two schooling incentives (a scholarship or stipend) or to participate in the control group that did not receive any incentives. Using administrative data from schools and survey data, the authors analyzed the impact of the treatment conditions on school attendance and child labor at the end of the school year and 16 months after the intervention ended. The study found that the stipend treatment group had significantly higher levels of school attendance than the scholarship treatment group at the end of the school year. However, the study found no statistically significant difference in rates of involvement in weaving carpets or the hours worked between the two groups. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Schooling Incentives Project, and not to other factors.","Schooling Incentives Project","Child labor Tuition assistance","Other, Low income",,International,2014,https://www.sciencedirect.com/science/article/pii/S0304387814001047,"Child Labor Review Protocol" "Did age discrimination protections help older workers weather the Great Recession?","Neumark, D., & Button, P. (2014). Did age discrimination protections help older workers weather the Great Recession? Journal of Policy Analysis and Management, 33(4), 566-601. doi:10.1002/pam.21762","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined whether the strong age discrimination laws moderated the impact of the Great Recession on employment outcomes of older workers. The study used statistical models and the data from the 2003–2011 Current Population Survey (CPS) and 2004–2011 Quarterly Workforce Indicators to estimate impacts. The study found that states with stronger age discrimination laws had experienced increases in unemployment rates, longer unemployment durations, and decreases in hiring rates for some types of older workers relative to younger workers in the months during and following the Great Recession. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the differential effect of the Great Recession on older workers in states with strong age discrimination laws, but other factors might also have contributed.","Age Discrimination Laws","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Female, Male",,"United States",2014,https://www.nber.org/papers/w19216,"Employment and Training Review Protocol" "A random assignment evaluation of learning communities at Kingsborough Community College: Seven years later","Weiss, M. J., Mayer, A., Cullinan, D., Ratledge, A., Sommo, C., & Diamond, J. (2014). A random assignment evaluation of learning communities at Kingsborough Community College: Seven years later. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study aimed to examine the impact of the Opening Doors learning communities at Kingsborough Community College in New York on progress toward completing a degree, actual completion of a degree, employment, and earnings. It measured impacts seven years after random assignment. Students in the Opening Doors learning communities took three linked courses during one semester and received tutoring and case management services. The study was a randomized controlled trial. Eligible students were randomly assigned to either the treatment group, which was offered the opportunity to participate in one of the learning communities, or the control group, which was not allowed to enroll in a learning community. The primary data sources were a baseline survey on the background characteristics of students, student transcripts, degree attainment information from the National Student Clearinghouse, and employment and earnings information from Unemployment Insurance (UI) wage records in New York. The study found no significant impacts on the number of credits earned or attempted, completion of any college degree, or employment or earnings in the seventh year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects would be attributable to the learning communities, and not to other factors.","Opening Doors Learning Communities at Kingsborough Community College","Community college education and other classroom training","Adult, Low income",,"United States",2014,http://www.mdrc.org/sites/default/files/A_Random_Assignment_Evaluation_of_Learn…,"Community College Review Protocol" "The impact of the Kenya CT-OVC programme on children's activities","de Hoop, J., Ranzani, M., Rosati, F. C. (2014). The impact of the Kenya CT-OVC programme on children’s activities (Working Paper). Retrieved from http://www.ucw-project.org/attachment/The_impact_of_the_Kenya_CT-OVC20140423_144552.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of the Kenya Cash Transfer for Orphans and Vulnerable Children Program on child labor and school participation. The study used a randomized controlled trial to assess the intervention. Child outcomes were compared between the treatment and control group households, using data from follow-up surveys administered two years after the start of the intervention. The study found a 5 percent reduction in the proportion of children in the treatment group who were working in unpaid labor or conducting household chores compared to the control group. The quality of causal evidence presented in this report is low because randomization was compromised and the authors did not ensure that the groups being compared were similar before the intervention. This means that if there were significant effects, we would not be confident that they were attributable to Kenya CT-OVC; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2014,http://www.ucw-project.org/attachment/The_impact_of_the_Kenya_CT-OVC20140423_14…,"Child Labor Review Protocol" "The economics of federal tax and employment laws: Empirical evidence from three studies.","Figinski, T. F. (2013). The economics of federal tax and employment laws: Empirical evidence from three studies. (Doctoral dissertation). Retrieved from ProQuest. Accession No. 1415455735.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Unfavorable impacts Public benefit receipt","Summary: The study examined the impact of removing the Social Security earnings test on Social Security claims, earnings, and labor force participation for female beneficiaries. The study used a statistical model and the data from the Social Security Administration’s Benefit and Earnings Public Use File to estimate impacts. The study found that removing the earnings test was associated with an increase in Social Security claims among women who were primary or spousal beneficiaries and with an increase in average earnings and in labor force participation among women who were primary beneficiaries. The qaulity of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the change in Social Security earings test. This means we are not confident that the estimated effects are attributable to the removal of the Social Security earnings test; other factors are likely to have contributed.","Social Security 2000 Earnings Test Removal","Federal retirement benefits Older workers' programs","Adult, Older worker, Female",,"United States",2014,,"Employment and Training Review Protocol" "The impact of earnings disregards on the behavior of low‐income families.","Matsudaira, J. D., & Blank, R. M. (2014). The impact of earnings disregards on the behavior of low‐income families. Journal of Policy Analysis and Management, 33(1), 7-35.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of earnings disregards—the amount of earned income that is not counted when calculating whether someone is eligible for public benefits—for welfare assistance on the employment, earnings, and public assistance receipt of low-skilled single mothers. The study used a difference-in-differences approach to compare the outcomes of women before and after changes in the disregard rate within their state relative to women in other states over the same time period. The study did not find any statistically significant effects of earnings disregards on the outcomes of interest. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design; this is the highest causal evidence rating possible for a nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to earnings disregards, but other factors might also have contributed. However, the study did not find statistically significant effects.","Earnings Disregards for Welfare Assistance","Other employment and reemployment","Female, Parent, Low income",,"United States",2014,,"Employment and Training Review Protocol" "You get what you pay for: Schooling incentives and child labor","Edmonds, E. V., & Shrestha, M. (2014). You get what you pay for: Schooling incentives and child labor. Journal of Development Economics, 111, 196-211. doi:10.1016/j.jdeveco.2014.09.005","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of financial schooling incentives (a scholarship and stipend) on school attendance and carpet weaving (a worst form of child labor) among youth ages 10-16 in Nepal. This summary focuses on the comparison between the stipend treatment group and the control group. The study was a randomized controlled trial (RCT) in which children were randomly assigned to receive one of two schooling incentives (a scholarship or stipend) or to participate in the control group that did not receive any incentives. Using administrative data from schools and survey data, the authors analyzed the impact of the treatment conditions on school attendance and child labor at the end of the school year and 16 months after the intervention ended. The study found that the stipend treatment group had significantly higher levels of school attendance and lower rates of carpet weaving than the control group at the end of the school year. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Schooling Incentives Project Stipend, and not to other factors.","Schooling Incentives Project","Child labor Tuition assistance","Other, Low income",,International,2014,https://www.sciencedirect.com/science/article/pii/S0304387814001047,"Child Labor Review Protocol" "Gasper, J., & Henderson, K. (2014). Sector-focused career centers evaluation: Effects on employment and earnings after one year.","Gasper, J., & Henderson, K. (2014). Sector-focused career centers evaluation: Effects on employment and earnings after one year. New York: New York City Center for Economic Opportunity. Retrieved from http://www.nyc.gov/html/ceo/downloads/pdf/CEO-Sector_Based_Approaches_Evaluation_Report-2014_final.pdf.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of sector-focused career centers in New York City on employment and earnings. The authors estimated the effect of sector-focused career centers by comparing employment and earnings outcomes captured in New York State unemployment insurance data among participants in New York City sector-focused career centers against the outcomes for individuals served by New York City career centers without a specific sector focus who were deemed similar in terms of initial characteristics to the sector-focused group. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the authors did not demonstrate that the groups were similar at baseline or make statistical adjustments for differences between the two groups in the analyses. This means we are not confident that the estimated effects are attributable to sector-focused career centers; other factors are likely to have contributed.","New York City Sector-focused Career Centers","Job search assistance and supportive services Other employment and reemployment","Low income","Manufacturing, Health care and social assistance, Transportation and warehousing","Urban, United States",2014,http://www.nyc.gov/html/ceo/downloads/pdf/CEO-Sector_Based_Approaches_Evaluatio…,"Employment and Training Review Protocol" "Does promoting school attendance reduce child labour? Evidence from Burkina Faso’s Bright project","de Hoop, J. & Rosati, F. C. (2014). Does promoting school attendance reduce child labour? Evidence from Burkina Faso’s Bright project. Economics of Education Review, 39, 78-96. doi:10.1016/j.econedurev.2013.11.001","Child Labor","Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to examine the impact of the BRIGHT project on school participation and child labor in Burkina Faso in West Africa. The study used a regression discontinuity design. Villages were assigned to the treatment and comparison groups based on a numeric score (a constructed index score of how likely the program would be to benefit girls). Villages above the cut-off score received the program; villages below did not receive the program. Using survey data from schools and households, the authors analyzed the impact of the program on child labor, school enrollment, and school attendance for children aged 5-12. The study found that participation in the BRIGHT project was significantly associated with an increase in the probability of children working in the family business or selling goods on the streets. However, program participation was also significantly related to an increase in school enrollment and attendance. This study used a regression discontinuity design and therefore was reviewed using CLEAR’s descriptive study evidence review guidelines. As such, it does not receive a causal rating.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2014,https://www.sciencedirect.com/science/article/pii/S0272775713001556,"Child Labor Review Protocol" "Work-related CBT versus vocational services as usual for unemployed persons with social anxiety disorder: A randomized controlled pilot trial.","Himle, J., Bybee, D., Steinberger, E., Laviolette, W., Weaver, A., Vlnka, S., Golenberg, Z., Levine, D., Heimberg, R., & O’Donnell, L. (2014). Work-related CBT versus vocational services as usual for unemployed persons with social anxiety disorder: A randomized controlled pilot trial. Behaviour Research and Therapy, 63, 169-176.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of group-based, work-related cognitive-behavioral therapy (CBT) on work-related outcomes of unemployed, homeless people diagnosed with social anxiety disorder. The study was a randomized controlled trial. The authors randomly assigned eligible participants to either a treatment group, which received work-related CBT and vocational services, or to a control group, which received vocational services alone. Trained independent evaluators collected the self-reported data used in the study. The study found that participants assigned to the treatment group had higher job search self-efficacy and activity than participants assigned to the control group. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects on employment are attributable to work-based CBT; other factors are likely to have contributed.",,"Job search assistance and supportive services","Unemployed, Low income, Homeless",,"United States",2014,,"Employment and Training Review Protocol" "Retiree health insurance for public school employees: Does it affect retirement?","Fitzpatrick, M. D. (2014). Retiree health insurance for public school employees: Does it affect retirement? Journal of Health Economics, 38, 88-98.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of an Illinois Public Schools retiree health insurance program on the retirement rates of eligible staff ages 55 to 75. The study used a nonexperimental approach to compare the retirement rates of eligible staff with those of staff who were not eligible and staff in years prior to the introduction of the health insurance program who would have been eligible. The author used data from the Illinois Public Schools' Teacher Service Record database from 1970 to 1992. The study found that eligibility for the program was associated with an overall decrease in retirement age, with eligible staff more likely to retire at ages 55 or 56, but less likely to retire after age 65 compared with those who were not eligible for the program. The quality of the causal evidence presented in this report is low because the study is a nonexperimental analysis that does not account for possible differences in the groups. This means we are not confident that the estimated effects are attributable to the Illinois Public Schools Teachers Retirement Health Insurance Plan; other factors are likely to have contributed.","Illinois Public Schools Teachers Retirement Health Insurance Plan","Employer provided retirement benefits Health insurance Older workers' programs","Adult, Older worker",,"United States",2014,https://www.nber.org/papers/w19524,"Employment and Training Review Protocol" "Teenage school attendance and cash transfers: An impact evaluation of PANES","Amarante, V., Ferrando, M., & Vigorito, A. (2013). Teenage school attendance and cash transfers: An impact evaluation of PANES. Economia, 61-93.","Child Labor","Study Type: Descriptive Analysis",,"Child labor-Low-No impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: This objective of this study was to examine the impact of a conditional cash transfer program, National Plan for Social Emergency Assistance (PANES), on child labor and school attendance for children 14-17 years old in Uruguay. The primary design was a regression discontinuity design (RDD) using households within a 2 percent range of the cutoff score. The authors also used a difference-in-differences (DID) approach. The study used administrative data collected before the launch of the program and household surveys implemented in two follow-up waves (at two months and 18 months after the program ended). The authors compared the differential effects of receiving the program on outcomes for those in the treatment group versus those in the comparison group. The study found no statistically significant relationships between the PANES program and child labor or schooling. The quality of causal evidence presented in this report under the DID design is low. The RDD does not receive a causal rating.","National Plan for Social Emergency Assistance (PANES)","Child labor","Other, Low income",,International,2013,https://www.researchgate.net/publication/265975653_Teenage_School_Attendance_an…,"Child Labor Review Protocol" "Does federally-funded job training work? Nonexperimental estimates of WIA training impacts using longitudinal data on workers and firms","Andersson, F., Holzer, H. J., Lane, J. I., Rosenblum, D., & Smith, J. (2013). Does federally-funded job training work? Nonexperimental estimates of WIA training impacts using longitudinal data on workers and firms (Discussion paper no. 7621). Bonn, Germany: IZA. [Adult Program ONLY]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Employment-Mod/high-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) adult program’s training services on the employment and earnings of low-income adults. The authors investigated similar research questions in another study, whose profile can be found [here]. The other study examined the effects of WIA’s dislocated worker program’s training services on the employment and earnings of dislocated workers. The authors used statistical analysis to compare the earnings and employment outcomes of WIA-registered low-income adults who received training services to the outcomes of those who were registered in WIA, but did not receive training services. The study found that employment was significantly lower for the treatment group than it was for the comparison group in the first quarters after WIA registration (Quarters 1 and 2 in State A and Quarters 1–4 in State B), but later became and generally stayed significantly higher in Quarters 6 through 12 in both states. Total earnings in the third year after WIA registration were significantly higher for the treatment group than the comparison group. People in the treatment group earned $1,257 and $1,703 more than those in the comparison group in State A and State B, respectively. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design; this is the highest causal evidence rating possible for a nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WIA adult program training services, but other factors might also have contributed to the effects.","Workforce Investment Act (WIA) Program Training Services","Adult and Dislocated Worker programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Unemployed, Low income",,"United States",2013,https://www.nber.org/papers/w19446.pdf,"Employment and Training Review Protocol" "Conditional cash transfers in New York City: The continuing story of the Opportunity NYC—Family Rewards demonstration","Riccio, J., Dechausay, N., Miller, C., Nunez, S., Verma, N., & Yang E. (2013). Conditional cash transfers in New York City: The continuing story of the Opportunity NYC—Family Rewards demonstration. New York, NY: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employer benefits receipt-Mod/high-Favorable impacts Employer benefits receipt Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Family Rewards, an experimental privately funded conditional cash transfer program in New York City, on earnings, employment, public benefits receipt, and education. The study was based on a randomized controlled trial and estimated the effect of the Family Rewards program on low-income families. The authors used New York City and New York State administrative data to compare average outcomes between families offered access to the program and families excluded from the program, after adjusting for chance initial differences between the groups. The authors found that, on average, the Family Rewards program decreased the likelihood of ever being employed at an Unemployment Insurance (UI)-covered job in the first year by 2 percentage points, but increased monthly earnings by $353 and decreased the share of families receiving income from Supplemental Security Income (SSI) or disability benefits by 3.9 percentage points. The authors also found that parents in the Family Rewards program group were 4.2 percentage points more likely to have achieved any trade license training certification. The quality of causal evidence presented in this report is high for most outcomes because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Family Rewards program, and not to other factors. However, some outcomes in the study receive a moderate or low causal evidence rating, meaning that we are less confident that the estimated effects are attributable to the Family Rewards program; other factors may have contributed.","the Family Rewards Program","Other employment and reemployment Other training and education","Low income, Parent",,"United States, Urban",2013,http://files.eric.ed.gov/fulltext/ED545453.pdf,"Employment and Training Review Protocol" "Stimulating opportunity: An evaluation of ARRA-funded subsidized employment programs","Roder, A. & Elliott, M. (2013). Stimulating opportunity: An evaluation of ARRA-funded subsidized employment programs. New York: Economic Mobility Corporation. Retrieved from http://economicmobilitycorp.org/uploads/stimulating-opportunity-full-report.pdf.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of subsidized employment programs in five states on the employment and earnings outcomes of unemployed people. The focus of this profile is Florida’s Back to Work program, which placed participants in partially subsidized jobs in which employers were expected to cover 5 to 20 percent of the employee’s wages for up to one year. For the evaluation of the Florida Back to Work program, the authors used administrative wage data to compare the employment and earnings outcomes of program participants with the employment and earnings outcomes of a similar group of people who were not placed in subsidized employment. The study found that participants in Florida Back to Work were more likely to be employed and earned $1,921 more in the year following the program than those in the comparison group. The quality of causal evidence presented in this report is low because the authors did not include sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the subsidized employment program. Other factors are likely to have contributed.","Florida's Back to Work Program","Other employment and reemployment","Unemployed, Low income",,"United States",2013,http://economicmobilitycorp.org/uploads/stimulating-opportunity-full-report.pdf,"Employment and Training Review Protocol" "A randomized controlled trial to improve health among women receiving welfare in the U.S.: The relationship between employment outcomes and the economic recession.","Kneipp, S., Kairalla, J. & Sheely, A. (2013). A randomized controlled trial to improve health among women receiving welfare in the U.S.: The relationship between employment outcomes and the economic recession. Social Science & Medicine, 80, 130-140.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Public Health Nurse (PHN) intervention on employment outcomes. The authors conducted a randomized controlled trial. Researchers used self-reported job beginning and ending dates to determine whether a participant was employed over a nine-month period. The authors found no statistically significant effect of PHN on any employment in the first nine months after random assignment. The quality of causal evidence presented in this study is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to PHN and not to other factors. However, the study did not find statistically significant effects.","Public Health Nurse Intervention","Other employment and reemployment","Disability, Low income",,"United States",2013,,"Employment and Training Review Protocol" "Can post-employment services combined with financial incentives improve employment retention for welfare recipients?","Dorsett, R., Hendra, R., Robins, P. K., & Williams, S. (2013). Can post-employment services combined with financial incentives improve employment retention for welfare recipients? Evidence from the Texas Employment Retention and Advancement evaluation. (No. 1413-13). Madison, WI: Institute for Research on Poverty.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Texas Employment Retention and Advancement (ERA) program on employment entry and retention in two sites: Corpus Christi and Fort Worth. The authors conducted a non-experimental study using data originally collected for a randomized controlled trial. They analyzed survey data and state Unemployment Insurance records to estimate the effects of the ERA program on employment entry and retention. The study found a positive and statistically significant relationship between participation in the ERA program and the likelihood of transitioning into employment and between ERA and employment retention at the Corpus Christi site. The quality of causal evidence presented in this report is low because the authors did not account for differences in wages or employment between the ERA and comparison groups before the beginning of the ERA program. This means we are not confident that the estimated effects are attributable to the Texas ERA program; other factors are likely to have contributed.","Texas Employment Retention and Advancement (ERA)","Job search assistance and supportive services Other wages and benefits","Unemployed, Low income, Female",,"United States",2013,http://www.niesr.ac.uk/sites/default/files/publications/dp409_0.pdf,"Review Protocol" "Impact evaluation: Combating worst forms of child labor by reinforcing policy response and promoting sustainable livelihoods and educational opportunities in Egypt, 2011-2012","ICF International. (2013). Impact evaluation: Combating worst forms of child labor by reinforcing policy response and promoting sustainable livelihoods and educational opportunities in Egypt, 2011-2012. Calverton, MD: Author.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of Combating Worst Forms of Child Labor by Reinforcing Policy Response and Promoting Sustainable Livelihoods and Educational Opportunities in Egypt (CWCLP) on schooling and work for children ages 6 to 11 (at the time of the baseline survey). Using survey data from a randomized controlled trial, the authors analyzed the impact of the CWCLP program on schooling and work after approximately 12-16 months of implementation (the timing of implementation varied). When compared to control group children, the study found that CWCLP participating children spent significantly less time in economic activities and unpaid household services and significantly more time in school-related activities. Participating children also had significantly higher school enrollment and significantly higher school attendance than children in the control group. The quality of causal evidence presented in this report is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the CWCLP program, but other factors might also have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2013,,"Child Labor Review Protocol" "The link between pensions and retirement timing: Lessons from California teachers.","Brown, K. M. (2013). The link between pensions and retirement timing: Lessons from California teachers. Journal of Public Economics, 98(C), 1-14.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of pension reform under the California State Teachers’ Retirement System (CalSTRS) on retirement timing. The author used a statistical model and data from retirement-eligible employees in Los Angeles Unified School District from 1997 to 2000 to estimate the impact. The study found public school employees were more likely to work an extra year in response to changes in pension plans that provided additional bonuses tied to age and tenure. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the changes in CalSTRS. This means we are not confident that the estimated effects are attributable to the changes in CalSTRS; other factors are likely to have contributed.","CalSTRS Defined Benefit Program","Older workers' programs Other wages and benefits","Adult, Older worker",,"United States",2013,https://eml.berkeley.edu//~saez/course/brown_jpube13.pdf,"Employment and Training Review Protocol" "Initial impacts of the Ticket to Work program for young new Social Security disability awardees: Estimates based on randomly assigned mail months","Stapleton, D., Mamun, A., & Page, J. (2013). Initial impacts of the Ticket to Work program for young new Social Security disability awardees: Estimates based on randomly assigned mail months. Princeton, NJ: Mathematica Policy Research, Center for Studying Disability Policy.","Disability Employment Policy, Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: This study examined impacts of the Ticket to Work (TTW) program, a work incentive program for Social Security disability recipients, on achieving Social Security Disability Insurance (SSDI) return-to-work earnings benchmarks and SSDI benefit suspension or termination for work. The study sample included SSDI recipients who entered the rolls from July 1999 to October 2003, were ages 18 to 39, and were not concurrently receiving Supplemental Security Income (SSI). The authors used data from the Ticket Research File (TRF), a Social Security administrative data file, for the analysis. The study found that TTW did not have a statistically significant impact on SSDI return to work earnings benchmarks or the number of SSDI recipients who had their benefits suspended or terminated due to work. The quality of the causal evidence presented in this report is moderate, the highest possible rating for a nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to TTW, but other factors might have contributed.","Ticket to Work","Disability insurance Supplemental security income (SSI) Supported employment or other employment supports","Disability, Low income",,"United States",2013,http://www.mathematica-mpr.com/~/media/publications/pdfs/disability/ttw_initial…,"Disability Employment Policy, Low-Income Adults Review Protocol" "Enhancing GED instruction to prepare students for college and careers: Early success in LaGuardia Community College’s Bridge to Health and Business program","Martin, V. & Broadus, J. (2013). Enhancing GED instruction to prepare students for college and careers: Early success in LaGuardia Community College’s Bridge to Health and Business program. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of LaGuardia Community College’s general educational development (GED) Bridge to Health and Business program on GED completion, college enrollment, and college persistence. The study was a randomized controlled trial. Eligible students (369 in total) were randomly assigned to either the treatment group, which could participate in the GED Bridge program, or the control group, which could not participate in the GED Bridge program but could participate in a traditional GED preparation course. The study found that, compared with students randomly assigned to the traditional GED Prep course, those offered enrollment in the GED Bridge to Health and Business program were more likely to complete the GED course, pass the GED exam within a year, enroll in a City University of New York (CUNY) community college by the end of the study, and reenroll for a second semester at a CUNY community college by the end of the study. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the GED Bridge to Health and Business program, and not to other factors.","the GED Bridge to Health and Business Program","Basic skills Community college education and other classroom training","Adult, Other barriers, Low income",,"United States",2013,http://www.mdrc.org/sites/default/files/Enhancing_GED_Instruction_brief.pdf,"Community College Review Protocol" "The impact of uncapping of mandatory retirement on postsecondary institutions.","Weinberg, S. L., & Scott, M. A. (2013). The impact of uncapping of mandatory retirement on postsecondary institutions. Educational Researcher, 42(6), 338-348.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of uncapping mandatory retirement on retirement ages at postsecondary institutions The study used a statistical model to examine the age of retirement before and after the policy change in 1993. It used data on faculty’s employment and retirement from a research university with multiple schools. The study found that uncapping was associated with a statistically significant increase in the retirement age among those who retired from the university. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar nor did they control for differences between the groups. This means we are not confident that the estimated effects are attributable to the federal Age Discrimination in Employment Act (ADEA); other factors are likely to have contributed.","Age Discrimination Employment Act (ADEA)","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2013,https://www.researchgate.net/publication/258134776_The_Impact_of_Uncapping_of_M…,"Employment and Training Review Protocol" "Does retiree health insurance encourage early retirement?","Nyce, S., Schieber, S. Shoven, J. B., Slavov, S., & Wise, D. A. (2013). Does retiree health insurance encourage early retirement? Journal of Public Economics, 104, 40-51.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of employer-provided retiree health insurance on early retirement. The authors used a nonexperimental design to compare early retirement outcomes of employees who are eligible for retiree health insurance with that of those who have no coverage. The study found that people who were employed at age 57 and eligible for employer-subsidized retiree health coverage were significantly more likely to retire at ages 62 to 64 (before becoming eligible for Medicare at age 65) compared with those with no coverage. The quality of causal evidence presented in this report is low because the authors did not account for other factors that could have affected the difference between the treatment and comparison groups. This means we are not confident that the estimated effects are attributable to retiree health insurance; other factors are likely to have contributed.","Retiree Health Insurance","Employer provided retirement benefits Older workers' programs","Adult, Older worker",,"United States",2013,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3770310/,"Employment and Training Review Protocol" "Training and retirement patterns.","Montizaan, R., Cörvers, F., & de Grip, A. (2013). Training and retirement patterns. Applied Economics, 45(15), 1991-1999. doi:10.1080/00036846.2011.646066","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of firm-specific training and general training on older men’s retirement decisions The study used a nonexperimental design and data from the U.S. National Longitudinal Survey of Older Men for 1966 to 1983 to estimate impacts. The study found that workers with firm-specific training were more likely to retire within the time period studied and to have jobs with a mandatory retirement age than workers without firm-specific training. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before receiving training and did not account for self-selection into training. This means we are not confident that the estimated effects are attributable to firm-specific or general training; other factors are likely to have contributed.","Firm-specific & General Training","Work based and other occupational training","Adult, Older worker, Male",,"United States",2013,https://www.researchgate.net/publication/236021967_Training_and_retirement_patt…,"Employment and Training Review Protocol" "Does Pantawid foster dependence or encourage work? Evidence from a randomized experiment","Orbeta, A., & Paqueo, V. (2013). Does Pantawid foster dependence or encourage work? Evidence from a randomized experiment. Philippine institute for Development Studies. Retrieved from http://nap.psa.gov.ph/ncs/12thncs/papers/INVITED/IPS-09%20Social%20Protection%20Statistics/IPS-09_2%20Impact_of_4Ps_on_Labor_Market_Outcomes%20AO-VP-new.pdf  ","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor","Summary: The study’s objective was to examine the impact of a conditional cash transfer program, called Pantawid Pamilya Pilipino Program (Pantawid) on child work participation and hours children worked per week. Using household survey data from a randomized controlled trial, the authors analyzed the impact of the Pantawid program on child work participation almost 24-months after implementation. The study found that there were no significant relationships between participation in the program and child work participation or hours worked per week. The quality of causal evidence presented in this report is low because it based on a randomized controlled trial with unknown attrition and the authors did not control for pre-existing differences. This means we are not confident that the estimated effects are attributable to Pantawid; other factors are likely to have contributed. However, the study did not find statistically significant effects.","Pantawid Pamilya Pilipino Program","Child labor","Other, Low income",,International,2013,http://nap.psa.gov.ph/ncs/12thncs/papers/INVITED/IPS-09%20Social%20Protection%2…,"Child Labor Review Protocol" "Do stronger age discrimination laws make Social Security reforms more effective?","Neumark, D., & Song, J. (2013). Do stronger age discrimination laws make Social Security reforms more effective? Journal of Public Economics, 108, 1-16.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Mixed impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study examined whether the strength of state age discrimination protections affected rates of Social Security benefit claiming and employment outcomes of older workers. The study used a nonexperimental design and the data on Social Security claiming and employment outcomes from the Health and Retirement Study (HRS) to estimate the impacts. The study found that among older men affected by the 1983 Social Security reform, age discrimination protections were associated with increases in employment rates between age 62 and the full retirement age and delayed benefit claiming. The quality of casual evidence presented in this report is moderate because the study was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to state age discrimination laws, but other factors might also have contributed.","The 1983 Social Security Reform","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2013,https://ideas.repec.org/a/eee/pubeco/v108y2013icp1-16.html,"Employment and Training Review Protocol" "Preventing youth violence and dropout: A randomized field experiment (No. w19014)","Heller, S., Pollack, H. A., Ander, R., & Ludwig, J. (2013). Preventing youth violence and dropout: A randomized field experiment (No. w19014). Cambridge, MA: National Bureau of Economic Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Becoming a Man program on arrest and educational outcomes. The study was a randomized controlled trial. Eligible male youth from 18 public schools in disadvantaged neighborhoods were screened for eligibility. The 2,740 who met requirements were randomly assigned to one of three treatment groups or a control group. The study found that being offered the opportunity to participate in the program reduced violent crime arrests during the program year and improved schooling outcomes in both the program and follow-up years. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Becoming a Man program, and not to other factors.","Becoming a Man","Other training and education Safety Youth programs Behavioral Interventions","Youth, Disconnected youth, Male, Low income",,"United States, Urban",2013,http://faculty.chicagobooth.edu/workshops/AppliedEcon/past/pdf/jensludwigyouthv…,"Opportunities for Youth Review Protocol" "Increasing opportunities for low-income women and student parents in science, technology, engineering, and math at community colleges","Costello, C. (2012). Increasing opportunities for low-income women and student parents in science, technology, engineering, and math at community colleges. Washington, DC: Institute for Women’s Policy Research.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study examined the enrollment patterns for low-income women and students with children (including mostly mothers and some fathers, collectively referred to as student parents) in STEM fields at community colleges in the United States, comparing outcomes for 2000–2001 to 2008–2009. In addition, the study presented examples of promising strategies to encourage low-income women and student parents to participate in STEM education at community colleges. To assess the involvement of low-income women and student parents in STEM fields at community colleges, the author analyzed publicly available data, including data from the U.S. Department of Labor and the National Center for Education Statistics at the U.S. Department of Education. The author also completed a review of existing programs at community colleges that encourage low-income women and student parents to participate in STEM fields, and consulted with 16 experts to formulate suggestions for additional programs to support these students in STEM fields. The study found that in the 2008–2009 school year, women earned 22 percent of associate’s degrees awarded in STEM fields—a 7 percentage point reduction in the proportion of STEM associate degrees earned by women eight years earlier. The study also found that, in 2008, roughly one-third of community college students were parents and student parents with children younger than 12 who ultimately earned a baccalaureate or master’s degree in a STEM field were more likely to have attended a community college at some point than students without young children. Given the decline in women’s share of STEM associate degrees earned over the study observation period, as well as the high proportion of student parents in STEM fields who attend community colleges (compared with students without young children), the author highlighted potential strategies to increase and improve the involvement of low-income women and student parents in STEM fields at community colleges, including targeted recruitment, financial support, child care services, strong developmental education options, and specific counseling and academic support for women. These recommendations were informed by information gathered from existing programs and consultation with experts.",,"Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Female, Male, Parent, Low income",,"United States",2012,http://www.iwpr.org/initiatives/student-parent-success-initiative/increasing-op…,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Educational and child labour impacts of two food-for-education schemes: Evidence from a randomised trial in rural Burkina Faso","Kazianga, H., De Walque, D., & Alderman, H. (2012). Educational and child labour impacts of two food-for-education schemes: Evidence from a randomised trial in rural Burkina Faso. Journal of African Economies, 21(5), 723-760. doi:10.1093/jae/ejs010.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two food-for-education programs (a school meals program and a take home rations program) on education and labor outcomes for children. This summary focuses on the comparison between the take home rations treatment group and the control group. The study was a randomized controlled trial (RCT) conducted in low-income villages in northern rural Burkina Faso, West Africa. Villages were randomly assigned to one of two treatment groups or a control group. Survey data were collected from randomly selected households located close to the schools in the villages. Outcomes were analyzed using difference-in-differences models. The study found that the take home rations program significantly decreased productive labor for all children, with a larger decrease for girls than boys. For children enrolled in school at the time of the survey, the program significantly decreased productive labor for all children. The study also found that the take home rations program significantly increased school enrollment for all children. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the take home rations program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2012,https://doi.org/10.1093/jae/ejs010,"Child Labor Review Protocol" "Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. [San Diego—EARN!]","Miller, C., Tessler, B. L., & Van Dok, M. (2012). Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. New York: MDRC. [San Diego—EARN!]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of participation in San Diego—EARN!, a Work Advancement and Support Center (WASC), on participants’ earnings, employment, educational attainment and benefit receipt. This study was a randomized controlled trial and used administrative data from the Employment Development Department in California, the San Diego County Health and Human Service Agency, and the National Student Clearinghouse to measure outcomes. The authors used a 12-month follow-up survey with a random subset of participants to measure receipt of work supports and job characteristics. The study found that members of the treatment group were 5.7 percentage points more likely than the control group to have ever received Food Stamps one year after the program began. The study also found that members of the treatment group received an average of $155 more in Food Stamps than the control group one year after the program began and an average of $320 more in Food Stamps than the control group three years after the program began. The quality of causal evidence presented in this report is high for outcomes measured with administrative data. This means we are confident that the estimated effects on these outcomes are attributable to San Diego—EARN! and not to other factors. However, outcomes measured with survey data receive a low causal evidence rating, meaning that we are not confident that the estimated effects are attributable to San Diego—EARN!; other factors may have contributed.","Work Advancement and Support Center Demonstration (WASC), San Diego—EARN!","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States, Urban",2012,http://www.mdrc.org/sites/default/files/full_627.pdf,"Employment and Training Review Protocol" "From protection to production: Productive impacts of the Malawi Social Cash Transfer scheme","Covarrubias, K., Davis, B. & Winters, P. (2012). From protection to production: Productive impacts of the Malawi Social Cash Transfer scheme, Journal of Development Effectiveness, 4(1), 50-77.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of the Malawi Social Cash Transfer Scheme (SCTS) on household work activities, including child labor. The study used household survey data from a randomized controlled trial. Due to pre-existing baseline differences between the original treatment and control groups, the authors used a matched comparison group design to compare child schooling and labor outcomes between children in the treatment group and those in the control group. The study found that the SCTS program significantly decreased the proportion of children in paid domestic work outside of the household and the proportion of children pulled from school to work for food or money. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Malawi Social Cash Transfer Scheme (SCTS); however, other factors might have also contributed.","Malawi Social Cash Transfer Scheme","Child labor","Other, Low income",,International,2012,http://www.fao.org/fileadmin/user_upload/p2p/Publications/MalawiSCT_ProductiveI…,"Child Labor Review Protocol" "Income tax and older American workers’ job transition into self-employment.","Choi, S. (2012). Income tax and older American workers’ job transition into self-employment. Korea and the World Economy, 13(2), 189-214.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study examined the effect of a progressive income tax on the likelihood of transitioning to self-employment among older workers. The study used a nonexperimental approach (the exponential hazard model) that compared the likelihood of transitioning from a wage job to self-employment based on the marginal taxes a worker would expect to pay. The author used the data from the Health and Retirement Study in 1992 matched to the Social Security Administration Master Earnings File from 1980 to 1991, which contains W-2 records of earnings from both wage work and self-employment. The study found that a more progressive tax (that is, a tax schedule that increases sharply toward the higher end) or higher marginal tax rates reduces the likelihood of entering self-employment. The quality of causal evidence presented in this report is low because the author did not ensure that the groups with higher or lower marginal tax rates were similar before a change in the tax schedule. This means we are not confident that the estimated effects are attributable to changes in marginal taxes; other factors are likely to have contributed.","Progressive Income Tax","Other employment and reemployment","Adult, Older worker, Employed",,"United States",2012,,"Employment and Training Review Protocol" "Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. [Dayton—Move Up]","Miller, C., Tessler, B. L., & Van Dok, M. (2012). Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. New York: MDRC. [Dayton—Move Up]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of participation in Dayton—Move Up, a Work Advancement and Support Center (WASC), on participants’ earnings, employment, educational attainment, and benefit receipt. This study was a randomized controlled trial and used administrative data from the Ohio Department of Job and Family Services and the National Student Clearinghouse to measure outcomes. The authors used a 12-month follow-up survey with a random subset of participants to measure receipt of work supports and job characteristics. The study found that the treatment group was 6.4 percentage points more likely to obtain a license or certificate than the control group and 6.2 percentage points more likely to have ever received Food Stamps one year after the program began. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Dayton—Move Up and not to other factors.","Work Advancement and Support Center (WASC), Dayton—Move Up","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States",2012,http://www.mdrc.org/sites/default/files/full_627.pdf,"Employment and Training Review Protocol" "The efficacy of supported employment for middle-aged and older people with schizophrenia.","Twamley, E. W., Vella, L., Burton, C. Z., Becker, D. R., Bell, M. D., & Jeste, D. V. (2012). The efficacy of supported employment for middle-aged and older people with schizophrenia. Schizophrenia Research, 135(1-3), 100-104.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of Individual Placement and Support (IPS) on competitive employment for older people with schizophrenia The study was a randomized controlled trial (RCT) conducted at a community mental health clinic and used weekly work logs cross-referenced with pay stubs to measure employment outcomes over a 12-month period. The study found that IPS was positively associated with employment and earnings. The quality of causal evidence presented in this report is low because the RCT has a confounding factor. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support and Vocational Rehabilitation Program","Health Individuals facing barriers to employment Job search assistance and supportive services","Adult, Older worker, Disability",,"United States",2012,https://psycnet.apa.org/record/2011-30184-001,"Employment and Training Review Protocol" "What can a multifaceted program do for community college students? Early results from an evaluation of Accelerated Study in Associate Programs (ASAP) for developmental education students","Scrivener, S., Weiss, M., & Sommo, C. (2012). What can a multifaceted program do for community college students? Early results from an evaluation of Accelerated Study in Associate Programs (ASAP) for developmental education students. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Accelerated Study in Associate Programs (ASAP) on full-time enrollment, credits attempted, and credits earned.  The study was a randomized controlled trial. Data sources included a baseline information form (BIF), which collected demographic and background characteristics and students’ records from the City University of New York (CUNY), including students’ transcripts and CUNY assessment test data. The study found that ASAP had significant impacts on full-time enrollment, credits attempted, and credits earned during the first, second, and third semesters following random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to ASAP, and not to other factors.","the Accelerated Study in Associate Program (ASAP)","Basic skills Community college education and other classroom training","Adult, Other barriers, Low income",,"United States",2012,http://files.eric.ed.gov/fulltext/ED532840.pdf,"Community College Review Protocol" "What strategies work for the hard-to-employ? Final results of the Hard-to-Employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. [Minnesota Tier 2]","Butler, D., Alson, J., Bloom, D., Deitch, V., Hill, A., Hsueh, J., Jacobs, E., Kim, S., McRoberts, R., & Redcross, C. (2012). What strategies work for the hard-to-employ? Final results of the Hard-to-Employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. (OPRE report 2012-08). Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Minnesota Tier 2]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study examined the impact of the Minnesota Tier 2 program on employment, earnings, and receipt of public assistance for unemployed single parents. The study was a randomized controlled trial. The authors estimated the impact of the Tier 2 program by comparing the outcomes of the treatment and control groups four years after random assignment using data from Minnesota public assistance records and Unemployment Insurance wage records. The study found no statistically significant relationships between the Minnesota Tier 2 program and employment, earnings, or receipt of public assistance. The quality of causal evidence presented in this report is high for the employment and earnings outcomes because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects on earnings and employment would be attributable to the Minnesota Tier 2 program, and not to other factors. The public assistance outcomes receive a low rating, which means we would not be confident that any estimated effects on public assistance would be attributable to the Minnesota Tier 2 program; other factors are likely to have contributed. However, the study did not find any statistically significant effects on employment, earnings, or benefit receipt.","the Minnesota Tier 2 Program","Other employment and reemployment Substance abuse recovery","Low income, Parent",,"United States",2012,http://www.acf.hhs.gov/sites/default/files/opre/strategies_work.pdf,"Employment and Training Review Protocol" "Enhanced Early Head Start with employment services: 42-month impacts from the Kansas and Missouri sites of the Enhanced Services for the Hard-to-Employ Demonstration and Research Project","Hsueh, J., and Farrell, M. (2012). Enhanced Early Head Start with employment services: 42-month impacts from the Kansas and Missouri sites of the Enhanced Services for the Hard-to-Employ Demonstration and Research Project. OPRE Report 2012-05. Washington DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Enhanced Early Head Start (EHS) participation on employment, earnings, and public assistance receipt for low-income families with young children. The study used a randomized controlled trial design, assigning eligible families to either the Enhanced EHS program or existing services. To estimate the program’s impacts, the authors used administrative employment and earnings data, as well as a 42-month follow-up survey emphasizing respondents’ employment, income, and public assistance receipt. Outcomes were adjusted for characteristics before random assignment. The study found that the longest period of continuous employment during the 3.5-year follow-up period was, on average, 2.5 months shorter for mothers in the Enhanced EHS group than mothers in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Enhanced EHS services, and not to other factors.","Enhanced Early Head Start","Other employment and reemployment","Low income, Parent",,"United States, Rural",2012,http://www.acf.hhs.gov/sites/default/files/opre/kansas_missouri.pdf,"Employment and Training Review Protocol" "Cash transfers and children's education and labour among Malawi's poor","Miller, C., & Tsoka, M. (2012). Cash transfers and children's education and labour among Malawi's poor. Development Policy Review, 30(4), 499-522. doi:10.1111/j.1467-7679.2012.00586.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to assess the effects of an unconditional cash transfer program, the Malawi Social Cash Transfer Scheme (SCTS), on child school participation and child labor. To assess the program’s effects, the authors used a randomized controlled trial in which villages were randomly assigned to the treatment group, which would receive the intervention, and the control group, which would not. Child labor was assessed using household surveys, and schooling outcomes were assessed using household surveys and school records. To understand the program’s impact on child school and work participation, the authors compared change in these outcomes over the first year of the program. The study found that children participating in the intervention had significantly greater decreases in school absences over one year, relative to the comparison group. In addition, over one year there was a significantly lower increase in the percent of both boys and girls who worked for income if they were in the intervention group rather than the comparison group. The quality of causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Malawi Social Cash Transfer Scheme, but other factors might also have contributed.","Malawi Social Cash Transfer Scheme","Child labor","Other barriers, Other, Low income",,International,2012,http://interactions.eldis.org/sites/interactions.eldis.org/files/database_sp/Ma…,"Child Labor Review Protocol" "What strategies work for the hard-to-employ? Final results of the Hard-to-Employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. [NYC PRIDE]","Butler, D., Alson, J., Bloom, D., Deitch, V., Hill, A., Hsueh, J., Jacobs, E., Kim, S., McRoberts, R., & Redcross, C. (2012). What strategies work for the hard-to-employ? Final results of the Hard-to-Employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. (OPRE Report 2012-08). Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [NYC PRIDE]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Personal Roads to Individual Development and Employment (PRIDE) program on employment, earnings, and public assistance receipt. The study was a randomized controlled trial. The authors estimated the impact of PRIDE by comparing the outcomes of the treatment and control groups four years after random assignment using data from public assistance records and Unemployment Insurance wage records. The study found that those assigned to the PRIDE group were more likely to be employed and received less in cash assistance in the four years following random assignment than those in the control group. The quality of causal evidence presented in this report is low because the study had a shift in the probability of assignment and did not sufficiently demonstrate that the treatment and control groups were similar. This means we are not confident that the estimated effects are attributable to PRIDE; other factors are likely to have contributed.","the Personal Roads to Individual Development and Employment (PRIDE) Program","Other employment and reemployment Unemployment Insurance","Low income",,"United States",2012,http://www.acf.hhs.gov/sites/default/files/opre/strategies_work.pdf,"Employment and Training Review Protocol" "A study of the impact of a first-year experience initiative on first-year developmental education student success and persistence","Spencer, K. (2012). A study of the impact of a first-year experience initiative on first-year developmental education student success and persistence (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 3542047)","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Achieving the Dream learning community program on students’ retention and completion of developmental English and math courses at a community college in Michigan. The study used students’ records to compare outcomes of developmental education students who enrolled in the Achieving the Dream program to outcomes of those who took standard developmental courses. The study found no significant differences between the treatment and comparison groups in retention rates or in completion of English or math developmental courses. The quality of causal evidence presented in this study is low because the author did not include sufficient controls in the analysis. This means we are not confident that the estimated effects are attributable to Achieving the Dream. Other factors are likely to have contributed.","Achieving the Dream","Community college education and other classroom training","Adult, Low income, Other",,"United States",2012,,"Community College Review Protocol" "What strategies work for the hard-to-employ? Final results of the hard-to-employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. [NYC SACM]","Butler, D., Alson, J., Bloom, D., Deitch, V., Hill, A., Hsueh, J., Jacobs, E., Kim, S., McRoberts, R., & Redcross, C. (2012). What strategies work for the hard-to-employ? Final results of the hard-to-employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. (OPRE Report 2012-08.) Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [NYC SACM]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Substance Abuse Case Management (SACM) program on employment, earnings, and public assistance receipt after two years. The authors attempted to implement a randomized controlled trial, but they used a process that resulted in nonrandom assignment. The study estimated impacts by comparing the regression-adjusted outcomes of the treatment and control groups, using data collected from New York City public assistance records and Unemployment Insurance wage records for New York State. The study found no statistically significant relationships between SACM and employment, earnings, or public assistance receipt. The quality of causal evidence presented in this report is low because the assignment mechanism was nonrandom and the authors did not demonstrate that the treatment and control groups were similar. This means we would not be confident that any estimated effects would be attributable to the Substance Abuse Case Management program; other factors are likely to have contributed. However, the study did not find statistically siginificant effects.","the Substance Abuse Case Management (SACM) Program","Other employment and reemployment Substance abuse recovery","Low income",,"United States, Urban",2012,http://www.acf.hhs.gov/sites/default/files/opre/strategies_work.pdf,"Employment and Training Review Protocol" "Are conditional cash transfers effective in urban areas? Evidence from Mexico","Behrman, J. R., Gallardo-Garcıa, J., Parker, S. W., Todd, P. E., & Velez-Grajales, V. (2012). Are conditional cash transfers effective in urban areas? Evidence from Mexico. Education Economics, 20(3), 233-259.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on school enrollment and employment in paid activities for children ages 6 to 18 in urban areas. The study used a nonexperimental design to evaluate schooling and work outcomes from PROGRESA/Oportunidades program 1 and 2 years after implementation in urban areas. The study found that PROGRESA/Oportunidades was significantly related to reduced labor rates for boys who were 12-14 in the first and second year, and girls ages 15 to 18 in the first year. The program was also significantly related to an increase in school enrollment for boys and girls. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups were similar before program participation. This means we are not confident that the estimated effects are attributable to PROGRESA/Oportunidades; other factors are likely to have contributed.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,"International, Urban",2012,,"Child Labor Review Protocol" "Educational and child labour impacts of two food-for-education schemes: Evidence from a randomised trial in rural Burkina Faso","Kazianga, H., De Walque, D., & Alderman, H. (2012). Educational and child labour impacts of two food-for-education schemes: Evidence from a randomised trial in rural Burkina Faso. Journal of African Economies, 21(5), 723-760. doi:10.1093/jae/ejs010.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Compliance-Mod/high-Unfavorable impacts Compliance Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two food-for-education programs (a school meals program and a take home rations program) on education and labor outcomes for children. This summary focuses on the comparison between the school meals treatment group and the control group. The study was a randomized controlled trial (RCT) conducted in low-income villages in northern rural Burkina Faso, West Africa. Villages were randomly assigned to one of two treatment groups or a control group. Survey data were collected from randomly selected households located close to the schools in the villages. Outcomes were analyzed using difference-in-differences models. The study found that the school meals program significantly increased all labor (productive labor plus domestic labor/household chores) for boys enrolled at the time of survey. However, the study also found that the school meals program significantly increased school enrollment for all children. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the school meals program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2012,https://doi.org/10.1093/jae/ejs010,"Child Labor Review Protocol" "Tax elasticity of labor earnings for older individuals","Alpert, A. & Powell, D. (2012). Tax elasticity of labor earnings for older individuals. (Report no. 2012-272). Ann Arbor, MI: University of Michigan Retirement Research Center, University of Michigan.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of tax changes on people’s employment, retirement, and labor income outcomes. The study uses a nonexperimental approach and the data from the Health and Retirement Study to estimate the effect. The study found positive statistically significant relationships between increases in after-tax labor income and the employment of men and women as well as the delay in retirement for men. The study also found a positive statistically significant relationship between increases in the marginal net-of-tax rate and earnings for women. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to tax changes from the Economic Growth and Tax Relief Reconciliation Act (EGTRRA), the Jobs and Growth Tax Relief Reconciliation Act (JGTRRA), and their marriage tax penalty relief provision, but other factors might also have contributed.","Tax Changes","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2012,https://deepblue.lib.umich.edu/bitstream/handle/2027.42/94533/wp272.pdf?sequenc…,"Employment and Training Review Protocol" "Effect of the Mchinji Social Cash Transfer Pilot Scheme on children's schooling, work and health outcomes: A multilevel study using experimental data","Luseno, W. K. (2012). Effect of the Mchinji Social Cash Transfer Pilot Scheme on children's schooling, work and health outcomes: A multilevel study using experimental data (Doctoral dissertation). University of North Carolina at Chapel Hill, Chapel Hill, North Carolina. Retrieved from ProQuest Dissertations & Theses A&I (Accession No. 1240627043).","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Mixed impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The objective of the study was to examine the impact of the Mchinji Social Cash Transfer Pilot Scheme (SCTPS) on child labor and school outcomes.  The study was a randomized controlled trial conducted in the Mchinji district of Malawi. Within the district, eight villages were randomly assigned to either the treatment or control groups. Using survey data, the author compared the child labor and school outcomes of children ages 6-17 in households that received the cash transfer with those that did not receive the cash transfer. The study found that when compared to the control group, children in the Mchinji SCTPS program had significantly: 1) increased school enrollment; 2) fewer school absences; and 3) worked fewer hours outside of the home. An unexpected finding was that children participating in the Mchinji SCTPS also had significantly higher rates of domestic work when compared to children in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Mchinji Social Cash Transfer Pilot Scheme and not to other factors.","Mchinji Social Cash Transfer Pilot Scheme (SCTPS)","Child labor","Other barriers, Other, Low income",,International,2012,https://cdr.lib.unc.edu/indexablecontent/uuid:7052544c-df44-46b5-aa01-500991b72…,"Child Labor Review Protocol" "Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. [Academy for Career Advancement—Bridgeport]","Miller, C., Tessler B. L., & Van Dok, M. (2012). Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. New York: MDRC. [Academy for Career Advancement—Bridgeport]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of participation in the Academy for Career Advancement—Bridgeport, a Work Advancement and Support Center (WASC) on participants’ earnings, employment, educational attainment, and benefit receipt. This study was a randomized controlled trial and used administrative data from the Department of Labor, the Department of Social Services in Connecticut, and the National Student Clearinghouse to measure outcomes. The authors also used a 12-month follow-up survey with a random subset of participants to measure receipt of work supports and job characteristics. The study found that members of the treatment group were 3.9 percentage points less likely than the control group to have ever been employed in a Unemployment Insurance-covered job one year after the program began, and that members of the treatment group were 8.9 percentage points more likely to obtain a license or certificate one year after the program began than members of the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Academy for Career Advancement—Bridgeport and not to other factors.","Work Advancement and Support Center Demonstration, Academy for Career Advancement—Bridgeport","Job search assistance and supportive services Other employment and reemployment Other training and education Unemployment Insurance","Low income",,"United States",2012,http://www.mdrc.org/sites/default/files/full_627.pdf,"Employment and Training Review Protocol" "Poverty alleviation and child labor","Edmonds, E. V., & Schady, N. (2012). Poverty alleviation and child labor. American Economic Journal: Economic Policy, 4(4), 100-124.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of unconditional cash transfers on child labor, within the Bono de Desarrollo Humano (BDH) program. The study was a randomized controlled trial, where households within each local parish were randomly assigned to either the treatment group, who are eligible for the cash transfers, or the control group, who are not. The authors compared child labor and school enrollment outcomes, using a follow-up survey administered over a year after the program began. The study found that children were significantly less likely to participate in child labor and more likely to be enrolled in school if they were assigned to the treatment group than if they were assigned to the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Bono de Desarrollo Humano program, and not to other factors.","Bono de Desarrollo Humano (BDH) program","Child labor","Other, Low income",,International,2012,https://www.aeaweb.org/articles?id=10.1257/pol.4.4.100,"Child Labor Review Protocol" "Earnings progression among workforce development participants: Evidence from Washington State.","Chrisinger, C.K. (2011). Earnings progression among workforce development participants: Evidence from Washington State. Washington, DC: U.S. Department of Labor, Employment and Training Administration.","Job Search Assistance, Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program on the earnings of low-income adults ages 18 to 64 in Washington State. The author assigned workers to the treatment group if they received employment-related services through the WIA Adult Program from January 2002 to June 2008. Workers who participated in the Labor Exchange program during this time comprised the comparison group. The study found no statistically significant relationships between receiving services through the WIA Adult Program and quarterly earnings. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before program participation. This means we would not be confident that the estimated effects would be attributable to the WIA Adult Program; however, the study did not find statistically significant effects.","the Workforce Investment Act (WIA) Adult Program","Adult and Dislocated Worker programs Job search assistance and supportive services Labor Exchange Other employment and reemployment Other training and education Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Unemployed, Low income",,"United States",2011,https://wdr.doleta.gov/research/FullText_Documents/ETAOP_2011-11.pdf,"Job Search Assistance, Low-Income Adults Review Protocol" "Beyond a summer work experience: The Recovery Act 2009 Post-Summer Youth Employment Initiative.","Holcomb, P., Ziegler, J., & Laird, E. (2011). Beyond a summer work experience: The Recovery Act 2009 Post-Summer Youth Employment Initiative. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: Funded by the American Recovery and Reinvestment Act of 2009, the Summer Youth Employment Initiative (SYEI) aimed to reverse the steep decline in youth employment during the recession by providing employment opportunities for youth in the summer of 2009. The 2009 Post-SYEI allowed states and local workforce investment areas to provide extended work experiences to older disconnected youth ages 18 to 24 from October 2009 through March 2010. The authors conducted in-depth site visits to eight selected study sites and analyzed the data using qualitative methods. The authors reported that the study sites effectively built upon the implementation of the SYEI by using the same service delivery structure and extending the work experiences of those youth who had already participated in the summer program. The longer time frame for the work experiences was seen as a benefit by participants and employers. Post-SYEI programs also focused on ensuring the alignment between participants’ interests and their work experiences. The authors recommended three considerations for the design of similar policies targeting older out-of-school youth in the future: allowing sufficient time to design such programs, because the needs of older out-of-school youth differ from those of younger youth who are traditionally served by these types of programs; supporting a year-round, not only summer, work experience; and incorporating a transition strategy from the work experience into future opportunities.","Summer Youth Employment Initiative (SYEI)","Basic skills Job search assistance and supportive services Work based and other occupational training Youth programs","Youth, Disconnected youth, Low-skilled, Low income",,"United States",2011,http://wdr.doleta.gov/research/FullText_Documents/ETAOP_201_03.pdf,"Opportunities for Youth Review Protocol" "Program Keluarga Harapan: Main findings from the impact evaluation of Indonesia’s pilot household conditional cash transfer program","World Bank. (2011). Program Keluarga Harapan: Main findings from the impact evaluation of Indonesia’s pilot household conditional cash transfer program. Retrieved from http://documents.worldbank.org/curated/en/589171468266179965/Program-Keluarga-Harapan-impact-evaluation-of-Indonesias-Pilot-Household-Conditional-Cash-Transfer-Program","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a conditional cash transfer program, Program Keluarga Harapan (PKH), on child school and work participation. The study was a randomized controlled trial (RCT) that compared outcomes between the treatment and control groups using household surveys conducted before and two years after initial program implementation. The study found a significant increase in time spent working in family enterprises for children 13-15 and children 7-12 in the treatment group compared to the control group. The study found that relative to the control group, children aged 13-15 who participated in the program had significantly larger increases in the hours attending school two years after program implementation began. However, school enrollment rates significantly decreased for children aged 7-12 who participated in the program. The quality of causal evidence presented in this report is moderate because randomization was compromised but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to Program Keluarga Harapan, but other factors might also have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2011,http://documents.worldbank.org/curated/en/589171468266179965/Program-Keluarga-H…,"Child Labor Review Protocol" "A two-generational child-focused program enhanced with employment services: Eighteen-month impacts from the Kansas and Missouri sites of the enhanced services for the Hard-to-Employ Demonstration and Evaluation project","Hsueh, J., Jacobs, E., & Farrell, M. (2011). A two-generational child-focused program enhanced with employment services: Eighteen-month impacts from the Kansas and Missouri sites of the enhanced services for the Hard-to-Employ Demonstration and Evaluation project. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Enhanced Early Head Start (EHS) participation on employment, earnings, public assistance receipt, and education for low-income families with young children. The study used a randomized controlled trial design, assigning eligible families to either the Enhanced EHS program or existing services. To estimate the program’s impacts, the authors used administrative employment and earnings data, as well as an 18-month follow-up survey emphasizing respondents’ employment, income, and other outcomes. Outcomes were adjusted for characteristics before random assignment. The study did not find any statistically significant effects on employment, earnings, public assistance receipt, or education. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to Enhanced EHS services and not to other factors. However, the study did not find statistically significant effects.","Enhanced Early Head Start (EHS)","Other employment and reemployment Other training and education","Low income, Parent",,"United States",2011,http://www.acf.hhs.gov/sites/default/files/opre/two_generational.pdf,"Employment and Training Review Protocol" "Labor market rigidities and the employment behavior of older workers.","Blau, D., & Shvydko, T. (2011). Labor market rigidities and the employment behavior of older workers. Industrial and Labor Relations Review, 64(3), 464-484.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of flexibility in hours of work on the likelihood that older workers separate from an employer. The study used a statistical model to compare the job exit behavior of older and younger workers in firms with different shares of women younger than age 30. The analysis used monthly data on workers ages 45 to 69 in the Survey of Income and Program Participation from 1990 to 2001 matched to employers in the Longitudinal Employment and Household Dynamics data. The study found that workers in their sixties who work for employers with a higher share of women younger than age 30 are less likely to experience job separations compared with workers in their late 40s to mid-50s. The quality of causal evidence presented in this report is low because the groups being compared might not be similar before leaving their employer. This means we are not confident that the estimated effects are attributable to employment flexibility, other factors are likely to have contributed.","Employment flexibility","Other employer services","Adult, Older worker",,"United States",2011,https://www.jstor.org/stable/41149475?seq=1#page_scan_tab_contents,"Employment and Training Review Protocol" "Do conditional cash transfers for schooling generate lasting benefits? A five-year followup of PROGRESA/Oportunidades","Behrman, J. R., Parker, S. W., & Todd, P. E. (2011). Do conditional cash transfers for schooling generate lasting benefits? A five-year followup of PROGRESA/Oportunidades. Journal of Human Resources, 46(1), 93-122. doi:10.3368/jhr.46.1.93","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Child labor-Low-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on long-term schooling and work for children ages 9 to 15 (during the time of the intervention). Using survey data from a randomized controlled trial, the authors analyzed the impact of the PROGRESA/Oportunidades program on schooling and work 18-months after implementation. The authors also used a nonexperimental design to evaluate schooling and work outcomes five-and-a-half years post-implementation. The study found that 18 months of program exposure significantly increased the school grade completion by 2.4 percent for boys and 2.7 percent for girls. The 18-month program exposure significantly decreased participation in work by 4.1 percent for boys but had no significant effect for girls. The study found a statistically significant relationship between the program and increased school grade completion five-and-a-half years post-implementation for all groups except for girls aged 17-19. It also found a statistically significant relationship between the program and a reduction in child labor for boys aged 15-16 in 2003 but did not find a significant relationship between the program for girls or for any other age groups of boys. The quality of causal evidence presented in this report is high for short-term outcomes (18 months) because they are based on a well-implemented randomized controlled trial but low for longer-term outcomes (five-and-a-half years) because the authors did not account for the outcomes of schooling and work at baseline.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,International,2011,https://www.mcgill.ca/isid/files/isid/behrman_et_al_2011.pdf,"Child Labor Review Protocol" "Youth Corps emerging practices for education and employment. Prepared for the Corporation for National and Community Service","Gan, K., Jastrzab, J., Jefferson, A., Schneider, G., & Schlager, C. (2011). Youth Corps emerging practices for education and employment. Prepared for the Corporation for National and Community Service. Cambridge, MA: Abt Associates Inc.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This study examined emerging practices used by Youth Corps sites to enhance their participants’ educational and employment opportunities. Youth Corps is a program that engages youth ages 16 to 25 in a combination of community service, workforce development, and education. It is designed to have a positive impact on both its participants and their communities. The authors gathered and analyzed data from interviews with the executive directors of four Youth Corps sites, along with site visits to those sites. Although the studied sites varied, the authors found that all shared a set of common principles that led to increased educational and employment opportunities for its members. These included an understanding of the local labor market in which the corps operated, in order to enhance employment opportunities, and building partnerships with outside community resources. The authors provided a tool kit for youth education and employment service providers that highlights lessons learned; other practitioners can use this information, as can those interested in developing similar initiatives.","Youth Corps Programs","Community college education and other classroom training Job search assistance and supportive services Other training and education Youth programs","Youth, Low-skilled, Low income",,"United States",2011,http://www.nationalservice.gov/pdf/emerging_practices_youthcorps.pdf,"Opportunities for Youth Review Protocol" "After-school programs for high school students: An evaluation of after-school matters.","Hirsch, B., Hedges, L., Stawicki, J., & Mekinda, M. (2011). After-school programs for high school students: An evaluation of after-school matters. Evanston, IL: Northwestern University.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The report’s objective was to evaluate the impact of the After School Matters (ASM) apprenticeship program on academic outcomes in high school and on the likelihood of being hired for a summer or permanent entry-level position in the labor market. For this evaluation, 535 students from 10 high schools in Chicago were randomly assigned to the treatment group, which could enroll in ASM, or the control group, which could not. Outcome data were derived from high school records from both semesters of the academic year of study participation and a mock job interview at the end of the spring semester of the same year. The study reported no statistically significant impacts of participation in ASM on high school grade point average (GPA), number of classes failed, school absences, or likelihood of being hired for a permanent or summer entry-level position. The quality of the causal evidence presented in this report is high for all academic outcomes. This means we are confident that estimated impacts for these outcomes would be solely attributable to ASM, and not other factors. For the likelihood of employment outcomes, the quality of evidence is moderate. This means we have confidence that the effects estimated in this study would be attributable at least in part to the ASM program, though other factors could also have contributed.","After School Matters","Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States, Urban",2011,,"Opportunities for Youth Review Protocol" "A promising start: Initial impacts of Year Up on low-income young adults’ careers.","Roder, A., & Elliott, M. (2011). A promising start: Initial impacts of Year Up on low-income young adults' careers. Economic Mobility Corporation.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: This report presents preliminary findings for the impacts of the Year Up program, which provides technical skills training and internships to low-income adults ages 18 to 24. The authors randomly assigned eligible applicants to either be invited to participate in the program immediately (treatment group) or gain entry after 10 months (control group). They compared the outcomes of treatment and control group members for approximately two years after random assignment. The authors reported many statistically significant and positive impacts of the program in the second year after random assignment. These included impacts on annual earnings and hourly wages. The quality of causal evidence is low because the randomized controlled trial had high attrition and the study did not show that the groups being compared were equivalent prior to the program. This means we are not confident that the estimated effects are attributable to Year Up. Other factors are likely to have contributed.","Year Up","Mentoring Work based and other occupational training Youth programs","Youth, Low income","Finance and insurance","United States, Urban",2011,,"Opportunities for Youth Review Protocol" "Long-term findings from an experimental evaluation of three service delivery models.","Perez-Johnson, I., Moore, Q., & Santillano, R. (2011). Long-term findings from an experimental evaluation of three service delivery models. Series: ETAOP 2012-06. Washington, DC: Employment and Training Administration, U.S. Department of Labor.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of individual training account (ITA) programs on employment, earnings, education and training, and benefit receipt. The authors conducted a randomized controlled trial. They used Unemployment Insurance (UI) records of the full sample and a follow-up survey conducted on average seven years after random assignment for a random subsample of the full sample (4,800 of 7,920) to determine education and training, employment, and earnings outcomes. The study found that a significantly higher percentage of the maximum customer choice group (59 percent) had earned a certificate or degree from a training program within 3 years of random assignment compared with the guided customer choice group (53 percent). The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the ITA models, and not to other factors.","The Individual Training Accounts (ITA) models","Other employment and reemployment Other training and education Unemployment Insurance","Low income, Dislocated or displaced worker",,"United States",2011,https://wdr.doleta.gov/research/FullText_Documents/ETAOP_2012_06.pdf,"Employment and Training Review Protocol" "Analysis of Associations between Contemporaneous Job Corps Performance Measures and Impact Estimates from National Corps Study.","Fortson, J., & Schochet, P. (2011). Analysis of Associations between Contemporaneous Job Corps Performance Measures and Impact Estimates from National Corps Study. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: An analysis for the National Job Corps Study found no relationship between estimated impacts on participants and Job Corps center aggregate performance measures. This study sought to determine whether adjusting the performance measures to account for characteristics of students attending the centers would yield performance measures that predict estimated impacts. Job Corps is a national vocationally focused education and training program for disadvantaged youth between ages 16 and 24. The authors used data from multiple sources, particularly the National Job Corps study. They conducted quantitative analysis of survey data to compute center-level impacts and regression analysis to compute adjusted center-level performance measures. The analysis found that, although the performance measures adjusted for individual and local area characteristics had a modest impact on the relative performance rankings of the centers, they did not predict participant impacts more accurately than the unadjusted performance measures.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2011,http://www.mathematica-mpr.com/publications/pdfs/labor/jobcorps_performance.pdf,"Opportunities for Youth Review Protocol" "Same bureaucracy, different outcomes in human capital? How indigenous and rural non-indigenous areas in Panama responded to the CCT","Arriaz, I., & Rozo, S. (2011). Same bureaucracy, different outcomes in human capital? How indigenous and rural non-indigenous areas in Panama responded to the CCT. Inter-American Development Bank, Office of Evaluation & Oversight.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Red de Oportunidades (RdO), a conditional cash transfer program in Panama, on child labor and school enrollment. The authors used cross-sectional data to compare the treatment group to the comparison group on several outcomes, including child labor (if the child worked in the previous week) and school enrollment (if the child was enrolled in formal schooling). In the analyses for rural areas, the study found that the receipt of the RdO was significantly associated with a decrease in child labor by 6.2 percentage points and an increase in school enrollment by 8.8 percentage points. In the analyses for the indigenous areas, the receipt of RdO was significantly associated with an increase in school enrollment by 6.3 percentage points, but not related to child labor. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Red de Oportunidades (RdO) program; other factors are likely to have contributed.","Red de Oportunidades (RdO)","Child labor","Other, Low income",,"International, Rural",2011,https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1847124,"Child Labor Review Protocol" "Adolescent perspectives of the ecological impact of a summer youth employment program.","Grant, N. (2011). Adolescent perspectives of the ecological impact of a summer youth employment program. Doctoral dissertation. Wichita, KS: Wichita State University. Available at http://soar.wichita.edu/handle/10057/5056.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: Using personal stories of youth who participated in the Area IV Kansas Summer Youth Employment Program (SYEP), the author sought to describe the ecosystems of urban youth, their relationships with adults, and the impacts of their participation in SYEP. SYEP was a summer program funded as part of the American Recovery and Reinvestment Act of 2009. It provided disadvantaged youth with summer employment and job skills training over two summers. The author interviewed 10 participating youth and analyzed their personal stories using ecological systems theory and a social capital framework. The author also analyzed documents containing the youths’ demographic and employment records. The author concluded that programs such as SYEP helped disadvantaged youth to make networking connections, learn ways of interacting in the workplace, and open doors to job opportunities that historically have not been available to those with lower socioeconomic status.","Summer Youth Employment Programs (Area IV Kansas)","Basic skills Work based and other occupational training Youth programs","Youth, Disconnected youth, Low-skilled, Low income",,"United States",2011,http://www.workforce-ks.com/modules/showdocument.aspx?documentid=2206,"Opportunities for Youth Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [TAAG—Medford]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [TAAG—Medford]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports on former and current public assistance recipients’ employment and benefits receipt outcomes after three years. The Medford site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,164 employed single parents who were former or current public assistance recipients to either a treatment group that received services from Medford’s ERA project (Transition, Advancement, and Growth, or TAAG), or a control group that could participate in other programs in the community. The authors analyzed data from Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those assigned to the Medford ERA project earned, on average, $41 more per week when surveyed one year after random assignment than those in the control group. However, treatment group members were also 6.7 percentage points more likely to have ever received Food Stamps at the three-year follow-up than those in the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Medford ERA project and not to other factors.","the Employment Retention and Advancement Project, Medford","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent, Employed",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Retiree health insurance and disengagement from a career job.","Robinson, C., & Clark, R. (2010). Retiree health insurance and disengagement from a career job. Journal of Labor Research, 31(3), 247-262.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: The study examined the effect of availability of retiree health insurance (RHI) on a person’s decision to leave a career job (a measure of retirement). Using data from the Health and Retirement Study (HRS), the authors used a nonexperimental approach to estimate the likelihood of retirement for those who worked at firms with RHI compared with those who worked at firms without RHI. The study found that workers at firms that offer RHI are more likely to retire than those at firms that do not offer RHI. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to the availability at RHI, but other factors might also have contributed.","Retiree Health Insurance","Other health and safety Older workers' programs","Adult, Older worker",,"United States",2010,https://link.springer.com/article/10.1007/s12122-010-9091-4,"Employment and Training Review Protocol" "Tuning in to local labor markets: Findings from the Sectoral Employment impact study.","Maguire, S., J. Freely, C. Clymer, M. Conway, & D. Schwartz. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment impact study. Philadelphia: Public/Private Ventures. [JVS-Boston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Jewish Vocational Service (JVS)-Boston sectoral employment program on earnings and employment. The study was based on a randomized controlled trial and used survey data to estimate the effect of offering eligible JVS-Boston applicants the program by comparing average outcomes among those offered access to the program with the average outcomes of those excluded from the program, after adjusting for differences between the groups. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition and the authors did not demonstrate that the groups were similar at or account for differences between the two groups in the analyses. This means we are not confident that the estimated effects are attributable to the JVS-Boston program; other factors are likely to have contributed.","the Jewish Vocational Service (JVS)-Boston Sectoral Employment Program","Other employment and reemployment Other training and education","Low income","Health care and social assistance","United States",2010,http://www.aspenwsi.org/wordpress/wp-content/uploads/TuningIntoLocalLaborMarket…,"Employment and Training Review Protocol" "The impact of conditional cash transfer program on human capital formation in Brazil","Helfand, S.M., & Souza, A.P. (2010). The impact of conditional cash transfer program on human capital formation in Brazil. University of California, Riverside, CA: Sao Paulo School of Economics.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to analyze the impact of Brazil’s Bolsa Escola program on school enrollment, school progression, and child labor for children ages 6 to 15 in rural areas. Using data from the 2001 and 2003 Brazilian Census, the authors used a structural model to examine the average program impact of the Bolsa Escola program. The study found that the Bolsa Escola program was significantly associated with an increase in school enrollment and school progression. However, the study did not find a statistically significant relationship between program participation and child labor. The quality of causal evidence presented in the study is low because the authors did not control for pre-intervention outcomes. This means we are not confident that the estimated effects are attributable to the Bolsa Escola program; other factors are likely to have contributed.","Bolsa Escola","Child labor","Other, Low income",,International,2010,,"Child Labor Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [Texas ERA—Forth Worth]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Texas ERA—Forth Worth]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Fort Worth site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,572 unemployed single-parent participants in Fort Worth’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that, compared with the control group, those in the Fort Worth ERA group received on average $162 more per year in Food Stamps across the first four years after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program and not to other factors.","the Employment Retention and Advancement project, Fort Worth","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Leveling the intra-household playing field: Compensation and specialization in child labor allocation","Del Carpio, X. V., & Macours, K. (2010). Leveling the intra-household playing field: Compensation and specialization in child labor allocation. In R. K. Akee, E. V. Edmonds, & K. Tatsiramos (Eds.), Child Labor and the Transition Between School and Work (pp. 259-295). Bingley, UK: Emerald Publishing Limited.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of Atención a Crisis (""Attention to the Crisis”), a conditional cash transfer program, on the allocation of child labor within poor households with two or more children. This summary focuses on the comparison between all treatment groups and the control group. The study was a randomized controlled trial (RCT) in northwest Nicaragua. The authors analyzed data from a household survey given at baseline and nine months into the program. The authors compared household allocation of child labor by age and gender of children in households with two or more children. The study found that in treatment households, economic labor significantly decreased for boys but not girls. Boys significantly decreased their hours per week in economic work (including agricultural, livestock, and non-agricultural economic activity) by 1.3 hours compared to girls. Older boys aged, 10-15, showed a larger, significant reduction in economic work by 2.8 hours a week compared to their siblings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to Atención a Crisis, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://openknowledge.worldbank.org/bitstream/handle/10986/4020/WPS4822.pdf?seq…,"Child Labor Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Training Focused and Work Plus—Riverside, California]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Training Focused and Work Plus—Riverside, California]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Riverside Phase 2 site was one of two in Riverside, California, that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 3,029 employed single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups (Work Plus and Training Focused) that received differing ERA services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that, compared with the control group, those in the Riverside Work Plus group were 3.2 percentage points more likely to have received Food Stamps in the first year after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Riverside Work Plus program and not to other factors.","the Employment Retention and Advancement Project—Work Plus and Training Focused (Phase 2), Riverside","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Tuning in to local labor markets: Findings from the Sectoral Employment impact study","Maguire, S., Freely, J., Clymer, C., Conway, M. & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment impact study. Philadelphia: Public/Private Ventures. [Wisconsin Regional Training Partnership]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Wisconsin Regional Training Partnership’s (WRTP) sectoral employment program on earnings and employment. The study was based on a randomized controlled trial and it estimated the effect of offering eligible WRTP applicants the program by using survey data to compare average outcomes among those offered access to the program against the average outcomes of those excluded, after adjusting for differences between the groups. The study found that being offered access to the WRTP’s sectoral employment program increased earnings by $6,255, on average, over the two years after acceptance to the program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the WRTP’s sectoral employment program, and not to other factors.","Wisconsin Regional Training Partnership’s (WRTP) Sectoral Employment Program","Job search assistance and supportive services Other employment and reemployment","Low income","Professional, scientific, and technical services","United States",2010,http://ppv.issuelab.org/resources/5101/5101.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Los Angeles EJC]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Los Angeles EJC]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to gauge how a Los Angeles job club focused on participants’ career interests affected employment, earnings, and benefits receipt outcomes after about 36 months. The Los Angeles site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. (See the CLEAR review of the interim report here.) The authors randomly assigned nearly 1,200 single-parent recipients of Temporary Assistance for Needy Families (TANF) to either a treatment group, which received Enhanced Job Club (EJC) services, or a control group, which received traditional job club (TJC) services. The authors collected employment and earnings data from Unemployment Insurance (UI) records and used automated TANF and food stamp databases to obtain benefits receipt information. Thirty-six months after random assignment, the study found no statistically significant differences between treatment and control group members’ employment, earnings, or benefits receipt. The quality of causal evidence provided in this study is high because it is based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the EJC and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Los Angeles’s Enhanced Job Club","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [PROGRESS—Eugene]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [PROGRESS—Eugene]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports on former welfare recipients’ employment and benefits receipt outcomes after three years. The Eugene site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,179 employed single parents who were former Temporary Assistance for Needy Families (TANF) program participants to either a treatment group that received employment retention services from Eugene’s Progress Towards Retention, Opportunities, Growth, Enhancement and Self-Sufficiency (PROGRESS) program or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those in the PROGRESS group were 7 percentage points less likely than control group members to be employed in the third year after random assignment and 6.6 percentage points less likely to have been employed in every quarter of that year. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Eugene ERA program and not to other factors.","the Employment Retention and Advancement Project, Eugene","Other employment and reemployment Unemployment Insurance","Employed, Low income, Parent",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Framing Social Security Reform: Behavioral responses to changes in the full retirement age","Behaghel, L., & Blau, D. M. (2010) Framing Social Security Reform: Behavioral responses to changes in the full retirement age. (IZA Discussion Paper No. 5310). Bonn, Germany: IZA.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of changes to the Full Retirement Age (FRA) on labor force exit, Old Age and Survivor’s Insurance (OASI) claims, and retirement. The study uses a statistical model and the data from the Health and Retirement Study (HRS) to compare outcomes of people in birth cohorts who were affected by the change in FRA with those of a comparison group of people who were not. The study found that the change in the FRA was associated with significant increases in the likelihood of claiming OASI and exiting the labor force at the new, later full retirement age. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the change in FRA, but other factors might also have contributed.","changes to the Full Retirement Age (FRA)","Older workers' programs Other employment and reemployment","Older worker",,"United States",2010,https://www.aeaweb.org/articles?id=10.1257/pol.4.4.41,"Employment and Training Review Protocol" "Reducing child labour through conditional cash transfers: Evidence from Nicaragua's Red de Protección Social","Gee, K.A. (2010). Reducing child labour through conditional cash transfers: Evidence from Nicaragua's Red de Protección Social. Development Policy Review, 28(6), 711-732.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of a conditional cash transfer program, Red de Protección Social (RPS), in Nicaragua on child labor outcomes for children who are working. The study was an expansion of an earlier randomized controlled trial (RCT). The author used survey data from the RCT taken before the program started (2000) and two years after (2002) to examine the probability and duration of child work. The study found that the receipt of the cash transfer significantly reduced the probability that a child would work by approximately 10.6 percent and, for a child that was working, significantly reduced the hours worked per week by approximately 3.65 hours, on average. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Red de Protección Social program, and not to other factors.","Red de Protección Social (RPS)","Child labor","Other, Low income",,"International, Rural",2010,,"Child Labor Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [Texas ERA—Corpus Christi]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Texas ERA—Corpus Christi]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Corpus Christi site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,727 unemployed single-parent participants in Corpus Christi’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that, compared with the control group, those in the Corpus Christi ERA group were more likely to be employed at all or for four consecutive quarters in the fourth year after random assignment. Corpus Christi ERA group members also had higher earnings and received lower Food Stamps benefits. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program and not to other factors.","the Employment Retention and Advancement project, Corpus Christi","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Can Social Security explain trends in labor force participation of older men in the United States?","Blau, D. M., & Goodstein, R. M. (2010). Can Social Security explain trends in labor force participation of older men in the United States? Journal of Human Resources, 45(2), 328-363.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of changes in Social Security Administration (SSA) retirement rules on men’s labor force participation rates in the 1960s–1980s and 1990s–2000s. The study used regression analyses to predicted labor force participation rates using actual and counterfactual SSA retirement rules. These analyses use data from the Current Population Survey (CPS) and the Survey of Income and Program Participation (SIPP) for the period from 1962 to 2005 merged with data from SSA on taxable earnings. The study found that changes in the delayed retirement credit and full retirement age in 1983 could explain one-quarter to one-half of the increase in labor force participation in the early 2000s. The quality of causal evidence presented in this report is moderate, because it is a well-implemented nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to SSA reforms, but other factors might also have contributed.","Social Security Administration Reforms","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2010,http://jhr.uwpress.org/content/45/2/328.abstract,"Employment and Training Review Protocol" "Rapid employment model evaluation: Update #2","Smith, T. C., King, C. T., & Schroeder, D. G. (2010). Rapid employment model evaluation: Update #2. Austin, TX: Ray Marshall Center for the Study of Human Resources.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Rapid Employment Model (REM) program on participants’ employment, earnings, and Unemployment Insurance (UI) benefit claims. (See the CLEAR review of the 2008 report here.) Using program data and state UI records, the authors matched treatment to comparison group cases and conducted regression analyses to estimate the effect of the intervention. The study found that participation in the REM program was associated with an increase in the likelihood that jobseekers were employed in the 10 quarters following program participation among the 2006 cohort. Participation in the REM program was also associated with an increase in the likelihood that jobseekers were employed, a decrease in quarterly earnings, and an increase in the likelihood jobseekers filed UI claims in the six quarters following program participation among the 2007 cohort. The quality of causal evidence presented in this report is moderate for earnings outcomes in both cohorts and for employment outcomes for the 2006 cohort because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects on employment and earnings are attributable to the REM program, but other factors might also have contributed. The quality of causal evidence presented for the UI benefit claiming outcome for both cohorts and the employment outcome for the 2007 cohort is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects on UI benefit claiming outcome are attributable to the REM program; other factors are likely to have contributed.","Rapid Employment Model (REM) Program","Job search assistance and supportive services Other training and education Unemployment Insurance","Justice-involved, Low-skilled, Low income",,"United States",2010,http://raymarshallcenter.org/files/2006/01/REM_eval_update_Jan2010.pdf,"Review Protocol" "Reinvesting in America’s youth: Lessons from the 2009 Recovery Act Summer Youth Employment Initiative.","Bellotti, J., Rosenberg, L., Sattar, S., Esposito, A., & Ziegler, J. (2010). Reinvesting in America’s youth: Lessons from the 2009 Recovery Act Summer Youth Employment Initiative. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: The research examines the implementation of the Summer Youth Employment Initiative (SYEI). Funded by the American Recovery and Reinvestment Act of 2009, SYEI aimed to reverse the steep decline in youth employment during the recession by providing employment opportunities for youth in the summer of 2009. Through the initiative, youth were placed in summer work experiences with local employers and their wages were paid with Recovery Act funds. The work experiences were fairly flexible, but had to be age appropriate and lead to youth meeting work readiness goals. The authors analyzed state performance data through December 31, 2009, and data from in-depth site visits to 20 selected sites during July and August 2009. The authors reported that it took a large effort to get the program up and running in such a short amount of time (about four months). Some sites reported having to make compromises along the way, given the quick time frame, but all reported satisfaction with their accomplishments. The initiative was implemented successfully in all the studied sites, with all sites able to recruit a sufficient number of participants and place them in employment. Youth participants and the employers interviewed were very positive about the initative. Although the implementation of SYEI was considered a success, it was not without some initial challenges, including handling the large volume of applicants and determining their eligibility, reaching older youth ages 22 to 24 and veterans and their spouses, and appropriately matching youth to employers.","Summer Youth Employment Initiative (SYEI)","Basic skills Job search assistance and supportive services Work based and other occupational training Youth programs","Youth, Disconnected youth, Low-skilled, Low income",,"United States",2010,http://files.eric.ed.gov/fulltext/ED510398.pdf,"Opportunities for Youth Review Protocol" "Productive safety net program and children’s time use between work and schooling in Ethiopia","Woldehanna T. (2010). Productive safety net program and children’s time use between work and schooling in Ethiopia. In J. Cockburn & J. Kabubo-Mariara (Eds.). Child Welfare in Developing Countries (pp. 157-209). New York, NY: Springer.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Public Work Program (PWP) on child labor and schooling outcomes in rural Ethiopia. The study used a matched-comparison group design. Using data from a household survey, the author compared time spent in child labor and schooling among PWP participants and non-participants. The study found that participation in PWP was significantly associated with a lower amount of time spent on child care and household chores. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Public Work Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://rd.springer.com/chapter/10.1007/978-1-4419-6275-1_6,"Child Labor Review Protocol" "Sustained earnings gains for residents in a public housing jobs program: Seven-year findings from the Jobs-Plus demonstration.","Riccio, J. (2010). Sustained earnings gains for residents in a public housing jobs program: Seven-year findings from the Jobs-Plus demonstration. MDRC policy brief. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Jobs-Plus program on the long-term earnings of residents in housing developments in three cities in the United States. The study was a randomized controlled trial that used data from administrative records to compare outcomes between treatment and control group members seven years after random assignment. The study did not find any statistically significant effects of Jobs-Plus on earnings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to Jobs-Plus and not to other factors. However, the study did not find statistically significant effects.","the Jobs-Plus Community Revitalization Initiative for Public Housing Families (Jobs-Plus) Program","Other employment and reemployment","Low income",,"United States",2010,http://www.mdrc.org/sites/default/files/policybrief_33.pdf,"Employment and Training Review Protocol" "Leveling the intra-household playing field: Compensation and specialization in child labor allocation","Del Carpio, X. V., & Macours, K. (2010). Leveling the intra-household playing field: Compensation and specialization in child labor allocation. In R. K. Akee, E. V. Edmonds, & K. Tatsiramos (Eds.), Child Labor and the Transition Between School and Work (pp. 259-295). Bingley, UK: Emerald Publishing Limited.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Mixed impacts Child labor","Summary: The study’s objective was to examine the impact of Atención a Crisis (""Attention to the Crisis”), a conditional cash transfer (CCT) program, on the allocation of child labor within poor households with two or more children. This summary focuses on the comparison between the treatment group receiving the basic CCT plus the business grant and the control group. The study was a randomized controlled trial (RCT) in northwest Nicaragua. The authors analyzed data from a household survey given at baseline and nine months into the program. The authors compared household allocation of child labor by age and gender of children in households with two or more children. The study found that in households receiving the basic CCT plus the business grant, economic labor significantly decreased for boys but not girls. Boys decreased their hours per week in economic work (including agricultural, livestock, and non-agricultural economic activity) by 1.8 hours compared to girls. Older boys, aged 10-15, showed a larger reduction in economic work by 3.3 hours a week compared to their siblings. However, older girls, aged 10-15, showed an increase in economic work by 1.5 hours a week and domestic work of an hour a week compared to their siblings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to Atención a Crisis, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://openknowledge.worldbank.org/bitstream/handle/10986/4020/WPS4822.pdf?seq…,"Child Labor Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Chicago ERA]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Chicago ERA]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to determine the effectiveness of a Chicago program to increase the earnings of Temporary Assistance for Needy Families (TANF) recipients. The Chicago site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,728 TANF recipients to either a treatment group, which received enhanced employment services, or a control group, which received benefits as usual. The authors collected employment and earnings data from Illinois Unemployment Insurance (UI) records over four follow-up years and Food Stamps and TANF receipt data from administrative records over three follow-up years. The study found that members of the treatment group received significantly less in average annual TANF benefits ($778 compared with $1,010 among control group members) but more in average annual Food Stamps ($4,111 compared with $3,959 among control group members). People in the ERA group were also more likely to be employed in the first year (69.7 percent) than people in the control group (66.2 percent). The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable to the Chicago ERA program, and not to other factors.","the Employment Retention and Advancement project, Chicago","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Tuning in to local labor markets: Findings from the Sectoral Employment Impact Study. [Per Scholas]","Maguire, S., Freely, J., Clymer, C., Conway, M., & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment Impact Study. Philadelphia, PA: Public/Private Ventures. [Per Scholas]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Per Scholas sectoral employment program on participants’ earnings and employment. The study was a randomized controlled trial and used survey data to estimate the effect of Per Scholas by comparing average outcomes among applicants offered access to the program with average outcomes of those excluded from the program, after adjusting for differences between the groups. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, this CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the study was a randomized controlled trial with high attrition, and the authors did not demonstrate that the groups that remained in the study were similar before the intervention began. This means we would not be confident that the estimated effects would be attributable to Per Scholas; other factors are likely to have contributed. However, the study did not find statistically significant effects.","Per Scholas","Work based and other occupational training","Low income","Professional, scientific, and technical services","United States",2010,http://ppv.issuelab.org/resources/5101/5101.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [PASS - Riverside]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [PASS - Riverside]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports and supportive services on recent welfare recipients’ employment and benefits receipt outcomes after four years. The Riverside Post-Assistance Self-Sufficiency (PASS) site was one of two in Riverside, California, that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,770 employed single parents who had recently left the Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and surveys administered 12 and 42 months after random assignment. The study found that individuals assigned to the Riverside PASS ERA program had significantly higher earnings in the first and fourth years after random assignment and were more likely to be employed in every quarter of the fourth year, compared with those in the control group. The quality of causal evidence provided in this study is high for most outcomes because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Riverside PASS ERA program and not to other factors. However, the study receives a moderate causal evidence rating for outcomes from the 12-month survey because that data source had high attrition, yet the analysis included adequate statistical controls to correct for resulting imbalance.","the Employment Retention and Advancement Project, Riverside Post-Assistance Self-Sufficiency (PASS) Program","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2010,http://www.acf.hhs.gov/sites/default/files/opre/era_core.pdf,"Employment and Training Review Protocol" "Productive safety net program and children’s time use between work and schooling in Ethiopia","Woldehanna T. (2010). Productive safety net program and children’s time use between work and schooling in Ethiopia. In J. Cockburn & J. Kabubo-Mariara (Eds.). Child Welfare in Developing Countries (pp. 157-209). New York, NY: Springer.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Direct Support Program (DSP) on child labor and schooling outcomes in Ethiopia. The study used a matched-comparison group design. Using data from a household survey, the author compared time spent in child labor and schooling among DSP participants and non-participants. The study found that participation in the DSP was significantly associated with a lower amount of total time spent in work outside home, time spent in unpaid work outside the home and a composite measure of total work (paid and unpaid outside the home plus child care and household chores). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Direct Support Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://rd.springer.com/chapter/10.1007/978-1-4419-6275-1_6,"Child Labor Review Protocol" "Elderly immigrants’ labor supply response to supplemental security income.","Kaushal, N. (2010). Elderly immigrants’ labor supply response to supplemental security income. Journal of Policy Analysis and Management, 29(1), 137-162.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study objective is to examine the impact of the Personal Responsibility and Work Opportunity Reconciliation Act (PRWORA) of 1996 on employment outcomes of foreign-born people and noncitizens ages 60 to 74 The study used a statistical model and the data from the Current Population Survey’s monthly outgoing rotation group and the March Current Population Survey from 1994 to 2005 to estimate the impact. The study found that the PRWORA is associated with increased employment and decreased retirement for foreign-born men compared with U.S.-born men, but it found no statistically significant association with the employment for foreign-born women. The quality of the causal evidence presented in this report is low because the study is a nonexperimental analysis that does not demonstrate that the groups were similar before the policy change. This means we are not confident that the estimated effects are attributable to PRWORA; other factors are likely to have contributed.","Personal Responsibility and Work Opportunity Reconciliation Act of 1996","Federal retirement benefits Foreign and temporary workers","Adult, Older worker, Immigrant",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4222576/,"Employment and Training Review Protocol" "Working toward Wellness: Telephone care management for Medicaid recipients with depression, eighteen months after random assignment.","Kim, S., LeBlanc, A., Morris, P., Simon, G., & Walter, J. (2010). Working toward Wellness: Telephone care management for Medicaid recipients with depression, eighteen months after random assignment. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impacts of a telephone care management program, Working toward Wellness (WtW), on low-income depressed parents’ employment and earnings. The study used a randomized controlled trial design, assigning eligible parents to either the WtW program or existing services. Authors used data from an 18-month follow-up survey to estimate program impacts, adjusting for sample members’ characteristics before random assignment. The study did not find any statistically significant effects of the WtW program on employment or earnings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to WtW and not to other factors. However, the study did not find statistically significant effects.","Working toward Wellness (WtW)","Other employment and reemployment","Low income, Parent",,"United States",2010,http://www.acf.hhs.gov/sites/default/files/opre/telephone_care.pdf,"Employment and Training Review Protocol" "Leveling the intra-household playing field: Compensation and specialization in child labor allocation","Del Carpio, X. V., & Macours, K. (2010). Leveling the intra-household playing field: Compensation and specialization in child labor allocation. In R. K. Akee, E. V. Edmonds, & K. Tatsiramos (Eds.), Child Labor and the Transition Between School and Work (pp. 259-295). Bingley, UK: Emerald Publishing Limited.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of Atención a Crisis (""Attention to the Crisis”), a conditional cash transfer (CCT) program, on the allocation of child labor within poor households with two or more children. This summary focuses on the comparison between the treatment group receiving the basic CCT and the control group. The study was a randomized controlled trial (RCT) in northwest Nicaragua. The authors analyzed data from a household survey given at baseline and nine months into the program. The authors compared household allocation of child labor by age and gender of children in households with two or more children. The study found that in households receiving the basic CCT, economic labor significantly decreased for boys but not girls. Boys decreased their hours per week in economic work (including agricultural, livestock, and non-agricultural economic activity) by 1.1 hours compared to girls. Older boys aged, 10-15, also showed a larger, significant reduction in economic work of 3.0 hours a week compared to their siblings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to Atención a Crisis, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://openknowledge.worldbank.org/bitstream/handle/10986/4020/WPS4822.pdf?seq…,"Child Labor Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Achieve—Cleveland]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Achieve—Cleveland]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to determine the impact of a Cleveland, Ohio, program designed to increase employment retention among low-wage workers in the long-term nursing care industry. Cleveland was one of 16 sites nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 44 firms to either a treatment group, whose employees could receive employment retention services through Cleveland Achieve, or a control group. The authors collected employment and earnings data from state Unemployment Insurance (UI) records. Three years after random assignment, the study found no statistically significant differences between the earnings and employment outcomes of employees in Achieve firms compared with employees in firms that did not have access to Achieve services. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the Achieve program, and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Cleveland","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [VISION—Salem, OR]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [VISION—Salem, OR]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on Temporary Assistance for Needy Families (TANF) recipients’ employment and benefits receipt outcomes after three years. The Salem site was one of several across the United States that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,504 single parents eligible for welfare-to-work programs to either a treatment group that received Valuing Individual Success and Increasing Opportunities Now (VISION) services or to a control group that received the state’s typical welfare-to-work program. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those in the VISION group were 6.7 percentage points more likely than those in the control group to have received TANF benefits at any point during the first follow-up year. The VISION group also received, on average, $298 more in annual TANF benefits during the first three follow-up years, compared with the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Salem ERA program and not to other factors.","the Salem Valuing Individual Success and Increasing Opportunities Now (VISION) Program","Other employment and reemployment Unemployment Insurance Job search assistance and supportive services","Low income, Parent",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Productive safety net program and children’s time use between work and schooling in Ethiopia","Woldehanna T. (2010). Productive safety net program and children’s time use between work and schooling in Ethiopia. In J. Cockburn & J. Kabubo-Mariara (Eds.). Child Welfare in Developing Countries (pp. 157-209). New York, NY: Springer.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Agricultural Extension Support Program (AEP) on child labor and schooling outcomes in rural Ethiopia. The study used a matched-comparison group design. Using data from a household survey, the author compared time spent in child labor and schooling among AEP participants and non-participants. The study found that AEP participation was significantly related to lower amounts of time spent in paid work and in a combined measure of all work, as well as greater amounts of time spent in school. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Agricultural Extension Support Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://rd.springer.com/chapter/10.1007/978-1-4419-6275-1_6,"Child Labor Review Protocol" "Work after prison: One-year findings from the Transitional Jobs Reentry Demonstration","Redcross, C., Bloom, D., Jacobs, E., Manno, M., Muller-Ravett, S., Seefeldt, D., Yahner, J., Young Jr., A., & Zweig, J. (2010). Work after prison: One-year findings from the Transitional Jobs Reentry Demonstration. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Transitional Jobs Reentry Demonstration (TJRD) on ex-offenders’ employment and wages. The study used a randomized controlled trial to assign former prisoners to either the transitional jobs program or to a control group that was offered job search assistance. The authors compared the two groups’ employment and earnings outcomes one year after random assignment, controlling for participants’ characteristics before random assignment. The study found that members of the transitional jobs group were 8.6 percentage points more likely than control group members to be employed during all four quarters of the year after random assignment, but 8.9 percentage points less likely to have unsubsidized employment during the year after random assignment. Transitional jobs group members’ total earnings from all jobs were $1,419 higher, on average, than those of control group members during the year after random assignment, but their total earnings from unsubsidized jobs were $625 lower. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the TJRD, and not to other factors.","the Transitional Jobs Reentry Demonstration (TJRD)","Job search assistance and supportive services Other employment and reemployment Reentry","Justice-involved, Male, Low income",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514698.pdf,"Employment and Training Review Protocol" "The effects of changes in state SSI supplements on preretirement labor supply","Neumark, D., & Powers, E. T. (2005). The effects of changes in state SSI supplements on preretirement labor supply. Public Finance Review, 33(1), 3-35.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of a theoretical increase in Supplemental Security Income (SSI) benefits on the preretirement employment outcomes for likely SSI participants ages 60 to 64. Using data from the annual Current Population Survey from 1979 to 2001 and state-level SSI receipt data, the authors used regression methods in a nonexperimental analysis of likely SSI participants to compare the outcomes of workers ages 62 to 64 with those of workers ages 60 to 61. The study found that an increase in monthly SSI benefits was associated with a statistically significant decrease in the employment rate and number of hours worked for likely SSI recipients ages 62 to 64 compared with those ages 60 to 61. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to changes in SSI benefits; other factors are likely to have contributed.","Supplemental Security Income (SSI) benefits","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2010,https://journals.sagepub.com/doi/pdf/10.1177/1091142104270655,"Employment and Training Review Protocol" "The influences on bridge employment decisions.","Pengcharoen, C., & Shultz, K. S. (2010). The influences on bridge employment decisions. International Journal of Manpower, 31(3), 322-336. doi:10.1108/01437721011050602","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study examined the impact of work schedule flexibility on retirement outcomes among older workers, where work schedule flexibility was measured as the ability to reduce hours from one’s regular work schedule. The study used a statistical model (multinomial logit regression) and the longitudinal data from the Health and Retirement Study (HRS) from 1992 and 2002 to examine the relationship between reporting work schedule flexibility or inflexibility during the baseline survey and reporting complete retirement, partial retirement, or continued employment at the follow-up survey 10 years later among older workers. The study found that individuals who reported work schedule inflexibility in the 1992 were more likely to report completely retired than partially retired in 2002, but when comparing the likelihood of reporting continued employment to complete or partial retirement, there was no difference between older workers reported work schedule flexibility and those who reported inflexibility in 1992. The quality of causal evidence presented in this study is low because the authors did not demonstrate that the participants reporting work schedule flexibility were similar to the participants reporting work schedule inflexibility in 1992. This means we are not confident that the estimated effects are attributable to work schedule flexibility; other factors are likely to have contributed.",,"Other wages and benefits","Adult, Older worker",,"United States",2010,https://www.researchgate.net/publication/46545640_The_influences_on_bridge_empl…,"Employment and Training Review Protocol" "The impact of conditional cash transfer programs on household work decisions in Brazil","Ferro, A. R., Lúcia Kassouf, A., & Levison, D. (2010). The impact of conditional cash transfer programs on household work decisions in Brazil. In R. K. Akee, E. V. Edmonds, & K. Tatsiramos (Eds.), Child Labor and the Transition between School and Work (pp. 193-218). Bingley, UK: Emerald Publishing Limited.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of the Bolsa Escola program, which provided conditional cash transfers to families in Brazil, on child labor and school enrollment. The authors used a nonexperimental matched comparison group design to compare the outcomes of children ages 6-15 that received the conditional cash transfers with those who had applied but who had not received it (waitlisted families), based on data from Brazil’s national household survey. The study found that receipt of the Bolsa Escola benefit was significantly related to higher rates of school enrollment and lower rates of child labor. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Bolsa Escola program; other factors are likely to have contributed.","Bolsa Escola","Child labor","Other, Low income",,International,2010,http://www.anpec.org.br/encontro2009/inscricao.on/arquivos/000-dde4869521f17def…,"Child Labor Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [RFS-Los Angeles]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [RFS-Los Angeles]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of individualized and flexible post-employment job supports on employed welfare recipients’ employment and benefits receipt outcomes after three years. The Los Angeles Reach for Success (RFS) site was one of two in Los Angeles that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 5,700 employed single-parent participants in Los Angeles’s Temporary Assistance for Needy Families (TANF) program who were working full-time to either a treatment group that received RFS services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and surveys administered 12 and 42 months after random assignment. The study found that, 12 to 42 months after random assignment, RFS group members’ employment, earnings, and benefits receipt did not differ significantly from those of control group members. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that any estimated effects would be attributable to Los Angeles’ RFS and not to other factors. However, the study did not find statistically significant effects.","Reach for Success (RFS)","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Tuning in to local labor markets: Findings from the Sectoral Employment impact study","Maguire, S., Freely, J., Clymer, C., Conway, M. & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment impact study. Philadelphia: Public/Private Ventures. [Wisconsin Regional Training Partnership]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Wisconsin Regional Training Partnership’s (WRTP) sectoral employment program on earnings and employment. The authors investigated similar research questions with two other programs, the profiles of which are available through the study search. The study was based on a randomized controlled trial, with the authors estimating the effect of offering eligible WRTP applicants the program by using survey data to compare average outcomes among those offered access to the program against the average outcomes of those not offered access, after adjusting for differences between the groups. The study found that being offered access to the WRTP’s sectoral employment program increased earnings by $6,255, on average, over the two years after acceptance to the program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the WRTP’s sectoral employment program, and not to other factors.","the WRTP Sectoral Employment Program","Job search assistance and supportive services Other training and education","Low income","Construction, Manufacturing, Health care and social assistance","United States",2010,https://www.explorevr.org/sites/explorevr.org/files/files/Tuning%20In%20to%20Lo…,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Moving Up—South Carolina]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Moving Up—South Carolina]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on former welfare recipients’ employment and benefits receipt outcomes after four years. The South Carolina site was one of 16 sites nationwide that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,776 single parents who had left the Temporary Assistance for Needy Families (TANF) program in the past three years to either a treatment group that received ERA services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study did not find any statistically significant effects on earnings, employment, or benefits receipt one to four years after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that any estimated effects would be attributable to the South Carolina ERA project and not to other factors. However, the study did not find statistically significant effects.","the Employment Retention and Advancement Project, South Carolina","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [Texas ERA—Houston]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Texas ERA—Houston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Houston site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,032 unemployed single-parent participants in Houston’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those in the Houston ERA group received on average $56 more per year in TANF benefits across the first four years after random assignment, compared with the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program and not to other factors.","the Employment Retention and Advancement project, Houston","Other employment and reemployment Unemployment Insurance","Parent, Low income",,"Urban, United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Child education and work choices in the presence of a conditional cash transfer programme in rural Colombia","Attanasio, O., Fitzsimons, E., Gomez, A., Gutierrez, M. I., Meghir, C., & Mesnard, A. (2010). Child education and work choices in the presence of a conditional cash transfer programme in rural Colombia. Economic Development and Cultural Change, 58(2), 181-210. doi:10.1086/648188.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of this study was to examine the impact of the conditional cash transfer program, Familias en Acción, on children’s work and school participation in Columbia. The study used a nonexperimental design to compare labor and schooling outcomes of children who received the conditional cash transfer with a comparison group of children who did not, based on data from a survey. The study found that receipt of the cash transfer was significantly associated with a decrease in the likelihood of participating in domestic work for urban children aged 10 to 17, a decrease in the hours spent in income-generating work for urban children aged 14 to 17, and a decrease in the hours spent in domestic work for all but rural children aged 14 to 17. Receipt of the cash transfer was also significantly related to an increase in the hours spent in school for all children in urban and rural areas. The quality of causal evidence presented in the study is low because the authors did not control for pre-intervention outcomes. This means we are not confident that the estimated effects are attributable to the Familias en Acción program; other factors are likely to have contributed.","Familias en Acción","Child labor","Other, Low income",,"International, Rural",2010,http://openaccess.city.ac.uk/5381/1/Child_Education.pdf,"Child Labor Review Protocol" "Do temporary-help jobs improve labor market outcomes for low-skilled workers? Evidence from “Work First”.","Autor, D. H., & Houseman, S. N. (2010). Do temporary-help jobs improve labor market outcomes for low-skilled workers? Evidence from “Work First”. American Economic Journal: Applied Economics, 2(3), 96–128.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of temporary-help and direct-hire jobs through the Work First program (a welfare-to-work program) on the earnings and employment of low-skilled workers in Detroit. The authors use a nonexperimental design that uses key features of the Work First program to compare the employment and earnings of participants placed in temporary- or permanent-hire positions. Work First program participants are assigned to different local contractors in their district on a rotating basis. The contractors assist participants with job placement, but vary the emphasis they place on temporary-hire or direct-hire positions; the authors use this variation across contractors to compare the employment and earnings of participants in different types of job placement. The study found that the average employment probability and quarterly earnings of those who found a direct-hire job increased significantly in the eight quarters following program participation compared with that of those who found a temporary-help job. The quality of causal evidence presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to temporary-hire and direct-hire job placements, but other factors might also have contributed.","the Work First Program","Job search assistance and supportive services Unemployment Insurance","Low income",,"United States",2010,,"Employment and Training Review Protocol" "Toward reduced poverty across generations: Early findings from New York City’s conditional cash transfer program","Riccio, J., Dechausay, N., Greenberg, D., Miller, C., Rucks, Z., and Verma, N. (2010). Toward reduced poverty across generations: Early findings from New York City’s conditional cash transfer program. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Family Rewards, an experimental privately funded conditional cash transfer program in New York City, on earnings, employment, public benefits receipt, and education. The study was based on a randomized controlled trial and estimated the effect of the Family Rewards program on low-income families. The authors used New York City and New York State administrative data to compare average outcomes among those offered access to the program against the average outcomes of those excluded, after adjusting for chance initial differences between the groups. The study found that, on average, the Family Rewards program decreased the likelihood of ever being employed at a job covered by unemployment insurance (UI) in the first year. However, the Family Rewards program increased the likelihood of being employed at a job not covered by UI after 18 months, total monthly income after 18 months, and the likelihood that adult recipients had received an associate’s degree after 18 months. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Family Rewards program, and not to other factors.","the Family Rewards Program","Other employment and reemployment Other training and education Unemployment Insurance","Unemployed, Low income, Parent",,"United States",2010,http://www.mdrc.org/sites/default/files/FamRewards2010ONYC%20FULL%20Report%20RE…,"Employment and Training Review Protocol" "Opening Doors: More guidance, better results? Three-year effects of an enhanced student services program at two community colleges","Scrivener, S., & Weiss, M.J. (2009). Opening Doors: More guidance, better results? Three-year effects of an enhanced student services program at two community colleges. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Opening Doors program at Lorain County Community College and Owens Community College in Ohio. The Opening Doors program at these schools provided students with enhanced counseling services and a modest stipend for two semesters. The study was a randomized controlled trial. Eligible students were randomly assigned to either the treatment group, which was eligible to receive Opening Doors counseling services and a stipend, or the control group, which was not offered these services. The primary data sources were a baseline survey on the background characteristics of students, students’ transcripts from the two colleges, and degree attainment information from the National Student Clearinghouse. The study reported outcomes for the two program semesters and four post-program follow-up semesters. The study found that cumulatively from the first program semester to the third follow-up semester, the treatment group registered for significantly more semesters and earned significantly more developmental credits than the control group. There was no significant difference in the proportion of treatment group students who completed a degree or certificate relative to the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects would be attributable to the Opening Doors program, and not to other factors.","Opening Doors Program at Lorain County Community College and Owens Community College","Community college education and other classroom training","Adult, Low income",,"United States",2009,http://www.mdrc.org/sites/default/files/More%20Guidance%20ES_1.pdf,"Community College Review Protocol" "The Employment Retention and Advancement project: Findings for the Eugene and Medford, Oregon, models: Implementation and early impacts for two programs that sought to encourage advancement among low-income workers.","Molina, F., van Dok, M., Hendra, R., Hamilton, G., and Cheng, W. (2009). The Employment Retention and Advancement project: Findings for the Eugene and Medford, Oregon, models: Implementation and early impacts for two programs that sought to encourage advancement among low-income workers. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [TAAG - Medford]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports on former and current welfare recipients’ employment and benefits receipt outcomes after 1.5 years. The Medford site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,164 single parents to either a treatment group that received ERA services or a control group that could participate in other programs in the community. People in the study were current or recent Temporary Assistance for Needy Families (TANF) program participants or people enrolled in other benefit programs that required clients to participate in employment or training. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that participants assigned to the Medford ERA program earned, on average, $40 more per week in the first year after random assignment than those in the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Medford ERA program and not to other factors.","the Employment Retention and Advancement Project, Medford","Other employment and reemployment Other training and education Unemployment Insurance","Low income",,"United States",2009,http://www.mdrc.org/sites/default/files/full_367.pdf,"Employment and Training Review Protocol" "Strategies to help low-wage workers advance: Implementation and early impacts of the Work Advancement and Support Center (WASC) demonstration. [San Diego]","Miller, C., Tessler, B., & Van Dok, M. (2009). Strategies to help low-wage workers advance: Implementation and early impacts of the Work Advancement and Support Center (WASC) demonstration. New York City: MDRC. [San Diego]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the early impacts of participation in the Work Advancement and Support Center (WASC) demonstration on employment, earnings, education and training, and receipt of public benefits outcomes. The authors randomly assigned eligible individuals to either a treatment group that received WASC services or to a control group that received existing job placement services focused on employment. The authors analyzed data from Unemployment Insurance records, San Diego county administrative records, and a survey administered 12 months after random assignment In the San Diego site’s first year, the study found that WASC increased participant’s receipt of Food Stamps by about 23 percent. It also found that 63.2 percent of WASC participants were employed for four consecutive quarters compared with 69.7 percent of control group members For outcomes measured with administrative data, the quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects on those outcomes are attributable to WASC and not to other factors. For employment and earnings outcomes measured with survey data, the quality of evidence is low because the authors did not account for preexisting differences between the groups being compared in their analysis. This means we are not confident that the estimated effects on those outcomes are attributable to WASC; other factors are likely to have contributed.","the Work Advancement and Support Center (WASC) Demonstration","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States",2009,http://www.mdrc.org/sites/default/files/full_516.pdf,"Employment and Training Review Protocol" "Evaluation of the YouthBuild Youth Offender Grants","Abrazaldo, W., Adefuin, J., Henderson-Frakes, J., Lea, C., Leufgen, J., Lewis-Charp, H., … Wiegand, A. (2009). Evaluation of the YouthBuild Youth Offender Grants. Oakland, CA: SPR Associates.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report summarizes the findings of an implementation and outcomes analysis of Young Offender grants. These grants, which were awarded to 30 YouthBuild USA sites in 2004 and 2005, were to provide academic instruction, vocational training, leadership opportunities, and counseling and other support services to young offenders. The objective was to understand how YouthBuild programming for young offenders was designed and implemented; identify the strategies and approaches associated with positive outcomes; and gain insight into the contextual factors influencing program implementation and participant performance. The authors collected and analyzed qualitative information gathered during two rounds of site visits—which included interviews with program staff, instructors and trainers, grantee partners, employers, and program participants—and quantitative management information systems data.  The implementation analysis found that the extent to which Young Offender grantees implemented the YouthBuild model varied, though all attempted to adhere to the model. In general, grantees had mature organizational structures and were able to form partnerships with workforce development agencies and the juvenile justice system. Young offenders tended to have better educational, employment, and social outcomes in grantee sites where teachers invested time in getting to know them on a personal level, the teacher-to-student ratio was low, academic work and vocational training were linked, and leadership opportunities were available.",Youthbuild,"Youth programs Other training and education Work based and other occupational training","Youth, Justice-involved, Low-skilled, Low income",,"United States",2009,http://wdr.doleta.gov/research/FullText_Documents/Evaluation%20of%20the%20Youth…,"Opportunities for Youth Review Protocol" "The Employment Retention and Advancement project: Findings for the Eugene and Medford, Oregon, models: Implementation and early impacts for two programs that sought to encourage advancement among low-income workers. [PROGRESS—Eugene]","Molina, F., van Dok, M., Hendra, R., Hamilton, G., & Cheng, W. (2009). The Employment Retention and Advancement project: Findings for the Eugene and Medford, Oregon, models: Implementation and early impacts for two programs that sought to encourage advancement among low-income workers. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [PROGRESS—Eugene]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports on former welfare recipients’ employment and benefits receipt outcomes after 1.5 years. The Eugene site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,137 employed people who were recent Temporary Assistance for Needy Families (TANF) program participants to either a treatment group that received ERA services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study did not find any statistically significant effects on earnings, employment, or benefits receipt 1.5 years after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we would be confident that any estimated effects would be attributable to the Eugene ERA program and not to other factors. However, the study did not find statistically significant effects.","the Employment Retention and Advancement Project, Eugene","Other employment and reemployment Unemployment Insurance","Low income",,"United States",2009,http://www.acf.hhs.gov/sites/default/files/opre/era_eug_medi.pdf,"Employment and Training Review Protocol" "Impact of the Uruguayan conditional cash transfer program","Borraz, F., & González, N. (2009). Impact of the Uruguayan conditional cash transfer program. Cuadernos de economia, 46(134), 243-271. doi:10.4067/S0717-68212009000200006","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to analyze the impact of a conditional cash transfer program (Ingreso Ciudadano) on school attendance (ages 8 to 14) and child labor (ages 6 to 14) among children in Uruguay from 2005 to 2007. Using the annual Uruguayan National Household Survey with cross sectional data from 2006 and 2007, the authors compared school attendance and child labor for households who received the conditional cash transfer to a group of non-participating households who had similar characteristics. The study found no statistically significant relationship between the conditional cash transfer program and school attendance. However, the study found a statistically significant relationship between the program and a reduction in child labor for females in the Montevideo region, but not for males in any region or females in the rest of the country. The quality of causal evidence presented in this report is low because the authors did not demonstrate that groups were similar at baseline. This means we are not confident that the estimated effects are attributable to Ingreso Ciudadano; other factors are likely to have contributed.","Ingreso Ciudadano","Child labor","Other, Low income",,International,2009,https://scielo.conicyt.cl/pdf/cecon/v46n134/art06.pdf,"Child Labor Review Protocol" "Strategies to help low-wage workers advance: Implementation and early impacts of the Work Advancement and Support Center (WASC) demonstration. [Dayton]","Miller, C., Tessler, B., & Van Dok, M. (2009). Strategies to help low-wage workers advance: Implementation and early impacts of the Work Advancement and Support Center (WASC) demonstration. New York City: MDRC. [Dayton]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the early impacts of participation in the Work Advancement and Support Center (WASC) demonstration on employment, earnings, education and training, and receipt of public benefits outcomes. The authors randomly assigned eligible individuals to either a treatment group that received WASC services or to a control group that received existing job placement services focused on employment. The authors analyzed data from Unemployment Insurance records, Ohio state administrative records, and a survey administered 12 months after random assignment. In the Dayton site’s first year, the study found that WASC increased participants’ receipt of Food Stamps by about 10 percent. The study also found that WASC participants were more likely to obtain a license or training certificate than control group members (18.1 percent compared with 11.3 percent, respectively). The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to WASC and not to other factors.","the Work Advancement and Support Center (WASC) Demonstration","Other employment and reemployment Other training and education","Low income",,"United States",2009,http://www.mdrc.org/sites/default/files/full_516.pdf,"Employment and Training Review Protocol" "The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor","Hoddinott, J., Gilligan, D. O., & Taffesse, A. S. (2009). The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor. Retrieved from http://ssrn.com/abstract=1412291","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Unfavorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of Ethiopia’s Productive Safety Net Program (PSNP) on child labor and school attendance, along with the potential added benefit of participation in the Other Food Security Program (OFSP). This summary focuses on the comparison between the group receiving both the PSNP and OFSP benefit and the comparison group. The study used a nonexperimental design to compare the outcomes of children ages 6-16 that received the cash transfers with those who did not, based on data from the Food Security Program Survey. Using several demographic characteristics, the authors created a matched comparison group of households who did not receive the benefit to assess the effectiveness of the cash transfer program. The study found a significant relationship between receipt of benefits from both PSNP and OFSP and an increase in domestic chores for girls. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the Productive Safety Net Program or the Other Food Security Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2009,http://ssrn.com/abstract=1412291,"Child Labor Review Protocol" "New evidence on the labor supply effects of the Social Security earnings test.","Friedberg, L., & Webb, A. (2009). New evidence on the labor supply effects of the Social Security earnings test. Tax Policy and the Economy, 23(1), 1-36.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of changes to the Social Security earnings test in 1996 and 2000 on employment outcomes. The authors used a nonexperimental design and the data from the Current Population Survey (CPS) and the Health and Retirement Study (HRS) to compare outcomes before and after the changes in earning test rules for those between the ages of 62 and 74 who faced different earnings test thresholds at different ages and years. The study found that upcoming anticipated earnings test between ages 62 to 69 was associated with a significantly lower likelihood of having a job last week. A higher present value of upcoming anticipated earnings threshold between ages 62 to 69 was associated with a significantly higher likelihood of having a job last week. The quality of causal evidence presented in this study is low because the study is a nonexperimental analysis that did not demonstrate that the groups being compared were similar and did not account for possible differences in the analysis. This means we are not confident that the estimated effects are attributable to the changes in the earnings test decision. Other factors are likely to have contributed.","Social Security Earnings Test","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2009,,"Employment and Training Review Protocol" "Rewarding Persistence: Effects of a performance-based scholarship program for low-income parents","Richburg-Hayes, L., Brock, T., LeBlanc, A., Paxson, C., Rouse, C.E., & Barrow, L. (2009). Rewarding persistence: Effects of a performance-based scholarship program for low-income parents. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Opening Doors program at Delgado Community College and Louisiana Technical College-West Jefferson in New Orleans, Louisiana, on progress toward completing a college degree. The Opening Doors program offered students with dependent children a performance-based $1,000 scholarship in each of two semesters. The study examined both the shorter- and longer-term impacts of the Opening Doors program using different cohorts of students. The study was a randomized controlled trial. Eligible students were randomly assigned to either the treatment group, which was offered the opportunity to receive the scholarship, or the control group, which was not eligible for the scholarship. The primary data sources were a baseline survey on the background characteristics of students, student transcripts, and degree attainment information from the National Student Clearinghouse. The study found that for all four cohorts of students, the treatment group was significantly more likely to have registered for any course and have enrolled full-time in college, and to have attempted and earned significantly more credits in both the first and second program semesters, compared with the control group. The study found that for the first two cohorts of students, the treatment group registered for classes at a higher rate, enrolled in more semesters of college, and earned more credits than the control group cumulatively through the fourth semester after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Opening Doors program, and not to other factors.","the Opening Doors Program at Delgado Community College and Louisiana Technical College-West Jefferson","Tuition assistance Community college education and other classroom training","Adult, Low income, Parent",,"United States",2009,http://www.mdrc.org/sites/default/files/rewarding_persistence_fr.pdf,"Community College Review Protocol" "Return on investment analysis of a selected set of workforce system programs in Indiana. [WIA Adult]","Hollenbeck, K. (2009). Return on investment analysis of a selected set of workforce system programs in Indiana. Indianapolis, IN: Indiana Chamber of Commerce Foundation. [WIA Adult]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program on the employment, earnings, and benefit receipt of low-income adults in Indiana. The author used a nonexperimental method to compare the short-term (three quarters after program exit) and long-term (seven quarters after program exit) employment, earnings, and Unemployment Insurance benefits between those who took part in the WIA Adult Program and those who participated in the WorkOne program. The study found that, compared with those who participated in the WorkOne program, WIA Adult Program participants had higher employment and earnings. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Adult Program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Adult Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Adult, Low-skilled, Low income",,"United States",2009,http://www.indianachamber.com/images/media/studies/ROIanalysisWorkforceDevelopm…,"Review Protocol" "The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor","Hoddinott, J., Gilligan, D. O., & Taffesse, A. S. (2009). The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor. Retrieved from http://ssrn.com/abstract=1412291","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of Ethiopia’s Productive Safety Net Program (PSNP) on child labor and school attendance, along with the potential added benefit of participation in the Other Food Security Program (OFSP). This summary focuses on the comparison between the group receiving a certain amount of the PSNP benefit and the comparison group. The study used a nonexperimental design to compare the outcomes of children ages 6-16 that received the cash transfers with those who did not, based on data from the Food Security Program Survey. Using several demographic characteristics, the authors created a matched comparison group of households who did not receive the benefit to assess the effectiveness of the cash transfer program. The study found that for boys ages 6-16, there was a significant relationship between households receiving a certain amount of cash transfer and increased school attendance rates. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Productive Safety Net Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2009,http://ssrn.com/abstract=1412291,"Child Labor Review Protocol" "Growing America through entrepreneurship: Final evaluation of Project GATE","Benus, J., Shen, T., Zhang, S., Chan, M., & Hansen, B. (2009). Growing America through entrepreneurship: Final evaluation of Project GATE. Washington, DC: IMPAQ International.","Entrepreneurship and Self-Employment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Growing America Through Entrepreneurship (Project GATE) demonstration project, which offered entrepreneurship training and business counseling to low-income individuals, on participants’ employment and earnings. The authors randomly assigned study participants to a treatment group, which could participate in Project GATE, or a control group, which could not participate. The authors collected information from all participants through follow-up surveys 6, 18, and 60 months after random assignment. The study found that Project GATE increased the likelihood of business ownership in the second and third quarters after random assignment. The study found few statistically significant impacts on employment or earnings over the 60-month follow-up period, though generally the Project GATE participants were slightly less likely than the control group members to be employed in later follow-up periods. The quality of causal evidence presented in this report is high for outcomes measured in the first two quarters after assignment because these outcomes were based on a well-implemented randomized controlled trial. However, outcomes measured at other follow-up points present low causal evidence because of high attrition and insufficient adjustment for differences in previous employment and earnings history.","the Project Growing America Through Entrepreneurship (GATE) Demonstration","Job search assistance and supportive services Other training and education","Low income",,"United States",2009,https://www.impaqint.com/sites/default/files/project-reports/Project%20GATE%20F…,"Employment and Training Review Protocol" "Essays on welfare, children, and families","Zhu, Yi. (2009.) Essays on welfare, children, and families. (Unpublished dissertation, Michigan State University.)","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of child care subsidies through the Child Care and Development Fund (CCDF) program on the employment of low-income single mothers. The author used data from the 2001–2007 Current Population Survey (CPS). The treatment condition was defined as the amount of the state child care subsidy for single mothers with children younger than 13. The study found a statistically significant relationship between the amount of child care subsidies and single mothers’ full-time employment. The study did not find relationships between child care subsidies and other employment outcomes examined. The quality of causal evidence presented in this report is low because the author did not account for existing differences between the mothers who did and did not receive the child care assistance. This means we are not confident that the estimated effects are attributable to the child care subsidies; other factors are likely to have contributed.","Child Care Subsidies","Other employment and reemployment","Low income, Parent",,"United States",2009,,"Employment and Training Review Protocol" "Own and sibling effects of contiditional cash transfer programs: Theory and evidence from Cambodia","Ferreira, F. H. G., Filmer, D., & Schady, N. (2009). Own and sibling effects of conditional cash transfer programs: Theory and evidence from Cambodia (Policy Research Working Paper 5001, Impact Evaluationo Series). Washington, DC: The World Bank.","Child Labor","Study Type: Descriptive Analysis",,,"Summary: The objective of this study was to examine the impact of the CESSP Scholarship Program (CSP), a conditional cash transfer valued at 2-3 percent of household expenditure, on children’s and their ineligible siblings’ school enrollment and work participation in Cambodia. This study is an intent-to-treat regression discontinuity design. Data were collected from applications at all 100 CSP schools, as well as from household surveys at five randomly selected schools and households in five provinces, eighteen months after application. The cutoff score that was used to decide who would receive the scholarship offer was based on the application forms; 26 questions correlated with how likely the child was to drop out of school. Enrollment and work outcomes were compared for students around the cutoff score who did, and did not, receive a scholarship offer and their siblings. The study found children who received the scholarships were significantly more likely to be enrolled in school and less likely to work for pay than those that did not receive the scholarship. However, girls that received the scholarships were significantly more likely to work without pay. This study uses a regression discontinuity design and therefore was reviewed using CLEAR’s descriptive study evidence review guidelines. As such it does not receive a causal rating.","CESSP Scholarship Program (CSP)","Child labor Tuition assistance","Other, Low income",,International,2009,,"Child Labor Review Protocol" "Improving 24-month abstinence and employment outcomes for substance-dependent women receiving Temporary Assistance for Needy Families with intensive case management.","Morgenstern, J., Neighbors, C., Kuerbis, A., Riordan, A., Blanchard, K., McVeigh, K., Morgan, T., & McCrady, B. (2009). Improving 24-month abstinence and employment outcomes for substance-dependent women receiving Temporary Assistance for Needy Families with intensive case management. American Journal of Public Health, 99(2), 328-333.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact on employment of an intensive case management (ICM) program for substance-dependent women receiving Temporary Assistance for Needy Families (TANF). Women identified as substance-dependent were randomly assigned to either the ICM or usual care treatment programs. The primary data sources were daily self-reports and follow-up interviews conducted 3, 9, 15, and 24 months after random assignment. The study found that women in the ICM group were generally significantly more likely than women in the usual care group to be employed full-time, particularly at the 24-month follow-up period. In addition, the study found a significantly higher rate of improvement in employment outcomes for the ICM group compared with the usual care group. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition and the authors did not account for differences between the two groups in their analysis. This means we are not confident that the estimated effects are attributable to the ICM or usual care program; other factors are likely to have contributed.","Intensive Case Management (ICM) and Usual Care Programs","Other employment and reemployment Substance abuse recovery","Female, Low income",,"United States",2009,,"Employment and Training Review Protocol" "The impact of cash transfers on child labor and school enrollment in Brazil","Cardoso, E., & de Souza, A. F. (2009). The impact of cash transfers on child labor and school enrollment in Brazil. In P. F. Orazem, G. Sedlacek, & Z. Tzannatos (Eds.), Child labor and education in Latin America: An Economic perspective. Houndmills, U.K. and New York: Palgrave Macmillan.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two Brazilian income transfer programs (Minimum Income and Bolsa Escola) on child labor and school enrollment. The authors used a nonexperimental design to compare the outcomes of children ages 10 to 15 that received the conditional cash transfers with those who had not, based on data from the 2000 Brazilian Census. Using several demographic characteristics, they created a matched comparison group of families who had not received the transfers but who had similar characteristics to the treatment group to assess the effectiveness of the cash transfer program. The study found that the income transfer programs were significantly associated with an increase in school enrollment but not significantly associated with child labor. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the income transfer programs; other factors are likely to have contributed.","Income Transfer Programs (Minimum Income Program and Bolsa Escola)","Child labor","Other, Low income",,International,2009,https://ideas.repec.org/p/van/wpaper/0407.html,"Child Labor Review Protocol" "Education and child labor: Experimental evidence from a Nicaraguan conditional cash transfer program","Maluccio, J. A. (2009). Education and child labor: Experimental evidence from a Nicaraguan conditional cash transfer program. In P. F. Orazem, G. Sedlacek, & Z. Tzannatos (Eds.), Child labor and education in Latin America: An economic perspective (pp. 187-204). New York, NY: Palgrave Macmillan. doi.org/10.1057/9780230620100_12","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Red de Proteccion Social (RPS) cash transfer program on school attendance and enrollment and on child labor for children aged 7-13 in rural Nicaragua. Using panel survey data collected before and one year after program implementation, the author measured the impact of RPS using a randomized controlled trial (RCT). The study found that participation in RPS was significantly related to a reduction in child labor and a significant increase in school enrollment and attendance. The quality of the causal evidence presented in this report is low because, while it was based on an RCT, attrition was high and the authors did not demonstrate that the groups were similar at baseline. This means we are not confident that the estimated effects are attributable to the Red de Proteccion Social; other factors are likely to have contributed.","Red de Protección Social (RPS)","Child labor","Other, Low income",,"International, Rural",2009,,"Child Labor Review Protocol" "The Employment Retention and Advancement project: Results from the Substance Abuse Case Management program in New York City.","Martinez, J., Azurdia, G., Bloom, D., and Miller, C. (2009). The Employment Retention and Advancement project: Results from the Substance Abuse Case Management program in New York City. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the New York City Substance Abuse Case Management (SACM) program on employment, earnings, and public assistance receipt. The SACM program is part of the Employment Retention and Advancement (ERA) project. The authors assigned 8,831 low-income adults with substance abuse issues to either the SACM program or existing services. The authors analyzed data from Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), and Food Stamps administrative records. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because assignment to the program was not random, the treatment and control groups differed at baseline, and the authors did not appropriately account for differences in pre-intervention measures. This means we are not confident that the estimated effects are attributable to the SACM program; other factors are likely to have contributed.","the Employment Retention and Advancement (ERA) Project, New York City","Other employment and reemployment Substance abuse recovery","Low income",,"United States, Urban",2009,http://www.mdrc.org/sites/default/files/full_551.pdf,"Employment and Training Review Protocol" "Evaluating the direct and indirect effects of a conditional income support program: The case of Progresa","Badillo Bautista, C. (2009). Evaluating the direct and indirect effects of a conditional income support program: The case of Progresa (Doctoral dissertation). Retrieved from ProQuest Dissertations & Theses A&I. (Accession No. 1314572898)","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The objective of the study was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on child labor for children ages 8 to 17. Using survey data from a cluster randomized controlled trial, the authors analyzed the average program impact of the PROGRESA/Oportunidades program using a difference-in- differences (DID) regression model for the child labor outcome and cross-sectional models to estimate spillover effects on child labor. The study found the number of children aged 12-16 who worked significantly decreased in cash transfer participating households compared to control households. The quality of causal evidence presented in this study is high because it is based on a well-implemented, low attrition randomized controlled trial. This means we are confident that the estimated effects are attributable to PROGRESA/Oportunidades and not to other factors.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,"Rural, International",2009,,"Child Labor Review Protocol" "Return on investment analysis of a selected set of workforce system programs in Indiana. [WIA Dislocated Worker]","Hollenbeck, K. (2009). Return on investment analysis of a selected set of workforce system programs in Indiana. Indianapolis, IN: Indiana Chamber of Commerce Foundation. [WIA Dislocated Worker]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Dislocated Worker program on the employment rate, earnings, and benefit receipt of low-income adults who are dislocated workers. The author used a nonexperimental method to compare the short-term (three quarters after program exit) and long-term (seven quarters after program exit) employment, earnings, and Unemployment Insurance benefits between those who took part in the WIA Dislocated Worker Program relative to those who participated in the WorkOne program. The study found that, compared with those who participated in the WorkOne program, WIA Dislocated Worker Program participants had higher employment and earnings and lower benefit receipt. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Dislocated Worker program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Dislocated Worker Program","Job search assistance and supportive services Other employment and reemployment Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Dislocated or displaced worker, Low income",,"United States",2009,http://www.indianachamber.com/images/media/studies/ROIanalysisWorkforceDevelopm…,"Review Protocol" "The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor","Hoddinott, J., Gilligan, D. O., & Taffesse, A. S. (2009). The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor. Retrieved from http://ssrn.com/abstract=1412291","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of Ethiopia’s Productive Safety Net Program (PSNP) on child labor and school attendance, along with the potential added benefit of participation in the Other Food Security Program (OFSP). This summary focuses on the comparison between the group receiving the PSNP benefit and the comparison group. The study used a nonexperimental design to compare the outcomes of children ages 6-16 that received the cash transfers with those who did not, based on data from the Food Security Program Survey. Using several demographic characteristics, the authors created a matched comparison group of households who did not receive the benefit to assess the effectiveness of the cash transfer program. The study did not find a significant relationship between receipt of benefits from PSNP and the number of hours worked (in domestic labor, agricultural labor, or total labor hours) or school attendance rates. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the Productive Safety Net Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2009,http://ssrn.com/abstract=1412291,"Child Labor Review Protocol" "The repeal of the retirement earnings test and the labor supply of older men.","Engelhardt, G. V., & Kumar, A. (2009). The repeal of the retirement earnings test and the labor supply of older men. Journal of Pension Economics & Finance, 8(4), 429-450.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of the repeal of the earnings test under the Senior Citizens Freedom to Work Act of 2000 on the labor supply and earnings of older men ages 62 to 72. The authors used a nonexperimental approach and data from the Health and Retirement Study to compare labor force participation, annual hours of work, retirement behavior, and earnings of men who were and were not subject to the repeal of the earnings test. The study found that the policy change was associated with a significant increase in older men’s average annual hours of work. The policy change was also associated with a change in the distribution of real earnings in that a smaller proportion of older men had earnings at or below the earnings test threshold. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000; other factors are likely to have contributed.","Senior Citizens Freedom to Work Act of 2000","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2009,,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the Los Angeles Reach For Success program","Anderson, J., Freedman, S., and Hamilton, G. (2009). The Employment Retention and Advancement project: Results from the Los Angeles Reach For Success program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Mixed impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of an individualized case management program called Reach for Success (RFS) on employment, earnings, and public assistance receipt for recipients of Temporary Assistance for Needy Families (TANF) cash assistance benefits. The study used a randomized controlled trial design, assigning eligible people over a two-year period to either the RFS program or existing services. To estimate the program’s impacts, the authors used administrative employment, earnings, and public benefits data, as well as a 12-month follow-up survey emphasizing respondents’ employment, income, and other outcomes. Outcomes were adjusted for prerandom assignment characteristics. The study found that RFS participants were significantly more likely to receive TANF and Food Stamps benefits at the end of the two-year follow-up period. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the RFS program and not to other factors.","Reach for Success (RFS)","Other employment and reemployment","Parent, Low income",,"United States",2009,http://www.acf.hhs.gov/sites/default/files/opre/era_la_rfs_embed.pdf,"Employment and Training Review Protocol" "Working toward Wellness: Early results from a telephone care management program for Medicaid recipients with depression.","Kim, S., LeBlanc, A. and Michalopoulos, C. (2009). Working toward Wellness: Early results from a telephone care management program for Medicaid recipients with depression. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impacts of a telephone care management program, Working toward Wellness (WtW), on low-income depressed parents’ employment and earnings. The study used a randomized controlled trial design, assigning eligible parents to either the WtW program or existing services. Authors used data from a six-month follow-up survey to estimate program impacts, accounting for parents’ characteristics before random assignment. The study did not find any statistically significant effects of the WtW program on employment or earnings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to WtW and not to other factors. However, the study did not find statistically significant effects.","Working toward Wellness (WtW)","Other employment and reemployment","Low income, Parent",,"United States",2009,http://www.acf.hhs.gov/sites/default/files/opre/working_wellness.pdf,"Employment and Training Review Protocol" "An empirical study of the effects of Social Security reforms on benefit claiming behavior and receipt using public-use administrative microdata.","Benítez-Silva, H., & Yin, N. (2009). An empirical study of the effects of Social Security reforms on benefit claiming behavior and receipt using public-use administrative microdata. Social Security Bulletin, 69(3), 77-95.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study examined the impact of three policy changes to the Social Security program that went into effect in 2000 on average monthly benefits and the proportion of new claimants by age. The study was a nonexperimental analysis that examined outcomes for older workers by age and year using data from the 2004 Old Age, Survivors, and Disability Insurance program public-use microdata files. The study found that the changes were associated with lower average monthly benefits for individuals ages 66 to 69 after the year 2000 relative to individuals of the same ages in 1994. The quality of the causal evidence presented in this report is low because the authors did not demonstrate that the groups were similar before the intervention. This means we are not confident that the estimated effects are attributable to the intervention program; other factors are likely to have contributed.","Policy Changes to the Social Security Program","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2009,https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1480653,"Employment and Training Review Protocol" "Limiting child labor through behavior-based income transfers: An experimental evaluation of the PETI program in rural Brazil","Yap, Y. T., Sedlacek, G., & Orazem, P. F. (2009). Limiting child labor through behavior-based income transfers: An experimental evaluation of the PETI program in rural Brazil. In P. F. Orazem, G. Sedlacek, & Z. Tzannatos (Eds.), Child Labor and Education in Latin America (pp. 147-165). New York, NY: Palgrave Macmillan. doi.org/10.1057/9780230620100_10","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Programa de Erradicacao do Trabalho Infantil (PETI) or Program to Eradicate Child Labor on child labor and hours in school. The authors used an experimental design to compare the outcomes of children ages 7 to 14 residing in municipalities who received income transfers with those residing in municipalities who did not receive income transfers. Based on data from Brazil’s national household survey, the authors used statistical models to assess the impact of the program in each group. The PETI program was significantly associated with an increase in time in school and less time in work for participating children. The quality of causal evidence presented in this report is low because it is a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the PETI program; other factors are likely to have contributed.","Programa de Erradicacao do Trabalho Infantil (PETI) or Program to Eradicate Child Labor","Child labor","Other, Low income",,"International, Rural",2009,,"Child Labor Review Protocol" "The Employment Retention and Advancement project: Results from the Valuing Individual Success and Increasing Opportunities Now (VISION) program in Salem, Oregon","Molina, F., Cheng, W., and Hendra, R. (2008). The Employment Retention and Advancement project: Results from the Valuing Individual Success and Increasing Opportunities Now (VISION) program in Salem, Oregon. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Salem, Oregon, Valuing Individual Success and Increasing Opportunities Now (VISION) program on employment, earnings, and public benefits receipt among eligible single parents. VISION provided job search assistance and post-employment services to unemployed Temporary Assistance for Needy Families (TANF) applicants. The study used a randomized controlled trial to assign TANF applicants eligible for welfare-to-work programs to either VISION or the state’s typical welfare-to-work program, Job Opportunities and Basic Skills Training (JOBS), from May 2002 to May 2004. To estimate differences in outcomes between the two study groups, the authors retrieved data from unemployment insurance wage records, TANF and Food Stamps administrative records, and a 12-month follow-up survey. The study found that people in the VISION group received, on average, $365 more in TANF benefits and $160 more in Food Stamps than those in the JOBS group during the first year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to VISION, and not to other factors.","the Salem Valuing Individual Success and Increasing Opportunities Now (VISION) Program","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2008,http://files.eric.ed.gov/fulltext/ED501587.pdf,"Employment and Training Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [CTE]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [CTE]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Carl Perkins Postsecondary Career and Technical Education (CTE) program on employment and credential completion. The authors used administrative records to compare the outcomes of low-income adults who took part in the CTE program with the outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that CTE participants had higher employment and credential completion rates compared with those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to CTE; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Carl Perkins Postsecondary Career and Technical Education (CTE) Program","Other training and education Job search assistance and supportive services","Low income, Low-skilled",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Review Protocol" "Workforce Investment Act non-experimental net impact evaluation. [Adult sample]","Heinrich, C., Mueser, P., & Troske, K. (2008). Workforce Investment Act non-experimental net impact evaluation. Columbia, MD: IMPAQ International. [Adult sample]","Apprenticeship and Work-Based Training, Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the Workforce Investment Act (WIA) Adult Program’s impact on workers’ employment and earnings in 12 states. The authors analyzed administrative data to compare the employment and earnings outcomes of people receiving different tiers of WIA Adult Program services with two different matched comparison groups for 16 quarters after program entry. The study found that WIA Adult Program services had positive impacts on earnings and employment in most quarters examined. Those WIA Adult Program participants who received training earned more and were more likely to be employed than those who received only core and intensive services. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WIA Adult Program services, but other factors might also have contributed. The report also examined the impacts of WIA Dislocated Worker services; that profile is available here.","the Workforce Investment Act (WIA) Adult Program","Adult and Dislocated Worker programs Job search assistance and supportive services Other employment and reemployment Wagner-Peyser Act Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Other training and education","Unemployed, Low income",,"United States",2008,https://wdr.doleta.gov/research/FullText_Documents/Workforce%20Investment%20Act…,"Apprenticeship and Work-Based Training, Job Search Assistance Review Protocol" "How did the elimination of the US earnings test above the normal retirement age affect labour supply expectations?","Michaud, P., & Van Soest, A. (2008). How did the elimination of the US earnings test above the normal retirement age affect labour supply expectations? Fiscal Studies, 29(2), 197-231. doi:10.1111/j.1475-5890.2008.00073.x","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The authors used a nonexperimental approach and the data from Health and Retirement Study data from 1996 to 2002 and Social Security earnings history to estimate the impact. The study examined the impact of repealing the earnings test from Social Security recipients between full retirement age and age 70 on older workers’ subjective probability of retirement. The authors used a nonexperimental approach and the data from Health and Retirement Study data from 1996 to 2002 and Social Security earnings history to estimate the impact. The study found that after the repeal of the earnings test, the subjective probability of working of full-time past age 65 for older male workers who were likely to have most of their projected Social Security benefits reduced under the earnings test has increased their expected probability of working relative to those who were not likely to be affected. •The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design.This means we are somewhat confident that the estimated effects are attributable to the repeal of the earnings test, but other factors might also have contributed.","Social Security Earnings Test","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2008,,"Employment and Training Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [WIA-Adult]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [WIA-Adult]","Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Title I program for adults (including dislocated workers) on participants’ employment and credential completion rates. The study used administrative records to compare the outcomes for low-income adults who took part in the WIA program with a nonexperimental-matched group of adults who did not take part in the program. The study found that the WIA program participants had higher employment and credential completion rates than those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Title I program for adults (including dislocated workers); other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Title I Program for Adults","Adult and Dislocated Worker programs Job search assistance and supportive services Other employment and reemployment Other training and education Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Unemployed, Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Employment and Training Review Protocol" "Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia","Barrera-Osorio, F., Bertrand, M., Linden, L.L., & Perze-Calle, F. (2008). Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia (World Bank Policy Research Working Paper 4580). Washington, DC: World Bank.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Subsidios Condicionados a la Asistencia Escolar, a conditional cash transfer program (CCT), on school participation and child labor. This summary focuses on the comparison between the treatment group receiving the basic CCT and the control group in Suba. The study was a randomized controlled trial in two districts in Columbia (San Cristobal and Suba). The authors compared the differential effects of receiving the cash transfer on outcomes for those in the treatment group versus those in the control group. The study found that students in the basic treatment group had a significant increase in self-reported school attendance compared to students in the control group. The study did not find any significant differences in child labor or school enrollment between students receiving the basic treatment and the control group. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Subsidios Condicionados a la Asistencia Escolar, but other factors might also have contributed.","Subsidios Condicionados a la Asistencia Escolar (Conditional Subsidies for School Attendance)","Child labor","Other, Low income",,International,2008,http://siteresources.worldbank.org/EDUCATION/Resources/278200-1099079877269/547…,"Child Labor Review Protocol" "Workforce program performance indicators for the commonwealth of Virginia. Upjohn Institute technical report no. 08-024 [FSET]","Hollenbeck, K., Huang, W.-J., and WE Upjohn Institute for Employment Research. (2008). Workforce program performance indicators for the commonwealth of Virginia. Upjohn Institute technical report no. 08-024, Kalamazoo, MI: W. E. Upjohn Institute for Employment Research. [FSET]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Food Stamp Employment and Training Program (FSET) on employment and credential completion rates. The authors used administrative records to compare outcomes for low-income adults who took part in the FSET program to a nonexperimental matched group of adults who did not take part in the program. The study found that, compared to those who did not take part in the program, the employment rate was significantly lower. The FSET group also earned significantly fewer educational or training credentials. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to FSET; other factors are likely to have contributed.","the Food Stamp Employment and Training Program (FSET)","Job search assistance and supportive services Other employment and reemployment","Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Employment and Training Review Protocol" "Temporary help service firms’ use of employer tax credits: Implications for disadvantaged workers’ labor market outcomes","Hamersma, S., & Heinrich, C. (2008). Temporary help service firms’ use of employer tax credits: Implications for disadvantaged workers’ labor market outcomes. Southern Economic Journal, 74(4), 1123-1148.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the effect of subsidies paid to employers for hiring disadvantaged workers—specifically, the Work Opportunity Tax Credit and Welfare-to-Work Tax Credit—on workers’ earnings and employment. It also examined the interaction of the employment subsidies and being employed through a temporary help service. The study compared total earnings and total quarters employed in the first and second years after starting a job for certified workers—those workers for whom employers could receive subsidies—with those of eligible but uncertified workers. In addition, the study compared outcomes of certified workers employed through temporary help services with those of certified workers hired directly by an employer. The authors matched the groups being compared on observable characteristics using administrative data. The study found no statistically significant relationships between employer subsidies and workers’ earnings or employment. The quality of causal evidence presented in this report is low because the study did not adequately account for existing differences between the study groups. This means we are not confident that any estimated effects would be attributable to employer subsidies.","the Work Opportunity Tax Credit and Welfare-to-Work Tax Credit","Other employment and reemployment","Low income",,"United States",2008,,"Employment and Training Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [DBVI]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [DBVI]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Vocational Rehabilitation program administered by the Department for Blind and Vision Impaired (DBVI) on participants’ employment and credential completion. The study used administrative records to compare the outcomes of low-income adults who took part in the DBVI program with outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that DBVI participants had higher employment and credential completion rates compared with those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to DBVI; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Vocational Rehabilitation (VOC) Programs","Supported employment or other employment supports Vocational rehabilitation","Disability, Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Review Protocol" "The Employment Retention and Advancement project: A comparison of two job club strategies: The effects of enhanced versus traditional job clubs in Los Angeles","Navarro, D., Azurdia, G., & Hamilton, G. (2008). The Employment Retention and Advancement project: A comparison of two job club strategies: The effects of enhanced versus traditional job clubs in Los Angeles. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to gauge the effect of a Los Angeles job club focused on participants’ career interests on employment, earnings, and benefits receipt outcomes after about 18 months. The Los Angeles site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. (See the CLEAR review of the final report here.) The authors randomly assigned almost 1,200 single-parent Temporary Assistance for Needy Families (TANF) recipients to either a treatment group, which received Enhanced Job Club (EJC) services, or a control group, which received Traditional Job Club (TJC) services. The authors collected employment and earnings data from Unemployment Insurance (UI) records and used automated TANF and Food Stamps databases to obtain benefits receipt information. The study found that, 18 months after random assignment, there were no statistically significant differences between EJC and control group members’ employment, earnings, or public benefits receipt. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the EJC and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Los Angeles’s Enhanced Job Club","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2008,http://www.acf.hhs.gov/sites/default/files/opre/era_la.pdf,"Employment and Training Review Protocol" "Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia","Barrera-Osorio, F., Bertrand, M., Linden, L.L., & Perze-Calle, F. (2008). Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia (World Bank Policy Research Working Paper 4580). Washington, DC: World Bank.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Subsidios Condicionados a la Asistencia Escolar, a conditional cash transfer program (CCT), on school participation and child labor. This summary focuses on the comparison between the savings treatment group and the control group in San Cristobal. The study was a randomized controlled trial in two districts in Columbia (San Cristobal and Suba). The authors compared the differential effects of receiving the cash transfer on outcomes for those in the treatment group versus those in the control group. The study did not find any significant differences in child labor, school attendance, or school enrollment between students receiving the savings treatment and the control group. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Subsidios Condicionados a la Asistencia Escolar, but other factors might also have contributed. However, the study did not find statistically significant effects.","Subsidios Condicionados a la Asistencia Escolar (Conditional Subsidies for School Attendance)","Child labor","Other, Low income",,International,2008,http://siteresources.worldbank.org/EDUCATION/Resources/278200-1099079877269/547…,"Child Labor Review Protocol" "Learning better together: The impact of learning communities on the persistence of low-income students","Engstrom, C., & Tinto, V. (2008). Learning better together: The impact of learning communities on the persistence of low-income students. Opportunity Matters: A Journal of Research Informing Educational Opportunity Practice and Programs, 1(1), 5-21.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of learning communities on community college students’ persistence from freshman to sophomore year, an outcome in the progress toward degree completion domain. The authors used a nonrandom approach to select treatment and comparison students to include in their analysis. To measure the relationship between participation in a learning community and persistence, the authors used survey and administrative data from 13 community colleges to estimate a logistic regression. The study found that 62 percent of learning community students persisted from freshman to sophomore year, compared with 57 percent of comparison group students. This difference was statistically significant. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to learning communities. Other factors are likely to have contributed.","Learning Communities","Community college education and other classroom training Basic skills","Adult, Other barriers, Low income",,"United States",2008,,"Community College Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [DRS]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [DRS]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Vocational Rehabilitation program administered by Department of Rehabilitative Services (DRS) on participants’ employment and credential completion. The study used administrative records to compare the outcomes of low-income adults who took part in the DRS program with outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that DRS participants had higher employment and credential completion rates compared with those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to DRS; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies","the Vocational Rehabilitation (VOC) Programs","Job search assistance and supportive services Vocational rehabilitation","Disability, Low-skilled, Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Review Protocol" "Teaching self-sufficiency: An impact and benefit-cost analysis of a home visitation and life skills education program. Findings from the rural welfare-to-work strategies demonstration evaluation","Meckstroth, A., Burwick, A., & Moore, Q. (2008). Teaching self-sufficiency: An impact and benefit-cost analysis of a home visitation and life skills education program. Findings from the rural welfare-to-work strategies demonstration evaluation. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employer benefits receipt-Mod/high-Favorable impacts Employer benefits receipt Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Building Nebraska Families (BNF) rural welfare-to-work program on employment, earnings, and public benefit receipt. The authors randomly assigned Nebraska Temporary Assistance for Needy Families (TANF) recipients identified as hard-to-employ to either a treatment group, which received in-home life skills and family management training, or a control group, which did not. The authors evaluated the treatment’s impact using Nebraska state administrative data and follow-up surveys. The study found that BNF increased the average likelihood of ever being employed in the first year after enrollment by 10.8 percentage points and that of ever being employed in the first 30 months after enrollment by 6.3 percentage points. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the BNF rural welfare-to-work program and not to other factors.","Building Nebraska Families (BNF)","Other employment and reemployment","Low income",,"United States",2008,http://www.acf.hhs.gov/sites/default/files/opre/teaching_self.pdf,"Employment and Training Review Protocol" "The effect of the social security earnings test on male labor supply: New evidence from survey and administrative data.","Haider, S. J., & Loughran, D. S. (2008). The effect of the social security earnings test on male labor supply: New evidence from survey and administrative data. Journal of Human Resources, 43(1), 57-87.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts Earnings and wages Employer benefits receipt-Low-Favorable impacts Employer benefits receipt","Summary: The study’s objective is to examine the impact of 1983 and 2000 policy changes that removed the Social Security earnings test for certain age groups on the earnings and employment outcomes of affected men The study is a nonexperimental analysis that examines the correlations between the 1983 and 2000 policy changes and earnings and employment status. The study compares the outcomes of men affected by the policy changes with the outcomes of men of similar ages not affected by the policy changes. The study finds that the 1983 policy change is associated with few changes to the observed outcomes and that the 2000 policy change is associated with higher earnings and hours worked per week for affected men. The quality of causal evidence presented in this report is low because the study does not demonstrate that men affected by the policy changes are similar to the men not affected by the policy change, nor does it control for possible differences. This means we are not confident that the estimated effects are attributable to the 1983 and 2000 policy changes; other factors are likely to have contributed.","Social Security Earnings Test","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2008,http://jhr.uwpress.org/content/43/1/57.refs,"Employment and Training Review Protocol" "Rapid employment model evaluation: Update","Smith, T. C., King, C. T., & Schroeder, D. G. (2008). Rapid employment model evaluation: Update. Austin, TX: Ray Marshall Center for the Study of Human Resources.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Rapid Employment Model (REM) program on participants’ employment, earnings, and Unemployment Insurance (UI) benefit claims. (See the CLEAR review of the 2010 report here.) Using program data and state UI records, the authors matched treatment group cases to comparison group cases and conducted regression analyses to estimate the effect of the intervention. The study found that participation in the REM program was associated with an increase in the likelihood that jobseekers were employed in quarters following program participation. The quality of causal evidence presented in this report is moderate for employment and earnings outcomes because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects on employment and earnings are attributable to the REM program, but other factors might also have contributed. The quality of causal evidence presented for the UI benefit claiming outcome is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects on UI benefit claiming outcome are attributable to REM program; other factors are likely to have contributed.","Rapid Employment Model (REM) Program","Job search assistance and supportive services Other training and education Unemployment Insurance","Justice-involved, Low-skilled, Low income",,"United States",2008,http://sites.utexas.edu/raymarshallcenter/files/2008/12/REM_eval_update_01-28-0…,"Review Protocol" "Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia","Barrera-Osorio, F., Bertrand, M., Linden, L.L., & Perze-Calle, F. (2008). Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia (World Bank Policy Research Working Paper 4580). Washington, DC: World Bank.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Subsidios Condicionados a la Asistencia Escolar, a conditional cash transfer program (CCT), on school participation and child labor. This summary focuses on the comparison between the treatment group receiving the basic CCT and the control group in San Cristobal. The study was a randomized controlled trial in two districts in Columbia (San Cristobal and Suba). The authors compared the differential effects of receiving the cash transfer on outcomes for those in the treatment group versus those in the control group. The study found that students in grades 6-10 who received the basic treatment worked significantly fewer hours in the last week than students in the control group. The study did not find any significant differences in school attendance or school enrollment between students receiving the basic treatment and the control group. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Subsidios Condicionados a la Asistencia Escolar, but other factors might also have contributed.","Subsidios Condicionados a la Asistencia Escolar (Conditional Subsidies for School Attendance)","Child labor","Other, Low income",,International,2008,http://siteresources.worldbank.org/EDUCATION/Resources/278200-1099079877269/547…,"Child Labor Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [AEL]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [AEL]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Adult Education and Literacy (AEL) program on participants’ employment and credential completion. The study used administrative records to compare outcomes of low-income adults who took part in the AEL program with outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that AEL participants had a lower employment rate but were more likely to have earned a GED compared with those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to AEL; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Adult Education and Literacy (AEL) Program","Other training and education","Low-skilled, Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Review Protocol" "Testing case management in a rural context: An impact analysis of the Illinois Future Steps program: Findings from the Rural Welfare-to-Work Strategies Demonstration evaluation.","Meckstroth, A., Person, A., Moore, Q., Burwick, A., McGuirk, A., Ponza, M., Marsh, S., Novak, T., Zhao, Z., & Wheeler, J. (2008). Testing case management in a rural context: An impact analysis of the Illinois Future Steps program: Findings from the Rural Welfare-to-Work Strategies Demonstration evaluation. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Future Steps rural welfare-to-work program on employment, earnings, and public benefit receipt. The authors randomly assigned Temporary Assistance for Needy Families (TANF) and Food Stamps recipients required to work to either a treatment group, which received job search and other services, or a control group, which did not. The authors evaluated the treatment’s impact using Illinois administrative data and follow-up surveys. The authors found that the Future Steps program increased the likelihood of being employed 30 months after enrollment by 8.6 percentage points. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Future Steps rural welfare-to-work program and not to other factors.","the Future Steps Rural Welfare-to-Work Program","Job search assistance and supportive services Other employment and reemployment","Low income",,"Rural, United States",2008,http://www.acf.hhs.gov/sites/default/files/opre/testing_case.pdf,"Employment and Training Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [TAA]","Hollenbeck, K., & Huang, W.-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [TAA]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Training Adjustment Assistance (TAA) program on employment and credential completion. The study used administrative records to compare outcomes of low-income adults who took part in the TAA program with outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that TAA participants had a lower employment rate but were more likely to have obtained a training certificate compared with those who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to TAA; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Trade Adjustment Assistance (TAA) Program","Job search assistance and supportive services Other training and education","Low-skilled, Low income, Dislocated or displaced worker",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Review Protocol" "Growing America Through Entrepreneurship: Findings from the evaluation of Project GATE","Benus, J., McConnell, S., Bellotti, J., Shen, T., Fortson, K., & Kahvecioglu, D. (2008). Growing America Through Entrepreneurship: Findings from the evaluation of Project GATE. Columbia, MD: IMPAQ International.","Entrepreneurship and Self-Employment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impacts of the Growing America Through Entrepreneurship (Project GATE) demonstration project, which offered entrepreneurship training and business counseling to low-income individuals, on participants’ employment, earnings, and public assistance benefit receipt. The authors randomly assigned study participants to a treatment group, which could participate in Project GATE, or a control group, which could not participate. The authors used Unemployment Insurance (UI) wage records and survey data in their analyses. The study did not find any statistically significant effects of Project GATE on employment, earnings, or UI benefit receipt in any of the four quarters after random assignment, using UI wage record data. The quality of causal evidence presented in this report is high for outcomes measured using UI wage record data because they were based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to Project GATE and not to other factors. However, the study did not find statistically significant effects. Outcomes measured with survey data received a low evidence rating because there is high attrition and insufficient adjustment for differences in previous employment and earnings history.","the Project Growing America Through Entrepreneurship (GATE) Demonstration","Job search assistance and supportive services Other training and education Unemployment Insurance","Low income",,"United States",2008,https://wdr.doleta.gov/research/FullText_Documents/Findings%20from%20the%20Eval…,"Employment and Training Review Protocol" "State age protection laws and the Age Discrimination in Employment Act.","Lahey, J. State age protection laws and the Age Discrimination in Employment Act. (2008). The Journal of Law and Economics, 51(3), 433-460.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The study examined the impact of enforcement of age discrimination laws on the employment and earnings of older male workers The author used a nonexperimental regression model and data from the Current Population Survey to estimate the impact. The study found that males older than 50 in states with age discrimination laws were 0.2 percentage points less likely to be hired compared with those in states without their own age discrimination laws. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the state laws on age discrimination, but other factors might also have contributed.","Age Discrimination Employment Act (ADEA)","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2008,https://www.jstor.org/stable/10.1086/589670?seq=1#page_scan_tab_contents,"Employment and Training Review Protocol" "Cognitive and non-cognitive predictors of success in adult education programs: Evidence from experimental data with low-income welfare recipients","Leininger, L. J., & Kalil, A. (2008). Cognitive and non-cognitive predictors of success in adult education programs: Evidence from experimental data with low-income welfare recipients. Journal of Policy Analysis and Management, 27, 521-535. doi: 10.1002/pam.20357","Literacy, Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of an education-focused intervention and an employment-focused intervention on education outcomes. The authors used data from a randomized controlled trial, the National Evaluation of Welfare-to-Work Strategies (NEWWS). The NEWWS study randomly assigned individuals within seven geographic locations to one of three conditions: an education-focused intervention, an employment-focused intervention, or the control group. The current study used a subsample to examine participants’ completion of a high school diploma or equivalent two years after being assigned to one of the conditions. The study found that participation in the education-focused intervention was significantly associated with a higher likelihood of receiving a high school diploma or equivalent relative to the control group. The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with unknown attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to the education-focused or employment-focused interventions, although other factors could also have contributed.","the Education-Focused and Employment-Focused Interventions","Basic skills Other training and education","Adult, Low income",,"United States",2008,https://onlinelibrary.wiley.com/doi/abs/10.1002/pam.20357,"Literacy, Low-Income Adults Review Protocol" "The Employment Retention and Advancement project: Findings for the Cleveland Achieve model: Implementation and early impacts of an employer-based approach to encourage employment retention among low-wage workers","Miller, C., Martin, V., Hamilton, G., Cates, L., and Deitch, V. (2008). The Employment Retention and Advancement project: Findings for the Cleveland Achieve model: Implementation and early impacts of an employer-based approach to encourage employment retention among low-wage workers. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to determine the impact of a program designed to increase employment retention among low-wage workers in the long-term nursing care industry in Cleveland, Ohio. Cleveland was one of 16 sites nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 44 firms to either a treatment group, whose employees could receive employment retention services through Cleveland Achieve, or a control group. The authors collected data on employee turnover directly from firms and employment and earnings data from state Unemployment Insurance (UI) records. Two years after random assignment, the study did not find statistically significant differences in the turnover rates, employment rates, or earnings of employees in Achieve firms compared with employees in firms that did not have access to Achieve services. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the Achieve program, and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Cleveland","Other employment and reemployment Unemployment Insurance","Low income","Health care and social assistance","United States, Urban",2008,http://www.acf.hhs.gov/sites/default/files/opre/cleveland.pdf,"Employment and Training Review Protocol" "The heterogeneous impact of CCT programmes on child labor: The case of Tekoporã in Paraguay","Hirata, G. I. (2008). The heterogeneous impact of CCT programmes on child labor: The case of Tekoporã in Paraguay. Brazil: International Poverty Centre/UNDP.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Tekoporã conditional cash transfer program on children’s participation in non-domestic labor and school attendance. The author used a nonexperimental design to compare the outcomes of children ages 4 to 14 that received the conditional cash transfers with those who did not, based on data from a program eligibility questionnaire and a follow-up survey. The author used statistical models to estimate the effects of the program. The study found no significant relationship between the Tekoporã program and the number of children in the household who participated in non-domestic labor. However, the program was significantly related to decisions between school and work, with a decrease in the probability that children would “only work” or “neither work nor attend school.” The quality of causal evidence presented in this report is low because the author did not account for trends in outcomes before the intervention or adequately control for time-varying characteristics that might influence the outcome. This means we are not confident that the estimated effects are attributable to Tekoporã; other factors are likely to have contributed.",Tekoporã,"Child labor","Other, Low income",,International,2008,http://www.ucw-project.org/attachment/hirata.pdf,"Child Labor Review Protocol" "A good start: Two-year effects of a freshman learning community program at Kingsborough Community College","Scrivener, S., Bloom, D., LeBlanc, A., Paxson, C., Rouse, C.E., & Sommo, C. (2008). A good start: Two-year effects of a freshman learning community program at Kingsborough Community College. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Opening Doors learning communities at Kingsborough Community College in New York on progress toward completing a degree and enrollment in a four-year college in the program semester and three follow-up semesters. Students in the Opening Doors learning communities took three linked courses during one semester and were provided tutoring and case management services. The study was a randomized controlled trial. Eligible students were randomly assigned to either the treatment group, which was offered the opportunity to participate in a learning community, or the control group, which was not allowed to enroll in a learning community. The primary data sources were a baseline survey on the background characteristics of students, student transcripts, and degree attainment information from the National Student Clearinghouse. The study found that the treatment group earned significantly more credits than the control group, cumulatively across the program semester and the three follow-up semesters,. However, during that time, there were no significant cumulative differences between the two groups on registration for any courses, the number of semesters registered, or enrollment in either a two- or four-year college. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects would be attributable to the learning communities, and not to other factors.","Opening Doors Learning Communities at Kingsborough Community College","Community college education and other classroom training","Adult, Low income",,"United States",2008,http://www.mdrc.org/sites/default/files/A%20Good%20Start.pdf,"Community College Review Protocol" "Supported employment for middle-aged and older people with schizophrenia.","Twamley, E., Narvaez, J., Becker, D., Bartels, S., & Jeste, D. (2008). Supported employment for middle-aged and older people with schizophrenia. American Journal of Psychiatric Rehabilitation, 11(1), 76-89.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of Individual Placement and Support (IPS) on competitive employment for older people with schizophrenia The study was a randomized controlled trial (RCT) and used weekly work logs cross-referenced with pay stubs to measure employment outcomes over a 12-month period. The study found that IPS increased competitive employment and earnings compared with conventional services. The quality of causal evidence presented in this report is low because the RCT has a confounding factor. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support and Vocational Rehabilitation Program","Health Individuals facing barriers to employment Job search assistance and supportive services","Adult, Older worker, Disability",,"United States",2008,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2638571/,"Employment and Training Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. Upjohn Institute technical report no. 08-024. [TANF/VIEW]","Hollenbeck, K., Huang, W.-J., and WE Upjohn Institute for Employment Research (2008). Workforce program performance indicators for the Commonwealth of Virginia. Upjohn Institute technical report no. 08-024. Kalamazoo, MI: W. E. Upjohn Institute for Employment Research. [TANF/VIEW]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Virginia Initiative for Employment Not Welfare (TANF/VIEW) program on employment and credential completion rates. The authors used administrative records to compare outcomes for low-income adults who took part in the TANF/VIEW program to a nonexperimental matched group of adults who did not take part in the program. The study found that, compared with those who did not take part in the program, the employment rate was significantly lower for those who took part in the TANF/VIEW program, but the TANF/VIEW group earned significantly more educational or training credentials. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the TANF/VIEW program; other factors are likely to have contributed.","the Virginia Initiative for Employment Not Welfare (TANF/VIEW) Program","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Impacts for Portland’s Career Builders program.","Azurdia, G., & Barnes, Z. (2008). The Employment Retention and Advancement project: Impacts for Portland’s Career Builders program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of the Portland Career Builders program on welfare recipients’ employment, earnings, and public benefits receipt outcomes after two years. The Portland site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 634 Temporary Assistance for Needy Families (TANF) applicants and recipients to either a treatment group that received Career Builder services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects on employment, earnings, and public benefits receipt outcomes one and two years after program entry. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that the estimated effects would be attributable to the Career Builders program, and not to other factors. However, the study did not find any statistically significant effects.","The Employment Retention and Advancement Project, Portland Career Builders Program","Other employment and reemployment Unemployment Insurance Other training and education","Low income",,"United States",2008,http://www.mdrc.org/sites/default/files/full_550.pdf,"Employment and Training Review Protocol" "New Hope’s eight-year impacts on employment and family income.","Miller, C., Duncan, G., Classens, A., Engel, M., Hill, H., & Lindsay, C. (2008). New Hope’s eight-year impacts on employment and family income. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the New Hope program on employment, earnings, and public benefit receipt. The authors estimated the impact of the New Hope program by comparing average outcomes among a treatment group randomly selected to have access to the program with those of a randomly selected control group that did not have access to the program. The study found no statistically significant effects on employment, earnings, or public benefit receipt eight years after the program began. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to the New Hope program and not to other factors. However, the study did not find statistically significant effects.","The New Hope Program","Other employment and reemployment","Low income",,"United States",2008,http://www.mdrc.org/sites/default/files/full_458.pdf,"Employment and Training Review Protocol" "Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia","Barrera-Osorio, F., Bertrand, M., Linden, L.L., & Perze-Calle, F. (2008). Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia (World Bank Policy Research Working Paper 4580). Washington, DC: World Bank.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Subsidios Condicionados a la Asistencia Escolar, a conditional cash transfer program (CCT), on school participation and child labor. This summary focuses on the comparison between the tertiary treatment group and the control group in Suba. The study was a randomized controlled trial in two districts in Columbia (San Cristobal and Suba). The authors compared the differential effects of receiving the cash transfer on outcomes for those in the treatment group versus those in the control group. The study found that students in the tertiary treatment group worked significantly less in the past week than students in the control group. They were also significantly more likely to report their primary activity as studying and less likely to report their primary activity as work or home versus students in the control group. The study did not find any significant differences in school attendance or school enrollment between students receiving the tertiary treatment and the control group. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Subsidios Condicionados a la Asistencia Escolar, but other factors might also have contributed.","Subsidios Condicionados a la Asistencia Escolar (Conditional Subsidies for School Attendance)","Child labor","Other, Low income",,International,2008,http://siteresources.worldbank.org/EDUCATION/Resources/278200-1099079877269/547…,"Child Labor Review Protocol" "The Employment Retention and Advancement project: Results from two education and training models for employed welfare recipients in Riverside, California.","Navarro, D., Freedman, S., & Hamilton, G. (2007). The Employment Retention and Advancement project: Results from two education and training models for employed welfare recipients in Riverside, California. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of post-employment job supports and intensive case management on welfare recipients’ employment, earnings, and benefit receipt outcomes after two years. The Riverside Phase 2 site was one of two in Riverside, California, that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,907 employed single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups that received differing ERA services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that the households of participants in the Work Plus program were 10.5 percentage points less likely to receive TANF benefits relative to those in the control group 12 months after random assignment. The study found no statistically significant effects associated with the Training Focused program. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Riverside Work Plus program and not to other factors. It also means that we would be confident that any estimated effects would be attributable to Riverside Training Focused program and not to other factors. However, the study did not find statistically significant effects of the Training Focused program.","the Employment Retention and Advancement Project—Work Plus and Training Focused (Phase 2), Riverside","Other employment and reemployment","Parent, Low income",,"United States",2007,http://www.acf.hhs.gov/sites/default/files/opre/riverside_phase2.pdf,"Employment and Training Review Protocol" "Evaluation of LA’s HOPE: Ending chronic homelessness through employment and housing—Final report.","Burt, M. (2007). Evaluation of LA’s HOPE: Ending chronic homelessness through employment and housing—Final report. Washington, DC: U.S. Department of Housing and Urban Development and U.S. Department of Labor.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of Los Angeles’ Homeless Opportunity Providing Employment (HOPE) program on employment, housing, and income. The study used a quasi-experimental design in which the authors compared participants in the HOPE program with participants in other programs that provided many of the same services but not its specialized housing and employment resources. The authors presented direct comparisons, as well as comparisons that adjusted for the groups’ differences in age, race, mental health diagnoses, and recent experience of homelessness and incarceration. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the author did not account for differences between members of the program and comparisons groups or show that they were similar when they joined the study. This means we are not confident that the estimated effects are attributable to Los Angeles’ HOPE program; other factors are likely to have contributed.","Los Angeles’ Homeless Opportunity Providing Employment (HOPE)","Other employment and reemployment","Low income, Homeless, Disability",,"United States",2007,http://www.urban.org/sites/default/files/alfresco/publication-pdfs/411631-Evalu…,"Employment and Training Review Protocol" "Labor market shocks and retirement: Do government programs matter?","Coile, C., & Levine, P. (2007). Labor market shocks and retirement: Do government programs matter? Journal of Public Economics, 91(10), 1902-1919.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study examined the impact of the generosity of unemployment insurance (UI) benefits on retirement decisions. The study used a statistical model and data from the March Current Population Survey for 1980–2004 to estimate impacts. The study found no relationship between the generosity of UI benefits and the likelihood of retirement or receipt of UI. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before changes in the generosity of UI benefits were observed. This means we are not confident that the estimated effects are attributable to changes in the generosity of UI benefits; other factors are likely to have contributed.","Unemployment Insurance (UI)","Unemployment Insurance","Adult, Older worker, Unemployed",,"United States",2007,http://academics.wellesley.edu/Economics/Coile/PDF%20files/coile-levine%20JPubE…,"Employment and Training Review Protocol" "Protecting education for the poor in times of crisis: An evaluation of a scholarship programme in Indonesia","Sparrow, R. (2007). Protecting education for the poor in times of crisis: An evaluation of a scholarship programme in Indonesia. Oxford Bulletin of Economics and Statistics, 69, 99-122. doi: 10.1111/j.1468-0084.2006.00438.x","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Jaring Prengaman Sosial (JPS), a scholarship program in Indonesia, on child labor and school enrollment. The author used data from an annual Indonesian national survey to estimate an instrumental variable (IV) regression model to examine if scholarship receipt affected school enrollment, and probit models to examine the effects on child labor and school attendance. The study found that the receipt of a scholarship was significantly associated with a decrease in child labor and an increase in school attendance. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before receiving the JPS in the probit model and no evidence was provided on the strength of the instrument used in the IV model. This means we are not confident that the estimated effects are attributable to the Jaring Pengaman Sosial (JPS) scholarship program; other factors are likely to have contributed.","Jaring Prengaman Sosial","Child labor Tuition assistance","Other, Low income",,International,2007,https://pdfs.semanticscholar.org/8f79/add16372936ea1e388e3a9c82e320435a87d.pdf,"Child Labor Review Protocol" "Evaluating multi-treatment programs: Theory and evidence from the U.S. Job Training Partnership Act experiment.","Plesca, M., & Smith, J. (2007). Evaluating multi-treatment programs: Theory and evidence from the U.S. Job Training Partnership Act experiment. Empirical Economics, 32, 491-528.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Job Training Partnership Act (JTPA) on earnings and employment for disadvantaged adults. The authors conducted a randomized controlled trial. They analyzed data from one baseline survey, two follow-up surveys, and earnings and employment records. The study found that men in the treatment group had earned more at the 30-month follow-up than men in the control group, and that women in the treatment group experienced significantly better earnings and employment outcomes at several points compared to the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to JTPA, and not to other factors.","Job Training Partnership Act","Other training and education Supported employment or other employment supports Job search assistance and supportive services","Adult, Female, Male, Low-skilled, Low income",,"United States",2007,,"Review Protocol" "The Employment Retention and Advancement project: Results from the Post-Assistance Self-Sufficiency (PASS) program in Riverside, California","Navarro, D., van Dok, M., & Hendra, R. (2007). The Employment Retention and Advancement project: Results from the Post-Assistance Self-Sufficiency (PASS) program in Riverside, California. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Riverside Post-Assistance Self-Sufficiency (PASS) program on employment, earnings, and public benefits receipt after two years. The Riverside PASS site was one of two in Riverside, California, that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,770 employed single-parent participants who had recently left the Temporary Assistance for Needy Families (TANF) program to a treatment group that received ERA services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that Riverside PASS had positive impacts on earnings and employment in the first and second years after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Riverside PASS, and not to other factors.","the Riverside Post-Assistance Self-Sufficiency (PASS) Program","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2007,http://www.acf.hhs.gov/sites/default/files/opre/riverside_pass.pdf,"Employment and Training Review Protocol" "Youth Opportunity Grant Initiative: Impact and synthesis report","Jackson, R., Dixon, R., McCoy, A., Pistorino, C., Zador, P., Thomas, C., … Bruno, L. (2007). Youth Opportunity Grant Initiative: Impact and synthesis report. Houston, TX: Decision Information Resources, Inc.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: This report’s objective was to examine the effectiveness of the Youth Opportunity (YO) Grant Initiative, which sought to improve job prospects and education outcomes for youth in high-poverty areas by providing them with a mix of 15 youth development activities. Companion reports describe the initiative’s implementation. The initiative’s effectiveness was evaluated using two separate comparison group designs. In general, the study found positive and statistically significant relationships between the YO initiative and educational enrollment outcomes. However, there were few statistically significant effects on employment-related outcomes and educational attainment. The quality of the causal evidence presented in this study is low. This means we are not confident that the estimated impacts were caused by the YO Grant Initiative, and not other factors.","Youth Opportunity Grant Initiative","Basic skills Community college education and other classroom training Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2007,http://wdr.doleta.gov/research/FullText_Documents/YO%20Impact%20and%20Synthesis…,"Opportunities for Youth Review Protocol" "The Employment Retention and Advancement project: Results from the Personal Roads to Individual Development and Employment (PRIDE) program in New York City","Bloom, D., Miller, C., and Azurdia, G. (2007). The Employment Retention and Advancement project: Results from the Personal Roads to Individual Development and Employment (PRIDE) program in New York City. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Personal Roads to Individual Development and Employment (PRIDE) welfare-to-work program in New York City on the employment, earnings, and public benefits receipt of low-income single parents with physical or mental health problems that limited their ability to work. The study was a randomized controlled trial that used data from administrative records for the two years following assignment and a survey conducted with a random subset of the sample to assess outcomes one year after assignment. The study found that treatment group participants were significantly more likely than control group participants to have had a job and had higher average earnings. The treatment group was significantly less likely to receive cash assistance and received lower amounts of cash assistance benefits than the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to PRIDE and not to other factors.","Personal Roads to Individual Development and Employment (PRIDE)","Other employment and reemployment","Disability, Low income, Parent",,"United States, Urban",2007,http://www.acf.hhs.gov/sites/default/files/opre/era_pride.pdf,"Employment and Training Review Protocol" "A tax on work for the elderly: Medicare as a secondary payer.","Goda, G. S., Shoven, J. B., & Slavov, S. N. (2007). A tax on work for the elderly: Medicare as a secondary payer. (NBER Working Paper No. 13383). Cambridge, MA: National Bureau of Economic Research.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Medicare as a Secondary Payer (MSP) on older workers’ labor force participation and full-time employment The study used a nonexperimental regression design. The authors used data from the 1980 to 2006 March Supplement of the Current Population Survey. The study found that labor force participation for older males increased following the enforcement of the MSP policy, and that older males and females in the labor force were more likely to be employed full time after the policy was enforced. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention, and confounding factors could have impacted older workers differentially during the time periods examined. This means we are not confident that the estimated effects are attributable to MSP; other factors are likely to have contributed.","Medicare as a Secondary Payer","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2007,https://www.nber.org/papers/w13383,"Employment and Training Review Protocol" "Evaluating the impacts of Washington State repeated job search services on the earnings of prime‐age female TANF recipients.","Hsiao, C., Shen, Y., Wang, B., & Weeks, G. (2007). Evaluating the impacts of Washington State repeated job search services on the earnings of prime‐age female TANF recipients. Journal of Applied Econometrics, 22(2), 453-475.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impacts of Job Search Services (JSS) on employment and earnings outcomes of women ages 25 to 35 who participated in the WorkFirst program in Washington State. The authors used a nonexperimental study design to examine the earnings and employment outcomes of women who took part in JSS. Women were categorized as being in the treatment group if they participated in JSS at least once from the second quarter of 1998 to the fourth quarter of 2000. Women who did not participate in JSS during this time made up the comparison group. The study found that the first instance of participation in JSS increased the likelihood of employment by 4 percent for women seeking employment. The study also found a positive and statistically significant relationship between quarterly earnings and participation in JSS one or more times for employed women. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared exhibited similar employment or earnings outcomes before the intervention. This means we are not confident that the estimated effects are attributable to JSS; other factors are likely to have contributed.","Job Search Services (JSS)","Community college education and other classroom training Job search assistance and supportive services Other training and education","Low income",,"United States",2007,,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from Minnesota’s Tier 2 program","LeBlanc, A., Miller, C., Martinson, K., & Azurdia, G. (2007). The Employment Retention and Advancement project: Results from Minnesota’s Tier 2 program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to determine the 18-month impact of Minnesota’s Tier 2 welfare-to-work program compared with existing Tier 1 services. Minnesota’s Tier 2 program was part of the nationwide Employment Retention and Advancement (ERA) project. The authors randomly assigned approximately 1,700 long-term Temporary Assistance for Needy Families (TANF) recipients to either a treatment group, which received Tier 2 services including intensive assessments and case management, or a control group, which received Minnesota’s existing Tier 1 TANF services. The authors analyzed data from Minnesota Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study found that, 12 months after random assignment, more people in the Tier 2 group (79.2 percent) reported that they received Food Stamps than in the control group (70.0 percent). After 18 months however, there were no statistically significant differences between treatment and control group members’ employment, earnings, or benefits receipt. The quality of causal evidence provided in this study is high because it is based on a well-conducted randomized controlled trial. This means we are confident that any estimated effects are attributable to Minnesota’s Tier 2 program and not to other factors.","the Employment Retention and Advancement project, Minnesota’s Tier 2 Program","Job search assistance and supportive services Other employment and reemployment","Unemployed, Low income, Parent",,"United States",2007,http://www.acf.hhs.gov/sites/default/files/opre/minnesota_tier2.pdf,"Employment and Training Review Protocol" "Youth Opportunity grant initiative: process evaluation final report","Bruno, L., & Pistorino, C. (2007). Youth Opportunity grant initiative: process evaluation final report. Washington, DC: Decision Information Resources, Inc.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report summarized the results of the final round of the process evaluation of the Youth Opportunity (YO) grant initiative. The YO program offered educational, employment, leadership enhancement, and other support services to all youth ages 14 to 21 in targeted high-poverty areas across the country in order to boost their high school graduation, college enrollment, and employment rates. The study assessed program implementation and examined strengths and weaknesses of the YO model by gathering information on services provided, program outcomes, and implementation challenges and best practices at 25 sites. It drew on management information systems (MIS) data; group interviews with program administrators, line staff, and youth participants; and past process evaluation reports. Projects were successful in enrolling a large number of participants and nearly 40 percent of those enrolled received a long-term placement. Projects eventually succeeded in establishing YO centers but faced challenges in launching and running the centers, delivering comprehensive and integrated youth development services, sustaining long-term youth engagement, and developing partnerships for sustainability.","Youth Opportunity Grant Initiative","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2007,,"Opportunities for Youth Review Protocol" "Learning from the Youth Opportunity experience: Building delivery capacity in distressed communities","Harris, L. (2006). Learning from the Youth Opportunity experience: Building delivery capacity in distressed communities. Washington, DC: Center for Law and Social Policy.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This study explored the successes and challenges of implementing Youth Opportunity grants, which were awarded to 36 low-income communities in May 2000 to address high unemployment, low graduation rates, and endemic violence and crime among youth ages 14 to 21. The authors administered to 22 Youth Opportunity grantees a survey that gathered information on how the program engaged community leaders, connected different systems providing youth services, rolled out comprehensive programming, and collaborated with businesses. The researchers also conducted focus groups at several sites. The study found that Youth Opportunity grants had a high level of success in recruiting disadvantaged and out-of-school youth, boosting their enrollment in educational support programs, and placing participants in jobs and internships. The grants also improved the long-term capacity of these communities to serve low-income youth by enhancing youth workers’ skills and expertise and encouraging collaboration across different systems involved in youth development. Grantees faced challenges in setting up large-scale, complex initiatives in the allotted time, locating local funding, and ensuring that employers had reasonable expectations of program participants. The study recommended a lengthier planning phase and more closely engaging local and state officials and business representatives in the program.","Youth Opportunity Grant Initiative","Youth programs Other training and education Work based and other occupational training","Youth, Low-skilled, Low income",,"United States",2006,http://files.eric.ed.gov/fulltext/ED490191.pdf,"Opportunities for Youth Review Protocol" "National Job Corps study and longer-term follow-up study: Impact and benefit-cost findings using survey and summary earnings records data","Schochet, P., Burghardt, J., & McConnell, S. (2006). National Job Corps study and longer-term follow-up study: Impact and benefit-cost findings using survey and summary earnings records data. Washington, DC: Employment and Training Administration, U.S. Department of Labor.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The National Job Corps Study included several reports, including this longer-term impact report. The report’s objective was to examine the impact of the Job Corps program on participants’ long-term earnings, employment, and other outcomes. Job Corps offered intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. Its effectiveness was evaluated using a randomized controlled trial conducted in 48 states and the District of Columbia. The study found a number of statistically significant, positive impacts of Job Corps on earnings and employment in the first four follow-up years. However, there were no significant differences between the youth who were offered Job Corps and the control group on employment rate or earnings in the fifth through ninth follow-up years, as measured by administrative data. The quality of causal evidence presented in this report is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the effects estimated in the study are solely attributable to Job Corps, and not to other factors.","Job Corps","Job search assistance and supportive services Work based and other occupational training","Youth, Low-skilled, Low income",,"United States",2006,https://www.mathematica-mpr.com/-/media/publications/pdfs/jobcorpimpactbenefit…,"Opportunities for Youth Review Protocol" "New evidence on earnings and benefit claims following the changes in the retirement earnings test in 2000.","Song, J. G., & Manchester, J. (2006). New evidence on earnings and benefit claims following the changes in the retirement earnings test in 2000. (ORES Working Paper 107). Washington, DC: Social Security Administration, Office of Policy, Office of Research, Evaluation, and Statistics. Also available in Journal of Public Economics, 91(3–4), 669–700 (2007).","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Low-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study examined the impact of the Senior Citizens Freedom to Work Act of 2000 on employment, earnings, and public benefit receipt outcomes of workers ages 65 to 69. The study was a nonexperimental analysis and used Social Security Administrative data to estimate the impacts. The study found that the Senior Citizens Freedom to Work Act of 2000 was associated with significant increases in the rate of Social Security claims for both sets of individuals affected by the law. The study found no statistically significant relationship between the Senior Citizens Freedom to Work Act of 2000 and earnings. The quality of casual evidence presented in this report for Social Security claims and earnings outcomes is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000, but other factors might also have contributed. The quality of causal evidence presented in this report on employment is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000; other factors are likely to have contributed.","Senior Citizens Freedom to Work Act of 2000","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker",,"United States",2006,,"Employment and Training Review Protocol" "A comparison of two Welfare-to-Work strategies among African American women in Atlanta, Georgia. (Unpublished doctoral dissertation).","Wilson-Brewster, V.L. (2006). A comparison of two Welfare-to-Work strategies among African American women in Atlanta, Georgia. (Unpublished doctoral dissertation). Capella University, Minneapolis, Minnesota.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the effectiveness of two welfare-to-work programs—the Labor Force Attachment (LFA) program and the Human Capital Development (HCD) program—on the employment and earnings of African American women 25, 35, and 45 years old in Atlanta. The author analyzed a subsample of participants in the National Evaluation of Welfare-to-Work Strategies (NEWWS) study. The study was a randomized controlled trial that assigned individuals within a geographic location to one of three groups: LFA, HCD, or a control group. The study found that women in the 35-year-old group who participated in LFA or HCD had higher earnings and needed less time to find a job than those in the other age cohorts. The quality of causal evidence presented in this report is low because the study was a randomized controlled trial with unknown attrition and the authors did not account for preexisting differences between the groups being compared in their analysis. This means we are not confident that the estimated effects are attributable to LFA or HCD programs; other factors are likely to have contributed.","Labor Force Attachment (LFA) and Human Capital Development (HCD)","Other employment and reemployment Other training and education","Female, Black or African American, Low income, Parent",,"United States, Urban",2006,,"Employment and Training Review Protocol" "Paths to work in rural places: Key findings and lessons from the impact evaluation of the Future Steps rural welfare-to-work program.","Meckstroth, A., Burwick, A., Ponza, M., Marsh, S., Novak, T., Phillips, S., Diaz-Tena, N., & Ng, J. (2006). Paths to work in rural places: Key findings and lessons from the impact evaluation of the Future Steps rural welfare-to-work program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Future Steps rural welfare-to-work program on earnings and public benefit receipt. The authors randomly assigned Temporary Assistance for Needy Families (TANF) and Food Stamps recipients required to work to either a treatment group, which received earnings-focused case management, job search, and other services, or to a control group, which did not receive services. The authors evaluated the treatment’s impact using Illinois administrative data and follow-up surveys. The study did not find any statistically significant effects on earnings or public benefit receipt in the first 18 months after participants were offered access to the program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to the Future Steps rural welfare-to-work program and not to other factors. However, the study did not find statistically significant effects.","the Future Steps Rural Welfare-to-Work Program","Job search assistance and supportive services Other employment and reemployment","Low income",,"United States",2006,http://www.acf.hhs.gov/sites/default/files/opre/paths_to_work.pdf,"Employment and Training Review Protocol" "Cash transfers, conditions, school enrollment, and child work: Evidence from a randomized experiment in Ecuador","Schady, N. & Araujo, M. C. (2006). Cash transfers, conditions, school enrollment, and child work: Evidence from a randomized experiment in Ecuador. Policy Research Working Paper No. 3930. Washington, DC: The World Bank. Retrieved from https://openknowledge.worldbank.org/handle/10986/8452  ","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of the Bono de Desarrollo Humano (BDH) program on child labor and school enrollment for children 6-17 years old. The study used a randomized controlled trial to compare the outcomes of children in households assigned to participate in the program to outcomes of those who did not participate. The study found a significant relationship between being selected for the BDH program and whether children worked and hours per week children worked; both were significantly lower for those in the treatment group than those in the control group. The study also found that children selected into the BDH program had significantly higher rates of school enrollment and significantly lower rates of having dropped out since the program began. The quality of causal evidence presented in this report is low because it is a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Bono de Desarrollo Humano program; other factors are likely to have contributed.","Bono de Desarrollo Humano (BDH) program","Child labor","Other, Low income",,International,2006,https://openknowledge.worldbank.org/handle/10986/8452,"Child Labor Review Protocol" "An examination of the delivery of literacy services at Job Corps Centers.","KPMG (2006). An examination of the delivery of literacy services at Job Corps Centers. Washington, DC: U.S. Department of Labor, Office of Job Corps.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: The purpose of the study was to identify areas in which Job Corps can improve its delivery of literacy services. Job Corps is a national program that provides youth with job training skills while they pursue a high school diploma or general equivalency diploma (GED). It also provides career counseling and job placement services following completion of the job training component. The authors primarily analyzed qualitative data collected from site visits to six Job Corps sites across the United States. The visits included interviews with key staff and observations of Job Corps classes. The authors also conducted descriptive quantitative analyses of administrative participant and survey data. The authors made recommendations for improvements in the delivery of literacy services in the following areas: employing certified teaching staff on government pay scales so that they can compete with public school teachers in terms of compensation and benefits; providing additional resources, such as special education instructors, psychologists, and counselors, to allow instructors to devote more time to their classes; and building partnerships and relationships with other educational institutions and the community.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2006,http://wdr.doleta.gov/research/FullText_Documents/Job%20Corps%20Literacy%20Repo…,"Opportunities for Youth Review Protocol" "The Employment Retention and Advancement project: Results from the Texas ERA site [Texas ERA—Houston]","Martinson, K., & Hendra, R. (2006). The Employment Retention and Advancement project: Results from the Texas ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Houston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after 18 to 24 months. The Houston site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,800 single-parent participants in Houston’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program (SNAP) administrative records. The study did not find any statistically significant effects on employment or earnings. However, the study found that treatment group members received, on average, $33 more in TANF benefits in the ninth quarter after random assignment than those in the control group. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program, and not to other factors.","the Employment Retention and Advancement project, Houston","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2006,http://www.acf.hhs.gov/sites/default/files/opre/results_texas.pdf,"Employment and Training Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). [WIA Adult]","Hollenbeck, K., & Huang, W-J. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [WIA Adult]","Apprenticeship and Work-Based Training, Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program on the employment rate, earnings, and public benefit receipt of low-income adults in Washington State. The authors used a nonexperimental design to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and public benefit receipt between those who took part in the WIA Adult Program and those who registered for employment services at the state Labor Exchange. The study found that, compared with those who registered for services at the Labor Exchange, participants in the WIA Adult Program had higher employment, earnings, and public benefit receipt. The quality of causal evidence presented in this report is low because the authors compared the treatment and comparison groups at different follow-up points and the groups were therefore not equivalent. This means we are not confident that the estimated effects are attributable to the WIA Adult Program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Adult Program","Adult and Dislocated Worker programs Job search assistance and supportive services Labor Exchange Other employment and reemployment Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Other training and education","Unemployed, Low income",,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica…,"Apprenticeship and Work-Based Training, Job Search Assistance Review Protocol" "The Employment Retention and Advancement project: Results from the Texas ERA site [Texas ERA—Forth Worth]","Martinson, K., & Hendra, R. (2006). The Employment Retention and Advancement project: Results from the Texas ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Forth Worth]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after 18 to 24 months. The Fort Worth site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,200 single-parent participants in Fort Worth’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program (SNAP) administrative records. The study found that treatment group members were 6.1 percentage points more likely to have been employed at any time in the second year after random assignment than those in the control group. Treatment group members were also 4.2 percentage points more likely to be employed during the last quarter of that second year. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program, and not to other factors.","the Employment Retention and Advancement project, Fort Worth","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2006,http://www.acf.hhs.gov/sites/default/files/opre/results_texas.pdf,"Employment and Training Review Protocol" "Effects of housing vouchers on welfare families: Final report","Mills, G., Gubits, D., Orr, L., Long, D., Feins, J., Kaul, B., Wood, M., Jones, A., Cloudburst Consulting Associates, & the QED Group. (2006). Effects of housing vouchers on welfare families: Final report. Prepared for the U.S. Department of Housing and Urban Development, Office of Policy Development and Research. Cambridge, MA: Abt Associates Inc.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of providing low-income families with private market housing vouchers on employment, earnings, receipt of public assistance, and receipt of education and training. It also examined impacts on several measures of housing security, which are not included in this review. The authors implemented a randomized controlled trial and estimated regression models to compare outcomes of treatment and comparison families. The study found that treatment group members received more Temporary Assistance for Needy Families (TANF) cash benefits and food stamps than control group members. There were no statistically significant effects of the program on employment, earnings, or receiving education or training. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the housing voucher, and not to other factors.","the Welfare-to-Work Voucher Program","Other wages and benefits","Low-skilled, Low income",,"United States",2006,http://www.huduser.gov/publications/pdf/hsgvouchers_1_2011.pdf,"Review Protocol" "Effects of housing vouchers on welfare families: Final report","Mills, G., Gubits, D., Orr, L., Long, D., Feins, J., Kaul, B., & Wood, M. (2006). Effects of housing vouchers on welfare families: Final report. Washington, DC: U.S. Department of Housing and Urban Development.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Welfare-to-Work housing voucher on employment, earnings, and public benefit receipt. The authors allocated the available vouchers by lottery to eligible families who were willing to participate in the study. Using Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), housing assistance administrative data, and baseline and follow-up surveys, the authors compared the outcomes of those randomly assigned to receive a voucher with outcomes of those who were not, adjusting for chance preintervention differences between the groups. The study found that the Welfare-to-Work vouchers increased the likelihood of receiving TANF benefits in the third half-year (months 12–18) after random assignment by 2.1 percentage points and the likelihood of receiving Food Stamps in the same period by 2.5 percentage points. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Welfare-to-Work voucher and not to other factors.","the Welfare-to-Work Voucher Program","Other employment and reemployment","Low income",,"Urban, United States",2006,https://www.huduser.gov/publications/pdf/hsgvouchers_1_2011.pdf,"Employment and Training Review Protocol" "Paying for persistence: Early results of a Louisiana scholarship program for low-income parents attending community college","Brock, T., & Richburg-Hayes, L. (2006). Paying for persistence: Early results of a Louisiana scholarship program for low-income parents attending community college. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Louisiana Opening Doors, a scholarship program, on semester-to-semester retention and course completion at two community colleges in Louisiana. The study was a randomized controlled trial that compared the outcomes of treatment and control groups over three semesters. The primary data sources were students’ transcripts from the colleges and a baseline survey on students’ background characteristics. The study found that students who participated in the Opening Doors program attempted and passed a greater number of courses, registered for and earned more credits, and were enrolled for more semesters than students in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Louisiana Opening Doors program, and not to other factors.","Opening Doors in Louisiana","Community college education and other classroom training Tuition assistance","Adult, Low income, Parent",,"United States",2006,http://www.mdrc.org/sites/default/files/full_472.pdf,"Community College Review Protocol" "Managing customers’ training choices: Findings from the Individual Training Account experiment","McConnell, S., Stuart, E., Fortson, K., Decker, P., Perez-Johnson, I., Harris, B., & Salzman, J. (2006). Managing customers’ training choices: Findings from the Individual Training Account experiment. Final report, Series: ETAOP 2007-01. Washington, DC: Employment and Training Administration, U.S. Department of Labor.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Training-Mod/high-Favorable impacts Training","Summary: The study’s objective was to compare the impacts of individual training account (ITA) approaches on customers’ training completion, employment, earnings, and benefits receipt outcomes after 15 months. The authors randomly assigned about 8,000 adults and dislocated workers from eight workforce investment agencies across the United States to three ITA approaches: structured customer choice, maximum customer choice, or guided customer choice. The authors analyzed data from Unemployment Insurance (UI) records and from a survey conducted on a random subsample of study participants. The study found the customers in the structured customer choice approach received significantly higher amounts of public assistance benefits than did customers in the guided customer choice group. The study also found that the structured customer choice group had higher earnings and lower education and training compared with the maximum customer choice group, whereas the maximum customer choice group had lower earnings and higher public assistance benefits compared with the guided customer choice group. The quality of causal evidence provided in this study is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to differences in the ITA approaches, and not to other factors.","the Individual Training Accounts (ITA) Approaches","Other employment and reemployment Other training and education","Dislocated or displaced worker, Low income",,"United States",2006,http://scholar.google.com/scholar_url?url=http%3A//cire.mathematica-mpr.com/~/m…,"Employment and Training Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). [WIA Youth]","Hollenbeck, K., & Huang, W-J. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [WIA Youth]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Youth program on the employment rate and earnings of low-income youth. The authors used a nonexperimental method to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and public benefits receipt between those who took part in the WIA Youth program relative to those who registered for services at the Labor Exchange. The study found that, compared with those who registered for Labor Exchange services, WIA Youth program participants had lower employment, with mixed findings for earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Youth program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Youth Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Youth programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Youth, Low income",,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica…,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the Texas ERA site [Texas ERA—Corpus Christi]","Martinson, K., & Hendra, R. (2006). The Employment Retention and Advancement project: Results from the Texas ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Corpus Christi]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after 18 to 24 months. The Corpus Christi site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,300 single-parent participants in Corpus Christi’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program (SNAP) administrative records. The study did not find statistically significant effects 18 to 24 months after random assignment on employment, earnings, and public benefit receipt. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the ERA program and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Corpus Christi","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2006,http://www.acf.hhs.gov/sites/default/files/opre/results_texas.pdf,"Employment and Training Review Protocol" "Evaluating the effectiveness of the Massachusetts workforce development system using no-shows as a nonexperimental comparison group.","Raphael, S., & Stoll, M. A. (2006). Evaluating the effectiveness of the Massachusetts workforce development system using no-shows as a nonexperimental comparison group. Evaluation Review, 30(4), 379-429.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Job Training Partnership Act (JTPA) workforce development program in Massachusetts on the earnings of disadvantaged adults. The study used a nonexperimental design to compare the earnings of program participants before and after the intervention, relative to the earnings of nonparticipants who were eligible and offered services but chose not to participate in a training program. The authors used administrative records from the Commonwealth Corporation of Massachusetts for their analysis. The study found that, although the participants in the Massachusetts JTPA program earned significantly less than nonparticipants during the year of the program, participants earned significantly more one year ($1,876) and two years ($2,285) after the program, compared with nonparticipants. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to JTPA, but other factors might also have contributed.","the Massachusetts JTPA Workforce Development Program","Job search assistance and supportive services Other training and education","Low-skilled, Low income",,"United States",2006,,"Review Protocol" "The Employment Retention and Advancement project: Results from the Chicago ERA site","Bloom, D., Hendra, R., & Page, J. (2006). The Employment Retention and Advancement project: Results from the Chicago ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to determine the effectiveness of a Chicago program to increase the earnings of Temporary Assistance for Needy Families (TANF) recipients after two years. The Chicago site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,615 TANF recipients to either a treatment group, which received enhanced employment services, or a control group, which received benefits as usual. The authors collected employment and earnings data from Illinois Unemployment Insurance (UI) records and Food Stamps and TANF receipt data from Illinois administrative records. The study found that members of the ERA group were more likely to be employed (70 versus 66 percent) in the first year after random assignment and received significantly less in TANF benefits ($1,307, compared with $1,586 among control group members). Effects on employment and benefits receipt persisted into the second year after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable to the Chicago ERA program, and not to other factors.","the Employment Retention and Advancement project, Chicago","Other employment and reemployment Unemployment Insurance","Low income",,"United States, Urban",2006,http://www.acf.hhs.gov/sites/default/files/opre/chicago_era.pdf,"Employment and Training Review Protocol" "Entrepreneurial discovery by the working poor","Fiet, J., Nixon, R., Gupta, M., & Patel, P. (2006). Entrepreneurial discovery by the working poor. Journal of Developmental Entrepreneurship, 11(3), 255-273.","Entrepreneurship and Self-Employment","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of systematic search training on the number of business ideas participants generated, particularly business ideas inspired by occupational experience and ideas likely to create wealth. The authors randomly assigned sample members into a treatment group, which could participate in a series of training sessions on systematic search, and a control group, which could not participate in that training. They then compared the number of ideas each group produced, overall and in categories defined by type of idea. The study found that members of the treatment group produced significantly more wealth-creating ideas and developed more ideas based on occupational experience than members of the control group. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition and the authors did not adequately control for differences in background characteristics between the groups. This means we are not confident that the estimated effects are attributable to systematic search training; other factors are likely to have contributed.",,"Other training and education","Low income",,"United States",2006,,"Employment and Training Review Protocol" "College as a job advancement strategy: Final report on the New Visions Self-Sufficiency and Lifelong Learning Project","Fein, D., & Beecroft, E. (2006). College as a job advancement strategy: Final report on the New Visions Self-Sufficiency and Lifelong Learning Project. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Riverside Community College’s New Visions Self-Sufficiency and Lifelong Learning Project on welfare recipients’ employment, earnings, welfare receipt, and educational achievement. The study was based on a randomized controlled trial and estimated the effect of offering welfare recipients the New Visions Project services compared with encouraging recipients to participate in other employment services. The authors used California public benefits and community college administrative data to compare average outcomes among those offered access to New Visions with the average outcomes of those excluded, after adjusting for differences in demographic and pre-intervention characteristics between the groups. The study found that participants in the New Visions program received $456 more in Temporary Assistance for Needy Families (TANF) payments than control group participants in the third year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Visions Project, and not to other factors.","the New Visions Self-Sufficiency and Lifelong Learning Project","Community college education and other classroom training Other employment and reemployment","Low income, Parent",,"United States",2006,http://www.acf.hhs.gov/sites/default/files/opre/nv_final_pdf.pdf,"Employment and Training Review Protocol" "Youth Opportunity Grant Initiative: Ethnographic evaluation final report.","Lewis-Charp, H., Soukamneuth, S. & Goger, A.(2005). Youth Opportunity Grant Initiative: Ethnographic evaluation final report. Houston, TX: Decision Information Resources, Inc.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: The study aimed to understand the characteristics of communities participating in the Youth Opportunity (YO) grant initiative. It also sought to examine perceptions of whether the YO program had been implemented well and had enhanced the communities. Funded by the U.S. Department of Labor in 2000, the YO initiative looked to transform distressed neighborhoods by engaging youth in positive and productive activities and relationships. Programs were to provide education, employment, support, and leadership development services to youth ages 14 to 21 in high-poverty urban, rural, and Native American communities. The authors performed an ethnographic analysis based on site profiles for 35 YO communites. They also used U.S. Census data to further understand the characteristics of the communities. The authors described the social and economic trends of the 35 sites at length, focusing on the persistent and systemic obstacles facing the communities, including population decline, housing stress, and high rates of teen pregnancy. Participating communities had high rates of poverty and few quality jobs available.  The authors did not find a consensus about how well the YO initiative had been implemented in the communities. However, most community members, including participating youth, did strongly agree that YO programming benefited youth.","Youth Opportunity Grant Initiative","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2005,,"Opportunities for Youth Review Protocol" "The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [South Carolina] (Bloom et al. 2005)","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [South Carolina]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on former welfare recipients’ employment and benefits receipt outcomes after one year. The South Carolina site was one of 16 sites nationwide that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,839 people who had recently left the Temporary Assistance for Needy Families (TANF) to either a treatment group (Moving Up) that received ERA services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of Moving Up on employment, earnings, or benefits receipt one year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to Moving Up and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement Project, South Carolina","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the South Carolina ERA site","Scrivener, S., Azurdia, G., & Page, J. (2005). The Employment Retention and Advancement project: Results from the South Carolina ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of South Carolina’s Moving Up program on former welfare recipients’ employment, earnings and public benefits receipt outcomes after one year. The South Carolina site was one of 16 sites nationwide that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,864 people who had recently left Temporary Assistance for Needy Families (TANF) to either a treatment group that received Moving Up services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamp administrative records for the entire sample and a survey administered to a subsample of study participants 12 months after random assignment. The study did not find any statistically significant effects on employment, earnings, and public benefits receipt one year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the South Carolina Moving Up program and not to other factors. However, the study did not find statistically significant effects.","the Employment Retention and Advancement Project, South Carolina","Job search assistance and supportive services Other employment and reemployment","Low income",,"United States",2005,http://files.eric.ed.gov/fulltext/ED490879.pdf,"Employment and Training Review Protocol" "The challenge of repeating success in a changing world: Final report on the Center for Employment Training replication sites","Miller, C., Bos, J., Porter, K., Tseng, F., & Abe, Y. (2005). The challenge of repeating success in a changing world: Final report on the Center for Employment Training replication sites. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Mixed impacts Education and skills gains Employment-Mod/high-Mixed impacts Employment Training-Mod/high-Favorable impacts Training","Summary: This report’s objective was to examine the effectiveness of the Center for Employment Training (CET) model. Under this model, local employers help design training programs and provide them in a work-like environment to economically disadvantaged youth who are not in school or employed. A separate report examined CET implementation. The effectiveness of the CET model in improving employment, earnings, and participation in education and training programs was evaluated using a randomized controlled trial (RCT) conducted in 12 sites in seven states. The study found few statistically significant impacts on outcomes measured over a 54-month follow-up period. The quality of the causal evidence presented in this study is moderate. This means we have confidence that the effects estimated in this study are attributable at least in part to the CET program. However, other factors not accounted for in the study might also have contributed to the estimated effect.","the Center for Employment Training (CET) Replication","Basic skills Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2005,http://www.mdrc.org/sites/default/files/full_530.pdf,"Opportunities for Youth Review Protocol" "Study of Hispanics in Job Corps: 2004-2005","Garcia, Y. Study of Hispanics in Job Corps: 2004–2005. Washington, DC: HMA Associates, 2007.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report aimed to explore in greater detail the findings of the National Job Corps Study, an impact study whose final report was published in 2001. Specifically, the authors sought to understand why Hispanic youth did not experience positive impacts on employment outcomes similar to the rest of the study population. Job Corps offers intensive academic classroom instruction and vocational skills training, along with support services, to economically disadvantaged youth. The authors reviewed data on Hispanic youth from the National Job Corps Study, program data, and data from a survey administered in 2004 to Hispanic youth in Job Corps centers. They also conducted site visits to four Job Corps centers, where they interviewed program staff and current and former participants. The study found that Hispanic youth performed well in the Job Corps program, but did not fully leverage the training they received. Many took the first job they were offered in order to start supporting their family immediately instead of expanding their employment search to include more lucrative long-term options. They also limited their search to places of employment where they felt poor English language skills would not constrain them.","Job Corps","Job search assistance and supportive services Youth programs Other training and education Work based and other occupational training","Youth, Hispanic of any race, Low-skilled, Low income",,"United States",2005,http://wdr.doleta.gov/research/FullText_Documents/Hispanic%20Job%20Corps%202004…,"Opportunities for Youth Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Riverside, CA – Work Plus versus Training Focused]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [Riverside, CA – Work Plus versus Training Focused]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the effectiveness of a Riverside, California, program to increase the earnings of welfare recipients after one year. The Riverside Phase 2 site was one of two in Riverside that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned eligible single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups (Work Plus and Training Focused) that received differing ERA services or to a control group that received standard TANF services. This review focuses on the comparison between the Work Plus program and the Training Focused program. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of the Work Plus program on employment, earnings, and benefits receipt compared with the Training Focused program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to the Riverside Work Plus program and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement Project—Work Plus and Training Focused (Phase 2), Riverside","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Texas ERA—Houston]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Houston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after one year. The Houston site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,816 unemployed single-parent participants in Houston’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of the Houston ERA program on employment, earnings, and benefits receipt one year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to the Houston ERA program and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement project, Houston","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "Youth Opportunity grants: Lessons can be learned from program, but Labor needs to make data available.","Bellis, D. D., & General, A. O. (2005). Youth Opportunity grants: Lessons can be learned from program, but Labor needs to make data available. Washington, DC: Government Accountability Office.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report from the Government Accountability Office (GAO) summarizes the findings of a descriptive study of Youth Opportunity Grants. The 36 grants issued under this program, which began in 2000 and continued for five years, aimed to expand opportunities for at-risk youth in low-income areas by providing a variety of support services. The study explored how the grants were implemented, key barriers faced during implementation, and perceptions of the outcomes of the program and its impact on participating youth and their communities. To answer its research questions, the GAO conducted a survey with 36 Youth Opportunity Grant program directors and seven site visits. The site visits included interviews with program managers and staff, youth participants, and community members; facilities tours; observations of program activities; and collection of management information systems data. The study found that grantees adopted a variety of approaches to recruiting and serving at-risk youth, often responding to conditions in their local labor markets. However, many faced challenges in rolling out the program within the set time frames; addressing drug use, violence and unemployment in their communities; and adapting their services for youth struggling at school or with problems at home. Many program participants graduated from high school, enrolled in college, or joined the workforce after receiving Youth Opportunity Grant services. The GAO recommended that the Department of Labor complete the impact analysis of the Youth Opportunity Grant program and release all related reports and data.","Youth Opportunity Grant Initiative","Youth programs Other training and education Work based and other occupational training","Youth, Low-skilled, Low income",,"United States",2005,,"Opportunities for Youth Review Protocol" "Turning welfare into a work support: Six-year impacts on parents and children from the Minnesota Family Investment Program.","Gennetian, L., Miller, C., & Smith, J. (2005). Turning welfare into a work support: Six-year impacts on parents and children from the Minnesota Family Investment Program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Mixed impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Minnesota Family Investment Program (MFIP), a precursor to the national Temporary Assistance for Needy Families program, on employment, earnings, and public benefit receipt. The study was a randomized controlled trial: Families newly applying to Aid to Families with Dependent Children (AFDC) or families that were recertifying their eligibility were randomly assigned to MFIP or AFDC. Evaluators analyzed outcomes using a 36-month follow-up survey and administrative data from the six years after the intervention. The study found that, among single parents in the year after MFIP began, the MFIP group experienced higher rates of short-term employment and higher rates and levels of cash assistance than the AFDC group. For two-parent households, the study found that, in the first year after the study began, the MFIP group had lower rates of employment, lower levels of earnings, and higher rates and levels of benefits receipt than the AFDC group. In both family types, higher receipt of cash assistance for the MFIP group persisted through six years after the study began. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to MFIP, and not to other factors.","the Minnesota Family Investment Program (MFIP)","Other employment and reemployment Other training and education","Parent, Low income",,"United States",2005,http://www.mdrc.org/sites/default/files/full_594.pdf,"Employment and Training Review Protocol" "Building learning communities: Early results from the Opening Doors Demonstration at Kingsborough Community College","Bloom, D., & Sommo, C. (2005). Building learning communities: Early results from the Opening Doors Demonstration at Kingsborough Community College. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Opening Doors learning community program at Kingsborough Community College in Brooklyn, New York, on students’ persistence, course completion, and credits earned during the 2003–2004 academic year. The study was a randomized controlled trial in which students were randomly assigned to the Opening Doors learning community treatment group or the control group. Data sources included students’ transcript data provided by Kingsborough and data from a baseline survey completed by students at the time of random assignment. This study found that the Opening Doors learning community program at Kingsborough had positive impacts on developmental course enrollment and passage rates, percentage and number of courses passed, equated credits earned in the program semester, and developmental course enrollment in the first postprogram semester. During the first academic year, Opening Doors students earned significantly more equated credits and made significantly more progress in required English courses than the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Opening Doors learning communities, and not to other factors.","Opening Doors Learning Communities at Kingsborough Community College","Community college education and other classroom training","Adult, Low income",,"United States",2005,http://files.eric.ed.gov/fulltext/ED485506.pdf,"Community College Review Protocol" "The effect of the SSI program on labor supply: Improved evidence from Social Security administrative files","Neumark, D., & Powers, E. T. (2005). The effect of the SSI program on labor supply: Improved evidence from Social Security administrative files. Social Security Bulletin, 65(3), 45-60.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the relationship between generous state Supplemental Security Income (SSI) benefits and the employment of older worker nearing SSI eligibility age. The authors used a regression model and data from the Survey of Income and Program Participants (SIPP) and Social Security Administration (SSA) to estimate the effect. The study found that older males who were likely SSI participants in generous states worked significantly fewer hours and had lower employment rates compared with those living in less generous states. The authors, using the SSA administrative records, also found that likely older participants (ages 60 to 64) worked significantly fewer hours than younger ones. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to generosity of state SSI benefits; other factors are likely to have contributed.","state Supplemental Security Income (SSI) benefits","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2005,https://www.ssa.gov/policy/docs/ssb/v65n3/v65n3p45.html,"Employment and Training Review Protocol" "Net impact estimates for services provided through the Workforce Investment Act. ETA Occasional Paper 2005-06. [WIA Adult]","Hollenbeck, K., Schroeder, D., King, C., & Huang, W. (2005). Net impact estimates for services provided through the Workforce Investment Act. ETA Occasional Paper 2005-06. Washington, DC: U.S. Department of Labor, Employment and Training Administration. [WIA Adult]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program’s core, intensive, and training services on the employment rate, earnings, and benefits receipt of low-income adults ages 22 to 64. The authors established three treatment groups based on the level of WIA services used and matched them to three comparison groups that participated in Employment Services (ES) and/or the core WIA services. The study found that the employment rate and average quarterly earnings were significantly higher for those in each of the treatment groups compared with their matched comparison groups. Benefits receipt was also significantly lower for those in the treatment groups than in their comparison groups. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Adult Program; other factors are likely to have contributed.","the Workforce Investment Act (WIA) Adult Program","Job search assistance and supportive services Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Low-skilled, Low income",,"United States",2005,https://wdr.doleta.gov/research/FullText_Documents/Net%20Impact%20Estimates%20f…,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Chicago]","Bloom, D, Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Chicago]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to determine the effectiveness of a Chicago program to increase the earnings of Temporary Assistance for Needy Families (TANF) recipients after one year. The Chicago site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 990 TANF recipients to either a treatment group, which received enhanced employment services, or a control group, which received benefits as usual. The authors collected employment and earnings data from Illinois Unemployment Insurance (UI) records and Food Stamps and TANF receipt data from Illinois administrative records. The study found that those in the Chicago ERA program received, on average, $193 less in TANF benefits in the first year after random assignment than those in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Chicago ERA project, and not to other factors.","the Employment Retention and Advancement project, Chicago","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Texas ERA—Fort Worth]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [Texas ERA—Fort Worth]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after one year. The Fort Worth site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,163 unemployed single-parent participants in Fort Worth’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of the Texas ERA program in Fort Worth on employment, earnings, and benefits receipt one year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to Texas ERA and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement project, Fort Worth","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "Promoting work in public housing: The effectiveness of Jobs-Plus","Bloom, H., Riccio, J., Verma, N., & Walter, J. (2005). Promoting work in public housing: The effectiveness of Jobs-Plus. New York City: MDRC","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Jobs-Plus Community Revitalization Initiative for Public Housing Families (Jobs-Plus) program on the employment and earnings of residents in housing developments in six cities in the United States. The study was a randomized controlled trial that used data from administrative records to compare outcomes between treatment and control group members from one to five years after random assignment. The study found that residents in the Jobs-Plus housing developments had higher long-term earnings than residents in the control group developments. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Jobs-Plus program and not to other factors.","the Jobs-Plus Community Revitalization Initiative for Public Housing Families (Jobs-Plus) Program","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States, Urban",2005,http://www.mdrc.org/sites/default/files/full_485.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Texas ERA—Corpus Christi]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [Texas ERA—Corpus Christi]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after one year. The Corpus Christi site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,300 single-parent participants in Corpus Christi’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program administrative records. The study did not find any statistically significant effects one year after random assignment on employment, earnings, and public benefits receipt. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the Corpus Christi ERA program and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Corpus Christi","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Riverside, CA – Training Focused]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Riverside, CA – Training Focused]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the effectiveness of a Riverside, California, program to increase the earnings of welfare recipients after one year. The Riverside Phase 2 site was one of two in Riverside that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,912 employed single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups (Work Plus or Training Focused) that received differing ERA services, or to a control group (Work Focused) that received standard public benefits and some limited case management. This review compared between the Training Focused program and the control group. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects on employment, earnings, or benefit receipt. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means that we would be confident that any estimated effects would be attributable to Riverside Training Focused program and not to other factors. However, the study did not find statistically significant effects.","the Employment Retention and Advancement (ERA) Project—Training Focused (Phase 2), Riverside","Other employment and reemployment","Low income",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The effects of welfare-to-work program activities on labor market outcomes","Dyke, A., Heinrich, C., Mueser, P., & Troske, K. (2005). The effects of welfare-to-work program activities on labor market outcomes. Institute for Research on Poverty, 1295(5). [North Carolina]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of North Carolina’s welfare-to-work program training activities on the quarterly earnings of women ages 18 to 65 years in single-parent households who were cash recipients of Temporary Assistance for Needy Families (TANF). Using data from the state’s administrative records and unemployment insurance program, the authors compared the quarterly earnings of women who took part in the training activities with those who enrolled in the welfare-to-work program but never took part in any of the training. The study found that those taking part in any of the training activities experienced an initial (quarter 1) reduction in their quarterly earnings, compared with those who did not take part in the training activities. However, those who took part in the assessment or intensive training activities experienced an increase in both their cumulative (based on 16 quarters of follow-up) and average (based on quarters 11 to 15 of follow-up) quarterly earnings, compared with those who did not take part in any training activities. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the welfare-to-work program, but other factors might also have contributed.","the Welfare-to-Work Program","Job search assistance and supportive services","Female, Low income, Parent",,"United States",2005,http://repec.iza.org/dp1520.pdf,"Employment and Training Review Protocol" "Barriers to employment for out-of-school youth: Evidence from a sample of recent CET applicants.","Miller, C., & Porter, K. (2005). Barriers to employment for out-of-school youth: Evidence from a sample of recent CET applicants. MDRC working paper. New York: MDRC.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report describes the associations between barriers to employment and employment outcomes of a sample of applicants in the Center for Employment Training (CET) replication sites. The CET program provided an intensive, short-term job training program for economically disadvantaged out-of-school youth that was designed to mirror the workplace. The overall impact of CET on youths’ employment outcomes is described in a different report (see CLEAR profile of Miller et al. 2005). This report described whether three barriers to employment—(1) lack of a high school diploma or general education development (GED) certificate, (2) childbearing, and (3) arrests—were associated with lower employment rates, and whether lower employment rates stemmed from employment instability or a longer length of time needed to find a job. The authors used data from the 54-month survey of CET applicants from the impact evaluation. For that evaluation, eligible youth were randomly assigned to receive CET services or to the control group, which was ineligible for CET services. The authors found that youth who did not finish high school or obtain a GED were less successful in the labor market than those who received a high school credential. Wages for dropouts were lower on average and dropouts worked less than high school graduates and GED recipients. Among male dropouts, job instability contributed to low average employment rates; for female dropouts, both job instability and longer spells of unemployment contributed to low employment rates. Having children at study entry was not associated with poorer employment outcomes for males or females. However, young men who had arrest records faced substantial challenges in finding jobs and were more likely to work in lower quality jobs in the retail or service industries than those without arrest records.","the Center for Employment Training (CET) Replication","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2005,http://www.mdrc.org/sites/default/files/full_24.pdf,"Opportunities for Youth Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Riverside, CA – Work Plus]","Bloom, D., Hendra, R., Martinson, K. & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Riverside, CA – Work Plus]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the effectiveness of a Riverside, California, program to increase the earnings of welfare recipients after one year. The Riverside Phase 2 site was one of two in Riverside that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,912 employed single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups (Work Plus or Training Focused) that received different ERA services, or to a control group (Work Focused) that received standard public benefits and some limited case management. This review compared the Work Plus program and the control group. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study found that those in the Work Plus group were 5 percentage points more likely to receive Food Stamps in the year after random assignment than those in the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Riverside Work Plus program and not to other factors.","the Employment Retention and Advancement (ERA) Project—Work Plus (Phase 2), Riverside","Other employment and reemployment","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The effects of welfare-to-work program activities on labor marker outcomes","Dyke, A., Heinrich, C., Mueser, P., & Troske, K. (2005). The effects of welfare-to-work program activities on labor marker outcomes. Institute for Research on Poverty, 1295(5). [Missouri]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of Missouri’s welfare-to-work program training activities on the quarterly earnings of women ages 18 to 65 years in single-parent households who were cash recipients of Temporary Assistance for Needy Families (TANF). Using data from the state’s administrative records and unemployment insurance program, the authors compared the quarterly earnings of women who took part in the training activities with those who enrolled in the welfare-to-work program but never took part in any of the training. The study found that those taking part in the training activities experienced an initial (quarter 1) reduction in their quarterly earnings, compared with those who did not take part in the training activities. However, both cumulative (based on all 16 quarters of follow-up) and average (based on quarters 11 to 15) quarterly earnings increased for those who took part in the training activities compared with those who did not. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the welfare-to-work program training activities, but other factors might also have contributed.","the Welfare-to-Work Program","Job search assistance and supportive services","Female, Low income, Parent",,"United States",2005,http://repec.iza.org/dp1520.pdf,"Employment and Training Review Protocol" "Evaluation of the Welfare to Work Voucher program: Report to Congress","Patterson, R., Wood, M., Lam, K., Patrabansh, S., Mills, G., Sullivan, S., . . . Zandniapour, L. (2004). Evaluation of the Welfare to Work Voucher program: Report to Congress. Washington, DC: U.S. Department of Housing and Urban Development.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Welfare-to-Work housing voucher on employment, earnings, and public benefit receipt. The authors allocated the available vouchers by lottery to eligible families who were willing to participate in the study. Using Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), and housing assistance administrative data, as well as baseline and follow-up surveys, the authors compared the outcomes of those randomly assigned to receive a voucher to outcomes of those who were not, adjusting for chance pre-intervention differences between the groups. The authors found that the Welfare-to-Work vouchers reduced the total number of quarters employed in the first five quarters after random assignment by 0.165 quarters, on average. In the first five quarters, the program reduced total earnings by $325, on average. At the same time, the voucher program decreased the average likelihood of receiving TANF by 1.8 percentage points. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Welfare-to-Work Voucher program and not to other factors.","the Welfare-to-Work Voucher Program","Unemployment Insurance","Low income",,"United States",2004,https://www.huduser.gov/portal/publications/pdf/welfrwrkVchrPrg.pdf,"Employment and Training Review Protocol" "Enriching summer work: An evaluation of the Summer Career Exploration Program.","McClanahan, W., Sipe, C., & Smith, T. (2004). Enriching summer work: An evaluation of the Summer Career Exploration Program. Philadelphia, PA: Public/Private Ventures.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The evaluation’s objective was to examine the effects of the Summer Career Exploration Program (SCEP) on short-term earnings, employment, and other outcomes. SCEP offers youth job-related counseling, places them in career-related jobs, and supports them through mentoring. The report also describes program implementation and ways of improving SCEP. The program’s effectiveness was evaluated using a randomized control ed trial.  The study found statistically significant, positive impacts of SCEP on participants’ employment and earnings over the summer that the evaluation occurred; however, these were not sustained over the one-year follow-up period.  The quality of the causal evidence presented in this study is high for most outcomes and moderate for the remaining outcomes examined. For the outcomes with high causal evidence, this means we are confident that the estimated impacts are attributable to SCEP, and not other factors. For those with moderate causal evidence, other factors besides SCEP might have contributed to the estimated effects.","Summer Career Exploration Program","Basic skills Job search assistance and supportive services Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2004,http://www.cityofmadison.com/dpced/communitydevelopment/funding/documents/AreaI…,"Opportunities for Youth Review Protocol" "Life after YouthBuild: 900 YouthBuild graduates reflect on their lives, dreams, and experiences","Hahn, A., Leavitt, T., Horvat, E., & Davis, J. (2004). Life after YouthBuild: 900 YouthBuild graduates reflect on their lives, dreams, and experiences. Somerville, MA: Brandeis University Heller School for Social Policy and Management and Temple University College of Education.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report summarizes YouthBuild participants’ experiences after program completion. YouthBuild was founded in 1991 and offers academic instruction and construction training to economically disadvantaged youth who use those skills to build affordable housing for low-income households. The authors collected information on what students go on to do after YouthBuild by conducting in-depth interviews with 57 graduates and a detailed survey of 882 graduates. YouthBuild graduates who were interviewed had a very positive view of the program; they appreciated that staff set high expectations for them while acting as their substitute families and providing a caring environment. They also enjoyed the construction work, which enabled them to see tangible results of their efforts. Many expressed the need for additional career- or education-related programming after the period of full-time participation in YouthBuild. Seventy-five percent of the graduates who were surveyed were either working or engaged in postsecondary studies at the time of the survey, and similar percentages were free of government support and participating in at least one community activity. Like the interview findings, many survey respondents expressed a need for further career- or education-related programming.",Youthbuild,"Youth programs Other training and education Work based and other occupational training","Youth, Low income",Construction,"United States",2004,,"Opportunities for Youth Review Protocol" "Family Independence Initiative (FII): Follow-up study final report","Tao, F., & Alamprese, J. A. (2003). Family Independence Initiative (FII): Follow-up study final report. Retrieved from http://abtassociates.com/reports/2003/family-independence-initiative-%28fii%29-follow-up-stu.aspx.","Literacy, Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Family Independence Initiative (FII) on education, earnings, employment, and public benefit receipt outcomes of low-income adults. The authors used a pre-post study design to compare outcomes before and after participating in a work-focused family literacy program. The study found that program participation was associated with increased employment, earnings, and receipt of a high school diploma or GED, and a reduction in government cash assistance. However, the study did not include tests of statistical significance. The quality of causal evidence presented in this report is low because the authors did not observe outcomes for multiple periods before and after the intervention. This means we are not confident that the estimated effects are attributable to the Family Independence Initiative; other factors are likely to have contributed.","the Family Independence Initiative","Basic skills Other training and education","Adult, Low income",,"United States",2003,http://abtassociates.com/reports/2003/family-independence-initiative-%28fii%29-…,"Literacy, Low-Income Adults Review Protocol" "Evaluation of the Youthbuild Program.","Mitchell, M., Jenkins, D., Nguyen, D., Lerman, A., & DeBerry, M. (2003). Evaluation of the Youthbuild Program. Report submitted to U.S. Department of Housing and Urban Development, Office of Policy Research and Development Division. Chicago: The Counselors of Real Estate.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report presents an implementation analysis of the Youthbuild program. The program provided hands-on construction training, educational experiences, leadership training, and counseling and other support to youth ages 16 to 24 who had very low incomes (or resided in very low-income households) and had dropped out of high school. The study examined Youthbuild programs in 20 sites, focusing on program design, grantees’ characteristics, changes in program participants’ outcomes, and costs of operation. The study used program documentation, staff interviews, site visits, participant interviews, and a literature review of other workforce development programs targeting at-risk youth. The program was successful in enrolling and graduating more participants, and working on more housing units, than planned. More participants held jobs and a high school diploma or general equivalency degree (GED) at program exit than entry. However, many grantees faced implementation challenges. The authors noted that study results should not be interpreted as generalizable to all Youthbuild program sites because studied sites were only those that received a second round of funding.",Youthbuild,"Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2003,http://www.huduser.org/Publications/PDF/YouthBuild.pdf,"Opportunities for Youth Review Protocol" "Working with disadvantaged youth: Thirty-month findings from the evaluation of the Center for Employment Training replication sites","Miller, C., Bos, J., Porter, K., Tseng, M., Doolittle, F., Tanguage, D., & Vencill, M. (2003). Working with disadvantaged youth: Thirty-month findings from the evaluation of the Center for Employment Training replication sites. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This report’s objective was to examine the effectiveness of the Center for Employment Training (CET) model. Under this model, local employers helped to design training programs and provide them in a work-like environment to economically disadvantaged youth who were not in school or employed. The effectiveness of the CET model in improving employment, earnings, and participation in education and training programs was evaluated using a randomized controlled trial (RCT) conducted in 12 sites in seven states. The study found few statistically significant impacts on outcomes measured over a 30-month follow-up period. The quality of causal evidence presented in this report is high because it was based on a well-implemented RCT. This means we are confident that any estimated effects would be attributable to the CET program and not to other factors. However, the study did not generally find statistically significant effects.","the Center for Employment Training (CET) Replication","Other employment and reemployment Other training and education Youth programs","Youth, Low-skilled, Low income",,"United States",2003,https://www.doleta.gov/reports/searcheta/occ/papers/cet_full_report.pdf,"Opportunities for Youth Review Protocol" "New Hope for families and children: Five-year results of a program to reduce poverty and reform welfare.","Huston, A., Miller, C., Richburg-Hayes, C., Duncan, G., Eldred, C., Weisner, T., Lowe, T., McLoyd, V., Crosby, D., Ripke, M., & Redcross, C., (2003). New Hope for families and children: Five-year results of a program to reduce poverty and reform welfare. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the New Hope program on employment, earnings, and public benefit receipt. The authors estimated the impact of the New Hope program by comparing average outcomes among a treatment group randomly selected to have access to the program with those of a randomly selected control group that did not have access to the program. The study found that receiving access to New Hope services increased average earnings as determined through unemployment insurance data during the first year of the program by $1,088 and the average likelihood of ever being employed during the first year of the program by 8.2 percentage points. The authors also found that the program increased the likelihood of treatment group members reporting being employed in 12 consecutive quarters of the five years after the program began by 6.9 percentage points, on average. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Hope program, and not to other factors.","The New Hope Program","Health insurance Other employment and reemployment","Low income",,"United States",2003,http://www.mdrc.org/sites/default/files/full_457.pdf,"Employment and Training Review Protocol" "National Job Corps Study: Findings using administrative earnings records data","Schochet, P., McConnell, S., & Burghardt, J. (2003). National Job Corps Study: Findings using administrative earnings records data. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Training-Mod/high-No impacts Training","Summary: The study’s objective was to estimate the impact on long-term earnings and employment of the Job Corps program, which offers intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. The program’s effectiveness was evaluated using a randomized controlled trial conducted in 48 states and the District of Columbia. The study found statistically significant, positive impacts of Job Corps on participants’ earnings within the first three years and employment within the first four years of follow-up, but no impacts of Job Corps on these outcomes in the fifth and sixth years. The quality of the causal evidence presented in this study is high. This means we are confident that the Job Corps program—not other factors—caused the estimated impacts. ","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2003,http://www.mathematica-mpr.com/publications/pdfs/jobcorpsadmin.pdf,"Opportunities for Youth Review Protocol" "College as a job advancement strategy: An interim report on the New Visions Self-Sufficiency and Lifelong Learning Project","Fein, D., Beecroft, E., Long, D., & Robertson A. (2003). College as a job advancement strategy: An interim report on the New Visions Self-Sufficiency and Lifelong Learning Project. Cambridge, MA: Abt Associates Inc.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Riverside Community College’s New Visions Self-Sufficiency and Lifelong Learning Project on welfare recipients’ employment, earnings, and welfare receipt. The study is based on a randomized controlled trial and estimated the effect of offering welfare recipients the New Visions program by using California and community college administrative data to compare average outcomes among those offered access to the program to the average outcomes of those excluded, after adjusting for differences between the groups. The authors found that access to the New Visions program increased the average number of quarters during which participants received Temporary Assistance for Needy Families (TANF) benefits and increased the average amount of TANF benefits received in the first two years. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Visions program, and not to other factors.","the New Visions Self-Sufficiency and Lifelong Learning Project","Community college education and other classroom training Other employment and reemployment","Low income, Parent",,"United States",2003,,"Employment and Training Review Protocol" "The heterogeneous impact of conditional cash transfers","Galiani, S., & McEwan, P. J. (2013). The heterogeneous impact of conditional cash transfers. Journal of Public Economics, 103, 85-96. doi:10.1016/j.jpubeco.2013.04.004","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Honduran Programa de Asignación Familiar (PRAF-II) conditional cash transfer program on child labor and school enrollment. The authors used census data from a randomized sample of municipalities to compare the outcomes of children who received the conditional cash transfer to those who did not. The authors used statistical models to estimate program effects. The study found a significant relationship between the PRAF-II and child labor, with work outside the home decreasing by 3 percentage points and work inside the home decreasing by 4 percentage points. Program participation was also significantly related to an 8-percentage point increase in school enrollment. The quality of causal evidence presented in this report is low because it is a randomized controlled trial with unknown attrition and the authors did not account for preexisting differences between the groups before program participation. This means we are not confident that the estimated effects are attributable to the Programa de Asignación Familiar; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2003,https://doi.org/10.1016/j.jpubeco.2013.04.004,"Child Labor Review Protocol" "Improving basic skills: The effects of adult education in welfare-to-work programs","Bos, J. M., Scrivener, S., Snipes, J., Hamilton, G., Schwartz, C., & Walter, J. (2002). Improving basic skills: The effects of adult education in welfare-to-work programs. New York: Manpower Demonstration Research Corporation.","Literacy, Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of both education- and employment-focused welfare-to-work programs on earnings and public benefit receipt. The study was a randomized controlled trial conducted in seven geographic areas. The authors randomly assigned welfare recipients to the treatment condition (an education-focused intervention or an employment-focused intervention) or the control group. The study sample included a subset of welfare recipients who lacked a high school diploma or GED. The study found that participation in the welfare-to-work programs significantly increased earnings and reduced public benefit receipt and that participation in the employment-focused programs had a greater impact on earnings. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with unknown attrition, and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the effects are attributable the education-focused or employment-focused interventions; other factors are likely to have contributed.","the Education-Focused and Employment-Focused Interventions","Basic skills Other training and education","Adult, Low income",,"United States",2002,https://www.govinfo.gov/content/pkg/ERIC-ED464267/pdf/ERIC-ED464267.pdf,"Literacy, Low-Income Adults Review Protocol" "The benefits and costs of Job Corps","McConnell, S., & Glazerman, S. (2001). The benefits and costs of Job Corps. Mathematica Policy Research: Washington, DC.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to determine whether the benefits of Job Corps exceeded its costs. The authors used data on impacts from the National Job Corps Study to estimate the program’s benefits and administrative data from the Office of Job Corps to estimate the program’s costs. The study found that the benefits of Job Corps to society exceeded its costs by almost $17,000 per participant. This included positive benefits of about $20,000 to participants and negative benefits of about $3,000 to the rest of society.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2001,http://www.mathematica-mpr.com/~/media/publications/PDFs/01-jcbenefit.pdf,"Opportunities for Youth Review Protocol" "National Job Corps Study: Impacts by center characteristics.","Burghardt, J. & Schochet, P. (2001). National Job Corps Study: Impacts by center characteristics. Princeton, NJ: Mathematica Policy Research, Inc.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: The National Job Corps Study produced several reports, including a main impact report (see CLEAR profile of Schochet et al. 2001 ) that found positive impacts of Job Corps—a national vocationally focused education and training program for disadvantaged youth ages 16 to 24—on participants’ employment, earnings, and education and training outcomes measured after four years. In this report, the authors examined whether these impacts were related to center characteristics, including the type of center operator, capacity of the center, region of the country, and performance ranking. The authors used data collected as part of the National Job Corps Study, which consisted of 9,400 program participants and 6,000 nonparticipants randomly selected from 81,000 first-time Job Corps applicants nationwide. Data included Job Corps center characteristics and student outcomes in the areas of educational services and attainment, earnings, and arrests. The authors used Job Corps counselors’ predictions of which Job Corps center applicants would attend before random assignment to compare outcomes of treatment youth with those of comparison youth who would have attended the same centers, had they been randomly assigned a slot in the program. The authors found few impacts that varied by center characteristics. The impacts of Job Corps were similar across operators; large, medium, and small centers; most regions of the United States; and across high-, medium-, and low-performing centers, as determined by the Job Corps performance measurement system.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2001,http://wdr.doleta.gov/opr/fulltext/01-jccenter.pdf,"Opportunities for Youth Review Protocol" "National Job Corps Study: Assessing program effects on earnings for students achieving key program milestones","Gritz, R. M., and Johnson, T. (2001). National Job Corps Study: Assessing program effects on earnings for students achieving key program milestones. Report Prepared for the U.S. Department of Labor, Employment and Training Administration.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to estimate the impact of Job Corps on the employment and earnings of participants who obtained a general education development (GED) certificate or vocational training certificate during the course of the program. Job Corps offers intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. Job Corps’ overall effectiveness was evaluated using a randomized controlled trial—the National Job Corps Study (NJCS)—conducted in 48 states and the District of Columbia (see the Clearinghouse for Labor Evaluation and Research [CLEAR] profile of Schochet et al. 20011 for full results). For this report, the authors used data from the NJCS 48-month follow-up survey to match Job Corps participants to control group members who had similar propensities to obtain a GED or vocational certificate. The study found that Jobs Corps participants who completed a vocational certificate during the course of the program earned $40 to $50 per week more than their control group counterparts, and those who completed a GED earned $60 to $70 per week more. The quality of causal evidence presented in this study is moderate, the highest possible rating for a nonexperimental study. This means that we have some confidence that the estimated impacts are attributable to achieving programmatic milestones in the Job Corps program, although other factors might also have contributed.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2001,http://wdr.doleta.gov/opr/fulltext/MilestoneImpactReport-Final.pdf,"Opportunities for Youth Review Protocol" "National Job Corps Study: The impacts of Job Corps on participants’ employment and related outcomes","Schochet, P., Burghardt, J., & Glazerman, S. (2001). National Job Corps Study: The impacts of Job Corps on participants’ employment and related outcomes. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Training-Mod/high-Favorable impacts Training","Summary: The National Job Corps Study included several reports, including this final impact report. The report’s objective was to examine the impact of the Job Corps program on participants’ long-term earnings, employment, and other outcomes. It also described the participants’ Job Corps experiences. Job Corps offers intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. Its effectiveness was evaluated using a randomized controlled trial conducted in 48 states and the District of Columbia. This report found statistically significant, positive impacts of Job Corps on participants’ employment, earnings, and education and training outcomes measured after four years. The quality of the causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the Job Corps program—not other factors—caused the estimated impacts.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2001,http://wdr.doleta.gov/research/FullText_Documents/01-jcimpacts.pdf,"Opportunities for Youth Review Protocol" "College as a job advancement strategy: An early report of the New Visions Self-Sufficiency and Lifelong Learning Project","Fein, D., Beecroft, E., Long, D., & Catalfamo, A. (2000). College as a job advancement strategy: An early report of the New Visions Self-Sufficiency and Lifelong Learning Project. Bethesda, MD: Abt Associates Inc.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of a pilot for Riverside Community College’s New Visions Self-Sufficiency and Lifelong Learning Project on welfare recipients’ welfare receipt. The study was based on a randomized controlled trial and estimated the effect of offering welfare recipients the New Visions program compared with encouraging recipients to participate in other employment services. The authors used California Temporary Assistance for Needy Families (TANF) records to compare average outcomes among those offered access to the program against the average outcomes of those excluded, after adjusting for differences in demographic and pre-intervention characteristics between the groups. The authors did not find any statistically significant effect of the New Visions program on the likelihood of receiving TANF or the amount of TANF benefits received. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Visions Project, and not to other factors.","the New Visions Self-Sufficiency and Lifelong Learning Project","Community college education and other classroom training Other employment and reemployment","Low income, Parent",,"United States",2000,http://files.eric.ed.gov/fulltext/ED466834.pdf,"Employment and Training Review Protocol" "Evaluation of the Center for Employment Training replication sites: Interim report.","Walsh, S., Goldsmith, D., Abe, Y., & Cann, A. (2000). Evaluation of the Center for Employment Training replication sites: Interim report. Oakland, CA: Berkeley Policy Associates.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report presents an implementation analysis of 12 Center for Employment Training (CET) replication sites. The Center for Employment Training (CET) model targets economically disadvantaged youth who are not in school or employed. It delivers training in a work-like environment, requires full-time participation, and involves local employers in program design and delivery. The analysis assessed the fidelity of implementation to the CET model using qualitative data collected during site visits to 12 sites and preliminary administrative data from 8 sites. The study found that all the replication sites were generally successful in structuring services to mirror the workplace. Sites operated by CET (8 of 12) had overall higher fidelity to the model than non-CET-operated sites. Additionally, the study suggested that organizational capacity and stability are critical to replication; the 7 replication sites led by less-experienced organizations were prone to upheavals, and 4 closed during the course of the evaluation.","the Center for Employment Training (CET) Replication","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2000,,"Opportunities for Youth Review Protocol" "Final report on the implementation and impacts of the Minnesota Family Investment Program in Ramsey County. [MFIP-R versus AFDC, single parents in the early cohort]","Auspos, P., Miller, C., & Hunter, J. A. (2000). Final report on the implementation and impacts of the Minnesota Family Investment Program in Ramsey County. Washington, DC: U.S. Department of Health and Human Services, Administration for Children and Families, Office of Planning, Research and Evaluation. [MFIP-R versus AFDC, single parents in the early cohort]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Minnesota Family Investment Program of Ramsey County (MFIP-R), a precursor to the national Temporary Assistance for Needy Families program, on participants’ employment, earnings, and benefit receipt. The authors used a randomized controlled trial design, assigning eligible families to either MFIP-R or existing services. Employment, earnings, and benefit receipt data were collected quarterly from Minnesota’s Unemployment Insurance earnings and public assistance benefit records. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, this CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because assignment to condition was not fully random, and the authors did not account for potential pre-existing differences in group characteristics in their analysis. This means we are not confident that the estimated effects are attributable to MFIP-R; other factors are likely to have contributed.","the Minnesota Family Investment Program of Ramsey County (MFIP-R)","Job search assistance and supportive services Other employment and reemployment","Low income, Parent",,"United States",2000,http://www.mdrc.org/sites/default/files/full_364.pdf,"Employment and Training Review Protocol" "Retention in the United States Job Corps: Analysis and recommendations.","Ginsburg, K. R., Forke, C.M., Kinsman, S.B., Fleegler, E., Grimes, E.K., et al. (2000). Retention in the United States Job Corps: Analysis and recommendations. Philadelphia, PA: The Children’s Hospital of Philadelphia.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to collect information to help Job Corps program and policy staff improve participant retention in the program. Job Corps offers intensive academic classroom instruction and vocational skills training, along with support services, to economically disadvantaged youth. The authors used information from the Job Corps database on the demographic and other characteristics of participants who dropped out to study the timing of and reasons for withdrawal from the program. They administered a survey to the centers with the highest and lowest retention rates, and they conducted focus groups, interviews with program staff and participants, and observations of service delivery at five Job Corps sites. The authors’ analysis of characteristics and survey responses found that students with certain characteristics—for example, older students, those who entered the program with more advanced educational attainment, and those who interacted more closely with admissions counselors at Job Corps centers—were more likely to remain in the program. However, the authors noted that these were not highly reliable predictors of whether a student would remain in the program, suggesting unobserved factors played a role as well. The qualitative analysis of focus groups, interviews, and observations indicated that the students’ motivation, emotional maturity, and interpersonal skills and the strength of the relationships between participants and staff were important determinants of retention. Based on these findings, the authors recommended launching a staff training initiative to ensure staff were prepared to communicate effectively with students, challenge them, and build their sense of connectedness with one another and the program.","Job Corps","Job search assistance and supportive services Youth programs Other training and education Work based and other occupational training","Youth, Low-skilled, Low income",,"United States",2000,http://wdr.doleta.gov/research/FullText_Documents/00-jobcorps.pdf,"Opportunities for Youth Review Protocol" "National Job Corps Study: Job Corps applicants’ programmatic experiences","Johnson, T., Gritz, M., & Dugan, M. (2000). National Job Corps Study: Job Corps applicants’ programmatic experiences. Seattle, WA: Battelle Memorial Institute.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report built on the process and descriptive analyses of the National Job Corps Study to understand which Job Corps program features led to positive results for applicants and participants. Job Corps offers intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. The authors investigated programs’ enrollment procedures, characteristics of the Job Corps centers, and program practices to identify those that seemed to be related to positive programmatic experiences for participants. The authors used data from the program’s management information system, the Bureau of Labor Statistics, and surveys of program staff. The study found that students who had admissions counselors who put the onus on them to complete the admissions process, attended smaller centers in rural areas, and had access to high quality vocational training and academic instruction were more likely to have positive programmatic outcomes than those that did not. The extent to which staff and student populations had a similar racial make-up and gender composition, and the types and variety of vocational training offered, did not appear to influence programmatic outcomes.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2000,http://wdr.doleta.gov/research/FullText_Documents/00-jc_programmatic.pdf,"Opportunities for Youth Review Protocol" "New Hope for people with low incomes: Two-year results of a program to reduce poverty and reform welfare","Bos, J., Huston, A., Granger, R., Duncan, G., Brock, T., & McLoyd, V. (1999). New Hope for people with low incomes: Two-year results of a program to reduce poverty and reform welfare. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the New Hope program on employment, earnings, public benefits receipt, and educational attainment. The authors estimated the impact of the New Hope program by comparing average outcomes among a treatment group randomly selected to have access to the program with those of a randomly selected control group that did not have access to the program. The study found that receiving access to New Hope services increased average earnings in the first year of the program by $583 and the average likelihood of ever being employed in the first and second year of the program by 7.8 percentage points and 5.5 percentage points, respectively. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Hope program, and not to other factors.","The New Hope Program","Other employment and reemployment Other training and education","Low income, Parent",,"United States",1999,http://files.eric.ed.gov/fulltext/ED433455.pdf,"Employment and Training Review Protocol" "The employment and training outcomes of a job training partnership act program in a community college setting","Carter, D. L. (1999). The employment and training outcomes of a job training partnership act program in a community college setting (Unpublished doctoral dissertation). University of Florida.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The study's objective was to examine the impact of a Job Training Partnership Act (JTPA) funded vocational training program at a community college in North Florida on earnings outcomes. The author used an interrupted time series design to compare outcomes of participants before and after they participated in the JTPA program. Data for the study were compiled from the community college's existing JTPA records. The study found that participation in JTPA funded training was significantly related to higher post-training wages. The quality of causal evidence presented in this report is low because the author did not observe outcomes for multiple periods before or after the program nor account for selection into the intervention. This means we are not confident that the estimated effects are attributable to the JTPA funded vocational training program; other factors are likely to have contributed.","Job Training Partnership Act","Employment and Training Services Training and Education Basic skills Capacity building programs Community college education and other classroom training","Youth, Adult, Other barriers, Dislocated or displaced worker, Low income",,"Rural, United States",1999,,"Community College Review Protocol" "National Job Corps Study: Report on study implementation.","Burghardt, J., McConnell, S., Meckstroth, A., Schochet, P., Johnson, T., & Homrighausen, J. (1999). National Job Corps Study: Report on study implementation. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report describes the implementation of and lessons learned from the National Job Corps Study, a random assignment impact evaluation of Job Corps. Job Corps provides comprehensive job training to disadvantaged youth in the areas of basic education, vocational skills training, health care and education, counseling, and residential support. The authors conducted a qualitative analysis of planning and process documents for the study, as well as accounts of study team members’ first-hand experiences. The authors described the study design, sampling procedures, how they monitored sample build-up and decided when to end random assignment, and how they monitored adherence to the study’s random assignment procedures. They noted three key factors important for successful implementation of a randomized study design in an ongoing program: (1) commitment of program managers to the goals of the study and its related tasks, (2) close collaboration between research and program staff, and (3) monitoring of study procedures to ensure integrity.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",1999,http://wdr.doleta.gov/research/FullText_Documents/99-jc_implement.pdf,"Opportunities for Youth Review Protocol" "National Job Corps Study: Report on the Process Analysis","Johnson, T., Gritz, M., Jackson, R., Burghardt, J., Boussy, C., Leonard, J., & Orians, C. (1999). National Job Corps Study: Report on the Process Analysis. Submitted to the U.S. Department of Labor, Employment and Training Administration, Office of Policy and Research. Seattle: Battelle Human Affairs Research.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report presents a process study of the national Job Corps program. Initiated in 1964, Job Corps provides comprehensive education and employment skills training to disadvantaged youth ages 16 to 24. The study drew on survey, administrative, and qualitative data to present students’ and Job Corps centers’ characteristics across the full population of participating students and centers in 1996; sampling for site visits excluded noncontiguous states. This study was part of the National Job Corps Study that also included an impact evaluation and a benefit-cost analysis. Job Corps united federal agencies, private contractors, and unions in implementing a training and support model for disadvantaged youth. Job Corps centers generally implemented core service components with consistency. Links between outreach and admissions counselors to Job Corps centers, and job placement services, proved challenging. Findings are generally applicable to program implementation nationally; however, the study did not measure outputs such as content or quality of services, participation, or dosage.","the Job Corps Program","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",1999,http://wdr.doleta.gov/opr/FULLTEXT/99-jc_analysis.pdf,"Opportunities for Youth Review Protocol" "National Job Corps Study: Characteristics of youths served by Job Corps.","Schochet, P. (1998). National Job Corps Study: Characteristics of youths served by Job Corps. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: One of a series of reports emanating from the National Job Corps Study, a random assignment evaluation of the Job Corps program, this report describes the characteristics of eligible Job Corps applicants and compares them with the broader national population of disadvantaged youth. The Job Corps program offers intensive academic classroom instruction and vocational skills training, along with support services, to economically disadvantaged youth. The authors examined data collected as part of the National Job Corps Study on the characteristics of eligible youth. The study collected data through an interview at the time of random assignment and through surveys administered 12, 30 and 48 months after it. The findings in this report are based on the data collected through baseline interviews. The authors reported that, as intended, Job Corps served disadvantaged youth, most of whom had not completed high school (about 80 percent). Eligible applicants tended to be male (about 60 percent) and members of racial or ethnic minority groups (about 70 percent; 50 percent African American). More than a quarter of applicants had been arrested before applying to Job Corps. Female applicants tended to be older, more likely to have children and to have completed high school, and less likely to admit drug use or arrests than male applicants. Compared with the broader national population of disadvantaged youth, eligible Job Corps applicants were more likely to be 16- or 17-year-old African American males from large urban areas who were high school dropouts.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",1998,http://wdr.doleta.gov/opr/fulltext/99-jc_characteristics.pdf,"Opportunities for Youth Review Protocol" "Matching the disadvantaged to job opportunities: Structural explanations for the past successes of the Center for Employment Training.","Melendez, E., & Harrison, B. (1998). Matching the disadvantaged to job opportunities: Structural explanations for the past successes of the Center for Employment Training. Economic Development Quarterly, 12(1), 3-11.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: The authors’ objective was to propose a plausible explanation for the Center for Employment Training-San Jose’s (CET) success in placing disadvantaged people into jobs. CET is a national program that provides job training for disadvantaged people and matches them with entry-level jobs. The San Jose site, the focus of this article, served a mostly Hispanic population, consisting of dislocated farm workers, mothers on public assistance, out-of-school youth, and ex-offenders. The authors reviewed findings from a recent case study on CET-San Jose and posited explanations for the program’s success. They attributed the success of the program to its ability to develop in its participants the skills necessary in the local labor market and become part of employers’ trusted recruiting networks. They also noted that CET-San Jose is embedded in a powerful social movement (West Coast Hispanic politics and culture).","the Center for Employment Training (CET) Replication","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Hispanic of any race, Low-skilled, Low income",,"United States",1998,,"Opportunities for Youth Review Protocol" "Youth Corps: Promising strategies for young people and their communities","Jastrzab, J., Blomquist, J., Masker, J., & Orr, L. (1997). Youth Corps: Promising strategies for young people and their communities. Cambridge, MA: Abt Associates Inc.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report provides a high-level summary of a study on Youth Corps programs, which have engaged disadvantaged youth in community service projects since 1933. An in-depth impact analysis is contained in Jastrzab et al. 1996. The study’s objective was to gain insight into participants’ contributions and experiences; analyze program impacts on educational, employment, and behavioral outcomes; and assess the costs and benefits of the programs. The authors analyzed data on initiatives sponsored by the Commission on National and Community Service in 1993 and 1994, and during that time also collected data directly from Youth Corps programs for the impact analysis and cost-benefit assessment. In addition, the authors talked with several program staff and participants. The study found that although program completion rates were low, most participants felt the program was helpful and sponsors and beneficiaries were generally satisfied with youths’ performance. The program had a significant impact on the employment and earnings of corps members. The analysis of program costs and benefits showed aggregate benefits to society.","Youth Corps Programs","Mentoring Youth programs","Youth, Disconnected youth, Low-skilled, Low income",,"United States",1997,http://www.abtassociates.com/reports/Youth-Corps.pdf,"Opportunities for Youth Review Protocol" "The study of the replication of the CET job training model.","Hershey, A., & Rosenberg, L. (1994). The study of the replication of the CET job training model. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: The Center for Employment Training (CET) was shown by rigorous research conducted in the 1980s to increase the earnings and employment prospects of disadvantaged youth. The U.S. Department of Labor (DOL) commissioned a study to determine whether other organizations could replicate the CET model. This study reported on early efforts by 10 replication sites to implement the key features of the CET job training model. DOL later commissioned an impact evaluation of CET replication sites, including some sites examined in this study (see CLEAR profile of Miller et al. 2005). The CET model provides individualized, intensive, full-time job training. Its focus is on integrating basic and technical skills with job placement as the final goal. CET’s advisory board and instructors are well connected to industry and help to ensure that the skills taught in the program align with those desired by employers. The authors conducted telephone interviews with staff from the CET main office in San Jose, California, telephone interviews with key staff and project directors of the 10 replication sites, and site visits to 5 of the 10 sites. The authors noted that the replication sites faced considerable challenges initiating the program, including finding a suitable space and ensuring consistent funding. When the programs began offering services, the authors reported some deviations from the CET model. In particular, they found that some sites used a screening process, rather than allowing open access to training, as specified by the CET model; some sites used whole group rather than individualized instruction; some did not integrate basic skills and technical skills training; some had not formed an advisory board to provide labor market analysis and guidance for needed training areas; and most were not placing participants into jobs at the completion of training.","the Center for Employment Training (CET) Replication","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",1994,,"Opportunities for Youth Review Protocol" "JOBSTART: Final report on a program for school dropouts.","Cave, G., Bos, H., Doolittle, F. & Toussaint, C. (1993). JOBSTART: Final report on a program for school dropouts. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the JOBSTART program on employment, earnings, and education and training outcomes over a four-year follow-up period. About 2,300 youth were randomly assigned to either the treatment group, which was eligible to participate in JOBSTART, or the control group, which could not participate in JOBSTART but could access other services in the community. The authors compared the outcomes of the treatment and control groups using data collected through follow-up surveys 12, 24, and 48 months after random assignment. The study found that, 48 months after random assignment, members of the treatment group were significantly more likely to have participated in education or training, and completed significantly more hours of it, compared with the control group. The treatment group was significantly less likely to be employed and earned significantly less than the control group in the first year after random assignment. There were no significant impacts on earnings or employment outcomes in later follow-up years. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the JOBSTART program, and not to other factors.","the JOBSTART Program","Basic skills Job search assistance and supportive services Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",1993,http://www.mdrc.org/sites/default/files/full_416.pdf,"Opportunities for Youth Review Protocol" "Impacts of transitional employment for mentally retarded young adults: Results of the STETS demonstration","Kerachsky, S., Thornton, C., Bloomenthal, A., Maynard, R. & Stephens, S. (1985). Impacts of transitional employment for mentally retarded young adults: Results of the STETS demonstration. New York: Manpower Demonstration Research Corporation.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Structured Training and Employment Transitional Services (STETS) program on employment rates, earnings, and Social Security Disability Income (SSDI) and Supplemental Security Income (SSI) receipt. The STETS program included a suite of work-readiness training, transitional jobs, and postplacement support services for young adults with intellectual disabilities. The study was a randomized controlled trial that randomly assigned young adults to the treatment group, which could participate in the STETS program, or to the control group, which could not. The study drew on data from in-person interviews conducted 6, 15, and 22 months after the start of the program. The study found that young adults in the treatment group were employed at significantly higher rates and, on average, earned more than the control group 15 and 22 months after the program began. The study also found that 15 months after random assignment, the young adults in the treatment group were significantly less likely than those in the control group to receive SSI or SSDI benefits. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the STETS program, and not to other factors.","Structured Training and Employment Transitional Services","Job search assistance and supportive services Other employment and reemployment","Disability, Low income",,"United States",1985,http://www.mdrc.org/sites/default/files/impacts_of_transitional_employment_fr.p…,"Employment and Training Review Protocol"