Title,Citation,Topic_area,Study_type,Study_evidence_rating,Outcome_effectiveness,Findings,Intervention_program,Topics,Target_population,Firm_characteristics,Geographic_setting,Original_publication_date,Original_publication_link,"Review Protocol"
"Encouraging evidence on a sector-focused advancement strategy","Hendra, R., Greenberg, D. H., Hamilton, G., Oppenheim, A. Pennington, A. Schaberg, K., and Tessler, B. L. (2016). Encouraging evidence on a sector-focused advancement strategy. New York: MDRC. [Towards Employment]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Mod/high-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Mod/high-No impacts
      
    
  
              


      
            Employment","Summary:

	The study’s objective was to examine the impact of the WorkAdvance sectoral training program at the Towards Employment site on employment, earnings, education, and training from 2011 to 2015. The authors investigated similar research questions with three other sites, the profiles of which are available here.
	The study used a randomized controlled trial design to compare the treatment group, which was able to access the WorkAdvance program at the Towards Employment site, and the control group, which was not eligible for WorkAdvance services but could access other services in the community. The authors collected data from two sources: a follow-up survey and unemployment insurance (UI) wage and employment data.
	Using survey data, the authors found that those in the treatment group were significantly more likely to complete education or training compared with those in the control group. The authors found no statistically significant impacts of the program on employment or earnings from either the UI data or survey data.
	The quality of the causal evidence is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the WorkAdvance program at the Towards Employment site and not to other factors.","the WorkAdvance sectoral training program","Work based and other occupational training","Low income",,"Urban, United States",2020,https://files.eric.ed.gov/fulltext/ED568395.pdf,"Employment and Training Review Protocol"
"Information technology career preparation for rural areas.","Hahs-Vaughn, D. L., Swan, B., & Clark, M. H. (2019). Information technology career preparation for rural areas. Community College Journal of Research and Practice, 1-13.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the Florida Information Technology Careers for Rural Areas (XCEL-IT) program on education, employment, and earnings outcomes.
The authors used a nonexperimental design to compare the differences in outcomes between XCEL-IT program participants and a comparison group.
The study found that XCEL-IT program participation was significantly related to program completion.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the XCEL-IT program; other factors are likely to have contributed.","the Florida Information Technology Careers for Rural Areas (XCEL-IT)","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Unemployed, Veteran or military",,"Rural, United States",2019,,"Community College Review Protocol"
"WIOA impacts on community college student success (Doctoral dissertation).","Crumpton, J. A. (2019). WIOA impacts on community college student success (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 13861007).","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the impact of a workforce development program administered by a community college under the Workforce Innovation and Opportunity Act (WIOA) on education outcomes. This summary focuses on the comparison between the community college WIOA program participants and the state workforce WIOA program participants.
The author used a nonexperimental design to compare WIOA program student education outcomes (measured by degree or certificate attainment) to the outcomes of participants in WIOA programs administered by entities other than community colleges (throughout the state). Data from the community college and the State Board for Workforce Development were used to examine education success rates over the course of three years (2014-2017).
The study found that WIOA program participants were significantly more likely to attain a degree or certificate than participants who entered the WIOA program through a state workforce development board.
The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the WIOA program; other factors are likely to have contributed","Workforce Innovation and Opportunity Act (WIOA) program","Basic skills Capacity building programs Community college education and other classroom training Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Adult, Low income",,"Rural, United States",2019,https://search.proquest.com/openview/f270d29734cd670349c3aed2866ce41a/1?pq-orig…,"Community College Review Protocol"
"WIOA impacts on community college student success (Doctoral dissertation).","Crumpton, J. A. (2019). WIOA impacts on community college student success (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 13861007).","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the impact of a workforce development program administered by a community college under the Workforce Innovation and Opportunity Act (WIOA) on education outcomes. This summary focuses on the comparison between WIOA program participants and non-participants. 
The author used a nonexperimental design to compare WIOA program student education outcomes (measured by degree or certificate attainment) to the outcomes of students with similar backgrounds (Pell Grant recipients) who were not enrolled in WIOA. Data from the community college were used to examine education success rates over the course of three years (2014-2017).
The study found that WIOA program participants were significantly more likely to attain a degree or certificate than students who were not enrolled in the WIOA program.
The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the WIOA Program; other factors are likely to have contributed","Workforce Innovation and Opportunity Act (WIOA) program","Basic skills Capacity building programs Community college education and other classroom training Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Adult, Low income",,"Rural, United States",2019,https://search.proquest.com/openview/f270d29734cd670349c3aed2866ce41a/1?pq-orig…,"Community College Review Protocol"
"Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program","Glosser, A., Barden, B., Williams, S., Anderson, C. (2016). Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program. (OPRE Report 2016-77). Washington, DC: Office of Planning, Research, and Evaluation. [Contrast 3: Paid work experience versus on-the-job training]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Mod/high-No impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-Favorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:

	The study’s objective was to examine the impact of paid work experience, part of Los Angeles’ Subsidized and Transitional Employment Demonstration, on employment, earnings, and public benefit receipt relative to on-the-job training. The authors also investigated related impacts, the profiles of which are available [here].
	The authors used regression methods in a randomized controlled trial study to examine the impacts of participating in paid work experience. The data sources included administrative wage records, subsidized employment payroll records, Temporary Assistance for Needy Families (TANF) benefit payment records, and survey data.
	The study found that paid work experience had positive, statistically significant impacts on employment, earnings, and benefit receipt compared with on-the-job training.
	The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the paid work experience program and not to other factors.","Los Angeles’ Subsidized and Transitional Employment Demonstration","Adult and Dislocated Worker programs Job search assistance and supportive services Other training and education","Low income",,"Urban, United States",2016,https://www.mdrc.org/publication/testing-two-subsidized-employment-approaches-r…,"Employment and Training Review Protocol"
"Encouraging evidence on a sector-focused advancement strategy","Hendra, R., Greenberg, D. H., Hamilton, G., Oppenheim, A. Pennington, A. Schaberg, K., and Tessler, B. L. (2016). Encouraging evidence on a sector-focused advancement strategy. New York: MDRC. [Per Scholas]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Mod/high-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

	The study’s objective was to examine the impact of the WorkAdvance sectoral training program at the Per Scholas site on employment, earnings, and education and training from 2011 to 2015. The authors investigated similar research questions with three other sites, the profiles of which are available here.
	The study used a randomized controlled trial design to compare the treatment group, which was able to access the WorkAdvance program at the Per Scholas site, and the control group, which was not eligible for WorkAdvance services but could access other services in the community. The authors collected data from two sources: a follow-up survey and unemployment insurance (UI) wage and employment data.
	The study found that the program had a statistically significant impact on quarterly earnings in the second and third years after random assignment (based on UI data) and average weekly earnings in the second year after random assignment (based on survey data). The study also found that the program did not have a significant impact on most employment outcomes. Using survey data, the authors found that members of the WorkAdvance group were significantly more likely to have obtained a degree or credential and to have completed a skills training program two years after random assignment.
	The quality of the causal evidence is moderate for employment and earnings outcomes based on UI data because those outcomes were based on a randomized controlled trial in which the authors did not demonstrate that they accounted for change in the probability of random assignment, but the authors did account for existing differences between the treatment and control groups. The quality of the causal evidence is moderate for education and training outcomes from the follow-up survey because those outcomes were based on a randomized controlled trial in which many people did not complete the follow-up survey, but the authors did account for existing differences between the treatment and control groups. This means we are somewhat confident that the estimated effects are attributable to the WorkAdvance program at the Per Scholas site, but other factors might also have contributed.","the WorkAdvance sectoral training program","Work based and other occupational training","STEM professional, Low income",,"Urban, United States",2016,https://files.eric.ed.gov/fulltext/ED568395.pdf,"Employment and Training Review Protocol"
"Encouraging evidence on a sector-focused advancement strategy","Hendra, R., Greenberg, D. H., Hamilton, G., Oppenheim, A. Pennington, A. Schaberg, K., and Tessler, B. L. (2016). Encouraging evidence on a sector-focused advancement strategy. New York: MDRC. [St. Nicks Alliance]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Mod/high-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

	The study’s objective was to examine the impact of the WorkAdvance sectoral training program at the St. Nicks Alliance site on employment, earnings, education, and training from 2011 to 2015. The authors investigated similar research questions with three other sites, the profiles of which are available here.
	The study used a randomized controlled trial design to compare the treatment group, which was able to access the WorkAdvance program at the St. Nicks Alliance site, and the control group, which was not eligible for WorkAdvance services but could access other services in the community. The authors collected data from two sources: a follow-up survey and unemployment insurance (UI) wage and employment data.
	Using UI data, the authors found that those assigned to the treatment group were significantly more likely to be ever employed in Quarters 2 to 5 after random assignment than those in the control group. Using survey data, the authors also found that those in the treatment group were significantly more likely to complete education or training than the control group.
	The quality of the causal evidence is high for employment and earnings outcomes based on UI data because those outcomes were based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects for those outcomes are attributable to the WorkAdvance program at the St. Nicks Alliance site and not to other factors. For education and training outcomes from the follow-up survey, the quality of the causal evidence is moderate because those outcomes were based on a randomized controlled trial in which many people did not complete the follow-up survey, but the authors did account for existing differences between the treatment and control groups. This means we are somewhat confident that the estimated effects for those outcomes are attributable to the WorkAdvance program at the St. Nicks Alliance site, but other factors might also have contributed.","the WorkAdvance sectoral training program","Work based and other occupational training","Low income",,"Urban, United States",2016,https://files.eric.ed.gov/fulltext/ED568395.pdf,"Employment and Training Review Protocol"
"Exploring the differential impact of public interventions on indigenous people: Lessons from Mexico's conditional cash transfer program","Lopez-Calva, L. F., & Patrinos, H. A. (2015). Exploring the differential impact of public interventions on indigenous people: Lessons from Mexico's conditional cash transfer program. Journal of Human Development and Capabilities, 16(3), 452-467. doi:10.1080/19452829.2015.1072378","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts
      
    
  
              


      
            Child labor
      


  
      
            Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The objective of the study was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on child labor and school attendance for children ages 8 to 17 across 3 indigenous, Spanish-speaking, and bilingual households.
Using survey data from a cluster randomized controlled trial, the authors analyzed the average program impact of the PROGRESA/Oportunidades program on indigenous households versus individuals who were bilingual or Spanish-speaking.
The study found that the PROGRESA/Oportunidades program was significantly related to a decrease in child labor and an increase in school attendance for indigenous speaking children.
The quality of causal evidence presented in this study is low because it was based on a randomized controlled trial with unknown attrition and the authors did not control for the required variables. As a result, we are not confident that the estimated effects are attributable to PROGRESA/Oportunidades; other factors are likely to have contributed.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,"International, Rural",2015,https://www.researchgate.net/publication/242464961_Exploring_the_Differential_I…,"Child Labor Review Protocol"
"The (surprising) efficacy of academic and behavioral intervention with disadvantaged youth: Results from a randomized experiment in Chicago","Cook, P., Dodge, K., Farkas, G., Fryer, R., Guryan, J., Ludwig, J. Mayer, S., Pollack, H., & Steinberg, L. (2014). The (surprising) efficacy of academic and behavioral intervention with disadvantaged youth: Results from a randomized experiment in Chicago. Cambridge, MA: National Bureau of Economic Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:


The study’s objective was to examine the impact of the Becoming a Man (BAM) program on youths’ academic outcomes, including grade point averages (GPAs), course failures, and achievement test scores. BAM provided mentoring and socialization activities to enhance cognitive, decision-making, and social skills.
The study was a randomized controlled trial conducted in one high school on the south side of Chicago, Illinois, in 2012–2013. Eligible youth were randomly assigned to one of three conditions: (1) a treatment group receiving BAM only, in which individuals could participate in the BAM program; (2) a treatment group receiving BAM plus tutoring, in which individuals could participate in the BAM program and received daily tutoring in math; or (3) the control group, which could not participate in BAM but could access existing services at their school. The authors estimated regressions to measure the impact of the BAM program on academic achievement using administrative data from Chicago Public Schools.
The study found that youth offered the opportunity to participate in BAM—either with or without supplemental tutoring—had significantly higher math achievement test scores than youth in the control group. In addition, youth in the BAM program group and the BAM plus tutoring program group had significantly higher math GPAs than members of the control group.
The quality of causal evidence presented in this report is high for the GPA and course failures outcomes because it was based on a randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to BAM and/or the tutoring sessions, and not to other factors. The quality of causal evidence is moderate for the math and reading achievement outcomes because these outcomes had high attrition but the authors included sufficient controls in their analysis. This means we are somewhat confident that the estimated effects are attributable to BAM and/or tutoring sessions, but other factors might also have contributed.","Becoming a Man","Mentoring Other training and education Youth programs Behavioral Interventions","Youth, Male, Low-skilled, Low income",,"United States, Urban",2014,http://www.nber.org/papers/w19862.pdf,"Opportunities for Youth Review Protocol"
"Gasper, J., & Henderson, K. (2014). Sector-focused career centers evaluation: Effects on employment and earnings after one year.","Gasper, J., & Henderson, K. (2014). Sector-focused career centers evaluation: Effects on employment and earnings after one year. New York: New York City Center for Economic Opportunity. Retrieved from http://www.nyc.gov/html/ceo/downloads/pdf/CEO-Sector_Based_Approaches_Evaluation_Report-2014_final.pdf.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary:

	The study’s objective was to examine the impact of sector-focused career centers in New York City on employment and earnings.
	The authors estimated the effect of sector-focused career centers by comparing employment and earnings outcomes captured in New York State unemployment insurance data among participants in New York City sector-focused career centers against the outcomes for individuals served by New York City career centers without a specific sector focus who were deemed similar in terms of initial characteristics to the sector-focused group.
	This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either.
	The quality of causal evidence presented in this report is low because the authors did not demonstrate that the groups were similar at baseline or make statistical adjustments for differences between the two groups in the analyses. This means we are not confident that the estimated effects are attributable to sector-focused career centers; other factors are likely to have contributed.","New York City Sector-focused Career Centers","Job search assistance and supportive services Other employment and reemployment","Low income","Manufacturing, Health care and social assistance, Transportation and warehousing","Urban, United States",2014,http://www.nyc.gov/html/ceo/downloads/pdf/CEO-Sector_Based_Approaches_Evaluatio…,"Employment and Training Review Protocol"
"Sustained gains: Year Up’s continued impacts on young adults’ earnings","Roder, A., & Elliott, M. (2014). Sustained gains: Year Up’s continued impacts on young adults’ earnings. New York: Economic Mobility Corporation.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Mod/high-No impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the effect of the Year Up program on employment, earnings, and education outcomes. Year Up is an intensive, yearlong program that provides training and internships in financial operations and information technology for young adults from low-income urban communities.
About 200 students in three cities were randomly assigned to the treatment group, which was eligible to participate in Year Up beginning in September 2007, or the control group, which was not eligible to participate in Year Up in 2007. Members of the control group were eligible to reapply to the program after 10 months, and many did. The authors compared the outcomes of the treatment and control groups using data collected through telephone interviews with participants four years after random assignment.
The authors reported a positive, statistically significant impact of Year Up on earnings measured three years after random assignment, but these impacts did not extend to the fourth year after random assignment. Cumulatively, treatment group members earned $13,645 more than the control group over years 2 through 4 after random assignment, and they were more likely to have been employed in a field targeted by the program.
The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to Year Up, although other factors could also have contributed.","Year Up","Basic skills Other training and education Work based and other occupational training Youth programs","Youth, Black or African American, Hispanic of any race, Low-skilled, Low income",,"United States, Urban",2014,http://economicmobilitycorp.org/uploads/sustained-gains-economic-mobility-corp…,"Opportunities for Youth Review Protocol"
"Preventing youth violence and dropout: A randomized field experiment (No. w19014)","Heller, S., Pollack, H. A., Ander, R., & Ludwig, J. (2013). Preventing youth violence and dropout: A randomized field experiment (No. w19014). Cambridge, MA: National Bureau of Economic Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:


The study’s objective was to examine the impact of the Becoming a Man program on arrest and educational outcomes.
The study was a randomized controlled trial. Eligible male youth from 18 public schools in disadvantaged neighborhoods were screened for eligibility. The 2,740 who met requirements were randomly assigned to one of three treatment groups or a control group.
The study found that being offered the opportunity to participate in the program reduced violent crime arrests during the program year and improved schooling outcomes in both the program and follow-up years.
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Becoming a Man program, and not to other factors.","Becoming a Man","Other training and education Safety Youth programs Behavioral Interventions","Youth, Disconnected youth, Male, Low income",,"United States, Urban",2013,http://faculty.chicagobooth.edu/workshops/AppliedEcon/past/pdf/jensludwigyouthv…,"Opportunities for Youth Review Protocol"
"Conditional cash transfers in New York City: The continuing story of the Opportunity NYC—Family Rewards demonstration","Riccio, J., Dechausay, N., Miller, C., Nunez, S., Verma, N., & Yang E. (2013). Conditional cash transfers in New York City: The continuing story of the Opportunity NYC—Family Rewards demonstration. New York, NY: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employer benefits receipt-Mod/high-Favorable impacts
      
    
  
              


      
            Employer benefits receipt
      


  
      
            Public benefits receipt-Mod/high-Favorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:


The study’s objective was to examine the impact of Family Rewards, an experimental privately funded conditional cash transfer program in New York City, on earnings, employment, public benefits receipt, and education.
The study was based on a randomized controlled trial and estimated the effect of the Family Rewards program on low-income families. The authors used New York City and New York State administrative data to compare average outcomes between families offered access to the program and families excluded from the program, after adjusting for chance initial differences between the groups.
The authors found that, on average, the Family Rewards program decreased the likelihood of ever being employed at an Unemployment Insurance (UI)-covered job in the first year by 2 percentage points, but increased monthly earnings by $353 and decreased the share of families receiving income from Supplemental Security Income (SSI) or disability benefits by 3.9 percentage points. The authors also found that parents in the Family Rewards program group were 4.2 percentage points more likely to have achieved any trade license training certification.
The quality of causal evidence presented in this report is high for most outcomes because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Family Rewards program, and not to other factors. However, some outcomes in the study receive a moderate or low causal evidence rating, meaning that we are less confident that the estimated effects are attributable to the Family Rewards program; other factors may have contributed.","the Family Rewards Program","Other employment and reemployment Other training and education","Low income, Parent",,"United States, Urban",2013,http://files.eric.ed.gov/fulltext/ED545453.pdf,"Employment and Training Review Protocol"
"Enhanced Early Head Start with employment services: 42-month impacts from the Kansas and Missouri sites of the Enhanced Services for the Hard-to-Employ Demonstration and Research Project","Hsueh, J., and Farrell, M. (2012). Enhanced Early Head Start with employment services: 42-month impacts from the Kansas and Missouri sites of the Enhanced Services for the Hard-to-Employ Demonstration and Research Project. OPRE Report 2012-05. Washington DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:


The study’s objective was to examine the impact of Enhanced Early Head Start (EHS) participation on employment, earnings, and public assistance receipt for low-income families with young children.
The study used a randomized controlled trial design, assigning eligible families to either the Enhanced EHS program or existing services. To estimate the program’s impacts, the authors used administrative employment and earnings data, as well as a 42-month follow-up survey emphasizing respondents’ employment, income, and public assistance receipt. Outcomes were adjusted for characteristics before random assignment.
The study found that the longest period of continuous employment during the 3.5-year follow-up period was, on average, 2.5 months shorter for mothers in the Enhanced EHS group than mothers in the control group.
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Enhanced EHS services, and not to other factors.","Enhanced Early Head Start","Other employment and reemployment","Low income, Parent",,"United States, Rural",2012,http://www.acf.hhs.gov/sites/default/files/opre/kansas_missouri.pdf,"Employment and Training Review Protocol"
"Are conditional cash transfers effective in urban areas? Evidence from Mexico","Behrman, J. R., Gallardo-Garcıa, J., Parker, S. W., Todd, P. E., & Velez-Grajales, V. (2012). Are conditional cash transfers effective in urban areas? Evidence from Mexico. Education Economics, 20(3), 233-259.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts
      
    
  
              


      
            Child labor
      


  
      
            Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on school enrollment and employment in paid activities for children ages 6 to 18 in urban areas.
The study used a nonexperimental design to evaluate schooling and work outcomes from PROGRESA/Oportunidades program 1 and 2 years after implementation in urban areas.
The study found that PROGRESA/Oportunidades was significantly related to reduced labor rates for boys who were 12-14 in the first and second year, and girls ages 15 to 18 in the first year. The program was also significantly related to an increase in school enrollment for boys and girls.
The quality of causal evidence presented in this study is low because the authors did not ensure that the groups were similar before program participation. This means we are not confident that the estimated effects are attributable to PROGRESA/Oportunidades; other factors are likely to have contributed.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,"International, Urban",2012,,"Child Labor Review Protocol"
"What strategies work for the hard-to-employ? Final results of the hard-to-employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. [NYC SACM]","Butler, D., Alson, J., Bloom, D., Deitch, V., Hill, A., Hsueh, J., Jacobs, E., Kim, S., McRoberts, R., & Redcross, C. (2012). What strategies work for the hard-to-employ? Final results of the hard-to-employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. (OPRE Report 2012-08.) Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [NYC SACM]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Low-No impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study’s objective was to examine the impact of the Substance Abuse Case Management (SACM) program on employment, earnings, and public assistance receipt after two years.
The authors attempted to implement a randomized controlled trial, but they used a process that resulted in nonrandom assignment. The study estimated impacts by comparing the regression-adjusted outcomes of the treatment and control groups, using data collected from New York City public assistance records and Unemployment Insurance wage records for New York State.
The study found no statistically significant relationships between SACM and employment, earnings, or public assistance receipt.
The quality of causal evidence presented in this report is low because the assignment mechanism was nonrandom and the authors did not demonstrate that the treatment and control groups were similar. This means we would not be confident that any estimated effects would be attributable to the Substance Abuse Case Management program; other factors are likely to have contributed. However, the study did not find statistically siginificant effects.","the Substance Abuse Case Management (SACM) Program","Other employment and reemployment Substance abuse recovery","Low income",,"United States, Urban",2012,http://www.acf.hhs.gov/sites/default/files/opre/strategies_work.pdf,"Employment and Training Review Protocol"
"Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. [San Diego—EARN!]","Miller, C., Tessler, B. L., & Van Dok, M. (2012). Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. New York: MDRC. [San Diego—EARN!]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Mod/high-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-Favorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study’s objective was to examine the impact of participation in San Diego—EARN!, a Work Advancement and Support Center (WASC), on participants’ earnings, employment, educational attainment and benefit receipt.
This study was a randomized controlled trial and used administrative data from the Employment Development Department in California, the San Diego County Health and Human Service Agency, and the National Student Clearinghouse to measure outcomes. The authors used a 12-month follow-up survey with a random subset of participants to measure receipt of work supports and job characteristics.
The study found that members of the treatment group were 5.7 percentage points more likely than the control group to have ever received Food Stamps one year after the program began. The study also found that members of the treatment group received an average of $155 more in Food Stamps than the control group one year after the program began and an average of $320 more in Food Stamps than the control group three years after the program began.
The quality of causal evidence presented in this report is high for outcomes measured with administrative data. This means we are confident that the estimated effects on these outcomes are attributable to San Diego—EARN! and not to other factors. However, outcomes measured with survey data receive a low causal evidence rating, meaning that we are not confident that the estimated effects are attributable to San Diego—EARN!; other factors may have contributed.","Work Advancement and Support Center Demonstration (WASC), San Diego—EARN!","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States, Urban",2012,http://www.mdrc.org/sites/default/files/full_627.pdf,"Employment and Training Review Protocol"
"A promising start: Initial impacts of Year Up on low-income young adults’ careers.","Roder, A., & Elliott, M. (2011). A promising start: Initial impacts of Year Up on low-income young adults' careers. Economic Mobility Corporation.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

This report presents preliminary findings for the impacts of the Year Up program, which provides technical skills training and internships to low-income adults ages 18 to 24.
The authors randomly assigned eligible applicants to either be invited to participate in the program immediately (treatment group) or gain entry after 10 months (control group). They compared the outcomes of treatment and control group members for approximately two years after random assignment.
The authors reported many statistically significant and positive impacts of the program in the second year after random assignment. These included impacts on annual earnings and hourly wages.
The quality of causal evidence is low because the randomized controlled trial had high attrition and the study did not show that the groups being compared were equivalent prior to the program. This means we are not confident that the estimated effects are attributable to Year Up. Other factors are likely to have contributed.","Year Up","Mentoring Work based and other occupational training Youth programs","Youth, Low income","Finance and insurance","United States, Urban",2011,,"Opportunities for Youth Review Protocol"
"Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up","LePage, J. P., Washington, E. L., Lewis, A. A., Johnson, K. E., & Garcia-Rea, E. (2011). Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up. Journal of Rehabilitation Research & Development, 48(3), 277-286. [Full About Face vs VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

	The study examined the impact of About Face (AF) vocational classes on competitive employment.
	In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who participated in the AF classes (full AF program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected biweekly data from participants in person or over the phone.
	The study revealed significantly higher competitive employment among justice-involved veterans in the full AF program (23.8 percent hired) than in the VERC condition (0 percent hired).
	The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"Urban, United States",2011,https://www.rehab.research.va.gov/jour/11/483/pdf/page277.pdf,"Reentry, Veterans Review Protocol"
"Same bureaucracy, different outcomes in human capital? How indigenous and rural non-indigenous areas in Panama responded to the CCT","Arriaz, I., & Rozo, S. (2011). Same bureaucracy, different outcomes in human capital? How indigenous and rural non-indigenous areas in Panama responded to the CCT. Inter-American Development Bank, Office of Evaluation & Oversight.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts
      
    
  
              


      
            Child labor
      


  
      
            Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the impact of Red de Oportunidades (RdO), a conditional cash transfer program in Panama, on child labor and school enrollment.
The authors used cross-sectional data to compare the treatment group to the comparison group on several outcomes, including child labor (if the child worked in the previous week) and school enrollment (if the child was enrolled in formal schooling).
In the analyses for rural areas, the study found that the receipt of the RdO was significantly associated with a decrease in child labor by 6.2 percentage points and an increase in school enrollment by 8.8 percentage points. In the analyses for the indigenous areas, the receipt of RdO was significantly associated with an increase in school enrollment by 6.3 percentage points, but not related to child labor.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Red de Oportunidades (RdO) program; other factors are likely to have contributed.","Red de Oportunidades (RdO)","Child labor","Other, Low income",,"International, Rural",2011,https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1847124,"Child Labor Review Protocol"
"After-school programs for high school students: An evaluation of after-school matters.","Hirsch, B., Hedges, L., Stawicki, J., & Mekinda, M. (2011). After-school programs for high school students: An evaluation of after-school matters. Evanston, IL: Northwestern University.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-No impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Mod/high-No impacts
      
    
  
              


      
            Employment","Summary:

The report’s objective was to evaluate the impact of the After School Matters (ASM) apprenticeship program on academic outcomes in high school and on the likelihood of being hired for a summer or permanent entry-level position in the labor market.
For this evaluation, 535 students from 10 high schools in Chicago were randomly assigned to the treatment group, which could enroll in ASM, or the control group, which could not. Outcome data were derived from high school records from both semesters of the academic year of study participation and a mock job interview at the end of the spring semester of the same year.
The study reported no statistically significant impacts of participation in ASM on high school grade point average (GPA), number of classes failed, school absences, or likelihood of being hired for a permanent or summer entry-level position.
The quality of the causal evidence presented in this report is high for all academic outcomes. This means we are confident that estimated impacts for these outcomes would be solely attributable to ASM, and not other factors. For the likelihood of employment outcomes, the quality of evidence is moderate. This means we have confidence that the effects estimated in this study would be attributable at least in part to the ASM program, though other factors could also have contributed.","After School Matters","Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States, Urban",2011,,"Opportunities for Youth Review Protocol"
"The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [Texas ERA—Houston]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Texas ERA—Houston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-Unfavorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:


The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Houston site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project.
The authors randomly assigned 2,032 unemployed single-parent participants in Houston’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment.
The study found that those in the Houston ERA group received on average $56 more per year in TANF benefits across the first four years after random assignment, compared with the control group.
The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program and not to other factors.","the Employment Retention and Advancement project, Houston","Other employment and reemployment Unemployment Insurance","Parent, Low income",,"Urban, United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol"
"The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [Texas ERA—Forth Worth]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Texas ERA—Forth Worth]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:


The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Fort Worth site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project.
The authors randomly assigned 1,572 unemployed single-parent participants in Fort Worth’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment.
The study found that, compared with the control group, those in the Fort Worth ERA group received on average $162 more per year in Food Stamps across the first four years after random assignment.
The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program and not to other factors.","the Employment Retention and Advancement project, Fort Worth","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol"
"The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Los Angeles EJC]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Los Angeles EJC]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-No impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-No impacts
      
    
  
              


      
            Public benefit receipt","Summary:


The study’s objective was to gauge how a Los Angeles job club focused on participants’ career interests affected employment, earnings, and benefits receipt outcomes after about 36 months. The Los Angeles site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. (See the CLEAR review of the interim report here.)
The authors randomly assigned nearly 1,200 single-parent recipients of Temporary Assistance for Needy Families (TANF) to either a treatment group, which received Enhanced Job Club (EJC) services, or a control group, which received traditional job club (TJC) services. The authors collected employment and earnings data from Unemployment Insurance (UI) records and used automated TANF and food stamp databases to obtain benefits receipt information.
Thirty-six months after random assignment, the study found no statistically significant differences between treatment and control group members’ employment, earnings, or benefits receipt.
The quality of causal evidence provided in this study is high because it is based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the EJC and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Los Angeles’s Enhanced Job Club","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol"
"The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [Texas ERA—Corpus Christi]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Texas ERA—Corpus Christi]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts
      
    
  
              


      
            Public benefit receipt
      


  
      
            Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:


The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Corpus Christi site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project.
The authors randomly assigned 1,727 unemployed single-parent participants in Corpus Christi’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment.
The study found that, compared with the control group, those in the Corpus Christi ERA group were more likely to be employed at all or for four consecutive quarters in the fourth year after random assignment. Corpus Christi ERA group members also had higher earnings and received lower Food Stamps benefits.
The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program and not to other factors.","the Employment Retention and Advancement project, Corpus Christi","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol"
"The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Chicago ERA]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Chicago ERA]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-Unfavorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:


The study’s objective was to determine the effectiveness of a Chicago program to increase the earnings of Temporary Assistance for Needy Families (TANF) recipients. The Chicago site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project.
The authors randomly assigned 1,728 TANF recipients to either a treatment group, which received enhanced employment services, or a control group, which received benefits as usual. The authors collected employment and earnings data from Illinois Unemployment Insurance (UI) records over four follow-up years and Food Stamps and TANF receipt data from administrative records over three follow-up years.
The study found that members of the treatment group received significantly less in average annual TANF benefits ($778 compared with $1,010 among control group members) but more in average annual Food Stamps ($4,111 compared with $3,959 among control group members). People in the ERA group were also more likely to be employed in the first year (69.7 percent) than people in the control group (66.2 percent).
The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable to the Chicago ERA program, and not to other factors.","the Employment Retention and Advancement project, Chicago","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol"
"The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [RFS-Los Angeles]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [RFS-Los Angeles]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-No impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-No impacts
      
    
  
              


      
            Public benefit receipt","Summary:


The study’s objective was to estimate the impact of individualized and flexible post-employment job supports on employed welfare recipients’ employment and benefits receipt outcomes after three years. The Los Angeles Reach for Success (RFS) site was one of two in Los Angeles that participated in the Employment Retention and Advancement (ERA) project.
The authors randomly assigned 5,700 employed single-parent participants in Los Angeles’s Temporary Assistance for Needy Families (TANF) program who were working full-time to either a treatment group that received RFS services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and surveys administered 12 and 42 months after random assignment.
The study found that, 12 to 42 months after random assignment, RFS group members’ employment, earnings, and benefits receipt did not differ significantly from those of control group members.
The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that any estimated effects would be attributable to Los Angeles’ RFS and not to other factors. However, the study did not find statistically significant effects.","Reach for Success (RFS)","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol"
"Child education and work choices in the presence of a conditional cash transfer programme in rural Colombia","Attanasio, O., Fitzsimons, E., Gomez, A., Gutierrez, M. I., Meghir, C., & Mesnard, A. (2010). Child education and work choices in the presence of a conditional cash transfer programme in rural Colombia. Economic Development and Cultural Change, 58(2), 181-210. doi:10.1086/648188.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts
      
    
  
              


      
            Child labor
      


  
      
            Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The objective of this study was to examine the impact of the conditional cash transfer program, Familias en Acción, on children’s work and school participation in Columbia.
The study used a nonexperimental design to compare labor and schooling outcomes of children who received the conditional cash transfer with a comparison group of children who did not, based on data from a survey.
The study found that receipt of the cash transfer was significantly associated with a decrease in the likelihood of participating in domestic work for urban children aged 10 to 17, a decrease in the hours spent in income-generating work for urban children aged 14 to 17, and a decrease in the hours spent in domestic work for all but rural children aged 14 to 17. Receipt of the cash transfer was also significantly related to an increase in the hours spent in school for all children in urban and rural areas.
The quality of causal evidence presented in the study is low because the authors did not control for pre-intervention outcomes. This means we are not confident that the estimated effects are attributable to the Familias en Acción program; other factors are likely to have contributed.","Familias en Acción","Child labor","Other, Low income",,"International, Rural",2010,http://openaccess.city.ac.uk/5381/1/Child_Education.pdf,"Child Labor Review Protocol"
"The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Achieve—Cleveland]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Achieve—Cleveland]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-No impacts
      
    
  
              


      
            Employment","Summary:


The study’s objective was to determine the impact of a Cleveland, Ohio, program designed to increase employment retention among low-wage workers in the long-term nursing care industry. Cleveland was one of 16 sites nationwide to participate in the Employment Retention and Advancement (ERA) project.
The authors randomly assigned 44 firms to either a treatment group, whose employees could receive employment retention services through Cleveland Achieve, or a control group. The authors collected employment and earnings data from state Unemployment Insurance (UI) records.
Three years after random assignment, the study found no statistically significant differences between the earnings and employment outcomes of employees in Achieve firms compared with employees in firms that did not have access to Achieve services.
The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the Achieve program, and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Cleveland","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol"
"Reducing child labour through conditional cash transfers: Evidence from Nicaragua's Red de Protección Social","Gee, K.A. (2010). Reducing child labour through conditional cash transfers: Evidence from Nicaragua's Red de Protección Social. Development Policy Review, 28(6), 711-732.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts
      
    
  
              


      
            Child labor","Summary:

The study’s objective was to examine the impact of a conditional cash transfer program, Red de Protección Social (RPS), in Nicaragua on child labor outcomes for children who are working.
The study was an expansion of an earlier randomized controlled trial (RCT). The author used survey data from the RCT taken before the program started (2000) and two years after (2002) to examine the probability and duration of child work.
The study found that the receipt of the cash transfer significantly reduced the probability that a child would work by approximately 10.6 percent and, for a child that was working, significantly reduced the hours worked per week by approximately 3.65 hours, on average.
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Red de Protección Social program, and not to other factors.","Red de Protección Social (RPS)","Child labor","Other, Low income",,"International, Rural",2010,,"Child Labor Review Protocol"
"Limiting child labor through behavior-based income transfers: An experimental evaluation of the PETI program in rural Brazil","Yap, Y. T., Sedlacek, G., & Orazem, P. F. (2009). Limiting child labor through behavior-based income transfers: An experimental evaluation of the PETI program in rural Brazil. In P. F. Orazem, G. Sedlacek, & Z. Tzannatos (Eds.), Child Labor and Education in Latin America (pp. 147-165). New York, NY: Palgrave Macmillan. doi.org/10.1057/9780230620100_10","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts
      
    
  
              


      
            Child labor
      


  
      
            Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the impact of the Programa de Erradicacao do Trabalho Infantil (PETI) or Program to Eradicate Child Labor on child labor and hours in school.
The authors used an experimental design to compare the outcomes of children ages 7 to 14 residing in municipalities who received income transfers with those residing in municipalities who did not receive income transfers. Based on data from Brazil’s national household survey, the authors used statistical models to assess the impact of the program in each group.
The PETI program was significantly associated with an increase in time in school and less time in work for participating children.
The quality of causal evidence presented in this report is low because it is a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the PETI program; other factors are likely to have contributed.","Programa de Erradicacao do Trabalho Infantil (PETI) or Program to Eradicate Child Labor","Child labor","Other, Low income",,"International, Rural",2009,,"Child Labor Review Protocol"
"Evaluating the direct and indirect effects of a conditional income support program: The case of Progresa","Badillo Bautista, C. (2009). Evaluating the direct and indirect effects of a conditional income support program: The case of Progresa (Doctoral dissertation). Retrieved from ProQuest Dissertations & Theses A&I. (Accession No. 1314572898)","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts
      
    
  
              


      
            Child labor","Summary:

The objective of the study was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on child labor for children ages 8 to 17.
Using survey data from a cluster randomized controlled trial, the authors analyzed the average program impact of the PROGRESA/Oportunidades program using a difference-in- differences (DID) regression model for the child labor outcome and cross-sectional models to estimate spillover effects on child labor.
The study found the number of children aged 12-16 who worked significantly decreased in cash transfer participating households compared to control households.
The quality of causal evidence presented in this study is high because it is based on a well-implemented, low attrition randomized controlled trial. This means we are confident that the estimated effects are attributable to PROGRESA/Oportunidades and not to other factors.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,"Rural, International",2009,,"Child Labor Review Protocol"
"Education and child labor: Experimental evidence from a Nicaraguan conditional cash transfer program","Maluccio, J. A. (2009). Education and child labor: Experimental evidence from a Nicaraguan conditional cash transfer program. In P. F. Orazem, G. Sedlacek, & Z. Tzannatos (Eds.), Child labor and education in Latin America: An economic perspective (pp. 187-204). New York, NY: Palgrave Macmillan. doi.org/10.1057/9780230620100_12","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts
      
    
  
              


      
            Child labor
      


  
      
            Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the impact of the Red de Proteccion Social (RPS) cash transfer program on school attendance and enrollment and on child labor for children aged 7-13 in rural Nicaragua.
Using panel survey data collected before and one year after program implementation, the author measured the impact of RPS using a randomized controlled trial (RCT).
The study found that participation in RPS was significantly related to a reduction in child labor and a significant increase in school enrollment and attendance.
The quality of the causal evidence presented in this report is low because, while it was based on an RCT, attrition was high and the authors did not demonstrate that the groups were similar at baseline. This means we are not confident that the estimated effects are attributable to the Red de Proteccion Social; other factors are likely to have contributed.","Red de Protección Social (RPS)","Child labor","Other, Low income",,"International, Rural",2009,,"Child Labor Review Protocol"
"The Employment Retention and Advancement project: Results from the Substance Abuse Case Management program in New York City.","Martinez, J., Azurdia, G., Bloom, D., and Miller, C. (2009). The Employment Retention and Advancement project: Results from the Substance Abuse Case Management program in New York City. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary:

The study’s objective was to examine the impact of the New York City Substance Abuse Case Management (SACM) program on employment, earnings, and public assistance receipt. The SACM program is part of the Employment Retention and Advancement (ERA) project.
The authors assigned 8,831 low-income adults with substance abuse issues to either the SACM program or existing services. The authors analyzed data from Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), and Food Stamps administrative records.
This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either.
The quality of causal evidence presented in this report is low because assignment to the program was not random, the treatment and control groups differed at baseline, and the authors did not appropriately account for differences in pre-intervention measures. This means we are not confident that the estimated effects are attributable to the SACM program; other factors are likely to have contributed.","the Employment Retention and Advancement (ERA) Project, New York City","Other employment and reemployment Substance abuse recovery","Low income",,"United States, Urban",2009,http://www.mdrc.org/sites/default/files/full_551.pdf,"Employment and Training Review Protocol"
"The Employment Retention and Advancement project: A comparison of two job club strategies: The effects of enhanced versus traditional job clubs in Los Angeles","Navarro, D., Azurdia, G., & Hamilton, G. (2008). The Employment Retention and Advancement project: A comparison of two job club strategies: The effects of enhanced versus traditional job clubs in Los Angeles. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-No impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-No impacts
      
    
  
              


      
            Public benefit receipt","Summary:


The study’s objective was to gauge the effect of a Los Angeles job club focused on participants’ career interests on employment, earnings, and benefits receipt outcomes after about 18 months. The Los Angeles site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. (See the CLEAR review of the final report here.)
The authors randomly assigned almost 1,200 single-parent Temporary Assistance for Needy Families (TANF) recipients to either a treatment group, which received Enhanced Job Club (EJC) services, or a control group, which received Traditional Job Club (TJC) services. The authors collected employment and earnings data from Unemployment Insurance (UI) records and used automated TANF and Food Stamps databases to obtain benefits receipt information.
The study found that, 18 months after random assignment, there were no statistically significant differences between EJC and control group members’ employment, earnings, or public benefits receipt.
The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the EJC and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Los Angeles’s Enhanced Job Club","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2008,http://www.acf.hhs.gov/sites/default/files/opre/era_la.pdf,"Employment and Training Review Protocol"
"Testing case management in a rural context: An impact analysis of the Illinois Future Steps program: Findings from the Rural Welfare-to-Work Strategies Demonstration evaluation.","Meckstroth, A., Person, A., Moore, Q., Burwick, A., McGuirk, A., Ponza, M., Marsh, S., Novak, T., Zhao, Z., & Wheeler, J. (2008). Testing case management in a rural context: An impact analysis of the Illinois Future Steps program: Findings from the Rural Welfare-to-Work Strategies Demonstration evaluation. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-No impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study’s objective was to examine the impact of the Future Steps rural welfare-to-work program on employment, earnings, and public benefit receipt.
The authors randomly assigned Temporary Assistance for Needy Families (TANF) and Food Stamps recipients required to work to either a treatment group, which received job search and other services, or a control group, which did not. The authors evaluated the treatment’s impact using Illinois administrative data and follow-up surveys.
The authors found that the Future Steps program increased the likelihood of being employed 30 months after enrollment by 8.6 percentage points.
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Future Steps rural welfare-to-work program and not to other factors.","the Future Steps Rural Welfare-to-Work Program","Job search assistance and supportive services Other employment and reemployment","Low income",,"Rural, United States",2008,http://www.acf.hhs.gov/sites/default/files/opre/testing_case.pdf,"Employment and Training Review Protocol"
"The Employment Retention and Advancement project: Findings for the Cleveland Achieve model: Implementation and early impacts of an employer-based approach to encourage employment retention among low-wage workers","Miller, C., Martin, V., Hamilton, G., Cates, L., and Deitch, V. (2008). The Employment Retention and Advancement project: Findings for the Cleveland Achieve model: Implementation and early impacts of an employer-based approach to encourage employment retention among low-wage workers. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-No impacts
      
    
  
              


      
            Employment","Summary:


The study’s objective was to determine the impact of a program designed to increase employment retention among low-wage workers in the long-term nursing care industry in Cleveland, Ohio. Cleveland was one of 16 sites nationwide to participate in the Employment Retention and Advancement (ERA) project.
The authors randomly assigned 44 firms to either a treatment group, whose employees could receive employment retention services through Cleveland Achieve, or a control group. The authors collected data on employee turnover directly from firms and employment and earnings data from state Unemployment Insurance (UI) records.
Two years after random assignment, the study did not find statistically significant differences in the turnover rates, employment rates, or earnings of employees in Achieve firms compared with employees in firms that did not have access to Achieve services.
The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the Achieve program, and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Cleveland","Other employment and reemployment Unemployment Insurance","Low income","Health care and social assistance","United States, Urban",2008,http://www.acf.hhs.gov/sites/default/files/opre/cleveland.pdf,"Employment and Training Review Protocol"
"The Employment Retention and Advancement project: Results from the Personal Roads to Individual Development and Employment (PRIDE) program in New York City","Bloom, D., Miller, C., and Azurdia, G. (2007). The Employment Retention and Advancement project: Results from the Personal Roads to Individual Development and Employment (PRIDE) program in New York City. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-Unfavorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:


The study’s objective was to examine the impact of the Personal Roads to Individual Development and Employment (PRIDE) welfare-to-work program in New York City on the employment, earnings, and public benefits receipt of low-income single parents with physical or mental health problems that limited their ability to work.
The study was a randomized controlled trial that used data from administrative records for the two years following assignment and a survey conducted with a random subset of the sample to assess outcomes one year after assignment.
The study found that treatment group participants were significantly more likely than control group participants to have had a job and had higher average earnings. The treatment group was significantly less likely to receive cash assistance and received lower amounts of cash assistance benefits than the control group.
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to PRIDE and not to other factors.","Personal Roads to Individual Development and Employment (PRIDE)","Other employment and reemployment","Disability, Low income, Parent",,"United States, Urban",2007,http://www.acf.hhs.gov/sites/default/files/opre/era_pride.pdf,"Employment and Training Review Protocol"
"A comparison of two Welfare-to-Work strategies among African American women in Atlanta, Georgia. (Unpublished doctoral dissertation).","Wilson-Brewster, V.L. (2006). A comparison of two Welfare-to-Work strategies among African American women in Atlanta, Georgia. (Unpublished doctoral dissertation). Capella University, Minneapolis, Minnesota.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the effectiveness of two welfare-to-work programs—the Labor Force Attachment (LFA) program and the Human Capital Development (HCD) program—on the employment and earnings of African American women 25, 35, and 45 years old in Atlanta.
The author analyzed a subsample of participants in the National Evaluation of Welfare-to-Work Strategies (NEWWS) study. The study was a randomized controlled trial that assigned individuals within a geographic location to one of three groups: LFA, HCD, or a control group.
The study found that women in the 35-year-old group who participated in LFA or HCD had higher earnings and needed less time to find a job than those in the other age cohorts.
The quality of causal evidence presented in this report is low because the study was a randomized controlled trial with unknown attrition and the authors did not account for preexisting differences between the groups being compared in their analysis. This means we are not confident that the estimated effects are attributable to LFA or HCD programs; other factors are likely to have contributed.","Labor Force Attachment (LFA) and Human Capital Development (HCD)","Other employment and reemployment Other training and education","Female, Black or African American, Low income, Parent",,"United States, Urban",2006,,"Employment and Training Review Protocol"
"Effects of housing vouchers on welfare families: Final report","Mills, G., Gubits, D., Orr, L., Long, D., Feins, J., Kaul, B., & Wood, M. (2006). Effects of housing vouchers on welfare families: Final report. Washington, DC: U.S. Department of Housing and Urban Development.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-Favorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study’s objective was to examine the impact of the Welfare-to-Work housing voucher on employment, earnings, and public benefit receipt.
The authors allocated the available vouchers by lottery to eligible families who were willing to participate in the study. Using Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), housing assistance administrative data, and baseline and follow-up surveys, the authors compared the outcomes of those randomly assigned to receive a voucher with outcomes of those who were not, adjusting for chance preintervention differences between the groups.
The study found that the Welfare-to-Work vouchers increased the likelihood of receiving TANF benefits in the third half-year (months 12–18) after random assignment by 2.1 percentage points and the likelihood of receiving Food Stamps in the same period by 2.5 percentage points.
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Welfare-to-Work voucher and not to other factors.","the Welfare-to-Work Voucher Program","Other employment and reemployment","Low income",,"Urban, United States",2006,https://www.huduser.gov/publications/pdf/hsgvouchers_1_2011.pdf,"Employment and Training Review Protocol"
"The Employment Retention and Advancement project: Results from the Texas ERA site [Texas ERA—Houston]","Martinson, K., & Hendra, R. (2006). The Employment Retention and Advancement project: Results from the Texas ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Houston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-No impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-Favorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:


The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after 18 to 24 months. The Houston site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project.
The authors randomly assigned about 1,800 single-parent participants in Houston’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program (SNAP) administrative records.
The study did not find any statistically significant effects on employment or earnings. However, the study found that treatment group members received, on average, $33 more in TANF benefits in the ninth quarter after random assignment than those in the control group.
The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program, and not to other factors.","the Employment Retention and Advancement project, Houston","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2006,http://www.acf.hhs.gov/sites/default/files/opre/results_texas.pdf,"Employment and Training Review Protocol"
"The Employment Retention and Advancement project: Results from the Chicago ERA site","Bloom, D., Hendra, R., & Page, J. (2006). The Employment Retention and Advancement project: Results from the Chicago ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-Favorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:


The study’s objective was to determine the effectiveness of a Chicago program to increase the earnings of Temporary Assistance for Needy Families (TANF) recipients after two years. The Chicago site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project.
The authors randomly assigned 1,615 TANF recipients to either a treatment group, which received enhanced employment services, or a control group, which received benefits as usual. The authors collected employment and earnings data from Illinois Unemployment Insurance (UI) records and Food Stamps and TANF receipt data from Illinois administrative records.
The study found that members of the ERA group were more likely to be employed (70 versus 66 percent) in the first year after random assignment and received significantly less in TANF benefits ($1,307, compared with $1,586 among control group members). Effects on employment and benefits receipt persisted into the second year after random assignment.
The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable to the Chicago ERA program, and not to other factors.","the Employment Retention and Advancement project, Chicago","Other employment and reemployment Unemployment Insurance","Low income",,"United States, Urban",2006,http://www.acf.hhs.gov/sites/default/files/opre/chicago_era.pdf,"Employment and Training Review Protocol"
"The Employment Retention and Advancement project: Results from the Texas ERA site [Texas ERA—Forth Worth]","Martinson, K., & Hendra, R. (2006). The Employment Retention and Advancement project: Results from the Texas ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Forth Worth]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:


The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after 18 to 24 months. The Fort Worth site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project.
The authors randomly assigned about 1,200 single-parent participants in Fort Worth’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program (SNAP) administrative records.
The study found that treatment group members were 6.1 percentage points more likely to have been employed at any time in the second year after random assignment than those in the control group. Treatment group members were also 4.2 percentage points more likely to be employed during the last quarter of that second year.
The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program, and not to other factors.","the Employment Retention and Advancement project, Fort Worth","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2006,http://www.acf.hhs.gov/sites/default/files/opre/results_texas.pdf,"Employment and Training Review Protocol"
"The Employment Retention and Advancement project: Early results from four sites [Texas ERA—Houston]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Houston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-No impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-No impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after one year. The Houston site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project.
The authors randomly assigned 1,816 unemployed single-parent participants in Houston’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records.
The study did not find any statistically significant effects of the Houston ERA program on employment, earnings, and benefits receipt one year after random assignment.
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to the Houston ERA program and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement project, Houston","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol"
"The Employment Retention and Advancement project: Early results from four sites [Chicago]","Bloom, D, Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Chicago]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Unfavorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study’s objective was to determine the effectiveness of a Chicago program to increase the earnings of Temporary Assistance for Needy Families (TANF) recipients after one year. The Chicago site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project.
The authors randomly assigned 990 TANF recipients to either a treatment group, which received enhanced employment services, or a control group, which received benefits as usual. The authors collected employment and earnings data from Illinois Unemployment Insurance (UI) records and Food Stamps and TANF receipt data from Illinois administrative records.
The study found that those in the Chicago ERA program received, on average, $193 less in TANF benefits in the first year after random assignment than those in the control group.
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Chicago ERA project, and not to other factors.","the Employment Retention and Advancement project, Chicago","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol"
"Promoting work in public housing: The effectiveness of Jobs-Plus","Bloom, H., Riccio, J., Verma, N., & Walter, J. (2005). Promoting work in public housing: The effectiveness of Jobs-Plus. New York City: MDRC","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages","Summary:

The study’s objective was to examine the impact of the Jobs-Plus Community Revitalization Initiative for Public Housing Families (Jobs-Plus) program on the employment and earnings of residents in housing developments in six cities in the United States.
The study was a randomized controlled trial that used data from administrative records to compare outcomes between treatment and control group members from one to five years after random assignment.
The study found that residents in the Jobs-Plus housing developments had higher long-term earnings than residents in the control group developments.
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Jobs-Plus program and not to other factors.","the Jobs-Plus Community Revitalization Initiative for Public Housing Families (Jobs-Plus) Program","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States, Urban",2005,http://www.mdrc.org/sites/default/files/full_485.pdf,"Employment and Training Review Protocol"
"An evaluation of an urban community college Single Parent and Displaced Homemaker Program  (Doctoral dissertation)","Rice, L. M. (1999). An evaluation of an urban community college Single Parent and Displaced Homemaker Program  (Doctoral dissertation). Old Dominion University. DOI: 10.25777/tqh7-3c76","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

	The study's objective was to examine the impact of the Single Parent and Displaced Homemaker Program on education outcomes by students at an urban community college.
	The study used a nonexperimental design to compare the outcomes of program participants to those on the waiting list. Using data from the community college’s Students Information System, the author conducted statistical tests to examine the differences between groups.
	The study found that participation in the Single Parent and Displaced Homemaker Program was significantly related to increased retention rates and number of credits taken.
	The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Single Parent and Displaced Homemaker Program; other factors are likely to have contributed.","the Single Parent and Displaced Homemaker Program","Employment and Training Services Training and Education Capacity building programs Community college education and other classroom training Other training and education","Adult, Other barriers, Female, Parent",,"Urban, United States",1999,https://digitalcommons.odu.edu/urbanservices_education_etds/50/,"Community College Review Protocol"
"The employment and training outcomes of a job training partnership act program in a community college setting","Carter, D. L. (1999). The employment and training outcomes of a job training partnership act program in a community college setting (Unpublished doctoral dissertation). University of Florida.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages","Summary:

	The study's objective was to examine the impact of a Job Training Partnership Act (JTPA) funded vocational training program at a community college in North Florida on earnings outcomes.
	The author used an interrupted time series design to compare outcomes of participants before and after they participated in the JTPA program. Data for the study were compiled from the community college's existing JTPA records.
	The study found that participation in JTPA funded training was significantly related to higher post-training wages.
	The quality of causal evidence presented in this report is low because the author did not observe outcomes for multiple periods before or after the program nor account for selection into the intervention. This means we are not confident that the estimated effects are attributable to the JTPA funded vocational training program; other factors are likely to have contributed.","Job Training Partnership Act","Employment and Training Services Training and Education Basic skills Capacity building programs Community college education and other classroom training","Youth, Adult, Other barriers, Dislocated or displaced worker, Low income",,"Rural, United States",1999,,"Community College Review Protocol"