Title,Citation,Topic_area,Study_type,Study_evidence_rating,Outcome_effectiveness,Findings,Intervention_program,Topics,Target_population,Firm_characteristics,Geographic_setting,Original_publication_date,Original_publication_link,"Review Protocol" "Synthesis Report: Evidence on the Effects of OSHA Activities",,"OSHA Enforcement",,,,"Findings: According to the research, there is some evidence that OSHA inspections reduce injury rates, on average. Some recent research has strong current relevance and provides valuable descriptive information, but low causal evidence on the impact of inspections. There is little information on the characteristics of OSHA inspections and other OSHA activities.","OSHA Enforcement Activities",Inspections,,,,,,"OSHA Enforcement Review Protocol" "Synthesis Report: Research Synthesis: Employment Programs and Demonstrations for SSI and SSDI Beneficiaries",,"Disability Employment Policy",,,,"Findings: Evidence echoes previous literature reviews on the challenges of generating substantive impacts, though customized supports to well-targeted populations show some potential. The most effective interventions provided intensive, customized supports and services focused on job training, placement, and retention to narrowly defined target populations. Interventions that provided support services or incentives to help beneficiaries keep more of their benefits when working had small or no impacts on employment, even if spending on services was high. There is no evidence of SSI or SSDI caseload reductions, even among interventions that improved employment and/or earnings. Little is known about interventions for improving earnings of people with TBI and PTSD. Recruiting beneficiaries to participate in demonstrations was difficult, which limited the generalizability of study findings. Fidelity to the demonstration model is important. Work incentives and supports can be difficult to implement in the context of SSA’s existing work incentives, creating potential confusion for beneficiaries and program staff. A strong technical assistance component, with incentives for service providers to accept the assistance, is important to successful implementation. Demonstrations should be pilot tested before being implemented on a national scale.",,,Disability,,,,,"Disability Employment Policy Review Protocol" "Synthesis Report: Reemployment Synthesis",,Reemployment,,,,"Findings: The majority of reemployment interventions reduced weeks of benefit receipt and amount of benefits paid. The reemployment interventions had varying degrees of effectiveness. The Reemployment and Eligibility Assistance (REA) program boosted short-and long-term employment and earnings. Job search assistance (JSA) services had favorable impacts on all outcomes examined, but employment and earnings impacts varied over time. Reemployment bonuses appear to work in the short term, but their long-term effects are not known. Lighter-touch interventions, such as profiling and changing employer contact requirements,yield more limited benefits.",,"Job search assistance and supportive services Other employment and reemployment Unemployment Insurance",Unemployed,,"United States",,,"Reemployment Review Protocol" "Synthesis Report: Evidence on the Effectiveness of the National Guard Youth ChalleNGe Program",,"Opportunities for Youth",,,,"Findings: Research provides strong evidence that NGYCP improves the educational outcomes of at-risk youth. There is also strong evidence that NGYCP improves the labor market outcomes of at-risk youth. A cost-benefit analysis found NGYCP produced large positive benefits. NGYCP is a multi-component intervention, with little evidence on the effectiveness of specific components.","the National Guard Youth ChalleNGe Program",,,,,,,"Opportunities for Youth Review Protocol" "Synthesis Report: Research Synthesis: Opportunities for Youth",,"Opportunities for Youth",,,,"Findings: Successful programs often involved a substantial time commitment from participating youth. Many successful programs involved a job placement component or job search assistance. Positive impacts tended to be realized in the short term and fade over time. More information is needed on the replicability of some programs.",,"Youth programs","Youth, Disconnected youth",,,,,"Opportunities for Youth Review Protocol" "Evaluation of impacts of the Reemployment and Eligibility Assessment (REA) Program: Final report","Klerman, J. A., Saunders, C., Dastrup, E., Epstein, Z., Walton, D., Adam, T., & Barnow, B. S. (2019). Evaluation of impacts of the Reemployment and Eligibility Assessment (REA) Program: Final report. Cambridge, MA: Abt Associates. [Comparison between multiple REA treatment group and single REA treatment group]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Reemployment and Eligibility Assessment (REA) program in four states (Indiana, New York, Washington, and Wisconsin) on people’s public benefit receipt, employment, and earnings. The authors investigated similar research questions for three other contrasts, the profiles of which are available using the study search. The authors used a randomized controlled trial to compare public benefit receipt outcomes among unemployment insurance (UI) claimants randomly assigned to states’ multiple REA treatment group as well as with the single REA treatment group. The authors drew on state administrative records from the UI benefit and case management systems for 28 weeks after random assignment. For this contrast, the study used data from New York and Washington. The study found that weeks of UI benefits were significantly lower for the multiple REA treatment group than the single REA treatment group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the REA program and not to other factors.","the Reemployment and Eligibility (REA) Program","RESEA Unemployment Insurance",Unemployed,,"United States",2019,https://www.dol.gov/sites/dolgov/files/OASP/evaluation/pdf/REA%20Impact%20Study…,"Reemployment Review Protocol" "Evaluation of impacts of the Reemployment and Eligibility Assessment (REA) Program: Final report","Klerman, J. A., Saunders, C., Dastrup, E., Epstein, Z., Walton, D., Adam, T., & Barnow, B. S. (2019). Evaluation of impacts of the Reemployment and Eligibility Assessment (REA) Program: Final report. Cambridge, MA: Abt Associates. [Comparison between existing REA services group and control group]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Reemployment and Eligibility Assessment (REA) program in four states on people’s public benefit receipt, employment, and earnings. The authors investigated similar research questions for three other contrasts, the profiles of which are available using the study search. The authors used a randomized controlled trial to compare the public benefit, earnings, and employment outcomes among unemployment insurance (UI) claimants randomly assigned to each state’s existing REA program or a control group. The authors drew on state administrative records from the UI benefit and case management systems for 28 weeks after random assignment and National Directory of New Hires data for two years after random assignment. The study found that, across the states, the existing REA treatment group received significantly fewer weeks and dollars of UI benefits than the control group did, and the existing REA treatment group had higher employment, longer job tenure, and higher earnings than the control group in the first or second year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the REA program and not to other factors.","the Reemployment and Eligibility (REA) Program","RESEA Unemployment Insurance",Unemployed,,"United States",2019,https://www.dol.gov/sites/dolgov/files/OASP/evaluation/pdf/REA%20Impact%20Study…,"Reemployment Review Protocol" "Evaluation of impacts of the Reemployment and Eligibility Assessment (REA) Program: Final report","Klerman, J. A., Saunders, C., Dastrup, E., Epstein, Z., Walton, D., Adam, T., & Barnow, B. S. (2019). Evaluation of impacts of the Reemployment and Eligibility Assessment (REA) Program: Final report. Cambridge, MA: Abt Associates. [Comparison between existing REA group and partial REA group]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Reemployment and Eligibility Assessment (REA) program in four states (Indiana, New York, Washington, and Wisconsin) on people’s public benefit receipt, employment, and earnings. The authors investigated similar research questions for three other contrasts, the profiles of which are available using the study search. The authors used a randomized controlled trial to compare public benefit receipt and employment outcomes among unemployment insurance (UI) claimants randomly assigned to each state’s existing REA program as well as with a partial REA condition. The authors drew on state administrative records from the UI benefit and case management systems for 28 weeks after random assignment and National Directory of New Hires data for two years after random assignment. The study found that the existing REA treatment group received significantly fewer weeks of UI benefits and worked significantly more quarters than the partial REA treatment group. These findings were consistent in some of the individual states. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the REA program and not to other factors.","the Reemployment and Eligibility (REA) Program","RESEA Unemployment Insurance",Unemployed,,"United States",2019,https://www.dol.gov/sites/dolgov/files/OASP/evaluation/pdf/REA%20Impact%20Study…,"Reemployment Review Protocol" "Evaluation of impacts of the Reemployment and Eligibility Assessment (REA) Program: Final report","Klerman, J. A., Saunders, C., Dastrup, E., Epstein, Z., Walton, D., Adam, T., & Barnow, B. S. (2019). Evaluation of impacts of the Reemployment and Eligibility Assessment (REA) Program: Final report. Cambridge, MA: Abt Associates. [Comparison between partial REA treatment group and control group]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Reemployment and Eligibility Assessment (REA) program in four states (Indiana, New York, Washington, and Wisconsin) on people’s public benefit receipt, employment, and earnings. The authors investigated similar research questions for three other contrasts, the profiles of which are available using the study search. The authors used a randomized controlled trial to compare public benefit receipt and employment outcomes among unemployment insurance (UI) claimants randomly assigned to a partial REA treatment group or a control group. The authors drew on state administrative records from the UI benefit and case management systems for 28 weeks after random assignment and National Directory of New Hires data for two years after random assignment. The study found that, across the four states, the partial REA treatment group received significantly fewer weeks of UI benefits. The study found no statistically significant differences between the groups in the number of quarters employed or longest job tenure one or two years after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the REA program and not to other factors.","the Reemployment and Eligibility (REA) Program","RESEA Unemployment Insurance",Unemployed,,"United States",2019,https://www.dol.gov/sites/dolgov/files/OASP/evaluation/pdf/REA%20Impact%20Study…,"Reemployment Review Protocol" "Evaluation of Richland College's Veterans-Focused Engineering Technology Project: Final Report","Haviland, S., Van Noy, M., Kuang, L., Vinton, J., & Pardalis, N. (2018). Evaluation of Richland College's Veterans-Focused Engineering Technology Project: Final Report. New Brunswick, NJ: Rutgers University Education and Employment Research Center.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Richland College’s Veterans-Focused Engineering Technology Project on education outcomes. The authors used a nonexperimental design to compare education outcomes of program participants to a matched comparison group one and two years after enrollment. The study found that program participation was significantly associated with fewer credit hours earned one year after enrollment. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the Veterans-Focused Engineering Technology Project; other factors are likely to have contributed program.","the Veterans-Focused Engineering Technology Project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Veteran or military",,"United States",2018,https://smlr.rutgers.edu/sites/default/files/evaluation_of_richland_colleges_ve…,"Community College Review Protocol" "SUN PATH comparison group study","Dauphinee, T., & Bishwakarma, R. (2018). SUN PATH comparison group study. Albuquerque, NM: University of New Mexico, Career to Cradle Policy Institute.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Skill‐UP Network Pathways Acceleration in Technology and Healthcare (SUN PATH) program on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare the outcomes of students who were in the SUN PATH program to a matched comparison group of students. The study found that SUN PATH students had higher rates of program completion, certificates/degree attainment, program retention, employment, and earnings than students in the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the SUN PATH program, but other factors might also have contributed.","the Skill‐UP Network Pathways Acceleration in Technology and Healthcare (SUN PATH) Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Other, Low-skilled, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18108/SUN%20PATH%20Compa…,"Community College Review Protocol" "Improving the labor market outcomes of U.S. veterans: The long-run effect of the Transition Assistance Program","Li, X. (2018). Improving the labor market outcomes of U.S. veterans: The long-run effect of the Transition Assistance Program. New York: Syracuse University.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact the Transitional Assistance Program (TAP) had on outcomes related to employment, earnings, and education. The study used statistical models to compare veterans who had been offered and received TAP to veterans who were not offered TAP. Data came from the veterans supplement of the Current Population Survey for survey years 1995 to 2010. The study found positive associations between participation in TAP and employment, earnings, and education. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to TAP; other factors are likely to have contributed to the findings.","the Transitional Assistance Program","Job search assistance and supportive services Veterans' reemployment Other training and education","Dislocated or displaced worker, Veteran or military",,"United States",2018,,"Employment and Training Review Protocol" "The Ohio Technical Skills Innovation Network (Ohio TechNet) Trade Adjustment Assistance Community College Career Training Grant (TAACCCT) Final Evaluation Report","The New Growth Group, LLC & The Ohio Education Research Center at The Ohio State University. (2018). The Ohio Technical Skills Innovation Network (Ohio TechNet) Trade Adjustment Assistance Community College Career Training Grant (TAACCCT) Final Evaluation Report. Retrieved from https://oerc.osu.edu/sites/oerc/themes/oerc/publications/LCCC%20OTN%20Lead%20Team%20Evaluation%20Final%20Report.pdf","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Mixed impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to evaluate the impact of advanced manufacturing programs offered through the Ohio Technical Skills Innovation Network (OTN) initiative on education, earnings, and employment outcomes. The study used a nonexperimental design to compare outcomes of students enrolled in OTN-affected programs/core courses to a matched comparison group. The study found that OTN participation was associated with a significant increase in program completion, program retention, credit hour completion, continuing further education, credential attainment, immediate employment, and job retention. Program participation was also associated with a significant decrease in retention in other programs and earning a degree. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the OTN grant programs; other factors are likely to have contributed.","The Ohio Technical Skills Innovation Network Initiative","Capacity building programs Community college education and other classroom training",Adult,,"United States",2018,https://oerc.osu.edu/sites/oerc/themes/oerc/publications/LCCC%20OTN%20Lead%20Te…,"Community College Review Protocol" "M-PATH: Advanced manufacturing final evaluation report. (Rep. No. 33VCDOLTACT2014.Y4S)","Swan, B., Clarke, M. H., Serpa, A., DeStefano, C., & Hahs-Vaughn (2018). M-PATH: Advanced manufacturing final evaluation report. (Rep. No. 33VCDOLTACT2014.Y4S). Orlando, FL: University of Central Florida, Program Evaluation and Educational Research Group (PEER).","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the M-PATH: Advanced Manufacturing Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant program on education, earnings, and employment outcomes. Using a nonexperimental design, the authors compared students in the M-PATH TAACCCT program to a matched comparison group. The study found that participation in the M-PATH TAACCCT program was significantly related to increased program completion and decreased continued education in another certificate program. The study also found that non-incumbent workers who completed the program were significantly more likely to enter employment than the comparison group. The quality of causal evidence presented in this report is low because the authors did not include sufficient control variables. This means we are not confident that the estimated effects are attributable to the M-PATH TAACCCT program; other factors are likely to have contributed.","the M-PATH: Advanced Manufacturing Trade Adjustment Assistance Community College and Career Training (TAACCCT) Grant Program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2018,http://www.skillscommons.org/bitstream/handle/taaccct/18579/TC-26475-14-60-A-12…,"Community College Review Protocol" "An analysis of the Veterans Employment Initiative","Moses-Stanton, S. (2018). An analysis of the Veterans Employment Initiative. (Doctoral dissertation). Retrieved from ProQuest. Accession No. 10745075.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact Presidential Executive Order 13518 (EO13518) had on the employment of veterans who served in the military starting in September 2001 (Gulf War II-era veterans). The author used graphical analysis to examine employment outcomes for veterans and non-veterans after the implementation of EO13518. The study used Integrated Public Use Microdata Series (IPUMS USA) data for the years 2008, 2009, 2014, and 2015. The study did not show evidence of a relationship between the implementation of EO13518 and employment of Gulf War II-era veterans. The study did not statistically compare the employment of the veterans and non-veterans following implementation of the Executive Order. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we would not be confident that any estimated effects would be attributable to the implementation of EO13518; other factors would be likely to have contributed to the findings. However, the study did not find statistically significant effects.","Executive Order 13518","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2018,https://search.proquest.com/openview/c2ddd5b8502115f80bf2a7352fe1e281/1?cbl=187…,"Employment and Training Review Protocol" "Long-term effects of job-search assistance: Experimental evidence using administrative tax data","Manoli, D. S., Michaelides, M., & Patel, A. (2018). Long-term effects of job-search assistance: Experimental evidence using administrative tax data. (Report no. w24422). Cambridge, MA: National Bureau of Economic Research.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study examined the impact of the Nevada Reemployment and Eligibility Assessment (REA) program on long-term employment, earnings, and Unemployment Insurance (UI) benefit receipt. This study was a randomized controlled trial that took place in the state of Nevada and involved new UI claimants from July to December 2009. The authors used program administrative and Internal Revenue Service (IRS) tax return data to compare outcomes of participants with outcomes of the control group for six years following the intervention. The study found that participants of the Nevada REA program experienced greater increases in employment and earnings relative to the control group for each of the six years following the intervention. Additionally, the study found that participants of the Nevada REA program experienced greater decreases in UI benefit receipt relative to the control group and lower benefit amounts in the first year after program entry. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Nevada REA program, and not to other factors. See more CLEAR profiles related to The Reemployment and Eligibility Assessment.","Reemployment Eligibility Assessment","RESEA Job search assistance and supportive services","Dislocated or displaced worker, Unemployed",,"Urban, United States",2018,http://www.daymanoli.com/wp-content/uploads/2018/03/Manoli_Michaelides_Patel-nv…,"Reemployment Review Protocol" "Health Profession Opportunity Grants (HPOG 1.0) impact study interim report: Program implementation and short-term impacts. (Report No. 2018-16a)","Peck, L. R., Werner, A., Harvill, E., Litwok, D., Moulton, S., Fountain, A. R., & Locke, G. (2018). Health Profession Opportunity Grants (HPOG 1.0) impact study interim report: Program implementation and short-term impacts. (Report No. 2018-16a). Washington, DC: Office of Planning. Research, and Evaluation, Administration for Children and Families, US Department of Health and Human Services.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Health Profession Opportunity Grant (HPOG) program on educational progress, earnings, and employment. The authors used a randomized controlled trial to analyze the effects of the program between a treatment group, an enhanced treatment group, and a control group. The study found that HPOG participants had significantly higher rates of educational progress, significantly higher earnings in the fifth quarter, and a significantly higher likelihood to be employed in healthcare than the control group. The quality of causal evidence presented in the study is high for the employment and earnings outcomes because they are based on a well-implemented randomized controlled trial with low attrition. However, the quality of causal evidence is moderate for the educational progress and employment in healthcare outcomes because sample attrition for these outcomes was high, but the authors controlled for key differences between the treatment and control groups at baseline. This means we are somewhat confident that estimated effects on these outcomes would be attributable to HPOG, but other factors might have also contributed.","the Health Profession Opportunity Grant (HPOG)","Capacity building programs Community college education and other classroom training","Adult, Low income",,"United States",2018,https://www.acf.hhs.gov/sites/default/files/opre/hpog_interim_appendices_final_…,"Community College Review Protocol" "Final evaluation report: Trade Adjustment Assistance Community – round 4: Nevada Community College Consortium","Pacific Research and Evaluation. (2018). Final evaluation report: Trade Adjustment Assistance Community – round 4: Nevada Community College Consortium. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/18580/NCCC%20TAACCCT%20Final%20Evaluation%20Report-Pacific%20Research%20and%20Evaluation.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Nevada Community College Consortium (NCCC) Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant program on education, earnings, and employment. Using community college data, the authors used a nonexperimental design to compare the outcomes of students in the program to a comparison group comprised of both concurrent and historical cohorts of students. The study found no statistically significant relationships between NCCC and education, earnings, and employment outcomes. The quality of causal evidence presented in this report is low because the authors did not include sufficient control variables. This means we are not confident that the estimated effects are attributable to NCCC; other factors are likely to have contributed.","Nevada Community College Consortium (NCCC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18580/NCCC%20TAACCCT%20F…,"Community College Review Protocol" "Providing Public Workforce Services to Job Seekers: 30-Month Impact Findings on the WIA Adult and Dislocated Worker Programs [Comparison Between Full-WIA Services versus Core-and-Intensive Services].","Fortson, K., Rotz, D., Burkander, P., Mastri, A., Schochet, P., Rosenberg, L., McConnell, S., & D'Amico, R. (2017). Providing Public Workforce Services to Job Seekers: 30-Month Impact Findings on the WIA Adult and Dislocated Worker Programs (No. 42e8b3550e40408f854b966d0229c3b5). Washington, DC: Mathematica Policy Research. [Comparison Between Full-WIA Services versus Core-and-Intensive Services]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Adult and Dislocated Worker programs on training, employment, earnings, and service receipt after 30 months. This summary focuses on the comparison between the group who received the full-WIA services versus the group who received core-and-intensive services. The study was a randomized controlled trial, where customers in each local area were randomly assigned to one of three groups: full-WIA, core-and-intensive, or core. The authors compared the outcomes between the groups from baseline to 30 months after study enrollment. The study found that full-WIA customers were significantly more likely than core-and-intensive customers to complete a training program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to the Adult and Dislocated Worker programs and not to other factors.","Adult and Dislocated Worker programs","Adult and Dislocated Worker programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Adult, Unemployed",,"United States",2017,https://www.mathematica-mpr.com/our-publications-and-findings/publications/prov…,"Review Protocol" "Iowa Western 2017 ITC2 annual evaluation report: Information technology - Credentials to Careers (ITC2), Iowa Western Community College","de la Mora, A., Callen, E., Kemis, M., & Abraham, W. (2017). Iowa Western 2017 ITC2 annual evaluation report: Information technology - Credentials to Careers (ITC2), Iowa Western Community College. Arnes, IA: Research Institute for Studies in Education.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Information Technology – Credentials to Careers (ITC2) program on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare the outcomes of students who were enrolled in Computer Information Technology (CIT) programs after the initiation of ITC2 programming to those who were enrolled in CIT programs prior to the start of the ITC2 program. The study found that ITC2 program participation was associated with a significant increase in certificate attainment. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention and did not include sufficient controls. This means we are not confident that the estimated effects are attributable to the ITC2 program; other factors are likely to have contributed.","Information Technology – Credentials to Careers (ITC2) Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2017,,"Community College Review Protocol" "Providing Public Workforce Services to Job Seekers: 30-Month Impact Findings on the WIA Adult and Dislocated Worker Programs [Comparison between Core-and-Intensive Services versus Core Services].","Fortson, K., Rotz, D., Burkander, P., Mastri, A., Schochet, P., Rosenberg, L., McConnell, S., & D'Amico, R. (2017). Providing Public Workforce Services to Job Seekers: 30-Month Impact Findings on the WIA Adult and Dislocated Worker Programs (No. 42e8b3550e40408f854b966d0229c3b5). Washington, DC: Mathematica Policy Research. [Comparison between Core-and-Intensive Services versus Core Services]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Adult and Dislocated Worker programs on training, employment, earnings, and service receipt after 30 months. This summary focuses on the comparison between the group who received core-and-intensive services versus the group who received core services. The study was a randomized controlled trial, where customers in each local area were randomly assigned to one of three groups: full-WIA, core-and-intensive, or core. The authors compared the outcomes between the groups from baseline to 30 months after study enrollment. The study found that compared to core customers, core-and-intensive customers were significantly more likely to receive a credential through a training program and have higher earnings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to the Adult and Dislocated Worker programs and not to other factors.","Adult and Dislocated Worker programs","Adult and Dislocated Worker programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Adult, Unemployed",,"United States",2017,https://www.mathematica-mpr.com/our-publications-and-findings/publications/prov…,"Review Protocol" "Testing rapid connections to subsidized private sector jobs for low-income individuals in San Francisco: Implementation and early impacts of the STEP Forward program","Walter, J., Navarro, D., Anderson, C., & Tso, A. (2017). Testing rapid connections to subsidized private sector jobs for low-income individuals in San Francisco: Implementation and early impacts of the STEP Forward program. OPRE Report 2017-103. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of STEP Forward on employment, earnings, and education outcomes. The authors used a randomized controlled trial to estimate impacts of enrollment in STEP Forward, using administrative data on enrollees and enrollees’ self-reported data. The study found that people enrolled in STEP Forward were more likely to become employed and earned more after random assignment than people in the control group. There were no significant differences between the groups in their education outcomes. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to STEP Forward, and not to other factors.","STEP Forward","Adult and Dislocated Worker programs Job search assistance and supportive services","Other barriers",,"Urban, United States",2017,https://www.acf.hhs.gov/opre/resource/testing-rapid-connections-subsidized-priv…,"Employment and Training Review Protocol" "Outcomes from a certification program for early career professionals in supply chain management","Maxwell, N., Dolfin, S., Bruch, J., & Luca, D. L. (2017). Outcomes from a certification program for early career professionals in supply chain management. Princeton, NJ: Mathematica Policy Research.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Leveraging, Integrating, Networking, and Coordinating Supplies (LINCS) program on employment and earnings. Using a nonexperimental design, the study authors compared students in the LINCS program to a historical comparison group who had not participated in the LINCS program. The study found no statistically significant relationships between LINCS program participation and employment or earnings. The quality of causal evidence provided in this study is moderate because it is based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to LINCS, but other factors might also have contributed. However, the study did not find statistically significant effects.","the Leveraging, Integrating, Networking, and Coordinating Supplies (LINCS) program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,https://www.mathematica.org/our-publications-and-findings/publications/outcomes…,"Community College Review Protocol" "Evaluation of the Michigan Coalition for Advanced Manufacturing (M-CAM) final report","Lewis-Charp, H., Khemani, D., D’Amico, R., Goger, A., Gutierrez, I., Clark, M., Mack, M., Sarver, M., & van Docto, C. (2017). Evaluation of the Michigan Coalition for Advanced Manufacturing (M-CAM) final report. Oakland, CA: Social Policy Research Associates.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Michigan Coalition for Advanced Manufacturing (M-CAM) program on earnings and employment outcomes. The study used a nonexperimental design to compare students in the treatment group to two different comparison groups of students: students who were not enrolled in M-CAM programs while the program was in operation (contemporary comparison group) and students who were enrolled in the same manufacturing program prior to M-CAM implementation (historical comparison group). The study found that M-CAM participation was significantly associated with higher employment rates and earnings than the contemporary comparison group. However, when compared to the historical comparison group, the study found that M-CAM participation was significantly associated with higher employment rates and lower earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Michigan Coalition for Advanced Manufacturing (M-CAM) program; other factors are likely to have contributed.","the Michigan Coalition for Advanced Manufacturing (M-CAM) Program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,https://strategies.workforcegps.org/resources/2019/12/10/15/58/Evaluation-of-th…,"Community College Review Protocol" "Providing Public Workforce Services to Job Seekers: 30-Month Impact Findings on the WIA Adult and Dislocated Worker Programs [Comparison Between Full-WIA Services versus Core Services].","Fortson, K., Rotz, D., Burkander, P., Mastri, A., Schochet, P., Rosenberg, L., McConnell, S., & D'Amico, R. (2017). Providing Public Workforce Services to Job Seekers: 30-Month Impact Findings on the WIA Adult and Dislocated Worker Programs (No. 42e8b3550e40408f854b966d0229c3b5). Washington, DC: Mathematica Policy Research. [Comparison Between Full-WIA Services versus Core Services]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Adult and Dislocated Worker programs on training, employment, earnings, and service receipt after 30 months. This summary focuses on the comparison between the group who received the full-WIA services versus the group who received core services. The study was a randomized controlled trial, where customers in each local area were randomly assigned to one of three groups: full-WIA, core-and-intensive, or core. The authors compared the outcomes between the groups from baseline to 30 months after study enrollment. The study found that compared to core customers, full-WIA customers reported a higher number of hours worked, an increased likelihood to receive a credential and complete a training program, and a decreased likelihood to receive public assistance. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to the Adult and Dislocated Worker programs and not to other factors.","Adult and Dislocated Worker programs","Adult and Dislocated Worker programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Adult, Unemployed",,"United States",2017,https://www.mathematica-mpr.com/our-publications-and-findings/publications/prov…,"Review Protocol" "Final evaluation Golden Triangle Modern Manufacturing Project","Harpole, S. (2017). Final evaluation Golden Triangle Modern Manufacturing Project. SHH Consulting, LLC","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Golden Triangle Modern Manufacturing Project on education, earnings, and employment outcomes. The author used a nonexperimental design to compare outcomes of Golden Triangle Modern Manufacturing Project participants to a matched comparison group. The study found that program participation was significantly associated with increases in program retention, credential attainment, and earnings. The quality of causal evidence presented in this study is low because the author used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to Golden Triangle Modern Manufacturing Project; other factors are likely to have contributed.","the Golden Triangle Modern Manufacturing Project","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed, Low-skilled, Veteran or military",,"United States",2017,https://www.skillscommons.org/handle/taaccct/15669,"Community College Review Protocol" "Pima Community College Pathways to Healthcare Program: Implementation and early impact report (Report No. 2017-10)","Gardiner, K., Rolston, H., Fein, D., & Cho, S-W. (2017). Pima Community College Pathways to Healthcare Program: Implementation and early impact report (Report No. 2017-10). Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to assess the impact of the Pathways to Healthcare program on students’ education and employment outcomes. The study used a randomized controlled trial to compare outcomes of students enrolled in the Pathways to Healthcare program with non-participants. The study found that Pathways to Healthcare program participants had significantly higher average total hours of college occupational training, higher rates of certification receipt, and higher rates of credential receipt from a college than the control group. The quality of causal evidence presented in this study is high because it is based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to the Pathways to Healthcare program and not to other factors.","the Pathways to Healthcare Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Low-skilled, Low income","Health care and social assistance","United States",2017,https://www.acf.hhs.gov/sites/default/files/opre/pathways_to_healthcare_impleme…,"Community College Review Protocol" "Evaluating recidivism and job quality outcomes for participants in the Hoosier Initiative for Reentry Employment (HIRE) program","Northcutt Bohmert, M., Hood, B. J., & Meckes, J. (2017). Evaluating recidivism and job quality outcomes for participants in the Hoosier Initiative for Reentry Employment (HIRE) program. Corrections: Policy, Practice and Research, 2(2), 110-129.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of job placement through the Hoosier Initiative for Reentry Employment (HIRE) program on recidivism among people released from Indiana prisons in 2014. The authors used HIRE program data and Indiana Department of Corrections data on the prison population to compare the recidivism outcomes of previously incarcerated people who were placed in a job through HIRE with the outcomes of those who were not placed in a job by the HIRE program. The authors used a statistical model to compare rates of recidivism between these two groups. The study found a statistically significant relationship between the intervention and recidivism. People obtaining a job placement were less likely to be reincarcerated between one to two years after release than nonparticipants who did not use intervention program services. The study also examined employment outcomes but these were not eligible for review. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to job placement through HIRE; other factors are likely to have contributed.","the Hoosier Initiative for Reentry Employment (HIRE) program","Other employment and reemployment Reentry",Justice-involved,,"United States",2017,https://doi.org/10.1080/23774657.2016.1277378,"Employment and Training Review Protocol" "Final evaluation report Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant: Round 3 Kapiʻolani Community College","Pacific Research & Evaluation, LLC. (2017). Final evaluation report Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant: Round 3 Kapiʻolani Community College. Portland, OR: Pacific Research & Evaluation, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of the grant-funded Implementing an Island-wide Strategy for Industry Cluster Formation and Community Revitalization in Hawai'i (C3T) project on education outcomes. The authors used a nonexperimental design to compare the outcomes of students enrolled in C3T programs and courses with students enrolled in comparable programs offered at the same community college. When compared to nonparticipating students, the study found that C3T participation was significantly associated with higher program completion and retention rates for students enrolled in the hospitality program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the C3T project; other factors are likely to have contributed.","the Implementing an Island-wide Strategy for Industry Cluster Formation and Community Revitalization in Hawai'i (C3T) Project","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,,"Community College Review Protocol" "Midlands Technical College TAACCCT Better Occupational Outcomes with Simulation Training: Program evaluation final report.","Center for Applied Research. (2017). Midlands Technical College TAACCCT Better Occupational Outcomes with Simulation Training: Program evaluation final report. Charlotte, NC: Center for Applied Research.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Better Occupational Outcomes with Simulation Training (BOOST) program on education outcomes. The authors used a nonexperimental design to compare the outcomes of students participating in BOOST to a matched comparison group using data from the colleges’ student information systems and the National Student Clearinghouse. The study found a significant relationship between BOOST participation and increased semester enrollment, increased certificate program completion, lower transfer rates, and faster rates of school completion. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the BOOST program; other factors are likely to have contributed.","Better Occupational Outcomes with Simulation Training (BOOST) Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Other barriers",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/15679/BOOST%20Final%20Ev…,"Community College Review Protocol" "Orthotics, Prosthetics, and Pedorthics (HOPE) careers consortium: Final evaluation report","Good, K., & Yeh-Ho, H. (2017). Orthotics, Prosthetics, and Pedorthics (HOPE) careers consortium: Final evaluation report. Denver, CO: McREL International.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Orthotics, Prosthetics & Pedorthics (HOPE) careers consortium program on education outcomes. The authors used a nonexperimental design to compare education outcomes of HOPE participants to a matched comparison group with institutional research data. The study found no significant associations between HOPE participation and program completion rates, completion of more than one certificate or degree, or furthering education status. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the HOPE program; other factors are likely to have contributed.","the Orthotics, Prosthetics & Pedorthics (HOPE) Careers Consortium Program","Capacity building programs Community college education and other classroom training","Adult, Other barriers, Dislocated or displaced worker, Unemployed, Veteran or military",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/13872/hope-consortium-tc…,"Community College Review Protocol" "Providing public workforce services to job seekers: 15-month impact findings on the WIA Adult and Dislocated Worker programs [Comparison between Core-and-Intensive Services versus Core Services].","McConnell, S., Fortson, K., Rotz, D., Schochet, P., Burkander, P., Rosenberg, L., Mastri, A., & D’Amico, R. (2016). Providing public workforce services to job seekers: 15-month impact findings on the WIA Adult and Dislocated Worker programs.  Washington, DC: Mathematica Policy Research. [Comparison between Core-and-Intensive Services versus Core Services]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult and Dislocated Worker programs on training, employment, earnings, and service receipt after 15 months. This summary focuses on the comparison between the group who received core-and-intensive services versus the group who received core services. The study was a randomized controlled trial, where customers in each local area were randomly assigned to one of three groups: full-WIA, core-and-intensive, or core. The authors compared the outcomes between the groups from baseline to 15 months after random assignment. The study found that core-and-intensive customers were significantly more likely than core customers to complete a training program, receive a training credential, and have higher earnings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to the Adult and Dislocated Worker programs and not to other factors.","Adult and Dislocated Worker programs","Adult and Dislocated Worker programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Adult, Unemployed",,"United States",2016,https://www.mathematica-mpr.com/our-publications-and-findings/publications/prov…,"Review Protocol" "Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program","Glosser, A., Barden, B., Williams, S., Anderson, C. (2016). Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program. (OPRE Report 2016-77). Washington, DC: Office of Planning, Research, and Evaluation. [Contrast 3: Paid work experience versus on-the-job training]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of paid work experience, part of Los Angeles’ Subsidized and Transitional Employment Demonstration, on employment, earnings, and public benefit receipt relative to on-the-job training. The authors also investigated related impacts, the profiles of which are available [here]. The authors used regression methods in a randomized controlled trial study to examine the impacts of participating in paid work experience. The data sources included administrative wage records, subsidized employment payroll records, Temporary Assistance for Needy Families (TANF) benefit payment records, and survey data. The study found that paid work experience had positive, statistically significant impacts on employment, earnings, and benefit receipt compared with on-the-job training. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the paid work experience program and not to other factors.","Los Angeles’ Subsidized and Transitional Employment Demonstration","Adult and Dislocated Worker programs Job search assistance and supportive services Other training and education","Low income",,"Urban, United States",2016,https://www.mdrc.org/publication/testing-two-subsidized-employment-approaches-r…,"Employment and Training Review Protocol" "Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program","Glosser, A., Barden, B., Williams, S., & Anderson, C. (2016). Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program. (OPRE Report 2016-77). Washington, DC: Office of Planning, Research, and Evaluation. [Contrast 1: Paid work experience versus comparison]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of a paid work experience program, part of Los Angeles’ Subsidized and Transitional Employment Demonstration, on employment, earnings, education, training, and public benefit receipt relative to no subsidized job opportunities. The authors also investigated related impacts, the profiles of which are available [here]. The authors used regression methods in a randomized controlled trial study to examine the impacts of participating in paid work experience. The data sources included administrative wage records, subsidized employment payroll records, Temporary Assistance for Needy Families (TANF) benefit payment records, and survey data. The study found that the paid work experience program had positive, statistically significant impacts on employment, earnings, and benefit receipt compared with the control condition of no subsidized job opportunities. Paid work experience had no impacts on education and training outcomes. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the paid work experience program and not to other factors.","Los Angeles’ Subsidized and Transitional Employment Demonstration","Adult and Dislocated Worker programs Job search assistance and supportive services Other training and education","Low income",,"United States",2016,https://www.mdrc.org/publication/testing-two-subsidized-employment-approaches-r…,"Employment and Training Review Protocol" "The Green Jobs and Health Care impact evaluation: Findings from the impact study of four training programs for unemployed and disadvantaged workers","Martinson, K., Williams, J., Needels, K., Peck, L., Moulton, S., Paxton, N., Mastri, A., Copson, E., Comfort, A., & Brown-Lyons, M. (2016). The Green Jobs and Health Care impact evaluation: Findings from the impact study of four training programs for unemployed and disadvantaged workers. Retrieved from https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2017-07%20Findings%20from%20the%20Impact%20Study.pdf","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Grand Rapids Community College (GRCC) Pathways to Prosperity program on education, earnings, and employment outcomes. The study was a randomized controlled trial. The authors used a baseline information form, the National Directory of New Hires (NDNH), a follow-up survey, and administrative program data to compare the outcomes between the treatment and control groups over an 18-month follow-up period. The study found that the GRCC Pathways to Prosperity program had a significant positive impact on completion rates for vocational training and life skills classes, and receipt of a vocational credential. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the GRCC Pathways to Prosperity program and not to other factors.","the Grand Rapids Community College (GRCC) Pathways to Prosperity Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Justice-involved, Other barriers, Unemployed, Low income",,"United States",2016,https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2017-07%20Findings%20f…,"Community College Review Protocol" "Consortium for Healthcare Education Online: Final evaluation report","Edwards, R., McKay, H., Mattoon, A., & Yang, S. (2016). Consortium for Healthcare Education Online: Final evaluation report. Piscataway, NJ: Rutgers Education and Employment Research Center.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Education and skills gains-Low-Mixed impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Consortium for Healthcare Education Online (CHEO) on education, earnings, and employment outcomes. This summary contains the findings from Flathead Valley Community College. Using institutional, employment, and wage data, the authors conducted a nonexperimental design to compare the outcomes of students who were enrolled in the CHEO program to a historic comparison group of students from previous enrollment years. The study found that CHEO program participation was significantly associated with earning more course credits, lower pass rates, a greater likelihood of pursuing further education, and higher rates of employment after program completion for incumbent workers. The quality of causal evidence presented in this study is low because the authors used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the CHEO program; other factors are likely to have contributed.","the Consortium for Healthcare Education Online (CHEO) Program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://epe.rutgers.edu/sites/default/files/images/Research_Documents/cheo_fina…,"Community College Review Protocol" "Retraining the Gulf Coast through Information Technology Pathways: Final impact evaluation report","Patnaik, A., & Prince, A. (2016). Retraining the Gulf Coast through Information Technology Pathways: Final Impact evaluation report. Austin, TX: The University of Texas at Austin, Lyndon B. Johnson School of Public Affairs.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Retraining the Gulf Coast Workforce through Information Technology Pathways Consortium (Gulf Coast IT Pathways) grant program on education outcomes. Using a nonexperimental design with institutional data from the college systems, the study authors compared students in the program to a matched historical cohort comparison group. The study found that the Gulf Coast IT Pathways program was significantly related to higher credential, certificate, or a degree attainment and higher credit hour accumulation. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Gulf Coast IT Pathways TAACCCT; other factors are likely to have contributed.","the Gulf Coast IT Pathways Program","Basic skills Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Low-skilled, Veteran or military",,"United States",2016,https://raymarshallcenter.org/files/2016/11/Retraining-the-Gulf-Coast-through-I…,"Community College Review Protocol" "Final evaluation report: Implementation and outcomes of Credentials to Careers","Skilton-Sylvester, P., Myran, S., Myran, G., Ross, S., & Williams, M. (2016). Final evaluation report: Implementation and outcomes of Credentials to Careers. Canadian Lakes, MI: Myran & Associates LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Credentials to Careers (C2C) program on earnings. The authors used a nonexperimental design to compare outcomes of C2C participants to a matched comparison group using data provided by the college. The study found that C2C program participation was significantly associated with a larger average percent increase in wages relative to the comparison group. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the C2C program; other factors are likely to have contributed.","the Credentials to Careers (C2C) Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Unemployed",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/15623/Final%20C2C%20Impl…,"Community College Review Protocol" "Providing public workforce services to job seekers: 15-month impact findings on the WIA Adult and Dislocated Worker programs [Comparison between Full-WIA Services versus Core-and-Intensive Services].","McConnell, S., Fortson, K., Rotz, D., Schochet, P., Burkander, P., Rosenberg, L., Mastri, A., & D’Amico, R. (2016). Providing public workforce services to job seekers: 15-month impact findings on the WIA Adult and Dislocated Worker programs. Washington, DC: Mathematica Policy Research.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult and Dislocated Worker programs on training, employment, earnings, and service receipt after 15 months. This summary focuses on the comparison between the group who received the full-WIA services versus the group who received core-and-intensive services. The study was a randomized controlled trial, where customers in each local area were randomly assigned to one of three groups: full-WIA, core-and-intensive, or core. The authors compared the outcomes between the groups from baseline to 15 months after random assignment. The study found that full-WIA customers were significantly more likely than core-and-intensive customers to complete a training program and receive a training credential. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to the Adult and Dislocated Worker programs and not to other factors.","Adult and Dislocated Worker programs","Adult and Dislocated Worker programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Adult, Unemployed",,"United States",2016,https://www.mathematica-mpr.com/our-publications-and-findings/publications/prov…,"Review Protocol" "Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program","Glosser, A., Barden, B., Williams, S., & Anderson, C. (2016). Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program. (OPRE Report 2016-77). Washington, DC: Office of Planning, Research, and Evaluation. [Contrast 2: On-the-job training versus comparison]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Unfavorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of on-the-job training, part of Los Angeles’ Subsidized and Transitional Employment Demonstration, on employment, earnings, education, training, and public benefit receipt relative to no subsidized job opportunities. The authors also investigated related impacts, the profiles of which are available [here]. The authors used regression methods in a randomized controlled trial study to examine the impacts of participating in on-the-job training. The data sources included administrative wage records, subsidized employment payroll records, Temporary Assistance for Needy Families (TANF) benefit payment records, and survey data. The study found that on-the-job training had positive, statistically significant impacts on employment and earnings compared with the control condition of no subsidized job opportunities. There were mixed impacts on benefit receipt and negative impacts on earning a professional license or certification. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the on-the-job training program and not to other factors.","Los Angeles’ Subsidized and Transitional Employment Demonstration","Adult and Dislocated Worker programs Job search assistance and supportive services Other training and education","Low income",,"United States",2016,https://www.mdrc.org/publication/testing-two-subsidized-employment-approaches-r…,"Employment and Training Review Protocol" "The labor market effects of U.S. reemployment programs during the Great Recession","Michaelides, M., & Mueser, P. (2016). The labor market effects of U.S. reemployment programs during the Great Recession. (Working paper 08-2015). Nicosia, Cyprus: University of Cyprus, Department of Economics.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Florida’s Priority Reemployment Services (PREP) program on Unemployment Insurance (UI) claimants’ reemployment rates, earnings, and receipt of UI benefits. The study was a randomized controlled trial. UI claimants were randomly assigned to either a treatment group that could receive PREP services, another treatment group that could receive Reemployment Eligibility and Assessment (REA) services, or a control group that had access to neither. The authors examined administrative data from Florida’s UI claims and wage records. The study found that the PREP group had significantly higher reemployment rates and lower UI benefit receipt but had similar earnings as the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the PREP program, and not to other factors. The study also examined the impact of Florida’s REA program compared with the control group. CLEAR’s profile of that study is available here.","Profiling, Reemployment Eligibility Assessment","RESEA Job search assistance and supportive services Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",2016,http://papers.econ.ucy.ac.cy/RePEc/papers/08-15.pdf,"Reemployment Review Protocol" "Incorporating individualized placement and support principles into vocational rehabilitation for formerly incarcerated veterans","LePage, J. P., Lewis, A. A., Crawford, A. M., Parish, J. A., Ottomanelli, L., Washington, E. L., & Cipher, D. J. (2016). Incorporating individualized placement and support principles into vocational rehabilitation for formerly incarcerated veterans. Psychiatric Services, 67(7), 735-742.","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the effect of the Individual Placement and Support (IPS) program on employment and earnings outcomes for justice-involved veterans with a prior felony conviction and a mental illness or substance abuse disorder. The study team used a randomized controlled trial and statistical tests to examine differences between justice-involved veterans who were offered the IPS program and veterans who were not offered this program. Justice-involved veterans self-reported their outcomes, which were verified based on a review of paystubs or contact with employers. The study showed that the IPS program increased employment, wages, number of days employed, and number of hours worked. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the IPS program, not to other factors.","Individual Placement and Support (IPS)","Job search assistance and supportive services Supported employment or other employment supports Veterans' reemployment","Veteran or military",,"United States",2016,https://ps.psychiatryonline.org/doi/full/10.1176/appi.ps.201500058,"Reentry, Veterans Review Protocol" "Evaluation of the Re-Integration of Ex-Offenders (RExO) program: Final impact reports","Wiegand, A., & Sussell, J. (2016). Evaluation of the Re-Integration of Ex-Offenders (RExO) program: Final impact reports. Retrieved from the Department of Labor website: https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2015-10_The-Evaluation-of-the-Re-Integration-of-Ex-Offenders-%28RExO%29-Program-Final-Impact-Report_Acc.pdf",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Reintegration of Ex-Offenders (RExO) programs on employment, earnings, public benefits receipt, and recidivism outcomes. The study was a randomized controlled trial whose authors employed a statistical method to estimate the impact of RExO using data from four sources, including qualitative data generated from an implementation study, administrative data on criminal justice outcomes, administrative data on employment and earnings from the National Directory of New Hires, and a follow-up survey of participants. The study found that the RExO program did not increase the long-term employment, earnings, public benefit receipt, or recidivism. The quality of causal evidence on employment, earnings, public benefit receipt, and recidivism outcomes presented in this report is high because the evidence is based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would have been attributable to the RExO program and not to other factors had the study found statistically significant effects.","Reintegration of Ex-Offenders (RExO) programs","Job search assistance and supportive services Reentry Mentoring",Justice-involved,,"Urban, United States",2016,https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2015-10_The-Evaluation…,"Employment and Training Review Protocol" "Evaluation of the Connecticut Health and Life Sciences Career Initiative. Final report.","Mokher, C., & Pearson, J. (2016) Evaluation of the Connecticut Health and Life Sciences Career Initiative. Final report. Alexandria, VA: CNA Corporation.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Health and Life Sciences Career Initiative (HL-SCI) program on education outcomes. Using school records, the authors conducted a nonexperimental design to compare education outcomes of HL-SCI participants to a comparison group of non-participants. The study found no significant relationships between participation in HL-SCI and college persistence, credential completion, and credit accumulation. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention and did not include sufficient controls. This means we are not confident that the estimated effects are attributable to the HCI-SCI program; other factors are likely to have contributed.","the HL-SCI program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2016,https://www.cna.org/cna_files/pdf/CT%20HL-SCI%20Final%20Evaluation%20Report-FIN…,"Community College Review Protocol" "Providing public workforce services to job seekers: 15-month impact findings on the WIA Adult and Dislocated Worker programs [Comparison betwwen Full-WIA Services versus Core Services].","McConnell, S., Fortson, K., Rotz, D., Schochet, P., Burkander, P., Rosenberg, L., Mastri, A., & D’Amico, R. (2016). Providing public workforce services to job seekers: 15-month impact findings on the WIA Adult and Dislocated Worker programs. Washington, DC: Mathematica Policy Research. [Comparison betwwen Full-WIA Services versus Core Services]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult and Dislocated Worker programs on training, employment, earnings, and service receipt after 15 months. This summary focuses on the comparison between the group who received the full-WIA services versus the group who received core services. The study was a randomized controlled trial, where customers in each local area were randomly assigned to one of three groups: full-WIA, core-and-intensive, or core. The authors compared the outcomes between the groups from baseline to 15 months after random assignment. The study found that full-WIA customers were significantly more likely than core customers to complete a training program and receive a training credential. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to the Adult and Dislocated Worker programs and not to other factors.","Adult and Dislocated Worker programs","Adult and Dislocated Worker programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Adult, Unemployed",,"United States",2016,https://www.mathematica-mpr.com/our-publications-and-findings/publications/prov…,"Review Protocol" "2016 I-AM annual evaluation report: Iowa Advanced Manufacturing Statewide Consortium","de la Mora, A., Kemis, M., Callen, E., & Starobin, S. (2016). 2016 I-AM annual evaluation report: Iowa Advanced Manufacturing Statewide Consortium. Ames, IA: Research Institute for Studies in Education (RISE), Iowa State University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Iowa Advanced Manufacturing Consortium (I-AM) on welding student’s education, earnings, and employment outcomes. The study used a nonexperimental design to compare outcomes of students in the I-AM program to a matched comparison group of students. The study found that participating in the I-AM program was significantly associated with higher rates of credential attainment, larger numbers of certificates and welding awards earned, higher employment rates, and higher earnings. The quality of causal evidence presented in this study is low because the authors used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to I-AM; other factors are likely to have contributed.","the Iowa Advanced Manufacturing Consortium (I-AM)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,,"Community College Review Protocol" "Evaluation report of the Amplifying Montana's Advanced Manufacturing and Innovation Industry (AMAMII) project: Final report","Feldman, J., Staklis, S., Hong, Y., & Elrahman, J. (2016). Evaluation report of the Amplifying Montana's Advanced Manufacturing and Innovation Industry (AMAMII) project: Final report. Berkeley, CA: RTI International.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Amplifying Montana’s Advanced Manufacturing and Innovation and Industry (AMAMII) program on education outcomes. The authors used a nonexperimental design to compare the outcomes of students participating in AMAMII to a matched comparison group using institutional research data. The study found a significant negative relationship between program participation and credit accumulation, with AMAMII students accumulating fewer credits than comparison students. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analyses. This means we are not confident that the estimated effects are attributable to the AMAMII program; other factors are likely to have contributed.","the Amplifying Montana’s Advanced Manufacturing and Innovation and Industry (AMAMII) Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Low-skilled",,"United States",2016,http://www.skillscommons.org/bitstream/handle/taaccct/15588/Flathead%20Valley%2…,"Community College Review Protocol" "Effects of the unemployment insurance work test on long-term employment outcomes.","Lachowska, M., Meral, M., & Woodbury, S.A. (2016). Effects of the unemployment insurance work test on long-term employment outcomes. Labour Economics, 41, 246–265.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of more-stringent work search requirements for unemployment insurance (UI) claimants on earnings, employment, and UI benefit receipt outcomes over a nine-year follow-up period. This study extended the work of Johnson and Klepinger (1991), the CLEAR profile of which is available here. The CLEAR profile of a related study, Lachowska et al. (2015), is available here. The study examined data from a randomized controlled trial conducted in the 1980s in Washington State. UI claimants were randomly assigned to one of four groups, each with different work search requirements and/or verification of that work search. The authors used administrative data to compare the outcomes of the groups up to nine years after the initial UI claims. The study found that the groups with more-stringent work search requirements were more likely to be employed than the group with less-stringent requirements in the first year following their claims. They also received UI benefits payments for fewer weeks, exhausted UI benefits at a lower rate, and received fewer conditional payments in the year following their initial UI claims. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the more stringent work search requirements, and not to other factors.","More stringent work search requirements","RESEA Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",2016,,"Reemployment Review Protocol" "Consortium for Healthcare Education Online: Final Evaluation Report","Edwards, R., McKay, H., Mattoon, A., & Yang, S. (2016). Consortium for Healthcare Education Online: Final evaluation report. Piscataway, NJ: Rutgers Education and Employment Research Center.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Consortium for Healthcare Education Online (CHEO) on education, earnings, and employment outcomes. This summary contains the findings from Pueblo Community College. Using institutional, employment, and wage data, the authors conducted a nonexperimental design to compare the outcomes of students who were enrolled in the CHEO program to a historic comparison group of students from previous enrollment years. The study found that CHEO program participation was significantly associated with earning more course credits, a higher probability of passing courses and receiving a credential, greater likelihood of pursuing further education, and higher rates of employment after program completion. The quality of causal evidence presented in this study is low because the authors used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the CHEO program; other factors are likely to have contributed.","the Consortium for Healthcare Education Online (CHEO) Program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://epe.rutgers.edu/sites/default/files/images/Research_Documents/cheo_fina…,"Community College Review Protocol" "Final evaluation report Trade Adjustment Assistance Community College and Career Training (TAACCCT) Grant: Round 2.","Pacific Research and Evaluation, LLC. (2016). Final evaluation report Trade Adjustment Assistance Community College and Career Training (TAACCCT) Grant: Round 2. Portland, OR: Rogue Community College.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Pathways to Allied Health Professions (PATH) program on education, earnings, and employment outcomes. Using institutional and student survey data, the authors conducted a nonexperimental study to compare the outcomes of PATH program participants to non-participants. The study found no significant associations between PATH program participation and education, earnings, and employment outcomes. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the PATH program; other factors are likely to have contributed.","the Pathways to Allied Health Professions (PATH) Program","Basic skills Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9295/RCC%20TAACCCT%20Fin…,"Community College Review Protocol" "Learning about job search: A field experiment with job seekers in Germany","Altmann, S., Falk, A., Jäger, S., & Zimmermann, F. (2015). Learning about job search: A field experiment with job seekers in Germany. Unpublished manuscript.","Behavioral Insights","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine whether providing job search information to unemployed job seekers affected their labor market outcomes. German citizens identified as unemployed were randomly assigned to the treatment group, which was mailed an informational brochure, or to the control group, which was not mailed a brochure. The Integrated Employment Biographies, an administrative database available through the German Federal Employment Agency, was the primary data source for the study. The study did not find any statistically significant effects of the brochure on the employment or earnings outcomes of the treatment group relative to the control group. However, the study did find positive impacts of the brochure on earnings and employment outcomes for the subgroup of individuals who had been identified as being at risk of long-term unemployment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the informational brochure, and not to other factors.",,"Job search assistance and supportive services Behavioral interventions","Adult, Unemployed",,International,2015,https://www.cens.uni-bonn.de/team/board/armin-falk/afjz-job-search-dp-150509.pdf,"Behavioral Insights Review Protocol" "Third-party evaluation of the outcomes and impact of the National Information, Security, & Geospatial Technologies Consortium (NISGTC)","Bridges, K., Bishop, C., & Giani, M. (2015). Third-party evaluation of the outcomes and impact of the National Information, Security & Geospatial Technologies Consortium (NISGTC). Champaign, IL: Office of Community College Research and Leadership, University of Illinois at Urbana-Champaign.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to assess the impact of TAACCCT-funded programming offered at National Information Security & Geospatial Technology Consortium (NISGTC) colleges on educational and employment outcomes. Using student-level data collected by the colleges’ Institutional Research offices and states’ Unemployment Insurance data systems, the study used a nonexperimental design to compare the outcomes of students enrolled in NISGTC programs with students enrolled in similar programs of study prior to the grant. The study found that students in the NISGTC-affected programs were significantly more likely to attain credentials and have higher average quarterly earnings than students in the comparison group. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis for the education outcomes. This means we are not confident that the estimated effects are attributable to the NISGTC-affected programs; other factors are likely to have contributed.","National Information Security & Geospatial Technology Consortium (NISGTC) Programs","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Other, Low-skilled",,"United States",2015,https://occrl.illinois.edu/docs/librariesprovider4/nisgtc/nisgtc-impact.pdf,"Community College Review Protocol" "A controlled trial of supported employment for people with severe mental illness and justice involvement","Bond, G. R., Kim, S. J., Becker, D. R., Swanson, S. J., Drake, R. E., Krzos, I. M., . . . Frounfelker, R. L. (2015). A controlled trial of supported employment for people with severe mental illness and justice involvement. Psychiatric Services, 66(10), 1027-1034.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Individual Placement and Support (IPS) intervention on employment and recidivism outcomes relative to a job club program called Work Choice. The authors used an experimental design to estimate the impact of IPS and analyzed data from people’s self-reports on forms and interviews and electronic medical and employment records. The authors found positive statistically significant impacts of IPS on employment compared with the job club program. The authors found no statistically significant impacts of IPS on recidivism. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the IPS intervention and not to other factors.","the Individual Placement and Support (IPS) intervention","Health Reentry","Justice-involved, Unemployed",,"United States",2015,https://doi.org/10.1176/appi.ps.201400510,"Employment and Training Review Protocol" "The effects of eliminating the work search requirement on job match quality and other long-term employment outcomes.","Lachowska, M., Meral, M., & Woodbury, S.A. (2015). The effects of eliminating the work search requirement on job match quality and other long-term employment outcomes. Washington, DC: U.S. Department of Labor.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of less-stringent work search requirements for unemployment insurance (UI) claimants on earnings, employment, and UI benefit receipt over a nine-year follow-up period. This study extended the work of Johnson and Klepinger (1991), the CLEAR profile of which is available here. The CLEAR profile of a related study, Lachowska et al. (2016), is available here. The study examined data from a randomized controlled trial conducted in the 1980s in Washington State. UI claimants were randomly assigned to one of four groups, each with different work search requirements and/or verification of that work search. The authors used administrative data to compare the outcomes of the groups up to nine years after the initial UI claims. The study found that the group with less-stringent work-search requirements was significantly less likely to be employed in the first quarter following their claims, compared with the groups with more-stringent requirements. In addition, they received more UI benefit payments for more weeks and exhausted UI benefits at a higher rate during the year following their initial claims. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the less-stringent work search requirements, and not to other factors.","Less stringent work search requirements","RESEA Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",2015,https://www.dol.gov/asp/evaluation/completed-studies/2013-2014-scholar-programs…,"Reemployment Review Protocol" "An experimental evaluation of a comprehensive employment-oriented prisoner re-entry program","Cook, P. J., Kang, S., Braga, A. A., Ludwig, J., & O’Brien, M. E. (2015). An experimental evaluation of a comprehensive employment-oriented prisoner re-entry program. Journal of Quantitative Criminology, 31, 355-382.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Milwaukee Safe Street Prisoner Release Initiative on employment, earnings, public benefit receipt, and recidivism. Drawing on administrative data from the Wisconsin Department of Corrections, the study used a randomized controlled trial to estimate program impacts. The authors used statistical models to compare the outcomes of treatment and comparison group members. The study found that those in the treatment group had significantly higher earnings and rates of employment and significantly lower likelihood of new arrests than those in the control group. The study found no significant differences between the groups in the likelihood of reimprisonment in the one year of follow-up. The quality of causal evidence presented in this report for the recidivism outcomes is moderate because it was based on a randomized controlled trial in which the authors did not account for the different probabilities of assignment to the treatment group; nevertheless, this study can be considered to have employed a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to Milwaukee Safe Street Prisoner Release Initiative and not to other factors. The quality of causal evidence presented in this report for the employment, earnings, and public benefit receipt outcomes is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Milwaukee Safe Street Prisoner Release Initiative; other factors are likely to have contributed.","the Milwaukee Safe Street Prisoner Release Initiative","Reentry Work based and other occupational training",Justice-involved,,"Urban, United States",2015,https://www.researchgate.net/profile/Philip_Cook2/publication/284942331_An_Expe…,"Employment and Training Review Protocol" "Job rationing in recessions: evidence from work-search requirements.","Toohey, D. (2015). Job rationing in recessions: evidence from work-search requirements. Newark, Delaware: University of Delaware.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of required contacts with employers on Unemployment Insurance (UI) claimants’ employment and UI benefit receipt. The study used a nonexperimental design in which the author compared the labor market outcomes of UI claimants in different states who were subject to different job search requirements between 2001 and 2013. The study found that an increase in the number of required contacts with employers was associated with decreases in the unemployment rate. Accounting for expected employment growth along with changes in the number of required contacts also decreased the unemployment rate. The study found no statistically significant relationships between the number of required contacts and UI claim duration. The quality of causal evidence presented in this report is low because the author did not account for differences in the age of UI claimants in the analysis. This means we are not confident that the estimated effects are attributable to required contacts with employers; other factors are likely to have contributed.","More stringent work search requirements","RESEA Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",2015,,"Reemployment Review Protocol" "An outcome evaluation of a prison work release program: Estimating its effects on recidivism, employment, and cost avoidance","Duwe, G. (2015). An outcome evaluation of a prison work release program: Estimating its effects on recidivism, employment, and cost avoidance. Criminal Justice Policy Review, 26(6), 531-554.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of the Minnesota Department of Correction’s work release program on post-release employment, earnings, and recidivism outcomes for adult offenders. The author used a nonexperimental design (propensity score matching) to create a comparison group of nonparticipants who were similar to program participants. The author estimated the program’s effects by comparing these groups’ post-release employment, earnings, and recidivism outcomes using data from the Minnesota Bureau of Criminal Apprehension, Minnesota Department of Corrections, and the Minnesota Department of Employee and Economic Development. The author found that, on average, program participation decreased the risk of reconviction by 14 percent and of re-incarceration by 17 percent, but increased the risk of participants having their supervised release revoked for a technical violation by 78 percent. The quality of causal evidence presented in this report is moderate for outcomes related to recidivism and low for post-release employment and earnings outcomes. This means we are somewhat confident that the estimated effects on recidivism are attributable to the work release program, although other factors might also have contributed, and we are not confident that the estimated effects on employment and earnings are attributable to the program; other factors are likely to have contributed.","Minnesota Department of Correction’s work release program","Job search assistance and supportive services Reentry",Justice-involved,,"United States",2015,,"Employment and Training Review Protocol" "Veterans Homelessness Prevention Demonstration evaluation: Final report","Cunningham, M. K., Biess, J., Emam, D., & Burt., M. R. (2015). Veterans Homelessness Prevention Demonstration evaluation: Final report. Washington, DC: Urban Institute.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Mixed impacts Public benefit receipt","Summary: The study examined the effect of the Veterans Homelessness Prevention Demonstration (VHPD) program on the employment, earnings, public benefit receipt, and education and training outcomes of veterans at risk of homelessness. The study uses a nonexperimental design to examine whether there were changes in veterans’ outcomes from before the program began to six months after the program ended using self-reported data directly from the veterans. The study found statistically significant positive relationships between the VHPD program and veterans’ employment and earnings six months after the program ended compared with before the program. The study found mixed relationships between the VHPD program and public benefit receipt: significantly fewer veterans in the study received several types of public benefits, such as Temporary Assistance for Needy Families (TANF) or the Supplemental Nutrition Assistance Program (SNAP). Significantly more veterans in the study, however, received Veterans Pension benefits after the program compared with before it. The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects are attributable to the VHPD program; other factors are likely to have contributed.","the Veterans Homelessness Prevention Demonstration (VHPD) program","Job search assistance and supportive services Other training and education","Low income, Veteran or military, Homeless",,"United States",2015,http://apps.urban.org/features/homeless-veterans/,"Employment and Training Review Protocol" "Training program impacts and the onset of the Great Recession. [Dislocated worker sample]","Heinrich, C.J., and Mueser, P. (2014). Training program impacts and the onset of the Great Recession. Columbia, MO: Department of Economics, University of Missouri-Columbia, unpublished. [Dislocated worker sample]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages","Summary: The study’s objective was to examine whether participation in the Workforce Investment Act (WIA) Dislocated Worker Program services increased participants' earnings and if so, whether those gains were greater during a recessionary period than in periods before and after the recession. The authors analyzed administrative data to compare the quarterly earnings of participants receiving services through the WIA Dislocated Worker Program with those of a matched comparison group that received Wagner-Peyser Employment Services (ES). The study presented impacts separately by gender and program year. The study found that males receiving services through the WIA Dislocated Worker Program from July 2007 to December 2007 (before the recession), from January 2008 to June 2008 (at the beginning of the recession), and from July 2008 to June 2009 (during the worst of the recession) earned less than males in the comparison group in most of the 16 follow-up quarters examined. In no quarter did females participating in the WIA Dislocated Worker Program before, during, or after the recession earn more than females in the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WIA Dislocated Worker Program services, but other factors might also have contributed. The report also examined the impacts of WIA Adult Program services; that profile is available here.","the Workforce Investment Act (WIA) Dislocated Worker Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs Job search assistance and supportive services","Dislocated or displaced worker, Female, Male",,"United States",2014,https://www.missourieconomy.org/pdfs/WDQI_MissouriReport_TrainingProgramImpacts…,"Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute Technical Report No. 13-029). [VOC]","Hollenbeck, K., & Huang, W-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute Technical Report No. 13-029). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. Retrieved from W.E. Upjohn Institute for Employment Research website: http://dx.doi.org/10.17848/tr13-029. [VOC]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Vocational Rehabilitation (VOC) programs on the employment rate, earnings, and benefit receipt of adults with disabilities in Washington State. The authors used a nonexperimental method to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and Unemployment Insurance benefits between those who took part in VOC programs relative to those who were eligible, but did not receive services from VOC programs. The study found that, compared with those who did not receive services from VOC programs, VOC program participants had higher employment and earnings. Receipt of benefits was lower in the short-term for VOC program participants relative to those who did not receive VOC program services. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to VOC programs; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Vocational Rehabilitation (VOC) Programs","Unemployment Insurance Vocational rehabilitation",Disability,,"United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica…,"Employment and Training Review Protocol" "Work-related CBT versus vocational services as usual for unemployed persons with social anxiety disorder: A randomized controlled pilot trial.","Himle, J., Bybee, D., Steinberger, E., Laviolette, W., Weaver, A., Vlnka, S., Golenberg, Z., Levine, D., Heimberg, R., & O’Donnell, L. (2014). Work-related CBT versus vocational services as usual for unemployed persons with social anxiety disorder: A randomized controlled pilot trial. Behaviour Research and Therapy, 63, 169-176.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of group-based, work-related cognitive-behavioral therapy (CBT) on work-related outcomes of unemployed, homeless people diagnosed with social anxiety disorder. The study was a randomized controlled trial. The authors randomly assigned eligible participants to either a treatment group, which received work-related CBT and vocational services, or to a control group, which received vocational services alone. Trained independent evaluators collected the self-reported data used in the study. The study found that participants assigned to the treatment group had higher job search self-efficacy and activity than participants assigned to the control group. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects on employment are attributable to work-based CBT; other factors are likely to have contributed.",,"Job search assistance and supportive services","Unemployed, Low income, Homeless",,"United States",2014,,"Employment and Training Review Protocol" "Gasper, J., & Henderson, K. (2014). Sector-focused career centers evaluation: Effects on employment and earnings after one year.","Gasper, J., & Henderson, K. (2014). Sector-focused career centers evaluation: Effects on employment and earnings after one year. New York: New York City Center for Economic Opportunity. Retrieved from http://www.nyc.gov/html/ceo/downloads/pdf/CEO-Sector_Based_Approaches_Evaluation_Report-2014_final.pdf.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of sector-focused career centers in New York City on employment and earnings. The authors estimated the effect of sector-focused career centers by comparing employment and earnings outcomes captured in New York State unemployment insurance data among participants in New York City sector-focused career centers against the outcomes for individuals served by New York City career centers without a specific sector focus who were deemed similar in terms of initial characteristics to the sector-focused group. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the authors did not demonstrate that the groups were similar at baseline or make statistical adjustments for differences between the two groups in the analyses. This means we are not confident that the estimated effects are attributable to sector-focused career centers; other factors are likely to have contributed.","New York City Sector-focused Career Centers","Job search assistance and supportive services Other employment and reemployment","Low income","Manufacturing, Health care and social assistance, Transportation and warehousing","Urban, United States",2014,http://www.nyc.gov/html/ceo/downloads/pdf/CEO-Sector_Based_Approaches_Evaluatio…,"Employment and Training Review Protocol" "Training program impacts and the onset of the Great Recession. [Adult sample]","Heinrich, C.J., and Mueser, P. (2014). Training program impacts and the onset of the Great Recession. Columbia, MO: Department of Economics, University of Missouri-Columbia, unpublished. [Adult sample]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages","Summary: The study’s objective was to examine whether participation in the Workforce Investment Act (WIA) Adult Program services increased participants' earnings and if so, whether those gains were greater during a recessionary period than in periods before and after the recession. The authors analyzed administrative data to compare the quarterly earnings of participants receiving services through the WIA Adult Program with those of a matched comparison group that received Wagner-Peyser Employment Services (ES). The study presented impacts separately by gender and program year. The study found that males and females receiving services from the WIA Adult Program from June to December 2007 (before the recession) earned more, on average, than the comparison group in some, but not all, of the 16 follow-up quarters examined. Males and females receiving services from July 2008 to June 2009 and from July 2009 to June 2010 (after the onset of the recession) tended to earn less, on average, than the comparison group in most of the 16 follow-up quarters. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WIA Adult Program services, but other factors might also have contributed. The report also examined the impacts of WIA Dislocated Worker services; that profile is available here.","the Workforce Investment Act (WIA) Adult Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Dislocated or displaced worker, Female, Male",,"United States",2014,https://www.missourieconomy.org/pdfs/WDQI_MissouriReport_TrainingProgramImpacts…,"Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute Technical Report No. 13-029). [WIA Youth]","Hollenbeck, K., & Huang, W-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute Technical Report No. 13-029). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. Retrieved from W.E. Upjohn Institute for Employment Research website: http://dx.doi.org/10.17848/tr13-029. [WIA Youth]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Youth Program, held on community and technical college campuses, on the employment rate and earnings of low-income youth in Washington State. The authors used a nonexperimental method to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment and earnings between those who took part in the WIA Youth program relative to those who registered for services at the Labor Exchange (Employment Services). The study found that, compared with those who registered for services at the Labor Exchange, WIA Youth participants had higher employment and earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Youth Program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Youth Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Youth programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Youth, Low-skilled, Low income",,"United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica…,"Employment and Training Review Protocol" "Sustained gains: Year Up’s continued impacts on young adults’ earnings","Roder, A., & Elliott, M. (2014). Sustained gains: Year Up’s continued impacts on young adults’ earnings. New York: Economic Mobility Corporation.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of the Year Up program on employment, earnings, and education outcomes. Year Up is an intensive, yearlong program that provides training and internships in financial operations and information technology for young adults from low-income urban communities. About 200 students in three cities were randomly assigned to the treatment group, which was eligible to participate in Year Up beginning in September 2007, or the control group, which was not eligible to participate in Year Up in 2007. Members of the control group were eligible to reapply to the program after 10 months, and many did. The authors compared the outcomes of the treatment and control groups using data collected through telephone interviews with participants four years after random assignment. The authors reported a positive, statistically significant impact of Year Up on earnings measured three years after random assignment, but these impacts did not extend to the fourth year after random assignment. Cumulatively, treatment group members earned $13,645 more than the control group over years 2 through 4 after random assignment, and they were more likely to have been employed in a field targeted by the program. The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to Year Up, although other factors could also have contributed.","Year Up","Basic skills Other training and education Work based and other occupational training Youth programs","Youth, Black or African American, Hispanic of any race, Low-skilled, Low income",,"United States, Urban",2014,http://economicmobilitycorp.org/uploads/sustained-gains-economic-mobility-corp…,"Opportunities for Youth Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). [WIA Adult]","Hollenbeck, K., & Huang, W.-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). Retrieved from W.E. Upjohn Institute for Employment Research website: http://dx.doi.org/10.17848/tr13-029 [WIA Adult]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program on the employment rate, earnings, and benefit receipt of low-income adults in Washington State. The authors used a nonexperimental method to compare short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and Unemployment Insurance benefits between those who took part in the WIA Adult Program with those who registered for services at the Labor Exchange Employment Services. The study found that, compared with those who registered for services at the Labor Exchange, participants in the WIA Adult Program had higher employment rates and average quarterly earnings and lower receipt of unemployment insurance benefits. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Adult Program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Adult Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Low-skilled, Low income",,"United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica…,"Employment and Training Review Protocol" "Reference-dependent job search: Evidence from Hungary","DellaVigna, S., Lindner, A., Reizer, B., & Schmieder, J. (2014). Reference-dependent job search: Evidence from Hungary. Unpublished working paper.","Behavioral Insights","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to empirically test a behavioral model of job search using a reform in Hungary’s Unemployment Insurance (UI) program. The authors compared rates of exit from unemployment in groups of claimants who entered UI before and after the reform’s implementation in November 2005. The authors used social security and UI data from Hungary’s Institute of Economics and National Employment Service. The study found support for the behavioral job search model and theorized that approximately budget-neutral transitions to two-step UI systems could speed claimants’ exit out of unemployment. The quality of causal evidence presented in this report is low because it cannot account for factors other than the UI program that also changed over the period of study and could also have influenced the outcomes of interest. This means we are not confident that the estimated effects are attributable to Hungary’s 2005 UI reform; other factors are likely to have contributed.","Hungary’s Unemployment Insurance Reform","Unemployment Insurance Behavioral Interventions Job search assistance and supportive services","Adult, Unemployed, Dislocated or displaced worker",,International,2014,http://eml.berkeley.edu/~sdellavi/wp/HungaryUIRD_wp_2014_07_20.pdf,"Behavioral Insights Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). [WIA Dislocated Workers]","Hollenbeck, K., & Huang, W-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). Retrieved from W.E. Upjohn Institute for Employment Research website: http://dx.doi.org/10.17848/tr13-029%20[WIA Dislocated Workers]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Dislocated Worker Program on the employment rate, earnings, and benefit receipt of dislocated workers in Washington State. The authors assigned dislocated workers to the treatment group if they received employment-related services through the WIA Dislocated Worker Program and exited from July 2005 to June 2006 or from July 2007 to June 2008. The comparison group comprised workers who registered for services at the Labor Exchange during this period. The study found that in both the short and long term the employment rate and average quarterly earnings increased for those in the treatment group compared to those in the comparison group. Benefit receipt decreased for those in the treatment group compared with those in the comparison group. The quality of causal evidence presented in this report is low because the treatment and comparison group were compared at different follow-up points and therefore were not equivalent. This means we are not confident that the estimated effects are attributable to the WIA Dislocated Worker Program; other factors are likely to have contributed.","the Workforce Investment Act (WIA) Dislocated Worker Program","Job search assistance and supportive services Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Dislocated or displaced worker",,"United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica…,"Employment and Training Review Protocol" "Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) for veterans with traumatic brain injury: Pilot randomized controlled trial","Twamley, E., Jak, A., Delis, D., Bondi, M., & Lohr, J. (2014). Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) for veterans with traumatic brain injury: Pilot randomized controlled trial. Journal of Rehabilitation Research and Development, 51(1), 59-70.","Disability Employment Policy, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of adding Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) to standard supported employment programming for veterans with a history of traumatic brain injury (TBI) and persistent related postconcussive symptoms. Veterans were referred to the program and completed a series of baseline neurocognitive and neuropsychological assessments to determine eligibility. Eligible veterans were randomly assigned to either the CogSMART treatment group, which received supported employment, enhanced by CogSMART sessions, or to a control group that did not participate in CogSMART sessions. The study found that veterans in the CogSMART group demonstrated statistically significant reductions in postconcussive symptoms and improvements in prospective memory functioning. Although a higher proportion of the treatment group entered competitive employment within 14 weeks of starting the program—50 percent compared to 26 percent in the control group—the difference was not statistically significant. The quality of causal evidence presented in this study is low because it is a randomized controlled trial with high or unknown attrition and no control variables included in the analysis. This means we are not confident that the estimated effects are attributable to CogSMART. Other factors are likely to have contributed.","Cognitive Symptom Management and Rehabilitation Therapy","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2014,,"Disability Employment Policy, Veterans Review Protocol" "Training program impacts and the onset of the Great Recession. [TAA sample]","Heinrich, C.J., and Mueser, P. (2014). Training program impacts and the onset of the Great Recession. Columbia, MO: Department of Economics, University of Missouri-Columbia, unpublished. [TAA sample]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages","Summary: The study’s objective was to examine whether participation in the Trade Adjustment Assistance (TAA) Program services increased participants’ earnings and, if so, whether those gains were greater during a recessionary period than in periods before and after the recession. The authors analyzed administrative data to compare the quarterly earnings of TAA participants with those of a matched comparison group that received Wagner-Peyser Employment Services (ES). The study presented impacts separately by gender and program year. The study found that males and females who received services through the TAA Program earned less, on average, than the comparison group during almost all of the 16 follow-up quarters examined. This held regardless of whether the participants began receiving services before, during, or after the recession. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to services received through the TAA Program, but other factors might also have contributed.","the Trade Adjustment Assistance (TAA) Program","Job search assistance and supportive services Other training and education","Dislocated or displaced worker, Female, Male",,"United States",2014,https://www.empiwifo.uni-freiburg.de/sonstige-dateien/heinrich-mueser_trainingi…,"Review Protocol" "An experimental evaluation of a nationally recognized employment-focused offender reentry program.","Farabee, D., Zhang, S. X., & Wright, B. (2014). An experimental evaluation of a nationally recognized employment-focused offender reentry program. Journal of Experimental Criminology, 10(3), 309–322.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study examined the impact of an employment-focused offender reentry program (STRIVE) operated in Southern California on the education, employment, and recidivism outcomes of a sample of people released from prison or jail between 2008 and 2011. Study members were randomly assigned to either receive STRIVE services (the treatment) or a list of other resources in the community, but not STRIVE services (the control). The primary data sources were interviews conducted at baseline and 12 months after random assignment and administrative recidivism data provided by the California Department of Justice. The study found no statistically significant relationships between STRIVE and education, employment, or recidivism 12 months after random assignment. The study also found no statistically significant relationship between STRIVE and recidivism two years after random assignment. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with fewer members of the control group participating in the study at follow-up than members of the STRIVE intervention group (thus, the study has high attrition). The authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects would have been attributable to the STRIVE program if the study had found statistically significant effects.","the STRIVE program","Reentry Other training and education",Justice-involved,,"United States",2014,,"Employment and Training Review Protocol" "CogSMART compensatory cognitive training for traumatic brain injury: Effects over 1 year","Twamley, E. W., Thomas, K. R., Gregory, A. M., Jak, A. J., Bondi, M. W., Delias, D. C., & Lohr, J. B. (2014). CogSMART compensatory cognitive training for traumatic brain injury: Effects over 1 year. Journal of Head Trauma Rehabilitation, 30(6), 391-401.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) and enhanced supported employment (ESE) on employment, earnings, and health outcomes. The authors conducted a randomized controlled trial that randomly assigned participants to the intervention and comparison groups. Employment data came from weekly reports on job attainment, hours worked, and wages earned. The study did not find any statistically significant relationships between CogSMART plus ESE and employment, earnings, or health outcomes. The quality of causal evidence presented in this report is low because the study had a confounding factor. Specifically, one interventionist delivered CogSMART plus ESE and another interventionist implemented services to the comparison group, which makes it impossible to separate the effect of CogSMART plus ESE from the effect of the individual interventionists. This means we are not confident that the estimated effects are attributable to CogSMART plus ESE; other factors are likely to have contributed to the findings.","CogSMART Plus ESE","Health Job search assistance and supportive services Supported employment or other employment supports Veterans' reemployment","Disability, Veteran or military",,"United States",2014,https://doi.org/10.1097/HTR.0000000000000076,"Employment and Training Review Protocol" "Can post-employment services combined with financial incentives improve employment retention for welfare recipients?","Dorsett, R., Hendra, R., Robins, P. K., & Williams, S. (2013). Can post-employment services combined with financial incentives improve employment retention for welfare recipients? Evidence from the Texas Employment Retention and Advancement evaluation. (No. 1413-13). Madison, WI: Institute for Research on Poverty.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Texas Employment Retention and Advancement (ERA) program on employment entry and retention in two sites: Corpus Christi and Fort Worth. The authors conducted a non-experimental study using data originally collected for a randomized controlled trial. They analyzed survey data and state Unemployment Insurance records to estimate the effects of the ERA program on employment entry and retention. The study found a positive and statistically significant relationship between participation in the ERA program and the likelihood of transitioning into employment and between ERA and employment retention at the Corpus Christi site. The quality of causal evidence presented in this report is low because the authors did not account for differences in wages or employment between the ERA and comparison groups before the beginning of the ERA program. This means we are not confident that the estimated effects are attributable to the Texas ERA program; other factors are likely to have contributed.","Texas Employment Retention and Advancement (ERA)","Job search assistance and supportive services Other wages and benefits","Unemployed, Low income, Female",,"United States",2013,http://www.niesr.ac.uk/sites/default/files/publications/dp409_0.pdf,"Review Protocol" "Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up","LePage, J. P., Lewis, A. A., Washington, E. L., Davis, B., & Glasgow, A. (2013). Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up. Journal of Rehabilitation Research & Development, 50(2), 183-191. doi:10.1682/JRRD.2011.09.0163 [Full About Face vs. VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of About Face (AF) vocational classes on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of veterans: (1) those who participated in the AF classes (full AF program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected monthly data from participants in person or over the phone. The study revealed significantly higher competitive employment in the full AF program (40.7 percent hired) than in the VERC-only condition (16.7 percent hired). The study also showed that veterans in the full AF program worked more months on average than veterans in the VERC-only condition (1.37 months vs. 0.35 months). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://www.rehab.research.va.gov/JOUR/2013/502/pdf/lepage502.pdf,"Reentry, Veterans Review Protocol" "Initial impacts of the Ticket to Work program for young new Social Security disability awardees: Estimates based on randomly assigned mail months","Stapleton, D., Mamun, A., & Page, J. (2013). Initial impacts of the Ticket to Work program for young new Social Security disability awardees: Estimates based on randomly assigned mail months. Princeton, NJ: Mathematica Policy Research, Center for Studying Disability Policy.","Disability Employment Policy, Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: This study examined impacts of the Ticket to Work (TTW) program, a work incentive program for Social Security disability recipients, on achieving Social Security Disability Insurance (SSDI) return-to-work earnings benchmarks and SSDI benefit suspension or termination for work. The study sample included SSDI recipients who entered the rolls from July 1999 to October 2003, were ages 18 to 39, and were not concurrently receiving Supplemental Security Income (SSI). The authors used data from the Ticket Research File (TRF), a Social Security administrative data file, for the analysis. The study found that TTW did not have a statistically significant impact on SSDI return to work earnings benchmarks or the number of SSDI recipients who had their benefits suspended or terminated due to work. The quality of the causal evidence presented in this report is moderate, the highest possible rating for a nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to TTW, but other factors might have contributed.","Ticket to Work","Disability insurance Supplemental security income (SSI) Supported employment or other employment supports","Disability, Low income",,"United States",2013,http://www.mathematica-mpr.com/~/media/publications/pdfs/disability/ttw_initial…,"Disability Employment Policy, Low-Income Adults Review Protocol" "Is Internet job search still ineffective?","Kuhn, P., & Mansour, H. (2013). Is Internet job search still ineffective? The Economic Journal, 124 (December), 1213-1233.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to determine whether the finding from a previous study that Internet job searches increased unemployment duration was upheld using more recent data. Specifically, the authors compared the impact of Internet job searches on unemployment duration using survey data from 2005–2008 to the estimated impact from a prior study on Internet job searches that used 1998–2001 survey data. The study used a nonexperimental design to compare the impacts of Internet job searches on the duration of unemployment at two different time periods. For the first time period, the authors analyzed data from the United States Current Population Survey (CPS) from 1998 to 2001. For the second time period, the authors used data from the National Longitudinal Survey of Youth (NLSY) 1997 sample, covering 2005 to 2008. The study found that in the earlier period (1998–2001) unemployed adults who used the Internet for any job search activities were unemployed 22 percent longer than those who did not use the Internet, whereas in the later period (2005–2008) young adults who used the Internet for job search activities were reemployed 25 percent faster than comparable workers who did not use the Internet as part of their job search strategy. Thus, the study found that the effect of using the Internet as part of a job search strategy on unemployment durations reversed in the 10 years covered by the two studies. The quality of causal evidence presented in this report is low because the authors did not account for other factors that might have affected unemployment duration. This means we are not confident that the estimated effects are attributable to the use of Internet search activities; other factors might have contributed.",,"Job search assistance and supportive services","Adult, Unemployed",,"United States",2013,,"Review Protocol" "Does federally-funded job training work? Nonexperimental estimates of WIA training impacts using longitudinal data on workers and firms","Andersson, F., Holzer, H. J., Lane, J. I., Rosenblum, D., & Smith, J. (2013). Does federally-funded job training work? Nonexperimental estimates of WIA training impacts using longitudinal data on workers and firms (Discussion paper no. 7621). Bonn, Germany: IZA. [Dislocated Worker Program ONLY]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Employment-Mod/high-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) dislocated worker program’s training services on the employment and earnings of dislocated workers. The authors investigated similar research questions in another study. The other study examined the effects of WIA’s adult program’s training services on the employment and earnings of low-income adults. The authors used a regression model with inverse propensity weights to compare the earnings and employment outcomes of WIA-registered dislocated workers who received training services to the outcomes of those who were registered in WIA, but did not receive training services. The study found that employment was initially significantly lower for the treatment group than for the comparison group in the quarters after WIA registration (Quarters 1 and 2 in State A and Quarters 1–4 in State B), but later became and stayed significantly higher in general in Quarters 6 through 12 in both states. The treatment group earned significantly less than the comparison group in the three years after WIA registration. People in the treatment group earned an average of $5,567 and $5,227 less than those in the comparison group in State A and State B, respectively. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design; this is the highest causal evidence rating possible for a nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the training services received from the WIA dislocated workers program, but other factors might also have contributed.","the Workforce Investment Act (WIA) Dislocated Worker Program","Adult and Dislocated Worker programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Dislocated or displaced worker",,"United States",2013,https://www.nber.org/papers/w19446.pdf,"Employment and Training Review Protocol" "Youth Initiated Mentoring: Investigating a new approach to working with vulnerable adolescents","Schwartz, S., Rhodes, J., Spencer, R., & Grossman, J. (2013). Youth Initiated Mentoring: Investigating a new approach to working with vulnerable adolescents. American Journal of Community Psychology, 52, 155–169.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: The study examined Youth Initiated Mentoring (YIM) within the context of the National Guard Youth ChalleNGe Program (NGYCP). Unlike a traditional mentoring program in which mentors are assigned to youth, under YIM, youth nominate their own mentors. The authors conducted a quantitative analysis using data from the 9-, 21- and 38-month follow-up surveys administered as part of a national evaluation of NGYCP, along with qualitative analysis of interviews with a subsample of NGYCP participants. The study found that YIM mentors included family friends, extended family members and godparents, school and extracurricular staff, and religious leaders. By the 38-month follow-up survey, 56 percent of youth reported still being in contact with their mentors. In addition, NGYCP youth who were in contact with their mentors at the 38-month follow-up showed significant benefits on a range of outcomes compared with the control group.","Youth Initiated Mentoring in the National Guard Youth ChalleNGe","Mentoring Youth programs","Youth, Disconnected youth",,"United States",2013,,"Opportunities for Youth Review Protocol" "Predictors of financial self-sufficiency among Social Security beneficiaries with psychiatric disabilities","Russinova, Zlatka, Rogers, E. Sally, Langer Ellison, Marsha, Bloch, Philippe, Lyass, Asya, & Wewiorski, Nancy. (2013). Predictors of financial self-sufficiency among Social Security beneficiaries with psychiatric disabilities. Journal of Vocational Rehabilitation, 38, 49–66.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study explored factors associated with the capacity of Social Security recipients with psychiatric disabilities to leave the Social Security disability rolls due to substantial gainful work activity. Data were from a survey conducted from May 2004 to January 2005 as part of a subsequent study of 213 participants in an earlier intervention that offered mental health treatment and assistance in finding competitive jobs to adults with psychiatric disabilities. Results suggested that people with higher occupational status, higher levels of proactive coping skills, and without medical comorbidities were more likely than other beneficiaries with psychiatric disabilities to terminate Social Security disability benefits and achieve financial self-sufficiency due to gainful employment.",,"Health Disability insurance Supplemental security income (SSI) Job search assistance and supportive services",Disability,,"United States",2013,,"Disability Employment Policy Review Protocol" "Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up","LePage, J. P., Lewis, A. A., Washington, E. L., Davis, B., & Glasgow, A. (2013). Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up. Journal of Rehabilitation Research & Development, 50(2), 183-191. doi:10.1682/JRRD.2011.09.0163 [Full About Face vs. self-study]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: This study examined the impact of About Face (AF) vocational classes on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who participated in the AF classes (full AF program) and (2) those who did not take the classes but had access to the AF manual to study on their own (self-study program). The authors collected monthly data from participants in person or over the phone. The study revealed significantly higher competitive employment among justice-involved veterans in the full AF program (40.7 percent hired) than in the self-study condition (11.9 percent hired). The study also showed that justice-involved veterans in the full AF program worked more months on average than justice-involved veterans in the self-study condition (1.37 months vs. 0.16 months). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://www.rehab.research.va.gov/JOUR/2013/502/pdf/lepage502.pdf,"Reentry, Veterans Review Protocol" "Veterans Health Administration vocational services for Operation Iraqi Freedom/Operation Enduring Freedom Veterans with mental health conditions","Twamley, E., Baker, D., Norman, S., Pittman, J., Lohr, J., & Resnick, S. (2013). Veterans Health Administration vocational services for Operation Iraqi Freedom/Operation Enduring Freedom Veterans with mental health conditions. Journal of Rehabilitation Research & Development, 50(5), 663-670.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: This study examined the impact of supported employment encounters on competitive employment for Operation Iraqi Freedom/Operation Enduring Freedom (OIF/OEF) veterans with mental health conditions. The study used statistical tests to examine differences between groups of OIF/OEF veterans with specified mental health conditions who had at least one supported employment encounter versus those who did not. The data for this study came from two nationwide Veterans Health Administration (VHA) databases for fiscal years 2008 and 2009. The study showed that having at least one supported employment encounter was associated with obtaining competitive employment. The quality of causal evidence presented in this report is low because the authors were not able to establish that the treatment and comparison groups were similar before the intervention. This means we are not confident that the estimated effects are attributable to VHA-supported employment encounters; other factors likely contributed to the effects.",,"Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://doi.org/10.1682/jrrd.2012.08.0137,"Employment and Training Review Protocol" "Does federally-funded job training work? Nonexperimental estimates of WIA training impacts using longitudinal data on workers and firms","Andersson, F., Holzer, H. J., Lane, J. I., Rosenblum, D., & Smith, J. (2013). Does federally-funded job training work? Nonexperimental estimates of WIA training impacts using longitudinal data on workers and firms (Discussion paper no. 7621). Bonn, Germany: IZA. [Adult Program ONLY]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Employment-Mod/high-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) adult program’s training services on the employment and earnings of low-income adults. The authors investigated similar research questions in another study, whose profile can be found [here]. The other study examined the effects of WIA’s dislocated worker program’s training services on the employment and earnings of dislocated workers. The authors used statistical analysis to compare the earnings and employment outcomes of WIA-registered low-income adults who received training services to the outcomes of those who were registered in WIA, but did not receive training services. The study found that employment was significantly lower for the treatment group than it was for the comparison group in the first quarters after WIA registration (Quarters 1 and 2 in State A and Quarters 1–4 in State B), but later became and generally stayed significantly higher in Quarters 6 through 12 in both states. Total earnings in the third year after WIA registration were significantly higher for the treatment group than the comparison group. People in the treatment group earned $1,257 and $1,703 more than those in the comparison group in State A and State B, respectively. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design; this is the highest causal evidence rating possible for a nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WIA adult program training services, but other factors might also have contributed to the effects.","Workforce Investment Act (WIA) Program Training Services","Adult and Dislocated Worker programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Unemployed, Low income",,"United States",2013,https://www.nber.org/papers/w19446.pdf,"Employment and Training Review Protocol" "A randomized controlled trial to improve health among women receiving welfare in the U.S.: The relationship between employment outcomes and the economic recession.","Kneipp, S., Kairalla, J. & Sheely, A. (2013). A randomized controlled trial to improve health among women receiving welfare in the U.S.: The relationship between employment outcomes and the economic recession. Social Science & Medicine, 80, 130-140.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Public Health Nurse (PHN) intervention on employment outcomes. The authors conducted a randomized controlled trial. Researchers used self-reported job beginning and ending dates to determine whether a participant was employed over a nine-month period. The authors found no statistically significant effect of PHN on any employment in the first nine months after random assignment. The quality of causal evidence presented in this study is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to PHN and not to other factors. However, the study did not find statistically significant effects.","Public Health Nurse Intervention","Other employment and reemployment","Disability, Low income",,"United States",2013,,"Employment and Training Review Protocol" "Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up","LePage, J. P., Lewis, A. A., Washington, E. L., Davis, B., & Glasgow, A. (2013). Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up. Journal of Rehabilitation Research & Development, 50(2), 183-191. doi:10.1682/JRRD.2011.09.0163 [Self-study vs. VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study examined the impact of self-study of the About Face (AF) manual on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who had access to the AF manual to study on their own (self-study program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected monthly data from participants in person or over the phone. The study showed no significant differences in competitive employment between the self-study condition (11.9 percent hired) and the VERC-only condition (16.7 percent hired). The study also showed no significant differences in average months employed (0.16 months for the self-study condition and 0.35 months for the VERC-only condition). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF manual; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://www.rehab.research.va.gov/JOUR/2013/502/pdf/lepage502.pdf,"Reentry, Veterans Review Protocol" "Does trade adjustment assistance make a difference?","Reynolds, K. M., & Palatucci, J. S. (2012). Does trade adjustment assistance make a difference? Contemporary Economic Policy, 30(1), 43-59. [TAA with training versus TAA without training]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Trade Adjustment Assistance (TAA) on the employment and earnings of participants displaced from jobs in the manufacturing sector who did and did not receive training services through TAA. The authors investigated similar research questions in another study examining the impact of TAA services relative to no TAA services, the profile of which is available [here]. The study uses a nonexperimental design to compare the outcomes of TAA participants who received job training and other program services with outcomes of a comparison group of participants who obtained a training waiver but received other forms of program assistance. Data for program participants were based on U.S. Department of Labor Trade Act Participant reports. The study found statistically significant relationships between receiving job training through the TAA program and employment and earnings when compared with participants who obtained a training waiver but received other forms of program assistance. The quality of causal evidence provided in this study is low because the study uses a nonexperimental design, and the authors did not demonstrate that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to TAA; other factors are likely to have contributed.","Trade Adjustment Assistance (TAA)-Funded Training","Adult and Dislocated Worker programs Job search assistance and supportive services Other training and education","Dislocated or displaced worker",,"United States",2012,http://faculty.smu.edu/Millimet/classes/eco7377/papers/reynolds%20palatucci%202…,"Employment and Training Review Protocol" "An evaluation of the effect of correctional education programs on post-release recidivism and employment: An empirical study in Indiana","Nally, J., Lockwood, S., Knutson, K., & Ho, T. (2012). An evaluation of the effect of correctional education programs on post-release recidivism and employment: An empirical study in Indiana. The Journal of Correctional Education, 63(1), 69-89.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study examined the effect of Indiana’s correctional education program on individuals’ employment, earnings, and recidivism outcomes after release from prison. The authors used administrative data from the Indiana Department of Corrections (IDOC) and Indiana Department of Workforce Development to compare individuals who participated in correctional education programs while in custody with those who did not. The study found that participation in correctional education programs was associated with a lower likelihood of recidivism. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups being compared were similar before the intervention.","Indiana’s Correctional Education Programs","Job search assistance and supportive services Other employment and reemployment Reentry",Justice-involved,,"United States",2012,https://www.thefreelibrary.com/An+evaluation+of+the+effect+of+correctional+educ…,"Employment and Training Review Protocol" "Can job search assistance do harm? Long-term effects of the Washington Alternative Work Search Experiment","Cebi, M., Lachowska, M., & Woodbury, S. (2012). Can job search assistance do harm? Long-term effects of the Washington Alternative Work Search Experiment. Unpublished manuscript.",,"Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to examine the effects of the Washington Alternative Work Search Experiment on the employment, earnings, and unemployment insurance benefit receipt among those who participated in the job search assistance offered as part of the experiment. CLEAR did not complete a review of this study because, although it is publicly available, according to the authors, the research is incomplete.",,"Job search assistance and supportive services",Adult,,"United States",2012,http://coin.wne.uw.edu.pl/wiem/papers_2012/Lachowska.pdf,"Review Protocol" "More than a job: Final results from the evaluation of the Center for Employment Opportunities (CEO) transitional job program","Redcross, C., Millenky, M., & Rudd, T. (2012). More than a job: Final results from the evaluation of the Center for Employment Opportunities (CEO) transitional job program. New York: MDRC.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Center for Employment Opportunities (CEO) transitional job program on earnings and employment outcomes. The authors conducted a randomized controlled trial. They used administrative data from New York State and New York City, along with data from the National Directory of New Hires and the CEO program itself, to measure earnings and employment outcomes. The study did not find any significant differences between CEO program participants and the control group in Year 2 or Year 3 on any employment or earnings outcomes. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to CEO program, and not to other factors.","The Center for Employment Opportunities (CEO) Transitional Job Program","Job search assistance and supportive services Other employment and reemployment",Justice-involved,,"United States",2012,http://www.mdrc.org/sites/default/files/full_451.pdf,"Review Protocol" "Does occupational training by the trade adjustment assistance program really help reemployment? Success measured as occupation matching.","Park, J. (2012). Does occupational training by the trade adjustment assistance program really help reemployment? Success measured as occupation matching. Review of International Economics, 20(5), 999-1016.","Apprenticeship and Work-Based Training, Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of training funded by Trade Adjustment Assistance (TAA) on dislocated workers’ employment. The author used a nonexperimental approach to compare the reemployment rate among TAA beneficiaries who completed a TAA-funded training program with that of those who did not complete training, and compared the reemployment rate among those who participated in each type of TAA-funded training with that of those who did not participate in any training, after adjusting for workers’ characteristics. The study found that, among TAA beneficiaries, completion of a training program was associated with higher reemployment rates. The study also found that participation in TAA-funded customized training was associated with lower reemployment rates, while participation in occupational training or in on-the-job training was associated with higher reemployment rates compared with not participating in training. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the program. This means we are not confident that the estimated effects are attributable to TAA-funded training; other factors are likely to have contributed.","Trade Adjustment Assistance (TAA)-Funded Training","Community college education and other classroom training Work based and other occupational training","Dislocated or displaced worker",,"United States",2012,,"Apprenticeship and Work-Based Training, Job Search Assistance Review Protocol" "Estimated impacts for participants in the Trade Adjustment Assistance (TAA) program under the 2002 amendments.","Schochet, P.Z., D’Amico, R., Berk, J., Dolfin, S., & Wozny, N. (2012). Estimated impacts for participants in the Trade Adjustment Assistance (TAA) program under the 2002 amendments. Princeton, NJ: Mathematica Policy Research.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Unfavorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Trade Adjustment Assistance (TAA) Program on education and training, employment, earnings, and public benefit receipt. The study used a nonexperimental method to match those who took part in the TAA Program to a similar group of nonparticipants. The authors used data from telephone surveys and administrative records to compare education, employment, earnings, and public benefits receipt outcomes across the groups. The study found that education and training programs completion and educational attainment were higher among TAA participants than similar nonparticipants. Employment, earnings, and receipt of cash assistance were lower for TAA participants than for similar nonparticipants, and a larger percentage of TAA participants than nonparticipants received Unemployment Insurance (UI) benefits and food stamps. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to TAA, but other factors might also have contributed.","the Trade Adjustment Assistance (TAA) Program","Job search assistance and supportive services Other training and education","Dislocated or displaced worker",,"United States",2012,https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&uact=8&…,"Review Protocol" "Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. [Dayton—Move Up]","Miller, C., Tessler, B. L., & Van Dok, M. (2012). Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. New York: MDRC. [Dayton—Move Up]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of participation in Dayton—Move Up, a Work Advancement and Support Center (WASC), on participants’ earnings, employment, educational attainment, and benefit receipt. This study was a randomized controlled trial and used administrative data from the Ohio Department of Job and Family Services and the National Student Clearinghouse to measure outcomes. The authors used a 12-month follow-up survey with a random subset of participants to measure receipt of work supports and job characteristics. The study found that the treatment group was 6.4 percentage points more likely to obtain a license or certificate than the control group and 6.2 percentage points more likely to have ever received Food Stamps one year after the program began. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Dayton—Move Up and not to other factors.","Work Advancement and Support Center (WASC), Dayton—Move Up","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States",2012,http://www.mdrc.org/sites/default/files/full_627.pdf,"Employment and Training Review Protocol" "What strategies work for the hard-to-employ? Final results of the Hard-to-Employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. [Minnesota Tier 2]","Butler, D., Alson, J., Bloom, D., Deitch, V., Hill, A., Hsueh, J., Jacobs, E., Kim, S., McRoberts, R., & Redcross, C. (2012). What strategies work for the hard-to-employ? Final results of the Hard-to-Employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. (OPRE report 2012-08). Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Minnesota Tier 2]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study examined the impact of the Minnesota Tier 2 program on employment, earnings, and receipt of public assistance for unemployed single parents. The study was a randomized controlled trial. The authors estimated the impact of the Tier 2 program by comparing the outcomes of the treatment and control groups four years after random assignment using data from Minnesota public assistance records and Unemployment Insurance wage records. The study found no statistically significant relationships between the Minnesota Tier 2 program and employment, earnings, or receipt of public assistance. The quality of causal evidence presented in this report is high for the employment and earnings outcomes because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects on earnings and employment would be attributable to the Minnesota Tier 2 program, and not to other factors. The public assistance outcomes receive a low rating, which means we would not be confident that any estimated effects on public assistance would be attributable to the Minnesota Tier 2 program; other factors are likely to have contributed. However, the study did not find any statistically significant effects on employment, earnings, or benefit receipt.","the Minnesota Tier 2 Program","Other employment and reemployment Substance abuse recovery","Low income, Parent",,"United States",2012,http://www.acf.hhs.gov/sites/default/files/opre/strategies_work.pdf,"Employment and Training Review Protocol" "Does trade adjustment assistance make a difference?","Reynolds, K. M., & Palatucci, J. S. (2012). Does trade adjustment assistance make a difference? Contemporary Economic Policy, 30(1), 43-59. [TAA versus no TAA]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of Trade Adjustment Assistance (TAA) on the employment and earnings of displaced manufacturing workers. The authors investigated similar research questions in another study, examining the impact of TAA services including training relative to TAA services not including training, the profile of which is available [here]. The study uses a nonexperimental design to compare the outcomes of workers displaced from manufacturing jobs from 2003 to 2005 who received services through TAA with the outcomes of a comparison group of workers displaced during the same period who likely did not receive assistance. The authors collected data on the treatment and comparison groups from different sources. Data for program participants were based on U.S. Department of Labor Trade Act Participant reports. Data for the comparison group were based on the Displaced Worker Survey from the Current Population Survey. The study did not find statistically significant relationships between receiving TAA and the employment or earnings of participants compared with those who did not receive assistance from the program. The quality of causal evidence provided in this study is low because the study uses a nonexperimental design, and the authors did not demonstrate that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to TAA; other factors are likely to have contributed.","Trade Adjustment Assistance (TAA)-Funded Training","Adult and Dislocated Worker programs Job search assistance and supportive services Work based and other occupational training","Other barriers",,"United States",2012,http://faculty.smu.edu/Millimet/classes/eco7377/papers/reynolds%20palatucci%202…,"Employment and Training Review Protocol" "The Social Security Administration’s Youth Transition Demonstration projects: Interim report on West Virginia Youth Works","Fraker, T., Mamun, A., Manno, M., Martinez, J., Reed, D., Thompkins, A., & Wittenburg, D. (2012). The Social Security Administration’s Youth Transition Demonstration projects: Interim report on West Virginia Youth Works. Report submitted to the Social Security Administration. Washington, DC: Mathematica Policy Research.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report presented an interim implementation and impact analysis on the West Virginia Youth Works Youth Transition Demonstration (YTD) project. The program sought to help youth with disabilities ages 14 through 25 who lived in 19 specific West Virginia counties to maximize their economic self-sufficiency. The study examined implementation of Youth Works, focusing on major aspects of service delivery, including the background, local context, and service environment. It provided information on participants’ characteristics and satisfaction with the program. The authors conducted qualitative analysis of staff and participant interviews, including data collected from site visits, and descriptive quantitative analysis of participants’ baseline and follow-up survey data and service utilization data from a management information system. Overall, the study found that Youth Works faced some substantial challenges, but that all participants received some project services and most received at least one contact for each of the four types of service: benefits planning, employment, education, and case management. Study findings related to implementation challenges and solutions are potentially applicable to other current or future projects that provide employment-related services to youth with disabilities.","the Youth Transition Demonstration Projects, West Virginia Youth Works Program","Supplemental security income (SSI) Youth programs Vocational rehabilitation","Youth, Disability",,"United States",2012,http://www.mdrc.org/sites/default/files/WV%20YTD%20Report%2012-3-2012.pdf,"Disability Employment Policy Review Protocol" "More than a job: Final results from the evaluation of the Center for Employment Opportunities (CEO) transitional jobs program","Redcross, C., Millenky, M., Rudd, T., and Levshin, V. (2012). More than a job: Final results from the evaluation of the Center for Employment Opportunities (CEO) transitional jobs program. OPRE Report 2011-18. Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of a comprehensive employment program on ex-offenders’ employment and wages. The authors randomly assigned former prisoners to an employment program offering transitional job placement and other services or to a control condition providing a more limited set of services. Employment and earnings data were collected quarterly for three years and compared between the two groups, controlling for characteristics before random assignment. The study found that treatment group members were 24.5 percentage points more likely to be employed during the first year after random assignment than control group members. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the employment program, and not to other factors.","the Center for Employment Opportunities (CEO) Transitional Jobs Program","Job search assistance and supportive services Other employment and reemployment Reentry",Justice-involved,,"Urban, United States",2012,http://www.acf.hhs.gov/sites/default/files/opre/more_than_job.pdf,"Employment and Training Review Protocol" "Pre- and post- wage differences of trade adjustment assistance job training participants in Arkansas. (Doctoral dissertation).","Gordon, K.H. (2012). Pre- and post- wage differences of trade adjustment assistance job training participants in Arkansas. (Doctoral dissertation). Retrieved from ProQuest Dissertations & Theses A&I. (1266388644).",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Trade Adjustment Assistance (TAA) Program on the wages of dislocated workers. The author used a nonexperimental method to compare the earnings outcomes of participants before and after they participated in the TAA program. The author also compared the change in earnings between those who completed the TAA-funded training and those who started but did not complete TAA-funded training The study found that participants had significantly lower wages in the three quarters after TAA program participation compared with the three quarters before program participation. The study also found that the change in wages differed by education level and employment tenure. The quality of causal evidence presented in this report is low because the author did not account for pre-intervention trends in earnings or account for differences between the treatment and comparison groups. This means we are not confident that the estimated effects are attributable to TAA program; other factors are likely to have contributed.","the Trade Adjustment Assistance (TAA) Program","Job search assistance and supportive services Other employment and reemployment Other training and education","Dislocated or displaced worker",,"United States",2012,http://scholarworks.uark.edu/cgi/viewcontent.cgi?article=1631&context=etd,"Review Protocol" "Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. [Academy for Career Advancement—Bridgeport]","Miller, C., Tessler B. L., & Van Dok, M. (2012). Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. New York: MDRC. [Academy for Career Advancement—Bridgeport]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of participation in the Academy for Career Advancement—Bridgeport, a Work Advancement and Support Center (WASC) on participants’ earnings, employment, educational attainment, and benefit receipt. This study was a randomized controlled trial and used administrative data from the Department of Labor, the Department of Social Services in Connecticut, and the National Student Clearinghouse to measure outcomes. The authors also used a 12-month follow-up survey with a random subset of participants to measure receipt of work supports and job characteristics. The study found that members of the treatment group were 3.9 percentage points less likely than the control group to have ever been employed in a Unemployment Insurance-covered job one year after the program began, and that members of the treatment group were 8.9 percentage points more likely to obtain a license or certificate one year after the program began than members of the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Academy for Career Advancement—Bridgeport and not to other factors.","Work Advancement and Support Center Demonstration, Academy for Career Advancement—Bridgeport","Job search assistance and supportive services Other employment and reemployment Other training and education Unemployment Insurance","Low income",,"United States",2012,http://www.mdrc.org/sites/default/files/full_627.pdf,"Employment and Training Review Protocol" "Does trade adjustment assistance make a difference?","Reynolds, K.M., & Palatucci, J.S. (2012). Does trade adjustment assistance make a difference? Contemporary Economic Policy, 30(1), 43-59. doi:10.1111/j.1465-7287.2010.00247.x",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Trade Adjustment Assistance (TAA) Program on the employment and earnings of displaced workers in the manufacturing sector from 2003 to 2005. The study uses a nonexperimental design to compare the outcomes of TAA recipients with a comparison group of nonrecipients who were also displaced from manufacturing jobs during the same period as the treatment group. The study found no statistically significant relationship between TAA participation and employment or earnings when comparing TAA recipients with displaced workers who did not participate in TAA. However, when comparing the TAA recipients who received training with recipients who did not receive training, the study found a significant relationship between training and employment and earnings. The quality of causal evidence provided in this study is low because the authors did not sufficiently account for potential differences between the study groups. This means we are not confident that estimated effects are attributable to the TAA program; other factors are likely to have contributed.","the Trade Adjustment Assistance (TAA) Program","Job search assistance and supportive services Other training and education","Dislocated or displaced worker",,"United States",2012,,"Review Protocol" "Notes on behavioral economics and labor market policy","Babcock, L., Congdon, W., Katz, L., & Mullainathan, S. (2012). Notes on behavioral economics and labor market policy. IZA Journal of Labor Policy, 1(1), 1-14.","Behavioral Insights","Study Type: Descriptive Analysis",,,"Summary: The article’s objective was to assess how behavioral economics can inform labor policy reforms to increase policy efficiency. The authors used behavioral economic theory to explain barriers to successful policies related to unemployment insurance, job search assistance, and job training. They also proposed policy solutions to overcome these barriers. For unemployment insurance, the authors recommended implementing wage loss insurance that subsidizes reemployment wages to counteract individuals’ tendencies to set high reservation wages when seeking employment, which slows their return to work. They also recommended providing small, immediate, and high frequency reminders and incentives to search for work. To increase participation in job search assistance, the authors recommended policies that automatically put unemployed individuals into services and/or to make job search assistance more user-friendly and personalized. Similarly, to increase participation in job training programs, the authors recommended streamlining or simplifying training offerings and providing guidance to reduce the burden on the prospective users to select and start a program. Simplifying the decision-making process by creating a competitive training market could also be beneficial to prospective users.",,"Job search assistance and supportive services Unemployment Insurance Other training and education","Adult, Unemployed",,"United States",2012,,"Behavioral Insights Review Protocol" "What strategies work for the hard-to-employ? Final results of the Hard-to-Employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. [NYC PRIDE]","Butler, D., Alson, J., Bloom, D., Deitch, V., Hill, A., Hsueh, J., Jacobs, E., Kim, S., McRoberts, R., & Redcross, C. (2012). What strategies work for the hard-to-employ? Final results of the Hard-to-Employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. (OPRE Report 2012-08). Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [NYC PRIDE]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Personal Roads to Individual Development and Employment (PRIDE) program on employment, earnings, and public assistance receipt. The study was a randomized controlled trial. The authors estimated the impact of PRIDE by comparing the outcomes of the treatment and control groups four years after random assignment using data from public assistance records and Unemployment Insurance wage records. The study found that those assigned to the PRIDE group were more likely to be employed and received less in cash assistance in the four years following random assignment than those in the control group. The quality of causal evidence presented in this report is low because the study had a shift in the probability of assignment and did not sufficiently demonstrate that the treatment and control groups were similar. This means we are not confident that the estimated effects are attributable to PRIDE; other factors are likely to have contributed.","the Personal Roads to Individual Development and Employment (PRIDE) Program","Other employment and reemployment Unemployment Insurance","Low income",,"United States",2012,http://www.acf.hhs.gov/sites/default/files/opre/strategies_work.pdf,"Employment and Training Review Protocol" "The efficacy of supported employment for middle-aged and older people with schizophrenia.","Twamley, E. W., Vella, L., Burton, C. Z., Becker, D. R., Bell, M. D., & Jeste, D. V. (2012). The efficacy of supported employment for middle-aged and older people with schizophrenia. Schizophrenia Research, 135(1-3), 100-104.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of Individual Placement and Support (IPS) on competitive employment for older people with schizophrenia The study was a randomized controlled trial (RCT) conducted at a community mental health clinic and used weekly work logs cross-referenced with pay stubs to measure employment outcomes over a 12-month period. The study found that IPS was positively associated with employment and earnings. The quality of causal evidence presented in this report is low because the RCT has a confounding factor. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support and Vocational Rehabilitation Program","Health Individuals facing barriers to employment Job search assistance and supportive services","Adult, Older worker, Disability",,"United States",2012,https://psycnet.apa.org/record/2011-30184-001,"Employment and Training Review Protocol" "Impact of the Reemployment and Eligibility Assessment (REA) Initiative in Nevada","Michaelides, M., Poe-Yamagata, E., Benus, J., & Tirumalasetti, D. (2012). Impact of the Reemployment and Eligibility Assessment (REA) Initiative in Nevada. Columbia, MD: IMPAQ International, LLC.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of the Reemployment and Eligibility Assessment (REA) Initiative in Nevada on Unemployment Insurance (UI) benefits receipt, employment, and earnings after six quarters.  The study was a randomized controlled trial. Of some 33,000 first-time UI claimants eligible for the study, about 5,100 were randomly assigned to the treatment group, which had to take part in REA and reemployment services (RES) to retain UI eligibility, and the rest were randomly assigned to the control group, which was not required to participate in such services. The authors compared state administrative records on UI payments and covered employment of the two groups to estimate the program’s effectiveness. The study found that, in the first six calendar quarters following the initial claim, REA services substantially reduced the average duration and amount of UI benefits receipt, increased employment rates, and increased earnings. The quality of causal evidence presented in this study is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the REA services, and not other factors.","Reemployment Eligibility Assessment","RESEA Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",2012,http://wdr.doleta.gov/research/FullText_Documents/ETAOP_2012_08_REA_Nevada_Foll…,"Reemployment Review Protocol" "Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. [San Diego—EARN!]","Miller, C., Tessler, B. L., & Van Dok, M. (2012). Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. New York: MDRC. [San Diego—EARN!]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of participation in San Diego—EARN!, a Work Advancement and Support Center (WASC), on participants’ earnings, employment, educational attainment and benefit receipt. This study was a randomized controlled trial and used administrative data from the Employment Development Department in California, the San Diego County Health and Human Service Agency, and the National Student Clearinghouse to measure outcomes. The authors used a 12-month follow-up survey with a random subset of participants to measure receipt of work supports and job characteristics. The study found that members of the treatment group were 5.7 percentage points more likely than the control group to have ever received Food Stamps one year after the program began. The study also found that members of the treatment group received an average of $155 more in Food Stamps than the control group one year after the program began and an average of $320 more in Food Stamps than the control group three years after the program began. The quality of causal evidence presented in this report is high for outcomes measured with administrative data. This means we are confident that the estimated effects on these outcomes are attributable to San Diego—EARN! and not to other factors. However, outcomes measured with survey data receive a low causal evidence rating, meaning that we are not confident that the estimated effects are attributable to San Diego—EARN!; other factors may have contributed.","Work Advancement and Support Center Demonstration (WASC), San Diego—EARN!","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States, Urban",2012,http://www.mdrc.org/sites/default/files/full_627.pdf,"Employment and Training Review Protocol" "Returning to work after prison: Final results from the Transitional Jobs Reentry Demonstration","Jacobs, E. (2012). Returning to work after prison: Final results from the Transitional Jobs Reentry Demonstration. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Transitional Jobs Reentry Demonstration (TJRD) on ex-offenders’ employment and wages. The author used a randomized controlled trial to assign former prisoners to the transitional jobs program or to a group that was offered job search assistance and compared the two groups’ employment and earnings outcomes two years after random assignment, controlling for participants’ characteristics before random assignment. The study found that members of the transitional jobs group were significantly more likely (by 29 percentage points) than control group members to be employed at any point during the two years after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the TJRD, and not to other factors.","the Transitional Jobs Reentry Demonstration (TJRD)","Job search assistance and supportive services Other employment and reemployment Reentry","Justice-involved, Unemployed, Male",,"United States",2012,http://www.mdrc.org/sites/default/files/full_626.pdf,"Employment and Training Review Protocol" "Impact of the Reemployment and Eligibility Assessment Initiative","Poe-Yamagata, E., Benus, J., Bill, N., Carrington, H., Michaelides, M., & Shen, T. (2011). Impact of the Reemployment and Eligibility Assessment Initiative. Columbia, MD: IMPAQ International. [Idaho sample]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: This study’s objective was to assess the effectiveness of the Reemployment and Eligibility Assessment (REA) Initiative in Idaho, a program that provided eligibility and reemployment case management services to Unemployment Insurance (UI) claimants, on duration and amount of UI benefits receipt. The study randomly assigned 18,156 eligible claimants to either the treatment group, which was eligible for REA services, or the control group, which was not offered REA services. Within the treatment group, claimants were randomly assigned either to receive a letter requiring them to enter work search activities into an online system, or to receive both the letter and an in-person interview. Data for the analysis comes from UI administrative records. The study found statistically significant reductions in weeks of UI benefits receipt, total amount of UI benefits received, total number of weeks receiving UI benefits, and the probability of benefits exhaustion for the treatment group. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the REA initiative, and not to other factors.","Reemployment Eligibility Assessment","RESEA Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",2011,http://wdr.doleta.gov/research/FullText_Documents/ETAOP_2012_08_Impact_of_the_R…,"Reemployment Review Protocol" "The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the City University of New York’s Project","Fraker, T., Black, A., Broadus, J., Mamun, A., Manno, M., Martinez, J., McRoberts, R., Rangarajan, A., & Reed, D. (2011). The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the City University of New York’s Project. Report submitted to the Social Security Administration. Washington, DC: Mathematica Policy Research.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report presents an interim implementation and impact analysis on the City University of New York (CUNY) Youth Transition Demonstration Project (YTDP). The program sought to maximize economic self-sufficiency and independence for youth disability insurance beneficiaries by improving their employment and educational opportunities. The program targeted youth ages 14 through 18 who received Supplemental Security Income (SSI) and resided in Bronx County. The study examined implementation of YTDP at two CUNY campuses, focusing on major aspects of service delivery, including the background, local context, and service environment of YTDP. It also provided information on beneficiaries’ characteristics and satisfaction with the program. The study used qualitative analysis of staff and beneficiary interviews, including data collected from site visits; and descriptive quantitative analysis of beneficiaries’ baseline and follow-up survey data and service utilization data from a management information system. The study found that youth beneficiaries had access to all of the services in the conceptual framework. Many began receiving individualized services before participating in structured workshops. However, education-related and person-centered services were among the less-intensive service offerings. Study findings related to implementation challenges and solutions are potentially applicable to other current or future projects that provide employment-related services to youth with disabilities.","the Youth Transition Demonstration Projects, The City University of New York","Supplemental security income (SSI) Youth programs Vocational rehabilitation","Youth, Disability",,"United States",2011,http://www.mdrc.org/sites/default/files/full_579.pdf,"Disability Employment Policy Review Protocol" "Analysis of Associations between Contemporaneous Job Corps Performance Measures and Impact Estimates from National Corps Study.","Fortson, J., & Schochet, P. (2011). Analysis of Associations between Contemporaneous Job Corps Performance Measures and Impact Estimates from National Corps Study. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: An analysis for the National Job Corps Study found no relationship between estimated impacts on participants and Job Corps center aggregate performance measures. This study sought to determine whether adjusting the performance measures to account for characteristics of students attending the centers would yield performance measures that predict estimated impacts. Job Corps is a national vocationally focused education and training program for disadvantaged youth between ages 16 and 24. The authors used data from multiple sources, particularly the National Job Corps study. They conducted quantitative analysis of survey data to compute center-level impacts and regression analysis to compute adjusted center-level performance measures. The analysis found that, although the performance measures adjusted for individual and local area characteristics had a modest impact on the relative performance rankings of the centers, they did not predict participant impacts more accurately than the unadjusted performance measures.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2011,http://www.mathematica-mpr.com/publications/pdfs/labor/jobcorps_performance.pdf,"Opportunities for Youth Review Protocol" "National evaluation of Youth Corps: Findings at follow-Up","Price, C., Williams, J., Simpson, L., Jastrzab, J., & Markovitz, C. (2011). National evaluation of Youth Corps: Findings at follow-up. Cambridge, MA: Abt Associates, Inc.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment Training-Mod/high-No impacts Training","Summary: The study’s objective was to examine the impact of Youth Corps, a diverse set of programs that offer educational services, employment and training, and community service activities to young adults. The programs’ effectiveness was evaluated using a randomized controlled trial conducted at 21 Youth Corps program sites. The study found a statistically significant positive impact on participants’ annual income 18 months after random assignment. There was no evidence of statistically significant impacts on employment, education, or training 30 months after random assignment, which was the primary follow-up period examined in the study. The quality of causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to Youth Corps, although other factors could also have contributed.","Youth Corps Programs","Job search assistance and supportive services Other training and education Youth programs",Youth,,"United States",2011,http://www.nationalservice.gov/pdf/nat_eval_youthcorps_impactreport.pdf,"Opportunities for Youth Review Protocol" "Evaluation of the Massachusetts Adolescent Outreach Program for Youths in Intensive Foster Care: Final Report","Courtney, M., Zinn, A., Johnson, H., and Malm, K. (2011). Evaluation of the Massachusetts Adolescent Outreach Program for Youths in Intensive Foster Care: Final Report. OPRE Report #2011-14. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Massachusetts Adolescent Outreach Program for Youths in Intensive Foster Care (Outreach) on youths’ education, employment, earnings, and public benefit receipt. Using a randomized controlled trial design, the authors estimated the program’s impact by comparing survey responses and college records for youth randomly selected to receive the Outreach program with those of youth randomly assigned to the control group. The study found that the Outreach program significantly increased college enrollment and persistence. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Massachusetts Adolescent Outreach Program for Youths in Intensive Foster Care, and not to other factors.","the Massachusetts Adolescent Outreach Program for Youths in Intensive Foster Care","Job search assistance and supportive services Other training and education Youth programs Behavioral Interventions","Youth, Disconnected youth",,"United States",2011,http://www.acf.hhs.gov/sites/default/files/opre/eval_mass.pdf,"Opportunities for Youth Review Protocol" "The Accelerated Benefits Demonstration and Evaluation Project: Impacts on health and employment at twelve months","Michalopoulos, C., Wittenburg, D., Israel, D., Schore, J., Warren, A., Zutshi, A., Freedman, S., & Schwartz, L. (2011). The Accelerated Benefits Demonstration and Evaluation Project: Impacts on health and employment at twelve months. New York: MDRC.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment Health and safety-Mod/high-Favorable impacts Health and safety Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: This is the 12-month survey impact report of the Accelerated Benefits Demonstration (ABD), an effort to provide immediate health insurance and employment and benefits counseling to new, uninsured Social Security Disability Insurance (SSDI) recipients during the 24 month Medicare eligibility waiting period.  About 2,000 volunteers were randomly assigned as part of the demonstration; this report focuses on approximately 1,500 of them. Study data sources included Social Security Administration (SSA) administrative records, a baseline telephone survey, a follow-up 12-month survey, health claims data, and a case management information system. ABD health insurance increased health care utilization, reduced unmet medical care needs, and improved self-reported health. However, ABD employment supports did not increase employment in the first 12 months of follow-up. The quality of the causal evidence presented in this report is high because the study is a well-implemented randomized controlled trial. This means we can be confident that the outcome differences between research groups are attributable to ABD, and not other factors.","Accelerated Benefits Demonstration","Disability insurance Health insurance Supplemental security income (SSI) Job search assistance and supportive services",Disability,,"United States",2011,http://www.mdrc.org/sites/default/files/full_528.pdf,"Disability Employment Policy Review Protocol" "Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up","LePage, J. P., Washington, E. L., Lewis, A. A., Johnson, K. E., & Garcia-Rea, E. (2011). Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up. Journal of Rehabilitation Research & Development, 48(3), 277-286. [Full About Face vs. self-study]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: This study examined the impact of About Face (AF) vocational classes on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of veterans: (1) those who took the AF classes (full AF program) and (2) those who did not take the classes but had access to the manual to study on their own (self-study program). The authors collected biweekly data from participants in person or over the phone. The study revealed significantly higher competitive employment among veterans in the full AF program (23.8 percent hired) than in the self-study condition (3 percent hired). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2011,https://www.rehab.research.va.gov/jour/11/483/pdf/page277.pdf,"Reentry, Veterans Review Protocol" "Beyond a summer work experience: The Recovery Act 2009 Post-Summer Youth Employment Initiative.","Holcomb, P., Ziegler, J., & Laird, E. (2011). Beyond a summer work experience: The Recovery Act 2009 Post-Summer Youth Employment Initiative. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: Funded by the American Recovery and Reinvestment Act of 2009, the Summer Youth Employment Initiative (SYEI) aimed to reverse the steep decline in youth employment during the recession by providing employment opportunities for youth in the summer of 2009. The 2009 Post-SYEI allowed states and local workforce investment areas to provide extended work experiences to older disconnected youth ages 18 to 24 from October 2009 through March 2010. The authors conducted in-depth site visits to eight selected study sites and analyzed the data using qualitative methods. The authors reported that the study sites effectively built upon the implementation of the SYEI by using the same service delivery structure and extending the work experiences of those youth who had already participated in the summer program. The longer time frame for the work experiences was seen as a benefit by participants and employers. Post-SYEI programs also focused on ensuring the alignment between participants’ interests and their work experiences. The authors recommended three considerations for the design of similar policies targeting older out-of-school youth in the future: allowing sufficient time to design such programs, because the needs of older out-of-school youth differ from those of younger youth who are traditionally served by these types of programs; supporting a year-round, not only summer, work experience; and incorporating a transition strategy from the work experience into future opportunities.","Summer Youth Employment Initiative (SYEI)","Basic skills Job search assistance and supportive services Work based and other occupational training Youth programs","Youth, Disconnected youth, Low-skilled, Low income",,"United States",2011,http://wdr.doleta.gov/research/FullText_Documents/ETAOP_201_03.pdf,"Opportunities for Youth Review Protocol" "Participation in the transition assistance program and job placement outcomes of U.S. veterans","Silva, E. (2011). Participation in the transition assistance program and job placement outcomes of U.S. veterans. (Publication No. AAI1491543) [Master’s dissertation, University of Rhode Island]. ProQuest.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Transition Assistance Program (TAP) on employment success—an outcome that reflects both employment and the desired number of work hours. The study involved a nonexperimental comparison group analysis that compared veterans who participated in TAP to those who did not, using data from the Current Population Survey and Veterans Supplement. The study showed no statistically significant relationship between TAP and veterans’ employment success. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we could not be confident that any estimated effects would be attributable to TAP and not to other factors. However, the study did not show any statistically significant effects.","the Transition Assistance Program","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2011,https://digitalcommons.uri.edu/dissertations/AAI1491543/,"Employment and Training Review Protocol" "Impact of the Reemployment and Eligibility Assessment Initiative","Poe-Yamagata, E., Benus, J., Bill, N., Carrington, H., Michaelides, M., & Shen, T. (2011). Impact of the Reemployment and Eligibility Assessment Initiative. Columbia, MD: IMPAQ International. [Nevada sample]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: This study’s objective was to assess the effectiveness of the Reemployment and Eligibility Assessment (REA) Initiative in Nevada, a program that provided eligibility and reemployment case management services to Unemployment Insurance (UI) claimants, on duration and amount of UI benefits receipt. The study was a randomized controlled trial. Of some 33,000 first-time UI claimants eligible for the study, about 5,100 were randomly assigned to the treatment group, which had to take part in REA and reemployment services (RES) to retain UI eligibility, and the rest were randomly assigned to the control group, which was not required to participate in such services. The authors compared state administrative records on UI benefits to estimate the program’s effectiveness. The study found statistically significant reductions in weeks of UI benefits receipt, total amount of UI benefits received, total number of weeks receiving UI benefits, and the probability of benefits exhaustion for the treatment group. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the REA initiative, and not to other factors.","Reemployment Eligibility Assessment","RESEA Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",2011,http://wdr.doleta.gov/research/FullText_Documents/ETAOP_2012_08_Impact_of_the_R…,"Reemployment Review Protocol" "Mental Health Treatment Study: Final Report","Frey, W., Drake, R., Bond, G., Miller, A., Goldman, H., Salkever, D., & Holsenbeck, S. (2011). Mental Health Treatment Study: Final Report. Baltimore, MD: Westat.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Health and safety-Low-Favorable impacts Health and safety Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Mental Health Treatment Study (MHTS), which provided supported employment services to Social Security Disability Insurance (SSDI) recipients with psychiatric disabilities. The study was a randomized controlled trial with 2,238 participants. The analysis used data from nine surveys administered over the two-year intervention period. The study found that MHTS had positive impacts on earnings measured 12 and 24 months after random assignment and on health outcomes 24 months after random assignment. There were no statistically significant impacts on disability benefits receipt. The quality of the evidence presented in this study is moderate for earnings and SSDI benefit receipt outcomes. This means we are somewhat confident that the estimated effects are attributable to the MHTS, but other factors might also have contributed. For the health outcomes, the quality of evidence presented in this study is low. This means we are not confident that the estimated effects are attributable to MHTS; other factors are likely to have contributed.","the Mental Health Treatment Study (MHTS)","Health Disability insurance Job search assistance and supportive services Vocational rehabilitation",Disability,,"United States",2011,http://socialsecurity.gov/disabilityresearch/documents/MHTS_Final_Report_508.pdf,"Disability Employment Policy Review Protocol" "Impact of the Reemployment and Eligibility Assessment Initiative","Poe-Yamagata, E., Benus, J., Bill, N., Carrington, H., Michaelides, M., & Shen, T. (2011). Impact of the Reemployment and Eligibility Assessment Initiative. Columbia, MD: IMPAQ International. [Florida sample]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: This study’s objective was to assess the effectiveness of the Reemployment and Eligibility Assessment (REA) Initiative in Florida, a program that provided eligibility and reemployment case management services to Unemployment Insurance (UI) claimants, on UI benefits receipt, employment, and earnings. The study randomly assigned 80,531 eligible UI claimants to either the treatment group or the control group. Those in the treatment group were required to participate in REA services to retain their UI eligibility. Data for the analysis came from UI administrative and wage records.  The study found statistically significant reductions in weeks of UI benefits receipt, total amount of UI benefits received, and the probability of benefits exhaustion for the REA treatment group. In addition, participants in REA had a statistically significantly higher probability of employment and earnings over the four follow-up quarters. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the REA initiative, and not to other factors.","Reemployment Eligibility Assessment","RESEA Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",2011,http://wdr.doleta.gov/research/FullText_Documents/ETAOP_2012_08_Impact_of_the_R…,"Reemployment Review Protocol" "Youth Corps emerging practices for education and employment. Prepared for the Corporation for National and Community Service","Gan, K., Jastrzab, J., Jefferson, A., Schneider, G., & Schlager, C. (2011). Youth Corps emerging practices for education and employment. Prepared for the Corporation for National and Community Service. Cambridge, MA: Abt Associates Inc.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This study examined emerging practices used by Youth Corps sites to enhance their participants’ educational and employment opportunities. Youth Corps is a program that engages youth ages 16 to 25 in a combination of community service, workforce development, and education. It is designed to have a positive impact on both its participants and their communities. The authors gathered and analyzed data from interviews with the executive directors of four Youth Corps sites, along with site visits to those sites. Although the studied sites varied, the authors found that all shared a set of common principles that led to increased educational and employment opportunities for its members. These included an understanding of the local labor market in which the corps operated, in order to enhance employment opportunities, and building partnerships with outside community resources. The authors provided a tool kit for youth education and employment service providers that highlights lessons learned; other practitioners can use this information, as can those interested in developing similar initiatives.","Youth Corps Programs","Community college education and other classroom training Job search assistance and supportive services Other training and education Youth programs","Youth, Low-skilled, Low income",,"United States",2011,http://www.nationalservice.gov/pdf/emerging_practices_youthcorps.pdf,"Opportunities for Youth Review Protocol" "Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up","LePage, J. P., Washington, E. L., Lewis, A. A., Johnson, K. E., & Garcia-Rea, E. (2011). Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up. Journal of Rehabilitation Research & Development, 48(3), 277-286. [Full About Face vs VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of About Face (AF) vocational classes on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who participated in the AF classes (full AF program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected biweekly data from participants in person or over the phone. The study revealed significantly higher competitive employment among justice-involved veterans in the full AF program (23.8 percent hired) than in the VERC condition (0 percent hired). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"Urban, United States",2011,https://www.rehab.research.va.gov/jour/11/483/pdf/page277.pdf,"Reentry, Veterans Review Protocol" "Earnings progression among workforce development participants: Evidence from Washington State.","Chrisinger, C.K. (2011). Earnings progression among workforce development participants: Evidence from Washington State. Washington, DC: U.S. Department of Labor, Employment and Training Administration.","Job Search Assistance, Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program on the earnings of low-income adults ages 18 to 64 in Washington State. The author assigned workers to the treatment group if they received employment-related services through the WIA Adult Program from January 2002 to June 2008. Workers who participated in the Labor Exchange program during this time comprised the comparison group. The study found no statistically significant relationships between receiving services through the WIA Adult Program and quarterly earnings. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before program participation. This means we would not be confident that the estimated effects would be attributable to the WIA Adult Program; however, the study did not find statistically significant effects.","the Workforce Investment Act (WIA) Adult Program","Adult and Dislocated Worker programs Job search assistance and supportive services Labor Exchange Other employment and reemployment Other training and education Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Unemployed, Low income",,"United States",2011,https://wdr.doleta.gov/research/FullText_Documents/ETAOP_2011-11.pdf,"Job Search Assistance, Low-Income Adults Review Protocol" "Impact of the Reemployment and Eligibility Assessment Initiative","Poe-Yamagata, E., Benus, J., Bill, N., Carrington, H., Michaelides, M., & Shen, T. (2011). Impact of the Reemployment and Eligibility Assessment Initiative. Columbia, MD: IMPAQ International. [Illinois sample]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to assess the effectiveness of the Reemployment and Eligibility Assessment (REA) Initiative in Illinois, a program that provided eligibility and reemployment case management services to Unemployment Insurance (UI) claimants, on duration and amount of UI benefits receipt. The study was a randomized controlled trial that assigned 3,112 eligible UI claimants to the treatment or control group. Those in the treatment group were required to participate in REA services to retain their UI eligibility. Data for the analysis came from UI administrative records. The study found no statistically significant impacts on any UI benefits receipt outcomes examined. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the REA initiative, and not to other factors.","Reemployment Eligibility Assessment","RESEA Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed, High-skilled",,"United States",2011,http://wdr.doleta.gov/research/FullText_Documents/ETAOP_2012_08_Impact_of_the_R…,"Reemployment Review Protocol" "Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up","LePage, J. P., Washington, E. L., Lewis, A. A., Johnson, K. E., & Garcia-Rea, E. (2011). Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up. Journal of Rehabilitation Research & Development, 48(3), 277-286. [Self-study vs. VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study examined the impact of self-studying the About Face (AF) manual on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who had access to the AF manual to study on their own (self-study program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected biweekly data from participants in person or over the phone. The study showed no significant differences in competitive employment between the self-study condition (3 percent hired) and the VERC-only condition (0 percent hired). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF manual; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2011,https://www.rehab.research.va.gov/jour/11/483/pdf/page277.pdf,"Reentry, Veterans Review Protocol" "A pilot study connecting youth with emotional or behavioral difficulties to summer work experiences.","Carter, E.W., Trainor, A.A., Ditchman, N., & Owens, L. (2011). A pilot study connecting youth with emotional or behavioral difficulties to summer work experiences. Career Development for Exceptional Individuals, 34(2), 95-106. doi:10.1177/0885728810395745","Job Search Assistance, Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of providing summer employment support on the employment of youth with emotional and behavioral difficulties. The authors used a randomized controlled trial to assign eligible youth with emotional and behavioral difficulties (63 in total) to either the treatment group, which received additional support finding and retaining summer employment, or the control group, which did not receive any additional support. The authors used data from telephone interviews with youth or parents to measure outcomes. The study found that, compared with youth randomly assigned to the control group, youth offered support finding and retaining summer employment were 27 percentage points more likely to be employed at the end of the summer. The quality of causal evidence presented in this report is low because attrition was high and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to summer employment support; other factors are likely to have contributed.","a Package of Employment Services for Youth","Job search assistance and supportive services Other employment and reemployment","Youth, Other barriers",,"United States",2011,,"Job Search Assistance, Opportunities for Youth Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [TAAG—Medford]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [TAAG—Medford]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports on former and current public assistance recipients’ employment and benefits receipt outcomes after three years. The Medford site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,164 employed single parents who were former or current public assistance recipients to either a treatment group that received services from Medford’s ERA project (Transition, Advancement, and Growth, or TAAG), or a control group that could participate in other programs in the community. The authors analyzed data from Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those assigned to the Medford ERA project earned, on average, $41 more per week when surveyed one year after random assignment than those in the control group. However, treatment group members were also 6.7 percentage points more likely to have ever received Food Stamps at the three-year follow-up than those in the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Medford ERA project and not to other factors.","the Employment Retention and Advancement Project, Medford","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent, Employed",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders","Penk, W., Drebing, C. E., Rosenheck, R, A., Krebs, C., Van Ormer, A., & Mueller, L. (2010). Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders. Psychiatric Rehabilitation Journal, 33(4), 297-307.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Veterans Health Administration (VHA) Transitional Work Experience (TWE) program on employment and income for veterans with substance abuse and non-psychotic psychiatric disorders, compared with job placement (JP) services only. The study was a randomized controlled trial carried out at one VHA medical center site over four years. Eligible veterans were randomly assigned to either the treatment group, which could participate in the TWE program, or to the control group, which could not participate in TWE but could receive JP services. The authors used data from participant surveys to measure impacts. The study found that members of the treatment group worked significantly more hours in paid employment (including employment sponsored by the TWE program itself) and significantly more total weeks in paid employment, compared with the control group. The study also found that the treatment group earned significantly higher total income for the year (including noncompetitive TWE employment income) than the control group. The quality of causal evidence presented in this report is low because the authors did not provide enough information to calculate attrition and did not include sufficient controls in their analysis to establish that treatment and control groups were similar on observable characteristics at baseline for the analytic sample. This means we are not confident that the estimated effects are attributable to TWE. Other factors are likely to have contributed.","the Transitional Work Experience (TWE) Program","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2010,,"Disability Employment Policy Review Protocol" "Tuning in to local labor markets: Findings from the Sectoral Employment impact study","Maguire, S., Freely, J., Clymer, C., Conway, M. & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment impact study. Philadelphia: Public/Private Ventures. [Wisconsin Regional Training Partnership]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Wisconsin Regional Training Partnership’s (WRTP) sectoral employment program on earnings and employment. The study was based on a randomized controlled trial and it estimated the effect of offering eligible WRTP applicants the program by using survey data to compare average outcomes among those offered access to the program against the average outcomes of those excluded, after adjusting for differences between the groups. The study found that being offered access to the WRTP’s sectoral employment program increased earnings by $6,255, on average, over the two years after acceptance to the program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the WRTP’s sectoral employment program, and not to other factors.","Wisconsin Regional Training Partnership’s (WRTP) Sectoral Employment Program","Job search assistance and supportive services Other employment and reemployment","Low income","Professional, scientific, and technical services","United States",2010,http://ppv.issuelab.org/resources/5101/5101.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [Texas ERA—Forth Worth]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Texas ERA—Forth Worth]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Fort Worth site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,572 unemployed single-parent participants in Fort Worth’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that, compared with the control group, those in the Fort Worth ERA group received on average $162 more per year in Food Stamps across the first four years after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program and not to other factors.","the Employment Retention and Advancement project, Fort Worth","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Tuning in to local labor markets: Findings from the Sectoral Employment Impact Study","Maguire, S., Freely, J., Clymer, C., Conway, M., & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment Impact Study. Philadelphia, PA: Public/Private Ventures. [Per Scholas]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Per Scholas sectoral employment program on participants’ earnings and employment. The authors investigated similar research questions with two other programs, the profiles of which are available through the study search. The study was a randomized controlled trial, with the authors using survey data to estimate the effect of Per Scholas by comparing average outcomes among applicants offered access to the program with average outcomes of those not offered access to the program, after adjusting for differences between the groups. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, this CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the study was a randomized controlled trial with high attrition, and the authors did not demonstrate that the groups that remained in the study were similar before the intervention began. This means we would not be confident that the estimated effects would be attributable to the Per Scholas sectoral employment program; other factors are likely to have contributed. The study did not, however, find statistically significant effects.","Per Scholas","Job search assistance and supportive services Other training and education",Adult,"Professional, scientific, and technical services","United States",2010,https://www.explorevr.org/sites/explorevr.org/files/files/Tuning%20In%20to%20Lo…,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Achieve—Cleveland]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Achieve—Cleveland]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to determine the impact of a Cleveland, Ohio, program designed to increase employment retention among low-wage workers in the long-term nursing care industry. Cleveland was one of 16 sites nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 44 firms to either a treatment group, whose employees could receive employment retention services through Cleveland Achieve, or a control group. The authors collected employment and earnings data from state Unemployment Insurance (UI) records. Three years after random assignment, the study found no statistically significant differences between the earnings and employment outcomes of employees in Achieve firms compared with employees in firms that did not have access to Achieve services. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the Achieve program, and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Cleveland","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Workforce development program: A pilot study of its impact in the U.S. Probation Office, District of Delaware.","Visher, C. A., Smolter, N., & O’Connell, D. (2010). Workforce development program: A pilot study of its impact in the U.S. Probation Office, District of Delaware. Federal Probation, 74(3), 16-21.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The authors examined the impact of the U.S. Probation Office, District of Delaware’s pilot workforce development program on employment, earnings, and recidivism outcomes for adult offendprobationers. The authors used a nonexperimental design to create a matched comparison group of nonparticipants who were similar to program participants. The authors’ estimated the program’s effects by comparing these groups’ employment, earnings, and recidivism outcomes one year after the program. Data were collected from probationer case files;, the Probation and Pretrial Services Automated Case Tracking System (PACTS) database;, and, for the treatment group, program records. The authors found that individuals people who participated in vocational training were employed for more months in the first year after program enrollment than were participants who received no vocational training. The authors found that individuals people in the program group were less likely to be rearrested or have their probation revoked than were members of the matched comparison group. The quality of causal evidence presented in this study is low. The authors did not account adequately for potential differences between the program and comparison groups before implementing the intervention was implemented. This means we are not confident that the estimated effects are attributable to the workforce development program; other factors are likely to have contributed.","the U.S. Probation Office, District of Delaware’s workforce development program","Job search assistance and supportive services Reentry",Justice-involved,,"United States",2010,https://www.uscourts.gov/sites/default/files/74_3_4_0.pdf,"Employment and Training Review Protocol" "Work after prison: One-year findings from the Transitional Jobs Reentry Demonstration","Redcross, C., Bloom, D., Jacobs, E., Manno, M., Muller-Ravett, S., Seefeldt, D., Yahner, J., Young Jr., A., & Zweig, J. (2010). Work after prison: One-year findings from the Transitional Jobs Reentry Demonstration. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Transitional Jobs Reentry Demonstration (TJRD) on ex-offenders’ employment and wages. The study used a randomized controlled trial to assign former prisoners to either the transitional jobs program or to a control group that was offered job search assistance. The authors compared the two groups’ employment and earnings outcomes one year after random assignment, controlling for participants’ characteristics before random assignment. The study found that members of the transitional jobs group were 8.6 percentage points more likely than control group members to be employed during all four quarters of the year after random assignment, but 8.9 percentage points less likely to have unsubsidized employment during the year after random assignment. Transitional jobs group members’ total earnings from all jobs were $1,419 higher, on average, than those of control group members during the year after random assignment, but their total earnings from unsubsidized jobs were $625 lower. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the TJRD, and not to other factors.","the Transitional Jobs Reentry Demonstration (TJRD)","Job search assistance and supportive services Other employment and reemployment Reentry","Justice-involved, Male, Low income",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514698.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [PROGRESS—Eugene]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [PROGRESS—Eugene]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports on former welfare recipients’ employment and benefits receipt outcomes after three years. The Eugene site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,179 employed single parents who were former Temporary Assistance for Needy Families (TANF) program participants to either a treatment group that received employment retention services from Eugene’s Progress Towards Retention, Opportunities, Growth, Enhancement and Self-Sufficiency (PROGRESS) program or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those in the PROGRESS group were 7 percentage points less likely than control group members to be employed in the third year after random assignment and 6.6 percentage points less likely to have been employed in every quarter of that year. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Eugene ERA program and not to other factors.","the Employment Retention and Advancement Project, Eugene","Other employment and reemployment Unemployment Insurance","Employed, Low income, Parent",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Rapid employment model evaluation: Update #2","Smith, T. C., King, C. T., & Schroeder, D. G. (2010). Rapid employment model evaluation: Update #2. Austin, TX: Ray Marshall Center for the Study of Human Resources.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Rapid Employment Model (REM) program on participants’ employment, earnings, and Unemployment Insurance (UI) benefit claims. (See the CLEAR review of the 2008 report here.) Using program data and state UI records, the authors matched treatment to comparison group cases and conducted regression analyses to estimate the effect of the intervention. The study found that participation in the REM program was associated with an increase in the likelihood that jobseekers were employed in the 10 quarters following program participation among the 2006 cohort. Participation in the REM program was also associated with an increase in the likelihood that jobseekers were employed, a decrease in quarterly earnings, and an increase in the likelihood jobseekers filed UI claims in the six quarters following program participation among the 2007 cohort. The quality of causal evidence presented in this report is moderate for earnings outcomes in both cohorts and for employment outcomes for the 2006 cohort because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects on employment and earnings are attributable to the REM program, but other factors might also have contributed. The quality of causal evidence presented for the UI benefit claiming outcome for both cohorts and the employment outcome for the 2007 cohort is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects on UI benefit claiming outcome are attributable to the REM program; other factors are likely to have contributed.","Rapid Employment Model (REM) Program","Job search assistance and supportive services Other training and education Unemployment Insurance","Justice-involved, Low-skilled, Low income",,"United States",2010,http://raymarshallcenter.org/files/2006/01/REM_eval_update_Jan2010.pdf,"Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [Texas ERA—Corpus Christi]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Texas ERA—Corpus Christi]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Corpus Christi site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,727 unemployed single-parent participants in Corpus Christi’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that, compared with the control group, those in the Corpus Christi ERA group were more likely to be employed at all or for four consecutive quarters in the fourth year after random assignment. Corpus Christi ERA group members also had higher earnings and received lower Food Stamps benefits. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program and not to other factors.","the Employment Retention and Advancement project, Corpus Christi","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Tuning in to local labor markets: Findings from the Sectoral Employment impact study","Maguire, S., Freely, J., Clymer, C., Conway, M., & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment impact study. Philadelphia, PA: Public/Private Ventures. [JVS-Boston]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Jewish Vocational Service (JVS)-Boston sectoral employment program on earnings and employment. The authors investigated similar research questions with two other programs, the profiles of which are available through the study search. The study was based on a randomized controlled trial, with the authors using survey data to estimate the effect of offering eligible JVS-Boston applicants the program by comparing average outcomes among those offered access to the program with the average outcomes of those not offered access to the program, after adjusting for differences between the groups. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition, and the authors did not demonstrate that the groups were similar at or account for differences between the two groups in the analyses. This means we are not confident that the estimated effects are attributable to the JVS-Boston sectoral employment program; other factors are likely to have contributed.","JVS-Boston Sectoral Employment","Job search assistance and supportive services Other training and education",Adult,"Finance and insurance","Urban, United States",2010,https://www.explorevr.org/sites/explorevr.org/files/files/Tuning%20In%20to%20Lo…,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Los Angeles EJC]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Los Angeles EJC]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to gauge how a Los Angeles job club focused on participants’ career interests affected employment, earnings, and benefits receipt outcomes after about 36 months. The Los Angeles site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. (See the CLEAR review of the interim report here.) The authors randomly assigned nearly 1,200 single-parent recipients of Temporary Assistance for Needy Families (TANF) to either a treatment group, which received Enhanced Job Club (EJC) services, or a control group, which received traditional job club (TJC) services. The authors collected employment and earnings data from Unemployment Insurance (UI) records and used automated TANF and food stamp databases to obtain benefits receipt information. Thirty-six months after random assignment, the study found no statistically significant differences between treatment and control group members’ employment, earnings, or benefits receipt. The quality of causal evidence provided in this study is high because it is based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the EJC and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Los Angeles’s Enhanced Job Club","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Do temporary-help jobs improve labor market outcomes for low-skilled workers? Evidence from “Work First”.","Autor, D. H., & Houseman, S. N. (2010). Do temporary-help jobs improve labor market outcomes for low-skilled workers? Evidence from “Work First”. American Economic Journal: Applied Economics, 2(3), 96–128.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of temporary-help and direct-hire jobs through the Work First program (a welfare-to-work program) on the earnings and employment of low-skilled workers in Detroit. The authors use a nonexperimental design that uses key features of the Work First program to compare the employment and earnings of participants placed in temporary- or permanent-hire positions. Work First program participants are assigned to different local contractors in their district on a rotating basis. The contractors assist participants with job placement, but vary the emphasis they place on temporary-hire or direct-hire positions; the authors use this variation across contractors to compare the employment and earnings of participants in different types of job placement. The study found that the average employment probability and quarterly earnings of those who found a direct-hire job increased significantly in the eight quarters following program participation compared with that of those who found a temporary-help job. The quality of causal evidence presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to temporary-hire and direct-hire job placements, but other factors might also have contributed.","the Work First Program","Job search assistance and supportive services Unemployment Insurance","Low income",,"United States",2010,,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [PASS - Riverside]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [PASS - Riverside]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports and supportive services on recent welfare recipients’ employment and benefits receipt outcomes after four years. The Riverside Post-Assistance Self-Sufficiency (PASS) site was one of two in Riverside, California, that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,770 employed single parents who had recently left the Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and surveys administered 12 and 42 months after random assignment. The study found that individuals assigned to the Riverside PASS ERA program had significantly higher earnings in the first and fourth years after random assignment and were more likely to be employed in every quarter of the fourth year, compared with those in the control group. The quality of causal evidence provided in this study is high for most outcomes because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Riverside PASS ERA program and not to other factors. However, the study receives a moderate causal evidence rating for outcomes from the 12-month survey because that data source had high attrition, yet the analysis included adequate statistical controls to correct for resulting imbalance.","the Employment Retention and Advancement Project, Riverside Post-Assistance Self-Sufficiency (PASS) Program","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2010,http://www.acf.hhs.gov/sites/default/files/opre/era_core.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Moving Up—South Carolina]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Moving Up—South Carolina]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on former welfare recipients’ employment and benefits receipt outcomes after four years. The South Carolina site was one of 16 sites nationwide that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,776 single parents who had left the Temporary Assistance for Needy Families (TANF) program in the past three years to either a treatment group that received ERA services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study did not find any statistically significant effects on earnings, employment, or benefits receipt one to four years after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that any estimated effects would be attributable to the South Carolina ERA project and not to other factors. However, the study did not find statistically significant effects.","the Employment Retention and Advancement Project, South Carolina","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Reinvesting in America’s youth: Lessons from the 2009 Recovery Act Summer Youth Employment Initiative.","Bellotti, J., Rosenberg, L., Sattar, S., Esposito, A., & Ziegler, J. (2010). Reinvesting in America’s youth: Lessons from the 2009 Recovery Act Summer Youth Employment Initiative. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: The research examines the implementation of the Summer Youth Employment Initiative (SYEI). Funded by the American Recovery and Reinvestment Act of 2009, SYEI aimed to reverse the steep decline in youth employment during the recession by providing employment opportunities for youth in the summer of 2009. Through the initiative, youth were placed in summer work experiences with local employers and their wages were paid with Recovery Act funds. The work experiences were fairly flexible, but had to be age appropriate and lead to youth meeting work readiness goals. The authors analyzed state performance data through December 31, 2009, and data from in-depth site visits to 20 selected sites during July and August 2009. The authors reported that it took a large effort to get the program up and running in such a short amount of time (about four months). Some sites reported having to make compromises along the way, given the quick time frame, but all reported satisfaction with their accomplishments. The initiative was implemented successfully in all the studied sites, with all sites able to recruit a sufficient number of participants and place them in employment. Youth participants and the employers interviewed were very positive about the initative. Although the implementation of SYEI was considered a success, it was not without some initial challenges, including handling the large volume of applicants and determining their eligibility, reaching older youth ages 22 to 24 and veterans and their spouses, and appropriately matching youth to employers.","Summer Youth Employment Initiative (SYEI)","Basic skills Job search assistance and supportive services Work based and other occupational training Youth programs","Youth, Disconnected youth, Low-skilled, Low income",,"United States",2010,http://files.eric.ed.gov/fulltext/ED510398.pdf,"Opportunities for Youth Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Training Focused and Work Plus—Riverside, California]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Training Focused and Work Plus—Riverside, California]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Riverside Phase 2 site was one of two in Riverside, California, that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 3,029 employed single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups (Work Plus and Training Focused) that received differing ERA services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that, compared with the control group, those in the Riverside Work Plus group were 3.2 percentage points more likely to have received Food Stamps in the first year after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Riverside Work Plus program and not to other factors.","the Employment Retention and Advancement Project—Work Plus and Training Focused (Phase 2), Riverside","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [RFS-Los Angeles]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [RFS-Los Angeles]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of individualized and flexible post-employment job supports on employed welfare recipients’ employment and benefits receipt outcomes after three years. The Los Angeles Reach for Success (RFS) site was one of two in Los Angeles that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 5,700 employed single-parent participants in Los Angeles’s Temporary Assistance for Needy Families (TANF) program who were working full-time to either a treatment group that received RFS services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and surveys administered 12 and 42 months after random assignment. The study found that, 12 to 42 months after random assignment, RFS group members’ employment, earnings, and benefits receipt did not differ significantly from those of control group members. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that any estimated effects would be attributable to Los Angeles’ RFS and not to other factors. However, the study did not find statistically significant effects.","Reach for Success (RFS)","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [Texas ERA—Houston]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Texas ERA—Houston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Houston site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,032 unemployed single-parent participants in Houston’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those in the Houston ERA group received on average $56 more per year in TANF benefits across the first four years after random assignment, compared with the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program and not to other factors.","the Employment Retention and Advancement project, Houston","Other employment and reemployment Unemployment Insurance","Parent, Low income",,"Urban, United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Tuning in to local labor markets: Findings from the Sectoral Employment impact study","Maguire, S., Freely, J., Clymer, C., Conway, M. & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment impact study. Philadelphia: Public/Private Ventures. [Wisconsin Regional Training Partnership]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Wisconsin Regional Training Partnership’s (WRTP) sectoral employment program on earnings and employment. The authors investigated similar research questions with two other programs, the profiles of which are available through the study search. The study was based on a randomized controlled trial, with the authors estimating the effect of offering eligible WRTP applicants the program by using survey data to compare average outcomes among those offered access to the program against the average outcomes of those not offered access, after adjusting for differences between the groups. The study found that being offered access to the WRTP’s sectoral employment program increased earnings by $6,255, on average, over the two years after acceptance to the program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the WRTP’s sectoral employment program, and not to other factors.","the WRTP Sectoral Employment Program","Job search assistance and supportive services Other training and education","Low income","Construction, Manufacturing, Health care and social assistance","United States",2010,https://www.explorevr.org/sites/explorevr.org/files/files/Tuning%20In%20to%20Lo…,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [VISION—Salem, OR]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [VISION—Salem, OR]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on Temporary Assistance for Needy Families (TANF) recipients’ employment and benefits receipt outcomes after three years. The Salem site was one of several across the United States that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,504 single parents eligible for welfare-to-work programs to either a treatment group that received Valuing Individual Success and Increasing Opportunities Now (VISION) services or to a control group that received the state’s typical welfare-to-work program. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those in the VISION group were 6.7 percentage points more likely than those in the control group to have received TANF benefits at any point during the first follow-up year. The VISION group also received, on average, $298 more in annual TANF benefits during the first three follow-up years, compared with the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Salem ERA program and not to other factors.","the Salem Valuing Individual Success and Increasing Opportunities Now (VISION) Program","Other employment and reemployment Unemployment Insurance Job search assistance and supportive services","Low income, Parent",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Chicago ERA]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Chicago ERA]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to determine the effectiveness of a Chicago program to increase the earnings of Temporary Assistance for Needy Families (TANF) recipients. The Chicago site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,728 TANF recipients to either a treatment group, which received enhanced employment services, or a control group, which received benefits as usual. The authors collected employment and earnings data from Illinois Unemployment Insurance (UI) records over four follow-up years and Food Stamps and TANF receipt data from administrative records over three follow-up years. The study found that members of the treatment group received significantly less in average annual TANF benefits ($778 compared with $1,010 among control group members) but more in average annual Food Stamps ($4,111 compared with $3,959 among control group members). People in the ERA group were also more likely to be employed in the first year (69.7 percent) than people in the control group (66.2 percent). The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable to the Chicago ERA program, and not to other factors.","the Employment Retention and Advancement project, Chicago","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Effect of job skills training on employment and job seeking behaviors in an American Indian substance abuse treatment sample.","Foley, K., Pallas, D., Forcehimes, A., Houck, J., Bogenschutz, M., Keyser-Marcus, L., & Svikis, D. (2010). Effect of job skills training on employment and job seeking behaviors in an American Indian substance abuse treatment sample. Journal of Vocational Rehabilitation, 33(2010), 181-192.","Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Unfavorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of workshops for job seekers on employment and training outcomes. The study used a randomized controlled trial (RCT) design, in which eligible participants were randomly assigned to the treatment group, which could participate in the job seeker workshops, or the control group, which could not participate. The authors used follow-up surveys three and six months after random assignment to measure self-reported employment and training outcomes. The study found that three months after workshop participation, the treatment group spent fewer hours on training activities than the control group; the study did not find any significant impacts of the job seekers’ workshop on the number of hours spent on work or percentage of each group who were employed at the three-month follow-up. The quality of causal evidence presented in this report is high for the percentage employed and hours spent on work and training outcomes collected at the three-month follow-up because those outcomes were based on a well-implemented RCT with low attrition. This means we are confident that the estimated effects are attributable to the job seekers’ workshop, and not to other factors. However, the quality of causal evidence presented in this report is low for the days to employment outcomes at the three-month follow-up and all outcomes at the six-month follow-up. This means we are not confident that the estimated effects are attributable to the job seekers’ workshop; other factors are likely to have contributed.","Job Seekers’ Workshop","Job search assistance and supportive services","Other barriers, Unemployed, American Indian or Alaska Native",,"United States",2010,,"Employment and Training Review Protocol" "Strategies to help low-wage workers advance: Implementation and early impacts of the Work Advancement and Support Center (WASC) demonstration. [San Diego]","Miller, C., Tessler, B., & Van Dok, M. (2009). Strategies to help low-wage workers advance: Implementation and early impacts of the Work Advancement and Support Center (WASC) demonstration. New York City: MDRC. [San Diego]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the early impacts of participation in the Work Advancement and Support Center (WASC) demonstration on employment, earnings, education and training, and receipt of public benefits outcomes. The authors randomly assigned eligible individuals to either a treatment group that received WASC services or to a control group that received existing job placement services focused on employment. The authors analyzed data from Unemployment Insurance records, San Diego county administrative records, and a survey administered 12 months after random assignment In the San Diego site’s first year, the study found that WASC increased participant’s receipt of Food Stamps by about 23 percent. It also found that 63.2 percent of WASC participants were employed for four consecutive quarters compared with 69.7 percent of control group members For outcomes measured with administrative data, the quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects on those outcomes are attributable to WASC and not to other factors. For employment and earnings outcomes measured with survey data, the quality of evidence is low because the authors did not account for preexisting differences between the groups being compared in their analysis. This means we are not confident that the estimated effects on those outcomes are attributable to WASC; other factors are likely to have contributed.","the Work Advancement and Support Center (WASC) Demonstration","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States",2009,http://www.mdrc.org/sites/default/files/full_516.pdf,"Employment and Training Review Protocol" "Transitional jobs for ex-prisoners: Implementation, two-year impacts, and costs of the Center for Employment Opportunities (CEO) prisoner reentry program","Redcross, C., Bloom, D., Azurdia, G., Zweig, J., and Pindus, N. (2009). Transitional jobs for ex-prisoners: Implementation, two-year impacts, and costs of the Center for Employment Opportunities (CEO) prisoner reentry program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of a comprehensive employment program on ex-offenders’ employment and wages. The authors randomly assigned former prisoners to an employment program offering transitional job placement and other services or to a control condition providing a more limited set of services. Employment and earnings data were collected quarterly for three years and compared between the two groups, controlling for characteristics before random assignment. The study did not find any statistically significant effects on employment in the sixth or eighth quarters after random assignment, nor on earnings in the sixth quarter or second year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to the employment program and not to other factors. However, the study did not find statistically significant effects.","the Center for Employment Opportunities (CEO) Transitional Jobs Program","Job search assistance and supportive services Other employment and reemployment Reentry",Justice-involved,,"Urban, United States",2009,http://www.acf.hhs.gov/sites/default/files/opre/ex_prisoners.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the Los Angeles Reach For Success program","Anderson, J., Freedman, S., and Hamilton, G. (2009). The Employment Retention and Advancement project: Results from the Los Angeles Reach For Success program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Mixed impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of an individualized case management program called Reach for Success (RFS) on employment, earnings, and public assistance receipt for recipients of Temporary Assistance for Needy Families (TANF) cash assistance benefits. The study used a randomized controlled trial design, assigning eligible people over a two-year period to either the RFS program or existing services. To estimate the program’s impacts, the authors used administrative employment, earnings, and public benefits data, as well as a 12-month follow-up survey emphasizing respondents’ employment, income, and other outcomes. Outcomes were adjusted for prerandom assignment characteristics. The study found that RFS participants were significantly more likely to receive TANF and Food Stamps benefits at the end of the two-year follow-up period. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the RFS program and not to other factors.","Reach for Success (RFS)","Other employment and reemployment","Parent, Low income",,"United States",2009,http://www.acf.hhs.gov/sites/default/files/opre/era_la_rfs_embed.pdf,"Employment and Training Review Protocol" "Return on investment analysis of a selected set of workforce system programs in Indiana. [WIA Dislocated Worker]","Hollenbeck, K. (2009). Return on investment analysis of a selected set of workforce system programs in Indiana. Indianapolis, IN: Indiana Chamber of Commerce Foundation. [WIA Dislocated Worker]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Dislocated Worker program on the employment rate, earnings, and benefit receipt of low-income adults who are dislocated workers. The author used a nonexperimental method to compare the short-term (three quarters after program exit) and long-term (seven quarters after program exit) employment, earnings, and Unemployment Insurance benefits between those who took part in the WIA Dislocated Worker Program relative to those who participated in the WorkOne program. The study found that, compared with those who participated in the WorkOne program, WIA Dislocated Worker Program participants had higher employment and earnings and lower benefit receipt. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Dislocated Worker program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Dislocated Worker Program","Job search assistance and supportive services Other employment and reemployment Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Dislocated or displaced worker, Low income",,"United States",2009,http://www.indianachamber.com/images/media/studies/ROIanalysisWorkforceDevelopm…,"Review Protocol" "The Employment Retention and Advancement project: Findings for the Eugene and Medford, Oregon, models: Implementation and early impacts for two programs that sought to encourage advancement among low-income workers. [PROGRESS—Eugene]","Molina, F., van Dok, M., Hendra, R., Hamilton, G., & Cheng, W. (2009). The Employment Retention and Advancement project: Findings for the Eugene and Medford, Oregon, models: Implementation and early impacts for two programs that sought to encourage advancement among low-income workers. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [PROGRESS—Eugene]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports on former welfare recipients’ employment and benefits receipt outcomes after 1.5 years. The Eugene site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,137 employed people who were recent Temporary Assistance for Needy Families (TANF) program participants to either a treatment group that received ERA services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study did not find any statistically significant effects on earnings, employment, or benefits receipt 1.5 years after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we would be confident that any estimated effects would be attributable to the Eugene ERA program and not to other factors. However, the study did not find statistically significant effects.","the Employment Retention and Advancement Project, Eugene","Other employment and reemployment Unemployment Insurance","Low income",,"United States",2009,http://www.acf.hhs.gov/sites/default/files/opre/era_eug_medi.pdf,"Employment and Training Review Protocol" "An Evaluation of the Latino Coalition’s Reclamando Nuestro Futuro (Reclaiming our Future) Program","Monsma, S., & Smidt, C. (2009). An Evaluation of the Latino Coalition’s Reclamando Nuestro Futuro (Reclaiming our Future) Program. Paul Henry Institute for the Study of Christianity and Politics,","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report presents an implementation analysis of the Latino Coalition’s Reclamando Nuestro Futuro (RNF) program. The program provided skills training, case management, and follow-up services to at risk youth and those with previous criminal justice experience between the ages of 14 and 21. The study examined RNF programs in 19 sites, focusing on program organization, sub-grantee characteristics, and participant characteristics and outcomes. The study utilized management information system (MIS) data, staff interviews, site visits, participant focus groups, and interviews with community partners. The program was successful in reaching and retaining minority youth and those with previous criminal justice experience, largely because program subgrantees were located in and matched the neighborhoods they served, and had staff members who seemed similar to, and accessible to, their target population. The Latino Coalition, the intermediary organization, played a critical role in the program’s success by establishing a robust organizational and oversight structure and providing capacity-building assistance to the relatively new and small faith-based and community organizations delivering program services.","Reclamando Nuestro Futuro (Reclaiming Our Future)","Basic skills Community college education and other classroom training Job search assistance and supportive services Mentoring Substance abuse recovery Work based and other occupational training Youth programs","Youth, Justice-involved, Hispanic of any race",,"United States",2009,http://wdr.doleta.gov/research/FullText_Documents/An%20Evaluation%20of%20the%20…,"Opportunities for Youth Review Protocol" "Assessment of the impact of WorkSource job search services","Lee, K., Weeks, G., Bodeutsch, G., Clay-Poole, S., Garoflo, T., Petritz, M., Stromsdorfer, E., Field, J., Paterson, T., & Jennings, K. (2009). Assessment of the impact of WorkSource job search services. Washington: Washington State Employment Security Department Labor Market and Economic Analysis.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to assess the effectiveness of Washington State WorkSource job search services. WorkSource services included staff-assisted job matching, provision of labor market information, job search and placement assistance, and initial assessments. Using a nonexperimental design, the authors compared the employment and earnings of Unemployment Insurance (UI) claimants who received at least one WorkSource service with those of UI claimants who did not receive any WorkSource services using state UI administrative records for more than 64,000 Washington State UI claimants with no UI-reported wage earnings in the third quarter of 2007. The study found that WorkSource services were associated with a higher probability of employment and higher earnings growth for men and women who were intermittently (rather than continuously) employed in the baseline period. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to WorkSource services. Other factors are likely to have contributed.","JSA services","RESEA Job search assistance and supportive services","Unemployed, Female, Male",,"United States",2009,https://esdorchardstorage.blob.core.windows.net/esdwa/Default/ESDWAGOV/labor-ma…,"Reemployment Review Protocol" "Return on investment analysis of a selected set of workforce system programs in Indiana. [TAA]","Hollenbeck, K. (2009). Return on investment analysis of a selected set of workforce system programs in Indiana. Indianapolis, IN: Indiana Chamber of Commerce Foundation. [TAA]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Trade Adjustment Assistance (TAA) Program on the employment, earnings, and benefit receipt of dislocated workers in Indiana. The author used a nonexperimental method to compare the short-term (three quarters after program exit) and long-term (seven quarters after program exit) employment and earnings between those who took part in the TAA Program relative to those who participated in the WorkOne program. The study found that, compared with those who participated in the WorkOne program, TAA Program participants had higher employment and lower benefit receipt. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the TAA Program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Trade Adjustment Assistance (TAA) Program","Adult and Dislocated Worker programs Job search assistance and supportive services","Dislocated or displaced worker",,"United States",2009,http://www.indianachamber.com/images/media/studies/ROIanalysisWorkforceDevelopm…,"Review Protocol" "Youth work and learn at Our Piece of the Pie (OPP): Findings of the formative evaluation of Connecticut's youth development model","Britner, P., Buch, R., Colon, R., Milan, S., Singer, M., & Snow, S. (2009). Youth work and learn at Our Piece of the Pie (OPP): Findings of the formative evaluation of Connecticut's youth development model. Storrs, CT: Center for Health, Intervention and Prevention, University of Connecticut.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report describes the work of Our Piece of the Pie (OPP), an organization that gives young people in Hartford, CT, access to a range of services, including academic assistance, vocational training, and guidance from caring adults trained to provide mentorship and other support. The study aimed to gather information on the characteristics of the youth served by OPP, their participation in program activities, and the progress they made in reaching academic and employment goals. The evaluation team conducted direct observations of intervention activities, interviews with program staff and participants, and surveys of participating youth. It also drew on program data collected by OPP. The study found that most participants spent a considerable amount of time with their mentors each week, with some also taking advantage of career advancement and educational preparation services. Although participating youth were making progress on their goals at the time of the evaluation, particularly in achieving educational milestones, the authors suggested that the program could benefit by strengthening participant-mentor relationships, adapting programming for special populations, and improving the quality of program data.","Our Piece of the Pie (OPP)","Job search assistance and supportive services Youth programs Mentoring Other training and education Work based and other occupational training","Youth, Disconnected youth",,"United States",2009,,"Opportunities for Youth Review Protocol" "The Employment Retention and Advancement project: Findings for the Eugene and Medford, Oregon, models: Implementation and early impacts for two programs that sought to encourage advancement among low-income workers.","Molina, F., van Dok, M., Hendra, R., Hamilton, G., and Cheng, W. (2009). The Employment Retention and Advancement project: Findings for the Eugene and Medford, Oregon, models: Implementation and early impacts for two programs that sought to encourage advancement among low-income workers. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [TAAG - Medford]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports on former and current welfare recipients’ employment and benefits receipt outcomes after 1.5 years. The Medford site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,164 single parents to either a treatment group that received ERA services or a control group that could participate in other programs in the community. People in the study were current or recent Temporary Assistance for Needy Families (TANF) program participants or people enrolled in other benefit programs that required clients to participate in employment or training. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that participants assigned to the Medford ERA program earned, on average, $40 more per week in the first year after random assignment than those in the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Medford ERA program and not to other factors.","the Employment Retention and Advancement Project, Medford","Other employment and reemployment Other training and education Unemployment Insurance","Low income",,"United States",2009,http://www.mdrc.org/sites/default/files/full_367.pdf,"Employment and Training Review Protocol" "Return on investment analysis of a selected set of workforce system programs in Indiana. [WIA Youth]","Hollenbeck, K. (2009). Return on investment analysis of a selected set of workforce system programs in Indiana. Indianapolis, IN: Indiana Chamber of Commerce Foundation. [WIA Youth]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Youth Program on the employment and earnings of low-income youths in Indiana State. The author used a nonexperimental method to compare the short-term (three quarters after program exit) and long-term (seven quarters after program exit) employment and earnings between youth who took part in the WIA Youth Program relative to youth who participated in the WorkOne program. The study found no statistically significant relationships between WIA Youth Program participants and employment and earnings. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before program participation. This means we would not be confident that any estimated effects are attributable to the WIA Youth Program; however, the study did not find statistically significant effects. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Youth Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs Youth programs",Youth,,"United States",2009,http://www.indianachamber.com/images/media/studies/ROIanalysisWorkforceDevelopm…,"Review Protocol" "Return on investment analysis of a selected set of workforce system programs in Indiana. [WIA Adult]","Hollenbeck, K. (2009). Return on investment analysis of a selected set of workforce system programs in Indiana. Indianapolis, IN: Indiana Chamber of Commerce Foundation. [WIA Adult]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program on the employment, earnings, and benefit receipt of low-income adults in Indiana. The author used a nonexperimental method to compare the short-term (three quarters after program exit) and long-term (seven quarters after program exit) employment, earnings, and Unemployment Insurance benefits between those who took part in the WIA Adult Program and those who participated in the WorkOne program. The study found that, compared with those who participated in the WorkOne program, WIA Adult Program participants had higher employment and earnings. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Adult Program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Adult Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Adult, Low-skilled, Low income",,"United States",2009,http://www.indianachamber.com/images/media/studies/ROIanalysisWorkforceDevelopm…,"Review Protocol" "Growing America through entrepreneurship: Final evaluation of Project GATE","Benus, J., Shen, T., Zhang, S., Chan, M., & Hansen, B. (2009). Growing America through entrepreneurship: Final evaluation of Project GATE. Washington, DC: IMPAQ International.","Entrepreneurship and Self-Employment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Growing America Through Entrepreneurship (Project GATE) demonstration project, which offered entrepreneurship training and business counseling to low-income individuals, on participants’ employment and earnings. The authors randomly assigned study participants to a treatment group, which could participate in Project GATE, or a control group, which could not participate. The authors collected information from all participants through follow-up surveys 6, 18, and 60 months after random assignment. The study found that Project GATE increased the likelihood of business ownership in the second and third quarters after random assignment. The study found few statistically significant impacts on employment or earnings over the 60-month follow-up period, though generally the Project GATE participants were slightly less likely than the control group members to be employed in later follow-up periods. The quality of causal evidence presented in this report is high for outcomes measured in the first two quarters after assignment because these outcomes were based on a well-implemented randomized controlled trial. However, outcomes measured at other follow-up points present low causal evidence because of high attrition and insufficient adjustment for differences in previous employment and earnings history.","the Project Growing America Through Entrepreneurship (GATE) Demonstration","Job search assistance and supportive services Other training and education","Low income",,"United States",2009,https://www.impaqint.com/sites/default/files/project-reports/Project%20GATE%20F…,"Employment and Training Review Protocol" "Evaluation of customized employment in building the capacity of the workforce development system","Elinson, L., Frey, W. D., Li, T., Palan, M. A., & Horne, R. L. (2008). Evaluation of customized employment in building the capacity of the workforce development system. Journal of Vocational Rehabilitation, 28(3), 141-158.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of customized employment services for disabled adults on earnings and employment. Using administrative data, the authors compared employment and earnings outcomes of people who participated in a customized employment intervention with outcomes of people who participated in a Working for Freedom, Opportunity, and Real Choice through Community Employment (WorkForce) intervention. The study found that those in the customized employment intervention were more likely to be employed for at least 12 months and to earn at least $8.15 per hour after participating in the intervention compared with the WorkForce group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the WorkForce intervention; other factors are likely to have contributed.","the customized employment services","Job search assistance and supportive services Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)",Disability,,"United States",2008,https://content.iospress.com/articles/journal-of-vocational-rehabilitation/jvr0…,"Employment and Training Review Protocol" "Reemployment and Eligibility Assessment (REA) Study: FY 2005 Initiative: final report","Benus, J., Poe-Yamagata, E., Wang, Y., & Blass, E. (2008). Reemployment and Eligibility Assessment (REA) Study: FY 2005 Initiative: final report. Columbia, MD: IMPAQ International. [Minnesota sample]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: This study’s objective was to assess the effectiveness of the Reemployment and Eligibility Assessment (REA) initiative in Minnesota, a program that provided eligibility and reemployment case management services to Unemployment Insurance (UI) claimants, on UI benefits receipt, wages, and employment. The study randomly assigned 5,898 eligible claimants to one of two treatment groups, which received REA services of varying intensity, or the control group. Those in the treatment groups were required to participate in the services to retain their UI eligibility. The authors estimated the program’s effectiveness by analyzing state administrative records on UI payments and information from a follow-up survey of a subsample of study participants. The study found that UI claimants in the more-intensive treatment group claimed fewer weeks of UI benefits and were less likely to have an overpayment detected. There were no significant impacts on employment or earnings for either treatment group. The quality of causal evidence presented in this report is moderate because it is a randomized controlled trial with different selection processes for the treatment and control groups, but the authors controlled sufficiently for baseline characteristics in the analysis. This means we have some confidence that the estimated effects are attributable to REA, although other factors might also have contributed.","the Reemployment and Eligibility Assessment (REA) Initiative in Minnesota","Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",2008,http://wdr.doleta.gov/research/FullText_Documents/Reemployment%20and%20Eligibil…,"Reemployment Review Protocol" "The Employment Retention and Advancement project: A comparison of two job club strategies: The effects of enhanced versus traditional job clubs in Los Angeles","Navarro, D., Azurdia, G., & Hamilton, G. (2008). The Employment Retention and Advancement project: A comparison of two job club strategies: The effects of enhanced versus traditional job clubs in Los Angeles. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to gauge the effect of a Los Angeles job club focused on participants’ career interests on employment, earnings, and benefits receipt outcomes after about 18 months. The Los Angeles site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. (See the CLEAR review of the final report here.) The authors randomly assigned almost 1,200 single-parent Temporary Assistance for Needy Families (TANF) recipients to either a treatment group, which received Enhanced Job Club (EJC) services, or a control group, which received Traditional Job Club (TJC) services. The authors collected employment and earnings data from Unemployment Insurance (UI) records and used automated TANF and Food Stamps databases to obtain benefits receipt information. The study found that, 18 months after random assignment, there were no statistically significant differences between EJC and control group members’ employment, earnings, or public benefits receipt. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the EJC and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Los Angeles’s Enhanced Job Club","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2008,http://www.acf.hhs.gov/sites/default/files/opre/era_la.pdf,"Employment and Training Review Protocol" "Effectiveness of supported employment for individuals with schizophrenia: Results of a multi-site, randomized trial","Cook, J., Blyler, C., Burke-Miller, J., McFarlane, W., Leff, H., Mueser, K., Gold, P., Goldberg, R., Shafer, M., Onken, S., Donegan, K., Carey, M., Razzano, L., Grey, D., Pickett-Schenk, S., & Kaufmann, C. (2008). Effectiveness of supported employment for individuals with schizophrenia: Results of a multi-site, randomized trial. Clinical Schizophrenia & Related Psychoses, 37-46.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to estimate the 24-month employment effects of supported employment interventions on people with severe mental illness, focusing on those with schizophrenia. Supported employment interventions use a combination of employment and health services and supports to improve employment and other outcomes. The authors analyzed data from seven sites, each of which implemented a distinct supported employment intervention using a randomized controlled trial. At each site, researchers interviewed participants in person twice yearly and collected weekly employment data. The study found that the programs were effective at improving 24-month employment outcomes for people with severe mental illness. Relative to treatment group members with different severe mental illnesses, people with a diagnosis of schizophrenia who received supported employment services were more likely to be employed after receiving those services. The quality of causal evidence provided in this study is moderate. This means we are somewhat confident that the estimated effects are attributable to the supported employment interventions, but other factors might also have contributed.","Supported Employment Programs","Health Job search assistance and supportive services Supported employment or other employment supports",Disability,,"United States",2008,,"Disability Employment Policy Review Protocol" "Bring them back, move them forward: Case studies of programs preparing out-of-school youths for further education and careers.","Buschmann, R., & Haimson, J. (2008). Bring them back, move them forward: Case studies of programs preparing out-of-school youths for further education and careers. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This study examined the work of six dropout recovery programs to explore how similar programs might more effectively prepare youth for postsecondary education and employment. It focused on the key services the programs provided to school dropouts, challenges related to implementing program activities, and strategies to address and resolve these challenges. The researchers conducted one- to two-day visits to each program site, during which they interviewed principals or program directors, instructors, counselors, records administrators, and participating students. They also gathered individual participants’ record data and aggregate reports of key outcomes. The study found that incoming participants’ academic ability varied greatly and that large class sizes sometimes limited the extent to which teachers could adapt their lessons to meet diverse needs. Program staff tried to develop relationships with participants and help them resolve personal problems, but found it difficult to address the most serious problems. Some participants had positive short-term outcomes such as enrolling in education or finding a job. The authors suggested that similar programs might want to consider collecting more cost data for planning purposes, track participants’ progress on educational and employment goals after program completion, and conduct rigorous impact studies to understand how individual program features influence their participants’ outcomes.","Dropout Programs","Job search assistance and supportive services Youth programs Community college education and other classroom training Other training and education",Youth,,"United States",2008,http://www.mathematica-mpr.com/publications/pdfs/bringback_moveforward.pdf,"Opportunities for Youth Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [CTE]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [CTE]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Carl Perkins Postsecondary Career and Technical Education (CTE) program on employment and credential completion. The authors used administrative records to compare the outcomes of low-income adults who took part in the CTE program with the outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that CTE participants had higher employment and credential completion rates compared with those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to CTE; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Carl Perkins Postsecondary Career and Technical Education (CTE) Program","Other training and education Job search assistance and supportive services","Low income, Low-skilled",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [TAA]","Hollenbeck, K., & Huang, W.-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [TAA]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Training Adjustment Assistance (TAA) program on employment and credential completion. The study used administrative records to compare outcomes of low-income adults who took part in the TAA program with outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that TAA participants had a lower employment rate but were more likely to have obtained a training certificate compared with those who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to TAA; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Trade Adjustment Assistance (TAA) Program","Job search assistance and supportive services Other training and education","Low-skilled, Low income, Dislocated or displaced worker",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Review Protocol" "Growing America Through Entrepreneurship: Findings from the evaluation of Project GATE","Benus, J., McConnell, S., Bellotti, J., Shen, T., Fortson, K., & Kahvecioglu, D. (2008). Growing America Through Entrepreneurship: Findings from the evaluation of Project GATE. Columbia, MD: IMPAQ International.","Entrepreneurship and Self-Employment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impacts of the Growing America Through Entrepreneurship (Project GATE) demonstration project, which offered entrepreneurship training and business counseling to low-income individuals, on participants’ employment, earnings, and public assistance benefit receipt. The authors randomly assigned study participants to a treatment group, which could participate in Project GATE, or a control group, which could not participate. The authors used Unemployment Insurance (UI) wage records and survey data in their analyses. The study did not find any statistically significant effects of Project GATE on employment, earnings, or UI benefit receipt in any of the four quarters after random assignment, using UI wage record data. The quality of causal evidence presented in this report is high for outcomes measured using UI wage record data because they were based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to Project GATE and not to other factors. However, the study did not find statistically significant effects. Outcomes measured with survey data received a low evidence rating because there is high attrition and insufficient adjustment for differences in previous employment and earnings history.","the Project Growing America Through Entrepreneurship (GATE) Demonstration","Job search assistance and supportive services Other training and education Unemployment Insurance","Low income",,"United States",2008,https://wdr.doleta.gov/research/FullText_Documents/Findings%20from%20the%20Eval…,"Employment and Training Review Protocol" "McNeil Education, Training and Evaluation (2008). Process evaluation of the Demand-Side Youth Offender Demonstration Project (Phase II).","McNeil Education, Training and Evaluation (2008). Process evaluation of the Demand-Side Youth Offender Demonstration Project (Phase II). Chapel Hill, NC: McNeil Education.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of being matched to employment through the Demand-Side Youth Offender Demonstration Project (DSYODP) Phase I on youths’ average weekly earnings. The study compared the wages of employed youth who were matched to employment through DSYODP with the wages of employed youth who were eligible for the DSYODP but had secured employment through other means. The study found that average weekly wages of youth matched to employment through DSYODP were significantly higher than wages of youth who secured employment through other means. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the DSYODP; however, other factors might also have contributed.","Demand-Side Youth Offender Demonstration Project (DSYODP)","Job search assistance and supportive services Youth programs","Youth, Justice-involved, Disconnected youth",,"United States",2008,https://wdr.doleta.gov/research/FullText_Documents/Process%20Evaluation%20of%20…,"Opportunities for Youth Review Protocol" "Evaluation of seven Second Chance Act Adult Demonstration Programs: Impact findings at 30 months","D'Amico, R., & Kim, H. (2008). Evaluation of seven Second Chance Act Adult Demonstration Programs: Impact findings at 30 months. Oakland, CA: Social Policy Research Associates. Retrieved from the National Criminal Justice Reference Service website: https://www.ncjrs.gov/pdffiles1/nij/grants/251702.pdf.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Second Chance Act (SCA) Adult Demonstration Program on employment, earnings, and recidivism. The study was a randomized controlled trial involving a sample of people recently or soon to be released from incarceration. The primary data sources included administrative data on employment and earnings from the National Directory of New Hires, state and local corrections records of recidivism, and 18-month follow-up survey data on employment, earnings, and recidivism. The authors used a statistical model to compare the outcomes of treatment and control group members, both overall and among groups with higher and lower risk of recidivism. The study found that the SCA program had no impacts on earnings, employment, or recidivism. Further, several recidivism outcomes from the administrative data sources demonstrated an increase in crime or crime-related activities. Among those in the sample at lower risk for recidivism, the study found that the program was associated with a larger number of reconvictions 30 months after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects for the full sample would have been attributable to the SCA Adult Demonstration Program and not to other factors had the study found statistically significant effects. The quality of causal evidence of the analyses by risk-level is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects for the risk subgroups are attributable to the SCA Adult Demonstration Program; other factors are likely to have contributed.","the Second Chance Act (SCA) Adult Demonstration Program","Health Reentry Other training and education",Justice-involved,,"United States",2008,https://www.ncjrs.gov/pdffiles1/nij/grants/251702.pdf,"Employment and Training Review Protocol" "Supported employment for middle-aged and older people with schizophrenia.","Twamley, E., Narvaez, J., Becker, D., Bartels, S., & Jeste, D. (2008). Supported employment for middle-aged and older people with schizophrenia. American Journal of Psychiatric Rehabilitation, 11(1), 76-89.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of Individual Placement and Support (IPS) on competitive employment for older people with schizophrenia The study was a randomized controlled trial (RCT) and used weekly work logs cross-referenced with pay stubs to measure employment outcomes over a 12-month period. The study found that IPS increased competitive employment and earnings compared with conventional services. The quality of causal evidence presented in this report is low because the RCT has a confounding factor. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support and Vocational Rehabilitation Program","Health Individuals facing barriers to employment Job search assistance and supportive services","Adult, Older worker, Disability",,"United States",2008,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2638571/,"Employment and Training Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [DBVI]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [DBVI]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Vocational Rehabilitation program administered by the Department for Blind and Vision Impaired (DBVI) on participants’ employment and credential completion. The study used administrative records to compare the outcomes of low-income adults who took part in the DBVI program with outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that DBVI participants had higher employment and credential completion rates compared with those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to DBVI; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Vocational Rehabilitation (VOC) Programs","Supported employment or other employment supports Vocational rehabilitation","Disability, Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Review Protocol" "The Employment Retention and Advancement project: Results from the Valuing Individual Success and Increasing Opportunities Now (VISION) program in Salem, Oregon","Molina, F., Cheng, W., and Hendra, R. (2008). The Employment Retention and Advancement project: Results from the Valuing Individual Success and Increasing Opportunities Now (VISION) program in Salem, Oregon. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Salem, Oregon, Valuing Individual Success and Increasing Opportunities Now (VISION) program on employment, earnings, and public benefits receipt among eligible single parents. VISION provided job search assistance and post-employment services to unemployed Temporary Assistance for Needy Families (TANF) applicants. The study used a randomized controlled trial to assign TANF applicants eligible for welfare-to-work programs to either VISION or the state’s typical welfare-to-work program, Job Opportunities and Basic Skills Training (JOBS), from May 2002 to May 2004. To estimate differences in outcomes between the two study groups, the authors retrieved data from unemployment insurance wage records, TANF and Food Stamps administrative records, and a 12-month follow-up survey. The study found that people in the VISION group received, on average, $365 more in TANF benefits and $160 more in Food Stamps than those in the JOBS group during the first year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to VISION, and not to other factors.","the Salem Valuing Individual Success and Increasing Opportunities Now (VISION) Program","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2008,http://files.eric.ed.gov/fulltext/ED501587.pdf,"Employment and Training Review Protocol" "Workforce Investment Act non-experimental net impact evaluation final report","Heinrich, C., Mueser, P., Troske, K., & Benus, J. (2008). Workforce Investment Act non-experimental net impact evaluation final report. Columbia, MD: IMPAQ International, LLC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The report’s objective was to examine the effects of participation in the Workforce Investment Act (WIA) Adult and Dislocated Worker programs on average earnings and employment. Results for earnings of participants ages 22 to 26 were presented separately and are the focus of this review. The effectiveness of the programs was evaluated using a matched comparison group design. Outcomes were examined up to 10 quarters after WIA participants entered the Adult or Dislocated Worker programs. The study found that participants in the WIA Adult Program under age 26 earned significantly more than those in the comparison group every quarter after program entry. In the WIA Dislocated Worker program, participants under age 26 began earning significantly more than those in the comparison group a year following program entry. The quality of the causal evidence presented in this study is moderate. This means we have confidence that the effects estimated in this study are attributable at least in part to WIA programs. However, as in any nonexperimental study, other factors not accounted for in the analysis might have contributed to the estimated effects.","the Workforce Investment Act (WIA)","Basic skills Community college education and other classroom training Job search assistance and supportive services Other training and education Work based and other occupational training","Adult, Youth, Dislocated or displaced worker, Female, Male",,"United States",2008,http://www.nawdp.org/Content/NavigationMenu/ResearchReports/2009-10-WIANon-Expe…,"Opportunities for Youth Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. Upjohn Institute technical report no. 08-024. [TANF/VIEW]","Hollenbeck, K., Huang, W.-J., and WE Upjohn Institute for Employment Research (2008). Workforce program performance indicators for the Commonwealth of Virginia. Upjohn Institute technical report no. 08-024. Kalamazoo, MI: W. E. Upjohn Institute for Employment Research. [TANF/VIEW]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Virginia Initiative for Employment Not Welfare (TANF/VIEW) program on employment and credential completion rates. The authors used administrative records to compare outcomes for low-income adults who took part in the TANF/VIEW program to a nonexperimental matched group of adults who did not take part in the program. The study found that, compared with those who did not take part in the program, the employment rate was significantly lower for those who took part in the TANF/VIEW program, but the TANF/VIEW group earned significantly more educational or training credentials. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the TANF/VIEW program; other factors are likely to have contributed.","the Virginia Initiative for Employment Not Welfare (TANF/VIEW) Program","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Employment and Training Review Protocol" "Rapid employment model evaluation: Update","Smith, T. C., King, C. T., & Schroeder, D. G. (2008). Rapid employment model evaluation: Update. Austin, TX: Ray Marshall Center for the Study of Human Resources.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Rapid Employment Model (REM) program on participants’ employment, earnings, and Unemployment Insurance (UI) benefit claims. (See the CLEAR review of the 2010 report here.) Using program data and state UI records, the authors matched treatment group cases to comparison group cases and conducted regression analyses to estimate the effect of the intervention. The study found that participation in the REM program was associated with an increase in the likelihood that jobseekers were employed in quarters following program participation. The quality of causal evidence presented in this report is moderate for employment and earnings outcomes because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects on employment and earnings are attributable to the REM program, but other factors might also have contributed. The quality of causal evidence presented for the UI benefit claiming outcome is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects on UI benefit claiming outcome are attributable to REM program; other factors are likely to have contributed.","Rapid Employment Model (REM) Program","Job search assistance and supportive services Other training and education Unemployment Insurance","Justice-involved, Low-skilled, Low income",,"United States",2008,http://sites.utexas.edu/raymarshallcenter/files/2008/12/REM_eval_update_01-28-0…,"Review Protocol" "The Employment Retention and Advancement project: Findings for the Cleveland Achieve model: Implementation and early impacts of an employer-based approach to encourage employment retention among low-wage workers","Miller, C., Martin, V., Hamilton, G., Cates, L., and Deitch, V. (2008). The Employment Retention and Advancement project: Findings for the Cleveland Achieve model: Implementation and early impacts of an employer-based approach to encourage employment retention among low-wage workers. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to determine the impact of a program designed to increase employment retention among low-wage workers in the long-term nursing care industry in Cleveland, Ohio. Cleveland was one of 16 sites nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 44 firms to either a treatment group, whose employees could receive employment retention services through Cleveland Achieve, or a control group. The authors collected data on employee turnover directly from firms and employment and earnings data from state Unemployment Insurance (UI) records. Two years after random assignment, the study did not find statistically significant differences in the turnover rates, employment rates, or earnings of employees in Achieve firms compared with employees in firms that did not have access to Achieve services. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the Achieve program, and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Cleveland","Other employment and reemployment Unemployment Insurance","Low income","Health care and social assistance","United States, Urban",2008,http://www.acf.hhs.gov/sites/default/files/opre/cleveland.pdf,"Employment and Training Review Protocol" "Reemployment and Eligibility Assessment (REA) Study: FY 2005 Initiative: final report","Benus, J., Poe-Yamagata, E., Wang, Y., & Blass, E. (2008). Reemployment and Eligibility Assessment (REA) Study: FY 2005 Initiative: final report. Columbia, MD: IMPAQ International. [North Dakota sample]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to assess the effectiveness of the Reemployment and Eligibility Assessment (REA) Initiative in North Dakota, a program that provided eligibility and reemployment case management services to Unemployment Insurance (UI) claimants, on UI benefits receipt, wages, and employment. The study randomly assigned nearly 2,000 eligible claimants to either the treatment group, which could receive REA services, or the control group, which could not access the same REA services. Those in the treatment group were required to participate in the services to retain their UI eligibility. The authors estimated the program’s effectiveness by analyzing state administrative records on UI payments and information from a follow-up survey of a subsample of study participants. The study found no statistically significant impacts of REA on UI benefits receipt, employment, or earnings. The quality of causal evidence presented in this report is high for the UI benefits receipt outcomes because it is based on a well-implemented randomized controlled trial. For the employment and wages outcomes, the quality of evidence presented in this report is moderate.","JSA services","RESEA Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",2008,http://wdr.doleta.gov/research/FullText_Documents/Reemployment%20and%20Eligibil…,"Reemployment Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report no. 08-024).","Hollenbeck, K. & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report no. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Wagner-Peyser/Employment Service program on outcomes of employment, earnings, and credential completion. The study used an interrupted time series (ITS) design to compare the outcomes of participants before and after participating in the Wagner-Peyser program. • The study found that the median earnings of Wagner-Peyser participants were $250 lower in the second quarter after program exit compared to their median earnings before program participation. The quality of causal evidence presented in this report is low because the authors did not observe outcomes for multiple periods before the intervention. This means we are not confident that the estimated effects are attributable to the Wagner-Peyser program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Wagner-Peyser Program","Job search assistance and supportive services",Adult,,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Review Protocol" "Evaluation of the Boys & Girls Clubs of America Targeted Re-Entry Initiative","Barton, W., Jarjoura, G., & Rosay, A. (2008). Evaluation of the Boys & Girls Clubs of America Targeted Re-Entry Initiative. Indianapolis: Indiana University School of Social Work, and Anchorage: Justice Center, University of Alaska Anchorage.","Justice-Involved Youth, Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Boys & Girls Clubs of America’s Targeted Re-Entry Initiative on youth’s recidivism. The authors used administrative data to match Initiative participants to a comparison group of nonparticipants released from the same rehabilitation facilities. The authors compared recidivism rates among program participants and the comparison group. The authors reported a statistically significant relationship between participation in the Targeted Re-Entry Initiative and higher rates of re-arrest at one of the three sites studied, and no statistically significant correlations at the other two sites. The quality of causal evidence presented in this report is low because the authors did not include sufficient controls for pre-existing differences between the study groups in their analysis. This means we are not confident that the estimated effects are attributable to the Boys & Girls Clubs of America Targeted Re-Entry Initiative; other factors are likely to have contributed.","the Boys & Girls Clubs of America Targeted Re-Entry Initiative","Health Substance abuse recovery Job search assistance and supportive services Reentry Youth programs Basic skills Other training and education Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2008,http://justice.uaa.alaska.edu/research/2000/0411.targeted_reentry/0411.05.targe…,"Justice-Involved Youth, Opportunities for Youth Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [DRS]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [DRS]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Vocational Rehabilitation program administered by Department of Rehabilitative Services (DRS) on participants’ employment and credential completion. The study used administrative records to compare the outcomes of low-income adults who took part in the DRS program with outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that DRS participants had higher employment and credential completion rates compared with those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to DRS; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies","the Vocational Rehabilitation (VOC) Programs","Job search assistance and supportive services Vocational rehabilitation","Disability, Low-skilled, Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [WIA-Adult]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [WIA-Adult]","Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Title I program for adults (including dislocated workers) on participants’ employment and credential completion rates. The study used administrative records to compare the outcomes for low-income adults who took part in the WIA program with a nonexperimental-matched group of adults who did not take part in the program. The study found that the WIA program participants had higher employment and credential completion rates than those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Title I program for adults (including dislocated workers); other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Title I Program for Adults","Adult and Dislocated Worker programs Job search assistance and supportive services Other employment and reemployment Other training and education Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Unemployed, Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Employment and Training Review Protocol" "Workforce Investment Act non-experimental net impact evaluation. [Adult sample]","Heinrich, C., Mueser, P., & Troske, K. (2008). Workforce Investment Act non-experimental net impact evaluation. Columbia, MD: IMPAQ International. [Adult sample]","Apprenticeship and Work-Based Training, Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the Workforce Investment Act (WIA) Adult Program’s impact on workers’ employment and earnings in 12 states. The authors analyzed administrative data to compare the employment and earnings outcomes of people receiving different tiers of WIA Adult Program services with two different matched comparison groups for 16 quarters after program entry. The study found that WIA Adult Program services had positive impacts on earnings and employment in most quarters examined. Those WIA Adult Program participants who received training earned more and were more likely to be employed than those who received only core and intensive services. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WIA Adult Program services, but other factors might also have contributed. The report also examined the impacts of WIA Dislocated Worker services; that profile is available here.","the Workforce Investment Act (WIA) Adult Program","Adult and Dislocated Worker programs Job search assistance and supportive services Other employment and reemployment Wagner-Peyser Act Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Other training and education","Unemployed, Low income",,"United States",2008,https://wdr.doleta.gov/research/FullText_Documents/Workforce%20Investment%20Act…,"Apprenticeship and Work-Based Training, Job Search Assistance Review Protocol" "Workforce Investment Act non-experimental net impact evaluation. [Dislocated worker sample]","Heinrich, C., Mueser, P., & Troske, K. (2008). Workforce Investment Act non-experimental net impact evaluation. Columbia, MD: IMPAQ International. [Dislocated worker sample]","Apprenticeship and Work-Based Training, Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the Workforce Investment Act (WIA) Dislocated Worker Program’s impact on workers’ employment and earnings in 12 states. The authors analyzed administrative data to compare the employment and earnings outcomes of people receiving different tiers of WIA Dislocated Worker Program services with two different matched comparison groups for 16 quarters after program entry. The study found that WIA Dislocated Worker Program services had positive impacts on earnings and employment in most quarters examined. However, those WIA Dislocated Worker Program participants who received core and/or intensive services had significantly better earnings and employment outcomes in the first seven quarters than those who also received training. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WIA Dislocated Worker Program services, but other factors might also have contributed. The report also examined the impacts of WIA Adult Program services; that profile is available here.","the Workforce Investment Act (WIA) Dislocated Worker Program","Other employer services Adult and Dislocated Worker programs Job search assistance and supportive services Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Other training and education","Dislocated or displaced worker, Unemployed",,"United States",2008,https://wdr.doleta.gov/research/FullText_Documents/Workforce%20Investment%20Act…,"Apprenticeship and Work-Based Training, Job Search Assistance Review Protocol" "Workforce program performance indicators for the commonwealth of Virginia. Upjohn Institute technical report no. 08-024 [FSET]","Hollenbeck, K., Huang, W.-J., and WE Upjohn Institute for Employment Research. (2008). Workforce program performance indicators for the commonwealth of Virginia. Upjohn Institute technical report no. 08-024, Kalamazoo, MI: W. E. Upjohn Institute for Employment Research. [FSET]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Food Stamp Employment and Training Program (FSET) on employment and credential completion rates. The authors used administrative records to compare outcomes for low-income adults who took part in the FSET program to a nonexperimental matched group of adults who did not take part in the program. The study found that, compared to those who did not take part in the program, the employment rate was significantly lower. The FSET group also earned significantly fewer educational or training credentials. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to FSET; other factors are likely to have contributed.","the Food Stamp Employment and Training Program (FSET)","Job search assistance and supportive services Other employment and reemployment","Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Employment and Training Review Protocol" "Testing case management in a rural context: An impact analysis of the Illinois Future Steps program: Findings from the Rural Welfare-to-Work Strategies Demonstration evaluation.","Meckstroth, A., Person, A., Moore, Q., Burwick, A., McGuirk, A., Ponza, M., Marsh, S., Novak, T., Zhao, Z., & Wheeler, J. (2008). Testing case management in a rural context: An impact analysis of the Illinois Future Steps program: Findings from the Rural Welfare-to-Work Strategies Demonstration evaluation. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Future Steps rural welfare-to-work program on employment, earnings, and public benefit receipt. The authors randomly assigned Temporary Assistance for Needy Families (TANF) and Food Stamps recipients required to work to either a treatment group, which received job search and other services, or a control group, which did not. The authors evaluated the treatment’s impact using Illinois administrative data and follow-up surveys. The authors found that the Future Steps program increased the likelihood of being employed 30 months after enrollment by 8.6 percentage points. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Future Steps rural welfare-to-work program and not to other factors.","the Future Steps Rural Welfare-to-Work Program","Job search assistance and supportive services Other employment and reemployment","Low income",,"Rural, United States",2008,http://www.acf.hhs.gov/sites/default/files/opre/testing_case.pdf,"Employment and Training Review Protocol" "Initial impacts of the Ticket to Work program on Social Security disability beneficiary service enrollment, earnings, and bene","Wittenburg, D., Fraker, T., Stapleton, D., Thornton, C., Gregory, J., & Mamun, A. (2007). Initial impacts of the Ticket to Work program on Social Security disability beneficiary service enrollment, earnings, and benefits. Journal of Vocational Rehabilitation, 27, 129–140.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages","Summary: The study’s objective was to determine the effectiveness of Ticket to Work (TTW), a program designed to enhance the employment services available to Supplemental Security Income (SSI) and Social Security Disability Insurance (SSDI) recipients. The authors analyzed the outcomes of a nationwide sample of 4.7 million SSI and SSDI recipients ages 18 to 57 who would have been eligible for TTW in 2001. The authors used administrative records through 2004 from the Social Security Administration (SSA) and Rehabilitation Services Administration (RSA). The study found that enrollment in employment services increased 0.1 to 0.4 percent in states where TTW was in effect. However, the authors found no evidence of increased earnings as a result of TTW. The quality of the causal evidence presented in this study is moderate, the highest possible rating for nonexperimental designs. This means we have some confidence that the observed effects represent the impact of TTW, although other factors might also have contributed.","Ticket to Work","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2007,,"Disability Employment Policy Review Protocol" "The Employment Retention and Advancement project: Results from Minnesota’s Tier 2 program","LeBlanc, A., Miller, C., Martinson, K., & Azurdia, G. (2007). The Employment Retention and Advancement project: Results from Minnesota’s Tier 2 program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to determine the 18-month impact of Minnesota’s Tier 2 welfare-to-work program compared with existing Tier 1 services. Minnesota’s Tier 2 program was part of the nationwide Employment Retention and Advancement (ERA) project. The authors randomly assigned approximately 1,700 long-term Temporary Assistance for Needy Families (TANF) recipients to either a treatment group, which received Tier 2 services including intensive assessments and case management, or a control group, which received Minnesota’s existing Tier 1 TANF services. The authors analyzed data from Minnesota Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study found that, 12 months after random assignment, more people in the Tier 2 group (79.2 percent) reported that they received Food Stamps than in the control group (70.0 percent). After 18 months however, there were no statistically significant differences between treatment and control group members’ employment, earnings, or benefits receipt. The quality of causal evidence provided in this study is high because it is based on a well-conducted randomized controlled trial. This means we are confident that any estimated effects are attributable to Minnesota’s Tier 2 program and not to other factors.","the Employment Retention and Advancement project, Minnesota’s Tier 2 Program","Job search assistance and supportive services Other employment and reemployment","Unemployed, Low income, Parent",,"United States",2007,http://www.acf.hhs.gov/sites/default/files/opre/minnesota_tier2.pdf,"Employment and Training Review Protocol" "Evaluating multi-treatment programs: Theory and evidence from the U.S. Job Training Partnership Act experiment.","Plesca, M., & Smith, J. (2007). Evaluating multi-treatment programs: Theory and evidence from the U.S. Job Training Partnership Act experiment. Empirical Economics, 32, 491-528.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Job Training Partnership Act (JTPA) on earnings and employment for disadvantaged adults. The authors conducted a randomized controlled trial. They analyzed data from one baseline survey, two follow-up surveys, and earnings and employment records. The study found that men in the treatment group had earned more at the 30-month follow-up than men in the control group, and that women in the treatment group experienced significantly better earnings and employment outcomes at several points compared to the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to JTPA, and not to other factors.","Job Training Partnership Act","Job search assistance and supportive services Supported employment or other employment supports Other training and education","Adult, Female, Male, Low-skilled, Low income",,"United States",2007,,"Review Protocol" "YO! participants’ employment and earnings","Callahan Consultants, Inc. (n.d.). YO! participants’ employment and earnings. Ellicott City, MD: Author.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to determine the effect of the YO! Baltimore initiative, which included a diverse set of programs offering comprehensive educational, employment preparation, support, and leadership development services to youth ages 14 to 21. The authors compared employment and earnings outcomes for participants and nonparticipants in YO! Baltimore. The study found that participants had increased earnings and employment after enrollment. The quality of the causal evidence presented in this study is low. This means we are not confident that the effects estimated in this study are attributable to the YO! Baltimore program.","YO! Baltimore","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs",Youth,,"United States, Urban",2007,http://www.yobaltimore.org/documents/Impact/impact_employment_earnings.pdf,"Opportunities for Youth Review Protocol" "Implementation of supported employment for homeless veterans with psychiatric or addiction disorders: Two-year outcomes","Rosenheck, R. A., & Mares, A. S. (2007). Implementation of supported employment for homeless veterans with psychiatric or addiction disorders: Two-year outcomes. Psychiatric Services, 58(3), 325-333.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact a newly implemented Individual Placement and Support (IPS) program had on employment and earnings outcomes of homeless veterans who were diagnosed with a psychiatric or substance abuse problem. The study team compared raw and adjusted outcome data for veterans who received IPS services and veterans who did not. The team used study participant interviews, activity logs, and employer contacts as data sources. The study found a statistically significant relationship between participation in the IPS program and competitive employment. The quality of causal evidence presented in this report is low because the data on the two groups were not collected at the same time. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support (IPS)","Substance abuse recovery Job search assistance and supportive services Veterans' reemployment","Other barriers, Veteran or military, Homeless",,"United States",2007,https://ps.psychiatryonline.org/doi/full/10.1176/ps.2007.58.3.325,"Employment and Training Review Protocol" "Evaluation of LA’s HOPE: Ending chronic homelessness through employment and housing—Final report.","Burt, M. (2007). Evaluation of LA’s HOPE: Ending chronic homelessness through employment and housing—Final report. Washington, DC: U.S. Department of Housing and Urban Development and U.S. Department of Labor.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of Los Angeles’ Homeless Opportunity Providing Employment (HOPE) program on employment, housing, and income. The study used a quasi-experimental design in which the authors compared participants in the HOPE program with participants in other programs that provided many of the same services but not its specialized housing and employment resources. The authors presented direct comparisons, as well as comparisons that adjusted for the groups’ differences in age, race, mental health diagnoses, and recent experience of homelessness and incarceration. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the author did not account for differences between members of the program and comparisons groups or show that they were similar when they joined the study. This means we are not confident that the estimated effects are attributable to Los Angeles’ HOPE program; other factors are likely to have contributed.","Los Angeles’ Homeless Opportunity Providing Employment (HOPE)","Other employment and reemployment","Low income, Homeless, Disability",,"United States",2007,http://www.urban.org/sites/default/files/alfresco/publication-pdfs/411631-Evalu…,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the Post-Assistance Self-Sufficiency (PASS) program in Riverside, California","Navarro, D., van Dok, M., & Hendra, R. (2007). The Employment Retention and Advancement project: Results from the Post-Assistance Self-Sufficiency (PASS) program in Riverside, California. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Riverside Post-Assistance Self-Sufficiency (PASS) program on employment, earnings, and public benefits receipt after two years. The Riverside PASS site was one of two in Riverside, California, that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,770 employed single-parent participants who had recently left the Temporary Assistance for Needy Families (TANF) program to a treatment group that received ERA services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that Riverside PASS had positive impacts on earnings and employment in the first and second years after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Riverside PASS, and not to other factors.","the Riverside Post-Assistance Self-Sufficiency (PASS) Program","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2007,http://www.acf.hhs.gov/sites/default/files/opre/riverside_pass.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from two education and training models for employed welfare recipients in Riverside, California.","Navarro, D., Freedman, S., & Hamilton, G. (2007). The Employment Retention and Advancement project: Results from two education and training models for employed welfare recipients in Riverside, California. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of post-employment job supports and intensive case management on welfare recipients’ employment, earnings, and benefit receipt outcomes after two years. The Riverside Phase 2 site was one of two in Riverside, California, that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,907 employed single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups that received differing ERA services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that the households of participants in the Work Plus program were 10.5 percentage points less likely to receive TANF benefits relative to those in the control group 12 months after random assignment. The study found no statistically significant effects associated with the Training Focused program. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Riverside Work Plus program and not to other factors. It also means that we would be confident that any estimated effects would be attributable to Riverside Training Focused program and not to other factors. However, the study did not find statistically significant effects of the Training Focused program.","the Employment Retention and Advancement Project—Work Plus and Training Focused (Phase 2), Riverside","Other employment and reemployment","Parent, Low income",,"United States",2007,http://www.acf.hhs.gov/sites/default/files/opre/riverside_phase2.pdf,"Employment and Training Review Protocol" "Evaluating the impacts of Washington State repeated job search services on the earnings of prime‐age female TANF recipients.","Hsiao, C., Shen, Y., Wang, B., & Weeks, G. (2007). Evaluating the impacts of Washington State repeated job search services on the earnings of prime‐age female TANF recipients. Journal of Applied Econometrics, 22(2), 453-475.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impacts of Job Search Services (JSS) on employment and earnings outcomes of women ages 25 to 35 who participated in the WorkFirst program in Washington State. The authors used a nonexperimental study design to examine the earnings and employment outcomes of women who took part in JSS. Women were categorized as being in the treatment group if they participated in JSS at least once from the second quarter of 1998 to the fourth quarter of 2000. Women who did not participate in JSS during this time made up the comparison group. The study found that the first instance of participation in JSS increased the likelihood of employment by 4 percent for women seeking employment. The study also found a positive and statistically significant relationship between quarterly earnings and participation in JSS one or more times for employed women. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared exhibited similar employment or earnings outcomes before the intervention. This means we are not confident that the estimated effects are attributable to JSS; other factors are likely to have contributed.","Job Search Services (JSS)","Community college education and other classroom training Job search assistance and supportive services Other training and education","Low income",,"United States",2007,,"Employment and Training Review Protocol" "Youth Opportunity grant initiative: process evaluation final report","Bruno, L., & Pistorino, C. (2007). Youth Opportunity grant initiative: process evaluation final report. Washington, DC: Decision Information Resources, Inc.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report summarized the results of the final round of the process evaluation of the Youth Opportunity (YO) grant initiative. The YO program offered educational, employment, leadership enhancement, and other support services to all youth ages 14 to 21 in targeted high-poverty areas across the country in order to boost their high school graduation, college enrollment, and employment rates. The study assessed program implementation and examined strengths and weaknesses of the YO model by gathering information on services provided, program outcomes, and implementation challenges and best practices at 25 sites. It drew on management information systems (MIS) data; group interviews with program administrators, line staff, and youth participants; and past process evaluation reports. Projects were successful in enrolling a large number of participants and nearly 40 percent of those enrolled received a long-term placement. Projects eventually succeeded in establishing YO centers but faced challenges in launching and running the centers, delivering comprehensive and integrated youth development services, sustaining long-term youth engagement, and developing partnerships for sustainability.","Youth Opportunity Grant Initiative","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2007,,"Opportunities for Youth Review Protocol" "The Employment Retention and Advancement project: Results from the Personal Roads to Individual Development and Employment (PRIDE) program in New York City","Bloom, D., Miller, C., and Azurdia, G. (2007). The Employment Retention and Advancement project: Results from the Personal Roads to Individual Development and Employment (PRIDE) program in New York City. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Personal Roads to Individual Development and Employment (PRIDE) welfare-to-work program in New York City on the employment, earnings, and public benefits receipt of low-income single parents with physical or mental health problems that limited their ability to work. The study was a randomized controlled trial that used data from administrative records for the two years following assignment and a survey conducted with a random subset of the sample to assess outcomes one year after assignment. The study found that treatment group participants were significantly more likely than control group participants to have had a job and had higher average earnings. The treatment group was significantly less likely to receive cash assistance and received lower amounts of cash assistance benefits than the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to PRIDE and not to other factors.","Personal Roads to Individual Development and Employment (PRIDE)","Other employment and reemployment","Disability, Low income, Parent",,"United States, Urban",2007,http://www.acf.hhs.gov/sites/default/files/opre/era_pride.pdf,"Employment and Training Review Protocol" "Reentry services: An evaluation of a pilot project in Clay County, MN","Bergseth, K., & McDonald, T. (2007). Reentry services: An evaluation of a pilot project in Clay County, MN. Fargo, ND: North Dakota State University, Department of Criminal Justice and Political Science.","Justice-Involved Youth, Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Reentry Services Project (RSP) on juvenile recidivism. The authors estimated regression models comparing the number of criminal and official contacts with police or the courts, pulled from an electronic Court Services Tracking System, between RSP and comparison group members, controlling for differences in demographics and number of prior charges. The study found that RSP group members had significantly fewer official and criminal contacts than the comparison group one year after release from out-of-home placement. The quality of causal evidence presented in this report is low because the program was implemented in only one county and there was no variation in the implementation of the program over time. This means we are not confident that the estimated effects are attributable to the RSP; other factors are likely to have contributed.","the Reentry Services Project (RSP)","Health Substance abuse recovery Job search assistance and supportive services Reentry Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2007,http://www.claycountycollaborative.org/projects/RSP%20Final%20Report%202007.pdf,"Justice-Involved Youth, Opportunities for Youth Review Protocol" "Youth Opportunity Grant Initiative: Impact and synthesis report","Jackson, R., Dixon, R., McCoy, A., Pistorino, C., Zador, P., Thomas, C., … Bruno, L. (2007). Youth Opportunity Grant Initiative: Impact and synthesis report. Houston, TX: Decision Information Resources, Inc.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: This report’s objective was to examine the effectiveness of the Youth Opportunity (YO) Grant Initiative, which sought to improve job prospects and education outcomes for youth in high-poverty areas by providing them with a mix of 15 youth development activities. Companion reports describe the initiative’s implementation. The initiative’s effectiveness was evaluated using two separate comparison group designs. In general, the study found positive and statistically significant relationships between the YO initiative and educational enrollment outcomes. However, there were few statistically significant effects on employment-related outcomes and educational attainment. The quality of the causal evidence presented in this study is low. This means we are not confident that the estimated impacts were caused by the YO Grant Initiative, and not other factors.","Youth Opportunity Grant Initiative","Basic skills Community college education and other classroom training Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2007,http://wdr.doleta.gov/research/FullText_Documents/YO%20Impact%20and%20Synthesis…,"Opportunities for Youth Review Protocol" "Transitional jobs for ex-prisoners: Early impacts from a random assignment evaluation of the Center for Employment Opportunities (CEO) prisoner reentry program.","Bloom, D., Redcross, C., Zweig, J. & Azurdia, G. (2007). Transitional jobs for ex-prisoners: Early impacts from a random assignment evaluation of the Center for Employment Opportunities (CEO) prisoner reentry program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of the Neighborhood Work Project (NWP) sponsored by the Center for Employment Opportunities (CEO) on the employment outcomes of former prisoners. The study was a randomized controlled trial. The authors used administrative data from the program and state data systems to compare the outcomes of former prisoners who had been randomly assigned to the NWP with those of former prisoners who were randomly assigned to a control group that received basic employment services. The study found that those assigned to the NWP were more likely than the control group to be employed in all four quarters during the year after the program and were more likely to be employed in the program’s worksite project in the fourth quarter after the program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the CEO NWP’s transitional job services and not to other factors.","the Center for Employment Opportunities’ Neighborhood Work Project (NWP)","Other employment and reemployment Reentry",Justice-involved,,"United States",2007,http://www.acf.hhs.gov/sites/default/files/opre/transitional_jobs.pdf,"Employment and Training Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). [Apprenticeships]","Hollenbeck, K., & Huang, W-J. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). Kalamazoo, MI: W. E. Upjohn Institute for Employment Research. [Apprenticeships]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act apprenticeship programs in Washington State on participants’ employment rates, earnings, and public benefit receipt. The authors used a nonexperimental design to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and public benefit receipt between those who took part in the apprenticeship programs and those who registered for employment services at the state Labor Exchange. The study found that, compared with those who registered for services at the Labor Exchange, participants in the apprentice programs had higher employment rates, more hours worked and greater quarterly earnings. Receipt of Unemployment Insurance benefits was higher for those in the apprenticeship group, and receipt of other public assistance was lower. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the apprenticeship programs; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","Workforce Investment Act (WIA) Apprenticeship Programs","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs",Adult,,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica…,"Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). [WIA Youth]","Hollenbeck, K., & Huang, W-J. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [WIA Youth]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Youth program on the employment rate and earnings of low-income youth. The authors used a nonexperimental method to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and public benefits receipt between those who took part in the WIA Youth program relative to those who registered for services at the Labor Exchange. The study found that, compared with those who registered for Labor Exchange services, WIA Youth program participants had lower employment, with mixed findings for earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Youth program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Youth Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Youth programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Youth, Low income",,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica…,"Employment and Training Review Protocol" "Final evaluation report of the SSI Work Incentives Demonstration Project","Kregel, J. (2006). Final evaluation report of the SSI Work Incentives Demonstration Project. Richmond, VA: State Partnership Systems Change Initiative Project Office, Virginia Commonwealth University.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to measure employment and earnings impacts for the four State Partnership Initiative (SPI) sites that implemented the Supplemental Security Income (SSI) Work Incentives Demonstration Project, also known as the SSI Waiver Demonstration Project. The author compared the outcomes of SSI Waiver Demonstration Project participants with those of nonparticipants using data from SPI project offices and Unemployment Insurance (UI) administrative records. The study found that during the intervention delivery period, SSI Waiver Demonstration Project participants’ earnings increased relative to (1) people at the same sites who chose not to participate in the demonstration and (2) people at other SPI sites that did not implement the demonstration. The quality of the causal evidence presented in this report is low because the study was a nonexperimental analysis that did not include adequate controls for underlying differences between the groups being compared. This means we are not confident that the estimated effects are attributable to the SSI Waiver Demonstration Project. Other factors are likely to have contributed.","the SSI Work Incentives Demonstration Project","Supplemental security income (SSI)",Disability,,"United States",2006,http://www.google.com/url?sa=t&rct=j&q=&esrc=s&frm=1&source=web&cd=1&cad=rja&ua…,"Disability Employment Policy Review Protocol" "The Employment Retention and Advancement project: Results from the Texas ERA site [Texas ERA—Forth Worth]","Martinson, K., & Hendra, R. (2006). The Employment Retention and Advancement project: Results from the Texas ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Forth Worth]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after 18 to 24 months. The Fort Worth site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,200 single-parent participants in Fort Worth’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program (SNAP) administrative records. The study found that treatment group members were 6.1 percentage points more likely to have been employed at any time in the second year after random assignment than those in the control group. Treatment group members were also 4.2 percentage points more likely to be employed during the last quarter of that second year. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program, and not to other factors.","the Employment Retention and Advancement project, Fort Worth","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2006,http://www.acf.hhs.gov/sites/default/files/opre/results_texas.pdf,"Employment and Training Review Protocol" "Workforce investment act services: Effect on dislocated worker reemployment (Doctoral Disertation)","Walker, M. A. (2006). Workforce investment act services: Effect on dislocated worker reemployment (Doctoral dissertation). Retrieved from ProQuest Dissertations & Theses. Accession No. UMI 3244857. [Study 1: Contrast: WIA employment services vs. no service]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the effects of employment services offered through the Workforce Investment Act of 1998 (WIA) on employment and earnings outcomes. The author investigated similar research questions in another study, whose profile can be found [here]. The other study examined the effects of WIA’s employment and training services on employment and earnings. The author used a statistical model in a nonexperimental analysis to compare the outcomes of workers who lost their jobs for reasons including being laid off and either did or did not receive WIA employment services. The author used data from the state Employment Commission’s dislocated worker database, Workforce Investment Act Title IB Standardized Record Data. The study found a statistically significant, negative relationship between the WIA employment services and employment. Those receiving employment services had longer durations of unemployment than those who did not, by about 21 weeks. There were no statistically significant relationships between the WIA employment services and earnings. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated relationships are attributable to the WIA employment services; other factors are likely to have contributed to those relationships.","the Workforce Investment Act (WIA)","Adult and Dislocated Worker programs Job search assistance and supportive services Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Dislocated or displaced worker",,"United States",2006,https://digitalcommons.odu.edu/cgi/viewcontent.cgi?article=1196&context=efl_etds,"Employment and Training Review Protocol" "Evaluating the effectiveness of the Massachusetts workforce development system using no-shows as a nonexperimental comparison group.","Raphael, S., & Stoll, M. A. (2006). Evaluating the effectiveness of the Massachusetts workforce development system using no-shows as a nonexperimental comparison group. Evaluation Review, 30(4), 379-429.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Job Training Partnership Act (JTPA) workforce development program in Massachusetts on the earnings of disadvantaged adults. The study used a nonexperimental design to compare the earnings of program participants before and after the intervention, relative to the earnings of nonparticipants who were eligible and offered services but chose not to participate in a training program. The authors used administrative records from the Commonwealth Corporation of Massachusetts for their analysis. The study found that, although the participants in the Massachusetts JTPA program earned significantly less than nonparticipants during the year of the program, participants earned significantly more one year ($1,876) and two years ($2,285) after the program, compared with nonparticipants. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to JTPA, but other factors might also have contributed.","the Massachusetts JTPA Workforce Development Program","Job search assistance and supportive services Other training and education","Low-skilled, Low income",,"United States",2006,,"Review Protocol" "A comparison of two Welfare-to-Work strategies among African American women in Atlanta, Georgia. (Unpublished doctoral dissertation).","Wilson-Brewster, V.L. (2006). A comparison of two Welfare-to-Work strategies among African American women in Atlanta, Georgia. (Unpublished doctoral dissertation). Capella University, Minneapolis, Minnesota.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the effectiveness of two welfare-to-work programs—the Labor Force Attachment (LFA) program and the Human Capital Development (HCD) program—on the employment and earnings of African American women 25, 35, and 45 years old in Atlanta. The author analyzed a subsample of participants in the National Evaluation of Welfare-to-Work Strategies (NEWWS) study. The study was a randomized controlled trial that assigned individuals within a geographic location to one of three groups: LFA, HCD, or a control group. The study found that women in the 35-year-old group who participated in LFA or HCD had higher earnings and needed less time to find a job than those in the other age cohorts. The quality of causal evidence presented in this report is low because the study was a randomized controlled trial with unknown attrition and the authors did not account for preexisting differences between the groups being compared in their analysis. This means we are not confident that the estimated effects are attributable to LFA or HCD programs; other factors are likely to have contributed.","Labor Force Attachment (LFA) and Human Capital Development (HCD)","Other employment and reemployment Other training and education","Female, Black or African American, Low income, Parent",,"United States, Urban",2006,,"Employment and Training Review Protocol" "National Job Corps study and longer-term follow-up study: Impact and benefit-cost findings using survey and summary earnings records data","Schochet, P., Burghardt, J., & McConnell, S. (2006). National Job Corps study and longer-term follow-up study: Impact and benefit-cost findings using survey and summary earnings records data. Washington, DC: Employment and Training Administration, U.S. Department of Labor.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The National Job Corps Study included several reports, including this longer-term impact report. The report’s objective was to examine the impact of the Job Corps program on participants’ long-term earnings, employment, and other outcomes. Job Corps offered intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. Its effectiveness was evaluated using a randomized controlled trial conducted in 48 states and the District of Columbia. The study found a number of statistically significant, positive impacts of Job Corps on earnings and employment in the first four follow-up years. However, there were no significant differences between the youth who were offered Job Corps and the control group on employment rate or earnings in the fifth through ninth follow-up years, as measured by administrative data. The quality of causal evidence presented in this report is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the effects estimated in the study are solely attributable to Job Corps, and not to other factors.","Job Corps","Job search assistance and supportive services Work based and other occupational training","Youth, Low-skilled, Low income",,"United States",2006,https://www.mathematica-mpr.com/-/media/publications/pdfs/jobcorpimpactbenefit…,"Opportunities for Youth Review Protocol" "Paths to work in rural places: Key findings and lessons from the impact evaluation of the Future Steps rural welfare-to-work program.","Meckstroth, A., Burwick, A., Ponza, M., Marsh, S., Novak, T., Phillips, S., Diaz-Tena, N., & Ng, J. (2006). Paths to work in rural places: Key findings and lessons from the impact evaluation of the Future Steps rural welfare-to-work program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Future Steps rural welfare-to-work program on earnings and public benefit receipt. The authors randomly assigned Temporary Assistance for Needy Families (TANF) and Food Stamps recipients required to work to either a treatment group, which received earnings-focused case management, job search, and other services, or to a control group, which did not receive services. The authors evaluated the treatment’s impact using Illinois administrative data and follow-up surveys. The study did not find any statistically significant effects on earnings or public benefit receipt in the first 18 months after participants were offered access to the program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to the Future Steps rural welfare-to-work program and not to other factors. However, the study did not find statistically significant effects.","the Future Steps Rural Welfare-to-Work Program","Job search assistance and supportive services Other employment and reemployment","Low income",,"United States",2006,http://www.acf.hhs.gov/sites/default/files/opre/paths_to_work.pdf,"Employment and Training Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). [WIA Dislocated Workers]","Hollenbeck, K., & Huang, W-J. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). Kalamazoo, MI: W. E. Upjohn Institute for Employment Research. [WIA Dislocated Workers]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Mixed impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Dislocated Worker Program on the employment rate, earnings, and public benefit receipt of dislocated workers in Washington State. The authors used a nonexperimental design to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and public benefit receipt between those who took part in the WIA Dislocated Worker Program and those who registered for employment services at the state Labor Exchange. The study found that, compared with those who registered for services at the Labor Exchange, participants in the WIA Dislocated Worker Program had higher employment and earnings, although the findings for public benefit receipt were mixed. The quality of causal evidence presented in this report is low because the authors compared the treatment and comparison groups at different follow-up points and the groups were therefore not equivalent. This means we are not confident that the estimated effects are attributable to WIA Dislocated Worker Program; other factors are likely to have contributed.","the Workforce Investment Act (WIA) Dislocated Worker Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Adult, Dislocated or displaced worker",,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica…,"Employment and Training Review Protocol" "Workforce investment act services: Effect on dislocated worker reemployment (Doctoral Disertation)","Walker, M. A. (2006). Workforce investment act services: Effect on dislocated worker reemployment (Doctoral dissertation). Available from ProQuest Dissertations & Theses. Accession No. UMI 3244857. [Study 2: Contrast: WIA employment and training services vs. no service]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the effects of employment and training services offered through the Workforce Investment Act of 1998 (WIA) on employment and earnings outcomes. The author investigated similar research questions in another study, the profile of which can be found [here]. The other study examined the effects of WIA’s employment services on the same employment and earnings outcomes when there were no training services. The author used a statistical model in a nonexperimental analysis to compare outcomes of workers who lost their jobs for reasons including being laid off and either did or did not receive WIA employment services. The author used data from the state Employment Commission dislocated worker database, Workforce Investment Act Title IB Standardized Record Data. The study found a statistically significant, negative relationship between the WIA employment and training services and employment. Those receiving employment and training services had longer durations of unemployment than those who did not, by about 23 weeks. There were no statistically significant relationships between the WIA employment and training services and earnings. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated relationships are attributable to the WIA employment and training services; other factors are likely to have contributed to those relationships.","the Workforce Investment Act (WIA)","Adult and Dislocated Worker programs Job search assistance and supportive services Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Dislocated or displaced worker",,"United States",2006,https://digitalcommons.odu.edu/cgi/viewcontent.cgi?article=1196&context=efl_etds,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the Texas ERA site [Texas ERA—Corpus Christi]","Martinson, K., & Hendra, R. (2006). The Employment Retention and Advancement project: Results from the Texas ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Corpus Christi]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after 18 to 24 months. The Corpus Christi site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,300 single-parent participants in Corpus Christi’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program (SNAP) administrative records. The study did not find statistically significant effects 18 to 24 months after random assignment on employment, earnings, and public benefit receipt. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the ERA program and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Corpus Christi","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2006,http://www.acf.hhs.gov/sites/default/files/opre/results_texas.pdf,"Employment and Training Review Protocol" "Evaluation of the strengthening the connections between unemployment insurance and the One-Stop Delivery Systems Demonstration Project in Wisconsin","Almandsmith, S., Ortiz Adams, L., & Bos, H. (2006). Evaluation of the strengthening the connections between unemployment insurance and the One-Stop Delivery Systems Demonstration Project in Wisconsin. Oakland, CA: Berkeley Policy Associates.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-No impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study examined the impact of the Worker Profiling Reemployment Services program for Unemployment Insurance (UI) claimants in Wisconsin on several outcomes: the rate at which the UI claimants went back to work, average earnings, and UI benefit receipt.  The authors used a matching procedure and several statistical models to compare the outcomes of demonstration and comparison group members, using administrative data.  The study found that demonstration participants had higher average quarterly earnings, shorter durations of UI benefits, smaller proportions of maximum UI benefits paid, and a lower average total payout of UI benefits. The study found no statistically significant relationship between demonstration participation and employment outcomes.  The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Worker Profiling Reemployment Services program; other factors are likely to have contributed.","JSA services","RESEA Job search assistance and supportive services Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",2006,https://wdr.doleta.gov/research/FullText_Documents/Evaluation%20of%20the%20Stre…,"Reemployment Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). [Community and Technical College Worker Retraining Program]","Hollenbeck, K., & Huang, W-J. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [Community and Technical College Worker Retraining Program]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Mixed impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Community and Technical College (CTC) Worker Retraining program on the employment rate, earnings, and public benefit receipt of long-term unemployed and dislocated workers in Washington State. The authors used a nonexperimental design to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and public benefit receipt between those who took part in the CTC Worker Retraining program and those who registered for employment services at the state Labor Exchange. The study found that, compared with those in the comparison group, participants in the CTC Worker Retraining program had higher employment and earnings, and lower public benefits receipt. The quality of causal evidence presented in this report is low because the authors compared the treatment and comparison groups at different follow-up points and the groups were therefore not equivalent. This means we are not confident that the estimated effects are attributable to CTC Worker Retraining program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","Community and Technical College Worker Retraining (CTC WR) Program","Community college education and other classroom training Other training and education","Dislocated or displaced worker, Unemployed",,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica…,"Employment and Training Review Protocol" "An examination of the delivery of literacy services at Job Corps Centers.","KPMG (2006). An examination of the delivery of literacy services at Job Corps Centers. Washington, DC: U.S. Department of Labor, Office of Job Corps.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: The purpose of the study was to identify areas in which Job Corps can improve its delivery of literacy services. Job Corps is a national program that provides youth with job training skills while they pursue a high school diploma or general equivalency diploma (GED). It also provides career counseling and job placement services following completion of the job training component. The authors primarily analyzed qualitative data collected from site visits to six Job Corps sites across the United States. The visits included interviews with key staff and observations of Job Corps classes. The authors also conducted descriptive quantitative analyses of administrative participant and survey data. The authors made recommendations for improvements in the delivery of literacy services in the following areas: employing certified teaching staff on government pay scales so that they can compete with public school teachers in terms of compensation and benefits; providing additional resources, such as special education instructors, psychologists, and counselors, to allow instructors to devote more time to their classes; and building partnerships and relationships with other educational institutions and the community.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2006,http://wdr.doleta.gov/research/FullText_Documents/Job%20Corps%20Literacy%20Repo…,"Opportunities for Youth Review Protocol" "The Employment Retention and Advancement project: Results from the Chicago ERA site","Bloom, D., Hendra, R., & Page, J. (2006). The Employment Retention and Advancement project: Results from the Chicago ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to determine the effectiveness of a Chicago program to increase the earnings of Temporary Assistance for Needy Families (TANF) recipients after two years. The Chicago site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,615 TANF recipients to either a treatment group, which received enhanced employment services, or a control group, which received benefits as usual. The authors collected employment and earnings data from Illinois Unemployment Insurance (UI) records and Food Stamps and TANF receipt data from Illinois administrative records. The study found that members of the ERA group were more likely to be employed (70 versus 66 percent) in the first year after random assignment and received significantly less in TANF benefits ($1,307, compared with $1,586 among control group members). Effects on employment and benefits receipt persisted into the second year after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable to the Chicago ERA program, and not to other factors.","the Employment Retention and Advancement project, Chicago","Other employment and reemployment Unemployment Insurance","Low income",,"United States, Urban",2006,http://www.acf.hhs.gov/sites/default/files/opre/chicago_era.pdf,"Employment and Training Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). [WIA Adult]","Hollenbeck, K., & Huang, W-J. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [WIA Adult]","Apprenticeship and Work-Based Training, Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program on the employment rate, earnings, and public benefit receipt of low-income adults in Washington State. The authors used a nonexperimental design to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and public benefit receipt between those who took part in the WIA Adult Program and those who registered for employment services at the state Labor Exchange. The study found that, compared with those who registered for services at the Labor Exchange, participants in the WIA Adult Program had higher employment, earnings, and public benefit receipt. The quality of causal evidence presented in this report is low because the authors compared the treatment and comparison groups at different follow-up points and the groups were therefore not equivalent. This means we are not confident that the estimated effects are attributable to the WIA Adult Program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Adult Program","Adult and Dislocated Worker programs Job search assistance and supportive services Labor Exchange Other employment and reemployment Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Other training and education","Unemployed, Low income",,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica…,"Apprenticeship and Work-Based Training, Job Search Assistance Review Protocol" "The Employment Retention and Advancement project: Results from the Texas ERA site [Texas ERA—Houston]","Martinson, K., & Hendra, R. (2006). The Employment Retention and Advancement project: Results from the Texas ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Houston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after 18 to 24 months. The Houston site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,800 single-parent participants in Houston’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program (SNAP) administrative records. The study did not find any statistically significant effects on employment or earnings. However, the study found that treatment group members received, on average, $33 more in TANF benefits in the ninth quarter after random assignment than those in the control group. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program, and not to other factors.","the Employment Retention and Advancement project, Houston","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2006,http://www.acf.hhs.gov/sites/default/files/opre/results_texas.pdf,"Employment and Training Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington State. Upjohn Institute technical report no. TR06-020. [Community and Technical College Job Prep Training]","Hollenbeck, K., & Huang, W-J. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. Upjohn Institute technical report no. TR06-020. Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [Community and Technical College Job Prep Training]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Community and Technical College (CTC) Job Preparatory Training program on the employment rate, earnings, and public benefit receipt of adults in Washington State. The authors used a nonexperimental design to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and public benefit receipt between those who took part in the CTC training program and those who registered for employment services at the state Labor Exchange. The study found that, compared with those who registered for services at the Labor Exchange, participants in the CTC training program had higher employment and earnings, although findings for public benefit receipt were mixed. The quality of causal evidence presented in this report is low because the authors compared the treatment and comparison groups at different follow-up points and the groups were therefore not equivalent. This means we are not confident that the estimated effects are attributable to the CTC Job Preparatory Training program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","Community and Technical College (CTC) Job Preparatory Training Program","Other training and education",Adult,,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica…,"Employment and Training Review Protocol" "College as a job advancement strategy: Final report on the New Visions Self-Sufficiency and Lifelong Learning Project","Fein, D., & Beecroft, E. (2006). College as a job advancement strategy: Final report on the New Visions Self-Sufficiency and Lifelong Learning Project. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Riverside Community College’s New Visions Self-Sufficiency and Lifelong Learning Project on welfare recipients’ employment, earnings, welfare receipt, and educational achievement. The study was based on a randomized controlled trial and estimated the effect of offering welfare recipients the New Visions Project services compared with encouraging recipients to participate in other employment services. The authors used California public benefits and community college administrative data to compare average outcomes among those offered access to New Visions with the average outcomes of those excluded, after adjusting for differences in demographic and pre-intervention characteristics between the groups. The study found that participants in the New Visions program received $456 more in Temporary Assistance for Needy Families (TANF) payments than control group participants in the third year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Visions Project, and not to other factors.","the New Visions Self-Sufficiency and Lifelong Learning Project","Community college education and other classroom training Other employment and reemployment","Low income, Parent",,"United States",2006,http://www.acf.hhs.gov/sites/default/files/opre/nv_final_pdf.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Texas ERA—Houston]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Houston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after one year. The Houston site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,816 unemployed single-parent participants in Houston’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of the Houston ERA program on employment, earnings, and benefits receipt one year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to the Houston ERA program and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement project, Houston","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "Net impact estimates for services provided through the Workforce Investment Act. ETA Occasional Paper 2005-06. [WIA Dislocated Worker]","Hollenbeck, K., Schroeder, D., King, C., & Huang, W. (2005). Net impact estimates for services provided through the Workforce Investment Act. ETA Occasional Paper 2005-06. Washington, DC: U.S. Department of Labor, Employment and Training Administration. [WIA Dislocated Worker]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Dislocated Worker Program’s core, intensive, and training services on the employment rate, earnings, and benefits receipt of low-income dislocated workers ages 22 to 64. The authors established three treatment groups based on the level of WIA services used and matched them to three comparison groups that participated in Employment Services (ES) and/or the core WIA services. The study found that the employment rate and average quarterly earnings were significantly higher for those in each of the treatment groups compared with their matched comparison groups. Benefit receipt was also significantly lower for those in the treatment groups than in their comparison groups. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Dislocated Worker Program; other factors are likely to have contributed.","the Workforce Investment Act (WIA) Dislocated Worker Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Dislocated or displaced worker",,"United States",2005,https://wdr.doleta.gov/research/FullText_Documents/Net%20Impact%20Estimates%20f…,"Employment and Training Review Protocol" "The effects of welfare-to-work program activities on labor market outcomes","Dyke, A., Heinrich, C., Mueser, P., & Troske, K. (2005). The effects of welfare-to-work program activities on labor market outcomes. Institute for Research on Poverty, 1295(5). [North Carolina]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of North Carolina’s welfare-to-work program training activities on the quarterly earnings of women ages 18 to 65 years in single-parent households who were cash recipients of Temporary Assistance for Needy Families (TANF). Using data from the state’s administrative records and unemployment insurance program, the authors compared the quarterly earnings of women who took part in the training activities with those who enrolled in the welfare-to-work program but never took part in any of the training. The study found that those taking part in any of the training activities experienced an initial (quarter 1) reduction in their quarterly earnings, compared with those who did not take part in the training activities. However, those who took part in the assessment or intensive training activities experienced an increase in both their cumulative (based on 16 quarters of follow-up) and average (based on quarters 11 to 15 of follow-up) quarterly earnings, compared with those who did not take part in any training activities. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the welfare-to-work program, but other factors might also have contributed.","the Welfare-to-Work Program","Job search assistance and supportive services","Female, Low income, Parent",,"United States",2005,http://repec.iza.org/dp1520.pdf,"Employment and Training Review Protocol" "Study of Hispanics in Job Corps: 2004-2005","Garcia, Y. Study of Hispanics in Job Corps: 2004–2005. Washington, DC: HMA Associates, 2007.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report aimed to explore in greater detail the findings of the National Job Corps Study, an impact study whose final report was published in 2001. Specifically, the authors sought to understand why Hispanic youth did not experience positive impacts on employment outcomes similar to the rest of the study population. Job Corps offers intensive academic classroom instruction and vocational skills training, along with support services, to economically disadvantaged youth. The authors reviewed data on Hispanic youth from the National Job Corps Study, program data, and data from a survey administered in 2004 to Hispanic youth in Job Corps centers. They also conducted site visits to four Job Corps centers, where they interviewed program staff and current and former participants. The study found that Hispanic youth performed well in the Job Corps program, but did not fully leverage the training they received. Many took the first job they were offered in order to start supporting their family immediately instead of expanding their employment search to include more lucrative long-term options. They also limited their search to places of employment where they felt poor English language skills would not constrain them.","Job Corps","Job search assistance and supportive services Youth programs Other training and education Work based and other occupational training","Youth, Hispanic of any race, Low-skilled, Low income",,"United States",2005,http://wdr.doleta.gov/research/FullText_Documents/Hispanic%20Job%20Corps%202004…,"Opportunities for Youth Review Protocol" "Youth Opportunity Grant Initiative: Ethnographic evaluation final report.","Lewis-Charp, H., Soukamneuth, S. & Goger, A.(2005). Youth Opportunity Grant Initiative: Ethnographic evaluation final report. Houston, TX: Decision Information Resources, Inc.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: The study aimed to understand the characteristics of communities participating in the Youth Opportunity (YO) grant initiative. It also sought to examine perceptions of whether the YO program had been implemented well and had enhanced the communities. Funded by the U.S. Department of Labor in 2000, the YO initiative looked to transform distressed neighborhoods by engaging youth in positive and productive activities and relationships. Programs were to provide education, employment, support, and leadership development services to youth ages 14 to 21 in high-poverty urban, rural, and Native American communities. The authors performed an ethnographic analysis based on site profiles for 35 YO communites. They also used U.S. Census data to further understand the characteristics of the communities. The authors described the social and economic trends of the 35 sites at length, focusing on the persistent and systemic obstacles facing the communities, including population decline, housing stress, and high rates of teen pregnancy. Participating communities had high rates of poverty and few quality jobs available.  The authors did not find a consensus about how well the YO initiative had been implemented in the communities. However, most community members, including participating youth, did strongly agree that YO programming benefited youth.","Youth Opportunity Grant Initiative","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2005,,"Opportunities for Youth Review Protocol" "Barriers to employment for out-of-school youth: Evidence from a sample of recent CET applicants.","Miller, C., & Porter, K. (2005). Barriers to employment for out-of-school youth: Evidence from a sample of recent CET applicants. MDRC working paper. New York: MDRC.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report describes the associations between barriers to employment and employment outcomes of a sample of applicants in the Center for Employment Training (CET) replication sites. The CET program provided an intensive, short-term job training program for economically disadvantaged out-of-school youth that was designed to mirror the workplace. The overall impact of CET on youths’ employment outcomes is described in a different report (see CLEAR profile of Miller et al. 2005). This report described whether three barriers to employment—(1) lack of a high school diploma or general education development (GED) certificate, (2) childbearing, and (3) arrests—were associated with lower employment rates, and whether lower employment rates stemmed from employment instability or a longer length of time needed to find a job. The authors used data from the 54-month survey of CET applicants from the impact evaluation. For that evaluation, eligible youth were randomly assigned to receive CET services or to the control group, which was ineligible for CET services. The authors found that youth who did not finish high school or obtain a GED were less successful in the labor market than those who received a high school credential. Wages for dropouts were lower on average and dropouts worked less than high school graduates and GED recipients. Among male dropouts, job instability contributed to low average employment rates; for female dropouts, both job instability and longer spells of unemployment contributed to low employment rates. Having children at study entry was not associated with poorer employment outcomes for males or females. However, young men who had arrest records faced substantial challenges in finding jobs and were more likely to work in lower quality jobs in the retail or service industries than those without arrest records.","the Center for Employment Training (CET) Replication","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2005,http://www.mdrc.org/sites/default/files/full_24.pdf,"Opportunities for Youth Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Riverside, CA – Training Focused]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Riverside, CA – Training Focused]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the effectiveness of a Riverside, California, program to increase the earnings of welfare recipients after one year. The Riverside Phase 2 site was one of two in Riverside that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,912 employed single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups (Work Plus or Training Focused) that received differing ERA services, or to a control group (Work Focused) that received standard public benefits and some limited case management. This review compared between the Training Focused program and the control group. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects on employment, earnings, or benefit receipt. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means that we would be confident that any estimated effects would be attributable to Riverside Training Focused program and not to other factors. However, the study did not find statistically significant effects.","the Employment Retention and Advancement (ERA) Project—Training Focused (Phase 2), Riverside","Other employment and reemployment","Low income",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "State Partnership Initiative: Selection of comparison groups for the evaluation and selected impact estimates: Final report","Peikes, D., Orzol, S., Moreno, L., & Paxton, N. (2005). State Partnership Initiative: Selection of comparison groups for the evaluation and selected impact estimates: Final report. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment","Summary: The study’s objective was to measure short-term impacts for the three State Partnership Initiative (SPI) sites whose effectiveness was evaluated using a randomized controlled trial. SPI was meant to increase employment and earnings for Supplemental Security Income (SSI) and Social Security Disability Insurance (SSDI) beneficiaries through the provision of direct services. The study’s data were collected from Social Security Administration (SSA) administrative data and the Summary Earnings Record (SER). The authors estimated program impacts on employment and earnings. The study found that SPI had negative and statistically significant impacts on employment and earnings, contrary to the initiative’s intent. The quality of causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the effects estimated in the study are attributable solely to the SPI, and not to other factors.","the State Partnership Initiative","Supplemental security income (SSI) Disability insurance",Disability,,"United States",2005,http://www.mathematica-mpr.com/~/media/publications/PDFs/SPIselectimpact.pdf,"Disability Employment Policy Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Texas ERA—Fort Worth]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [Texas ERA—Fort Worth]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after one year. The Fort Worth site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,163 unemployed single-parent participants in Fort Worth’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of the Texas ERA program in Fort Worth on employment, earnings, and benefits receipt one year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to Texas ERA and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement project, Fort Worth","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [South Carolina] (Bloom et al. 2005)","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [South Carolina]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on former welfare recipients’ employment and benefits receipt outcomes after one year. The South Carolina site was one of 16 sites nationwide that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,839 people who had recently left the Temporary Assistance for Needy Families (TANF) to either a treatment group (Moving Up) that received ERA services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of Moving Up on employment, earnings, or benefits receipt one year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to Moving Up and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement Project, South Carolina","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Chicago]","Bloom, D, Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Chicago]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to determine the effectiveness of a Chicago program to increase the earnings of Temporary Assistance for Needy Families (TANF) recipients after one year. The Chicago site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 990 TANF recipients to either a treatment group, which received enhanced employment services, or a control group, which received benefits as usual. The authors collected employment and earnings data from Illinois Unemployment Insurance (UI) records and Food Stamps and TANF receipt data from Illinois administrative records. The study found that those in the Chicago ERA program received, on average, $193 less in TANF benefits in the first year after random assignment than those in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Chicago ERA project, and not to other factors.","the Employment Retention and Advancement project, Chicago","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The effects of welfare-to-work program activities on labor marker outcomes","Dyke, A., Heinrich, C., Mueser, P., & Troske, K. (2005). The effects of welfare-to-work program activities on labor marker outcomes. Institute for Research on Poverty, 1295(5). [Missouri]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of Missouri’s welfare-to-work program training activities on the quarterly earnings of women ages 18 to 65 years in single-parent households who were cash recipients of Temporary Assistance for Needy Families (TANF). Using data from the state’s administrative records and unemployment insurance program, the authors compared the quarterly earnings of women who took part in the training activities with those who enrolled in the welfare-to-work program but never took part in any of the training. The study found that those taking part in the training activities experienced an initial (quarter 1) reduction in their quarterly earnings, compared with those who did not take part in the training activities. However, both cumulative (based on all 16 quarters of follow-up) and average (based on quarters 11 to 15) quarterly earnings increased for those who took part in the training activities compared with those who did not. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the welfare-to-work program training activities, but other factors might also have contributed.","the Welfare-to-Work Program","Job search assistance and supportive services","Female, Low income, Parent",,"United States",2005,http://repec.iza.org/dp1520.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the South Carolina ERA site","Scrivener, S., Azurdia, G., & Page, J. (2005). The Employment Retention and Advancement project: Results from the South Carolina ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of South Carolina’s Moving Up program on former welfare recipients’ employment, earnings and public benefits receipt outcomes after one year. The South Carolina site was one of 16 sites nationwide that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,864 people who had recently left Temporary Assistance for Needy Families (TANF) to either a treatment group that received Moving Up services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamp administrative records for the entire sample and a survey administered to a subsample of study participants 12 months after random assignment. The study did not find any statistically significant effects on employment, earnings, and public benefits receipt one year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the South Carolina Moving Up program and not to other factors. However, the study did not find statistically significant effects.","the Employment Retention and Advancement Project, South Carolina","Job search assistance and supportive services Other employment and reemployment","Low income",,"United States",2005,http://files.eric.ed.gov/fulltext/ED490879.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Riverside, CA – Work Plus]","Bloom, D., Hendra, R., Martinson, K. & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Riverside, CA – Work Plus]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the effectiveness of a Riverside, California, program to increase the earnings of welfare recipients after one year. The Riverside Phase 2 site was one of two in Riverside that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,912 employed single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups (Work Plus or Training Focused) that received different ERA services, or to a control group (Work Focused) that received standard public benefits and some limited case management. This review compared the Work Plus program and the control group. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study found that those in the Work Plus group were 5 percentage points more likely to receive Food Stamps in the year after random assignment than those in the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Riverside Work Plus program and not to other factors.","the Employment Retention and Advancement (ERA) Project—Work Plus (Phase 2), Riverside","Other employment and reemployment","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "Net impact estimates for services provided through the Workforce Investment Act. ETA Occasional Paper 2005-06. [WIA Adult]","Hollenbeck, K., Schroeder, D., King, C., & Huang, W. (2005). Net impact estimates for services provided through the Workforce Investment Act. ETA Occasional Paper 2005-06. Washington, DC: U.S. Department of Labor, Employment and Training Administration. [WIA Adult]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program’s core, intensive, and training services on the employment rate, earnings, and benefits receipt of low-income adults ages 22 to 64. The authors established three treatment groups based on the level of WIA services used and matched them to three comparison groups that participated in Employment Services (ES) and/or the core WIA services. The study found that the employment rate and average quarterly earnings were significantly higher for those in each of the treatment groups compared with their matched comparison groups. Benefits receipt was also significantly lower for those in the treatment groups than in their comparison groups. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Adult Program; other factors are likely to have contributed.","the Workforce Investment Act (WIA) Adult Program","Job search assistance and supportive services Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Low-skilled, Low income",,"United States",2005,https://wdr.doleta.gov/research/FullText_Documents/Net%20Impact%20Estimates%20f…,"Employment and Training Review Protocol" "Promoting work in public housing: The effectiveness of Jobs-Plus","Bloom, H., Riccio, J., Verma, N., & Walter, J. (2005). Promoting work in public housing: The effectiveness of Jobs-Plus. New York City: MDRC","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Jobs-Plus Community Revitalization Initiative for Public Housing Families (Jobs-Plus) program on the employment and earnings of residents in housing developments in six cities in the United States. The study was a randomized controlled trial that used data from administrative records to compare outcomes between treatment and control group members from one to five years after random assignment. The study found that residents in the Jobs-Plus housing developments had higher long-term earnings than residents in the control group developments. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Jobs-Plus program and not to other factors.","the Jobs-Plus Community Revitalization Initiative for Public Housing Families (Jobs-Plus) Program","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States, Urban",2005,http://www.mdrc.org/sites/default/files/full_485.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Texas ERA—Corpus Christi]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [Texas ERA—Corpus Christi]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after one year. The Corpus Christi site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,300 single-parent participants in Corpus Christi’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program administrative records. The study did not find any statistically significant effects one year after random assignment on employment, earnings, and public benefits receipt. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the Corpus Christi ERA program and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Corpus Christi","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Riverside, CA – Work Plus versus Training Focused]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [Riverside, CA – Work Plus versus Training Focused]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the effectiveness of a Riverside, California, program to increase the earnings of welfare recipients after one year. The Riverside Phase 2 site was one of two in Riverside that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned eligible single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups (Work Plus and Training Focused) that received differing ERA services or to a control group that received standard TANF services. This review focuses on the comparison between the Work Plus program and the Training Focused program. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of the Work Plus program on employment, earnings, and benefits receipt compared with the Training Focused program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to the Riverside Work Plus program and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement Project—Work Plus and Training Focused (Phase 2), Riverside","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The impact of enhanced incentives on vocational rehabilitation outcomes for dually diagnosed veterans.","Drebing, C. E., Van Ormer, E. A., Krebs, C., Rosenheck, R., & Rounsaville, B. (2005). The impact of enhanced incentives on vocational rehabilitation outcomes for dually diagnosed veterans. Journal of Applied Behavioral Analysis, 38(3), 359-372.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-No impacts Employment Health and safety-Low-Favorable impacts Health and safety","Summary: The study examined the impact of enhanced incentives within an existing Veteran’s Administration (VA) Compensated Work Therapy (CWT) program on sustained abstinence from substances, transitioning to competitive employment, retention in competitive employment, and wages. The study was a randomized controlled trial that compared outcomes for the intervention and control groups over 16 weeks. The CWT program’s clinical and financial records were used to assess employment and wage outcomes. Urine screens and participant reports were used to measure substance use outcomes. The study found that total wages for the enhanced incentives group were significantly higher than for the control group. The study also found that the intervention group abstained from substance use for a significantly longer time than the control group. The quality of causal evidence presented in this report is low for the employment and earnings outcomes because the authors did not establish that the intervention and control groups were equivalent one year before the intervention in terms of earnings or employment. This means we are not confident the estimated effects on these outcomes are attributable to the enhanced incentives in the CWT program; other factors are likely to have contributed.","Veterans’ Administration’s Compensated Work Therapy Program with Enhanced Incentives","Health Substance abuse recovery Veterans' reemployment","Veteran or military","Health care and social assistance","United States",2005,https://files.eric.ed.gov/fulltext/EJ725227.pdf,"Employment and Training Review Protocol" "The Quantum Opportunity Program Demonstration: Initial post-intervention impacts","Schirm, A., & Rodriguez-Planas, N. (2004). The Quantum Opportunity Program Demonstration: Initial post-intervention impacts. Washington, DC: Mathematica Policy Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Unfavorable impacts Employment","Summary: The report’s objective was to evaluate the impact of the Quantum Opportunity Program (QOP)—which includes case management and mentoring, education, developmental activities, community service, supportive services, and financial incentives—on educational attainment and labor market participation approximately seven years after program enrollment. Other reports presented impact findings from different time periods. About 1,100 9th-grade students from 11 high schools were randomly assigned to the treatment group, which could enroll in QOP, or to the control group, which could not participate in QOP activities. The study team administered a survey to treatment and control group members about seven years after program enrollment (three years after their scheduled graduation from high school) to collect information on postsecondary educational attainment and labor market outcomes. Participation in QOP had no statistically significant impact on most measures of postsecondary attainment and employment. The exceptions were that participation increased enrollment in college or vocational/technical school, an apprenticeship, or the military by 10 percentage points. It decreased the likelihood of working at least 35 hours at a main job by 11 percentage points. The quality of the causal evidence presented in this report is low. This means we do not have confidence that the estimated effects are attributable to QOP; other factors likely contributed.","Quantum Opportunities Program (QOP)","Mentoring Other training and education Youth programs",Youth,,"United States",2004,http://www.doleta.gov/reports/searcheta/occ/papers/June_04_QOP_report.pdf,"Opportunities for Youth Review Protocol" "Enriching summer work: An evaluation of the Summer Career Exploration Program.","McClanahan, W., Sipe, C., & Smith, T. (2004). Enriching summer work: An evaluation of the Summer Career Exploration Program. Philadelphia, PA: Public/Private Ventures.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The evaluation’s objective was to examine the effects of the Summer Career Exploration Program (SCEP) on short-term earnings, employment, and other outcomes. SCEP offers youth job-related counseling, places them in career-related jobs, and supports them through mentoring. The report also describes program implementation and ways of improving SCEP. The program’s effectiveness was evaluated using a randomized control ed trial.  The study found statistically significant, positive impacts of SCEP on participants’ employment and earnings over the summer that the evaluation occurred; however, these were not sustained over the one-year follow-up period.  The quality of the causal evidence presented in this study is high for most outcomes and moderate for the remaining outcomes examined. For the outcomes with high causal evidence, this means we are confident that the estimated impacts are attributable to SCEP, and not other factors. For those with moderate causal evidence, other factors besides SCEP might have contributed to the estimated effects.","Summer Career Exploration Program","Basic skills Job search assistance and supportive services Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2004,http://www.cityofmadison.com/dpced/communitydevelopment/funding/documents/AreaI…,"Opportunities for Youth Review Protocol" "Is the threat of reemployment services more effective than the services themselves? Evidence from random assignments in the UI system","Black, D., Smith, J., Berger, M., & Noel, B. (2003). Is the threat of reemployment services more effective than the services themselves? Evidence from random assignments in the UI system. American Economic Review, 93(4), 1313-1327.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study examined the impact of the Kentucky Worker Profiling and Reemployment Services (WPRS) on Unemployment Insurance (UI) benefit receipt and earnings.  In this study, about 2,000 UI claimants in Kentucky were randomly assigned to the treatment group, which was required to participate in reemployment services, or to the control group, which was not required to participate but could receive services voluntarily. The authors collected administrative data on UI benefit receipt and earnings for all study participants. The study found that those in the WPRS treatment group had a statistically significant reduction in UI benefit receipt of 2.2 weeks during the six-quarter follow-up period, compared to the control group. There were no statistically significant impacts of the program on the fraction of recipients exhausting benefits or total UI benefits received. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial (RCT). This means we are confident that the estimated effects are attributable to the WPRS and not to other factors.",Profiling,"RESEA Job search assistance and supportive services Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",2003,,"Reemployment Review Protocol" "National Job Corps Study: Findings using administrative earnings records data","Schochet, P., McConnell, S., & Burghardt, J. (2003). National Job Corps Study: Findings using administrative earnings records data. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Training-Mod/high-No impacts Training","Summary: The study’s objective was to estimate the impact on long-term earnings and employment of the Job Corps program, which offers intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. The program’s effectiveness was evaluated using a randomized controlled trial conducted in 48 states and the District of Columbia. The study found statistically significant, positive impacts of Job Corps on participants’ earnings within the first three years and employment within the first four years of follow-up, but no impacts of Job Corps on these outcomes in the fifth and sixth years. The quality of the causal evidence presented in this study is high. This means we are confident that the Job Corps program—not other factors—caused the estimated impacts. ","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2003,http://www.mathematica-mpr.com/publications/pdfs/jobcorpsadmin.pdf,"Opportunities for Youth Review Protocol" "Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness","Resnick, S., Neale, M., & Rosenheck, R. (2003). Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness. The Journal of Nervous and Mental Disease, 191(3), 139-144.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Unfavorable impacts Employment","Summary: The study evaluated the one-year impacts of a U.S. Department of Veterans Affairs (VA) model of assertive community treatment for veterans with serious mental illnesses known as Intensive Psychiatric Community Care (IPCC) on employment. The study conducted a randomized controlled trial (RCT); those randomly assigned to the treatment group were eligible to receive the IPCC services, whereas those randomly assigned to the control group could not access IPCC services but could use other available health- and workforce-related services from the VA. The authors analyzed outcomes based on self-reported employment data collected from participants one year after random assignment. The study found that 7 percent of veterans in the IPCC group were employed one year after random assignment compared to 11 percent of veterans in the control group. The authors did not report the statistical significance of this difference. The quality of the causal evidence presented in this report is high because it was based on a well-conducted RCT. This means we have confidence that the estimated effects are attributable to the IPCC program and not other factors.","Intensive Psychiatric Community Care (IPCC)","Health Job search assistance and supportive services Veterans' reemployment Basic skills","Disability, Veteran or military",,"United States",2003,https://journals.lww.com/jonmd/Abstract/2003/03000/IMPACT_OF_PUBLIC_SUPPORT_PAY…,"Employment and Training Review Protocol" "College as a job advancement strategy: An interim report on the New Visions Self-Sufficiency and Lifelong Learning Project","Fein, D., Beecroft, E., Long, D., & Robertson A. (2003). College as a job advancement strategy: An interim report on the New Visions Self-Sufficiency and Lifelong Learning Project. Cambridge, MA: Abt Associates Inc.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Riverside Community College’s New Visions Self-Sufficiency and Lifelong Learning Project on welfare recipients’ employment, earnings, and welfare receipt. The study is based on a randomized controlled trial and estimated the effect of offering welfare recipients the New Visions program by using California and community college administrative data to compare average outcomes among those offered access to the program to the average outcomes of those excluded, after adjusting for differences between the groups. The authors found that access to the New Visions program increased the average number of quarters during which participants received Temporary Assistance for Needy Families (TANF) benefits and increased the average amount of TANF benefits received in the first two years. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Visions program, and not to other factors.","the New Visions Self-Sufficiency and Lifelong Learning Project","Community college education and other classroom training Other employment and reemployment","Low income, Parent",,"United States",2003,,"Employment and Training Review Protocol" "Evaluation of the Significant Improvement Demonstration Grants for the provision of reemployment services for UI claimants","Needels, K., Corson, W., & Van Noy, M. (2002). Evaluation of the Significant Improvement Demonstration Grants for the provision of reemployment services for UI claimants. Princeton, NJ: Mathematica Policy Research.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study examined the impacts of the Significant Improvement Demonstration Grants—awarded to 11 states to improve reemployment services for Unemployment Insurance (UI) claimants—on weeks of UI receipt and UI benefit exhaustion. For each state, the authors compared outcomes before and at the end of the grant period using monthly data that states reported to the UI Service. The study found no statistically significant relationships between the Significant Improvement Demonstration Grants and UI benefit receipt outcomes. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Significant Improvement Demonstration Grants; other factors are likely to have contributed.","Significant Improvement Demonstration Grants","Job search assistance and supportive services Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",2002,https://www.doleta.gov/reports/searcheta/occ/papers/UI_final.pdf,"Reemployment Review Protocol" "The benefits and costs of Job Corps","McConnell, S., & Glazerman, S. (2001). The benefits and costs of Job Corps. Mathematica Policy Research: Washington, DC.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to determine whether the benefits of Job Corps exceeded its costs. The authors used data on impacts from the National Job Corps Study to estimate the program’s benefits and administrative data from the Office of Job Corps to estimate the program’s costs. The study found that the benefits of Job Corps to society exceeded its costs by almost $17,000 per participant. This included positive benefits of about $20,000 to participants and negative benefits of about $3,000 to the rest of society.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2001,http://www.mathematica-mpr.com/~/media/publications/PDFs/01-jcbenefit.pdf,"Opportunities for Youth Review Protocol" "National Job Corps Study: Assessing program effects on earnings for students achieving key program milestones","Gritz, R. M., and Johnson, T. (2001). National Job Corps Study: Assessing program effects on earnings for students achieving key program milestones. Report Prepared for the U.S. Department of Labor, Employment and Training Administration.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to estimate the impact of Job Corps on the employment and earnings of participants who obtained a general education development (GED) certificate or vocational training certificate during the course of the program. Job Corps offers intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. Job Corps’ overall effectiveness was evaluated using a randomized controlled trial—the National Job Corps Study (NJCS)—conducted in 48 states and the District of Columbia (see the Clearinghouse for Labor Evaluation and Research [CLEAR] profile of Schochet et al. 20011 for full results). For this report, the authors used data from the NJCS 48-month follow-up survey to match Job Corps participants to control group members who had similar propensities to obtain a GED or vocational certificate. The study found that Jobs Corps participants who completed a vocational certificate during the course of the program earned $40 to $50 per week more than their control group counterparts, and those who completed a GED earned $60 to $70 per week more. The quality of causal evidence presented in this study is moderate, the highest possible rating for a nonexperimental study. This means that we have some confidence that the estimated impacts are attributable to achieving programmatic milestones in the Job Corps program, although other factors might also have contributed.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2001,http://wdr.doleta.gov/opr/fulltext/MilestoneImpactReport-Final.pdf,"Opportunities for Youth Review Protocol" "National Job Corps Study: Impacts by center characteristics.","Burghardt, J. & Schochet, P. (2001). National Job Corps Study: Impacts by center characteristics. Princeton, NJ: Mathematica Policy Research, Inc.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: The National Job Corps Study produced several reports, including a main impact report (see CLEAR profile of Schochet et al. 2001 ) that found positive impacts of Job Corps—a national vocationally focused education and training program for disadvantaged youth ages 16 to 24—on participants’ employment, earnings, and education and training outcomes measured after four years. In this report, the authors examined whether these impacts were related to center characteristics, including the type of center operator, capacity of the center, region of the country, and performance ranking. The authors used data collected as part of the National Job Corps Study, which consisted of 9,400 program participants and 6,000 nonparticipants randomly selected from 81,000 first-time Job Corps applicants nationwide. Data included Job Corps center characteristics and student outcomes in the areas of educational services and attainment, earnings, and arrests. The authors used Job Corps counselors’ predictions of which Job Corps center applicants would attend before random assignment to compare outcomes of treatment youth with those of comparison youth who would have attended the same centers, had they been randomly assigned a slot in the program. The authors found few impacts that varied by center characteristics. The impacts of Job Corps were similar across operators; large, medium, and small centers; most regions of the United States; and across high-, medium-, and low-performing centers, as determined by the Job Corps performance measurement system.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2001,http://wdr.doleta.gov/opr/fulltext/01-jccenter.pdf,"Opportunities for Youth Review Protocol" "National Job Corps Study: The impacts of Job Corps on participants’ employment and related outcomes","Schochet, P., Burghardt, J., & Glazerman, S. (2001). National Job Corps Study: The impacts of Job Corps on participants’ employment and related outcomes. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Training-Mod/high-Favorable impacts Training","Summary: The National Job Corps Study included several reports, including this final impact report. The report’s objective was to examine the impact of the Job Corps program on participants’ long-term earnings, employment, and other outcomes. It also described the participants’ Job Corps experiences. Job Corps offers intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. Its effectiveness was evaluated using a randomized controlled trial conducted in 48 states and the District of Columbia. This report found statistically significant, positive impacts of Job Corps on participants’ employment, earnings, and education and training outcomes measured after four years. The quality of the causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the Job Corps program—not other factors—caused the estimated impacts.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2001,http://wdr.doleta.gov/research/FullText_Documents/01-jcimpacts.pdf,"Opportunities for Youth Review Protocol" "Measuring the effect of public labor exchange (PLX) referrals and placements in Washington and Oregon","Jacobson, L., & Petta, I. (2000). Measuring the effect of public labor exchange (PLX) referrals and placements in Washington and Oregon (Workforce Security Research Publications 2000–06). Washington, DC: U.S. Department of Labor.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-Mixed impacts Public benefit receipt","Summary: The study examined the impact of receiving public labor exchange (PLX) job referrals and placements on the duration of Unemployment Insurance (UI) benefit receipt for UI recipients in Oregon and Washington. The authors used statistical models to compare two distinct treatment groups to a comparison group within each state. The treatment groups both received PLX job search assistance, a job referral, and a job offer; one group did not actually work at the position offered while the other did. The comparison group received job search assistance but not PLX job referrals or placements. The authors used data from the Oregon Employment Department and the Washington State Employment Security Department. The study found that individuals in the treatment group tended to receive UI benefits for fewer weeks than individuals in the comparison group; this was a statistically significant difference. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated relationships are attributable to PLX job referrals or placements; other factors are likely to have contributed.",Other,"RESEA Job search assistance and supportive services Labor Exchange Wagner-Peyser Act",Unemployed,,"United States",2000,https://wdr.doleta.gov/owsdrr/00-6/00-6.pdf,"Reemployment Review Protocol" "Retention in the United States Job Corps: Analysis and recommendations.","Ginsburg, K. R., Forke, C.M., Kinsman, S.B., Fleegler, E., Grimes, E.K., et al. (2000). Retention in the United States Job Corps: Analysis and recommendations. Philadelphia, PA: The Children’s Hospital of Philadelphia.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to collect information to help Job Corps program and policy staff improve participant retention in the program. Job Corps offers intensive academic classroom instruction and vocational skills training, along with support services, to economically disadvantaged youth. The authors used information from the Job Corps database on the demographic and other characteristics of participants who dropped out to study the timing of and reasons for withdrawal from the program. They administered a survey to the centers with the highest and lowest retention rates, and they conducted focus groups, interviews with program staff and participants, and observations of service delivery at five Job Corps sites. The authors’ analysis of characteristics and survey responses found that students with certain characteristics—for example, older students, those who entered the program with more advanced educational attainment, and those who interacted more closely with admissions counselors at Job Corps centers—were more likely to remain in the program. However, the authors noted that these were not highly reliable predictors of whether a student would remain in the program, suggesting unobserved factors played a role as well. The qualitative analysis of focus groups, interviews, and observations indicated that the students’ motivation, emotional maturity, and interpersonal skills and the strength of the relationships between participants and staff were important determinants of retention. Based on these findings, the authors recommended launching a staff training initiative to ensure staff were prepared to communicate effectively with students, challenge them, and build their sense of connectedness with one another and the program.","Job Corps","Job search assistance and supportive services Youth programs Other training and education Work based and other occupational training","Youth, Low-skilled, Low income",,"United States",2000,http://wdr.doleta.gov/research/FullText_Documents/00-jobcorps.pdf,"Opportunities for Youth Review Protocol" "Two years after a job loss: Long-term impact of the JOBS Program on reemployment and mental health","Vinokur, A., Schul, Y., Vuori, J., & Price, R. (2000). Two years after a job loss: Long-term impact of the JOBS Program on reemployment and mental health. Journal of Occupational Health Psychology, 5(1), 32-47.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the JOBS II program on long-term employment, earnings, and monthly hours worked. The authors randomly assigned eligible unemployed individuals to either a treatment group, which could participate in JOBS II, or the control group, which could receive other services in the community, but not JOBS II. The study included a pre-test two weeks before the intervention and follow-up questionnaires 2, 6, and 24 months after the intervention. The authors found that JOBS II was associated with positive effects on the treatment group’s rate of reemployment and monthly earnings as measured two years after assignment, compared with the control group. The quality of causal evidence presented in this report is low because the study was a randomized controlled trial with unknown attrition and lack of sufficient controls in the analysis. This means we are not confident that the estimated effects are attributable to the JOBS II program; other factors are likely to have contributed.","the JOBS II Program","Job search assistance and supportive services","Dislocated or displaced worker, Unemployed",,"United States",2000,,"Reemployment Review Protocol" "National Job Corps Study: Job Corps applicants’ programmatic experiences","Johnson, T., Gritz, M., & Dugan, M. (2000). National Job Corps Study: Job Corps applicants’ programmatic experiences. Seattle, WA: Battelle Memorial Institute.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report built on the process and descriptive analyses of the National Job Corps Study to understand which Job Corps program features led to positive results for applicants and participants. Job Corps offers intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. The authors investigated programs’ enrollment procedures, characteristics of the Job Corps centers, and program practices to identify those that seemed to be related to positive programmatic experiences for participants. The authors used data from the program’s management information system, the Bureau of Labor Statistics, and surveys of program staff. The study found that students who had admissions counselors who put the onus on them to complete the admissions process, attended smaller centers in rural areas, and had access to high quality vocational training and academic instruction were more likely to have positive programmatic outcomes than those that did not. The extent to which staff and student populations had a similar racial make-up and gender composition, and the types and variety of vocational training offered, did not appear to influence programmatic outcomes.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2000,http://wdr.doleta.gov/research/FullText_Documents/00-jc_programmatic.pdf,"Opportunities for Youth Review Protocol" "College as a job advancement strategy: An early report of the New Visions Self-Sufficiency and Lifelong Learning Project","Fein, D., Beecroft, E., Long, D., & Catalfamo, A. (2000). College as a job advancement strategy: An early report of the New Visions Self-Sufficiency and Lifelong Learning Project. Bethesda, MD: Abt Associates Inc.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of a pilot for Riverside Community College’s New Visions Self-Sufficiency and Lifelong Learning Project on welfare recipients’ welfare receipt. The study was based on a randomized controlled trial and estimated the effect of offering welfare recipients the New Visions program compared with encouraging recipients to participate in other employment services. The authors used California Temporary Assistance for Needy Families (TANF) records to compare average outcomes among those offered access to the program against the average outcomes of those excluded, after adjusting for differences in demographic and pre-intervention characteristics between the groups. The authors did not find any statistically significant effect of the New Visions program on the likelihood of receiving TANF or the amount of TANF benefits received. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Visions Project, and not to other factors.","the New Visions Self-Sufficiency and Lifelong Learning Project","Community college education and other classroom training Other employment and reemployment","Low income, Parent",,"United States",2000,http://files.eric.ed.gov/fulltext/ED466834.pdf,"Employment and Training Review Protocol" "Assisting Unemployment Insurance claimants: The long-term impacts of the Job Search Assistance Demonstration","Decker, P., Olsen, R., & Freeman, L. (2000). Assisting Unemployment Insurance claimants: The long-term impacts of the Job Search Assistance Demonstration. Princeton, NJ: Mathematica Policy Research.","Job Search Assistance, Reemployment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Job Search Assistance Demonstration in Washington, D.C., and Florida on Unemployment Insurance (UI) benefits receipt, earnings, and employment. In this demonstration, about 20,000 UI claimants were randomized into one of three intervention groups, all of which received some variation of job search assistance services, or into a control group, which could receive existing services in the community. For all participants, the study team collected administrative data, which provided information on UI receipt, earnings, and employment. The study found that structured job search assistance was generally successful at reducing UI benefits receipt and increasing earnings in Washington, D.C., but not in Florida. The findings for individualized job search assistance treatment groups were less robust. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the job search assistance strategies tested, and not to other factors.","JSA services","Job search assistance and supportive services Other training and education","Dislocated or displaced worker, Unemployed",,"United States",2000,,"Job Search Assistance, Reemployment Review Protocol" "Evaluation of the Center for Employment Training replication sites: Interim report.","Walsh, S., Goldsmith, D., Abe, Y., & Cann, A. (2000). Evaluation of the Center for Employment Training replication sites: Interim report. Oakland, CA: Berkeley Policy Associates.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report presents an implementation analysis of 12 Center for Employment Training (CET) replication sites. The Center for Employment Training (CET) model targets economically disadvantaged youth who are not in school or employed. It delivers training in a work-like environment, requires full-time participation, and involves local employers in program design and delivery. The analysis assessed the fidelity of implementation to the CET model using qualitative data collected during site visits to 12 sites and preliminary administrative data from 8 sites. The study found that all the replication sites were generally successful in structuring services to mirror the workplace. Sites operated by CET (8 of 12) had overall higher fidelity to the model than non-CET-operated sites. Additionally, the study suggested that organizational capacity and stability are critical to replication; the 7 replication sites led by less-experienced organizations were prone to upheavals, and 4 closed during the course of the evaluation.","the Center for Employment Training (CET) Replication","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2000,,"Opportunities for Youth Review Protocol" "Final report on the implementation and impacts of the Minnesota Family Investment Program in Ramsey County. [MFIP-R versus AFDC, single parents in the early cohort]","Auspos, P., Miller, C., & Hunter, J. A. (2000). Final report on the implementation and impacts of the Minnesota Family Investment Program in Ramsey County. Washington, DC: U.S. Department of Health and Human Services, Administration for Children and Families, Office of Planning, Research and Evaluation. [MFIP-R versus AFDC, single parents in the early cohort]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Minnesota Family Investment Program of Ramsey County (MFIP-R), a precursor to the national Temporary Assistance for Needy Families program, on participants’ employment, earnings, and benefit receipt. The authors used a randomized controlled trial design, assigning eligible families to either MFIP-R or existing services. Employment, earnings, and benefit receipt data were collected quarterly from Minnesota’s Unemployment Insurance earnings and public assistance benefit records. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, this CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because assignment to condition was not fully random, and the authors did not account for potential pre-existing differences in group characteristics in their analysis. This means we are not confident that the estimated effects are attributable to MFIP-R; other factors are likely to have contributed.","the Minnesota Family Investment Program of Ramsey County (MFIP-R)","Job search assistance and supportive services Other employment and reemployment","Low income, Parent",,"United States",2000,http://www.mdrc.org/sites/default/files/full_364.pdf,"Employment and Training Review Protocol" "Evaluation of Worker Profiling and Reemployment Services systems: Final Report.","Dickinson, K., Kreutzer, S., West, R., & Decker, P. (1999). Evaluation of Worker Profiling and Reemployment Services systems: Final report. Research and Evaluation Report Series 99-D. Washington, DC: U.S. Department of Labor, Employment, and Training Administration.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study assessed the effectiveness of Worker Profiling and Reemployment Services (WPRS), a system for predicting which Unemployment Insurance (UI) recipients are at greatest risk of exhausting benefits and offering them early intervention services.  The study used a nonexperimental design to compare the UI benefit receipt, employment, and earnings outcomes of WPRS participants in six states to the outcomes of similar UI claimants who did not receive WPRS. The main data source was state UI administrative records for nearly 457,000 UI claimants. The study found that WPRS reduced UI benefit weeks and amounts in three of the states during the benefit year. However, there were few statistically significant impacts on employment rates or earnings in the four quarters after the initial claim, and some of the impacts were in an unexpected direction. The quality of causal evidence presented in this report is moderate, because it is a well-implemented nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to WPRS, but other factors might also have contributed.",Profiling,"RESEA Job search assistance and supportive services Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",1999,,"Reemployment Review Protocol" "National Job Corps Study: Report on study implementation.","Burghardt, J., McConnell, S., Meckstroth, A., Schochet, P., Johnson, T., & Homrighausen, J. (1999). National Job Corps Study: Report on study implementation. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report describes the implementation of and lessons learned from the National Job Corps Study, a random assignment impact evaluation of Job Corps. Job Corps provides comprehensive job training to disadvantaged youth in the areas of basic education, vocational skills training, health care and education, counseling, and residential support. The authors conducted a qualitative analysis of planning and process documents for the study, as well as accounts of study team members’ first-hand experiences. The authors described the study design, sampling procedures, how they monitored sample build-up and decided when to end random assignment, and how they monitored adherence to the study’s random assignment procedures. They noted three key factors important for successful implementation of a randomized study design in an ongoing program: (1) commitment of program managers to the goals of the study and its related tasks, (2) close collaboration between research and program staff, and (3) monitoring of study procedures to ensure integrity.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",1999,http://wdr.doleta.gov/research/FullText_Documents/99-jc_implement.pdf,"Opportunities for Youth Review Protocol" "National Job Corps Study: Report on the Process Analysis","Johnson, T., Gritz, M., Jackson, R., Burghardt, J., Boussy, C., Leonard, J., & Orians, C. (1999). National Job Corps Study: Report on the Process Analysis. Submitted to the U.S. Department of Labor, Employment and Training Administration, Office of Policy and Research. Seattle: Battelle Human Affairs Research.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report presents a process study of the national Job Corps program. Initiated in 1964, Job Corps provides comprehensive education and employment skills training to disadvantaged youth ages 16 to 24. The study drew on survey, administrative, and qualitative data to present students’ and Job Corps centers’ characteristics across the full population of participating students and centers in 1996; sampling for site visits excluded noncontiguous states. This study was part of the National Job Corps Study that also included an impact evaluation and a benefit-cost analysis. Job Corps united federal agencies, private contractors, and unions in implementing a training and support model for disadvantaged youth. Job Corps centers generally implemented core service components with consistency. Links between outreach and admissions counselors to Job Corps centers, and job placement services, proved challenging. Findings are generally applicable to program implementation nationally; however, the study did not measure outputs such as content or quality of services, participation, or dosage.","the Job Corps Program","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",1999,http://wdr.doleta.gov/opr/FULLTEXT/99-jc_analysis.pdf,"Opportunities for Youth Review Protocol" "Two essays on unemployment insurance: Claimant responses to policy changes. [Comparison between claimants who applied for UI benefits before and after WPRS]","Noel, B. J. (1998). Two essays on unemployment insurance: Claimant responses to policy changes (Doctoral dissertation). Retrieved from UMI (UMI No. 9922624). [Comparison between claimants who applied for UI benefits before and after WPRS]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of reemployment services through the Worker Profiling and Reemployment System (WPRS) on unemployment insurance (UI) benefit receipt and earnings for individuals who applied for UI in Kentucky. The authors investigated similar research questions for another contrast, the profile of which can be found here. The author compared outcomes for treatment group members, who were eligible to receive reemployment services, and comparison group members, who were not eligible to receive the reemployment services but could access other services in the community, using data from the Kentucky Department of Employment Services Unemployment Insurance administrative records. The study found statistically significant relationships between the WPRS reemployment services and UI benefit receipt and earnings, where those offered the reemployment services received fewer UI benefits in 26 weeks and earned more in one year, compared to those who did were not eligible to receive reemployment services. The quality of causal evidence presented in this report is low because the author did not account for trends in outcomes before the intervention. This means we are not confident that the estimated relationships are attributable to the WPRS reemployment services; other factors are likely to have contributed.  ",Profiling,"RESEA Job search assistance and supportive services Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",1998,,"Reemployment Review Protocol" "National Job Corps Study: Characteristics of youths served by Job Corps.","Schochet, P. (1998). National Job Corps Study: Characteristics of youths served by Job Corps. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: One of a series of reports emanating from the National Job Corps Study, a random assignment evaluation of the Job Corps program, this report describes the characteristics of eligible Job Corps applicants and compares them with the broader national population of disadvantaged youth. The Job Corps program offers intensive academic classroom instruction and vocational skills training, along with support services, to economically disadvantaged youth. The authors examined data collected as part of the National Job Corps Study on the characteristics of eligible youth. The study collected data through an interview at the time of random assignment and through surveys administered 12, 30 and 48 months after it. The findings in this report are based on the data collected through baseline interviews. The authors reported that, as intended, Job Corps served disadvantaged youth, most of whom had not completed high school (about 80 percent). Eligible applicants tended to be male (about 60 percent) and members of racial or ethnic minority groups (about 70 percent; 50 percent African American). More than a quarter of applicants had been arrested before applying to Job Corps. Female applicants tended to be older, more likely to have children and to have completed high school, and less likely to admit drug use or arrests than male applicants. Compared with the broader national population of disadvantaged youth, eligible Job Corps applicants were more likely to be 16- or 17-year-old African American males from large urban areas who were high school dropouts.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",1998,http://wdr.doleta.gov/opr/fulltext/99-jc_characteristics.pdf,"Opportunities for Youth Review Protocol" "Two essays on unemployment insurance: Claimant responses to policy changes [Contrast 1: Comparison between claimants who applied for UI benefits after WPRS only]","Noel, B. J. (1998). Two essays on unemployment insurance: Claimant responses to policy changes (Doctoral dissertation). Retrieved from UMI (UMI No. 9922624). [Comparison between claimants who applied for UI benefits after WPRS only]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of reemployment services through the Worker Profiling and Reemployment System (WPRS) on unemployment insurance (UI) benefit receipt and earnings for individuals who applied for UI in Kentucky. The authors investigated a similar research questions in another contrast, the profiles of which can be found here. The author compared outcomes for treatment group members, who were eligible to receive reemployment services, and comparison group members, who were not eligible to receive the reemployment services but could access other services in the community, using data from the Kentucky Department of Employment Services Unemployment Insurance administrative records. The study found statistically significant relationships between reemployment services and UI benefit receipt, where those who were offered the reemployment services received less UI benefits in 26 weeks, compared to those who did not receive reemployment services. There were no statistically significant relationships between reemployment services and earnings. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated relationships are attributable to the WPRS reemployment services; other factors are likely to have contributed.",Profiling,"RESEA Job search assistance and supportive services Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",1998,,"Reemployment Review Protocol" "Matching the disadvantaged to job opportunities: Structural explanations for the past successes of the Center for Employment Training.","Melendez, E., & Harrison, B. (1998). Matching the disadvantaged to job opportunities: Structural explanations for the past successes of the Center for Employment Training. Economic Development Quarterly, 12(1), 3-11.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: The authors’ objective was to propose a plausible explanation for the Center for Employment Training-San Jose’s (CET) success in placing disadvantaged people into jobs. CET is a national program that provides job training for disadvantaged people and matches them with entry-level jobs. The San Jose site, the focus of this article, served a mostly Hispanic population, consisting of dislocated farm workers, mothers on public assistance, out-of-school youth, and ex-offenders. The authors reviewed findings from a recent case study on CET-San Jose and posited explanations for the program’s success. They attributed the success of the program to its ability to develop in its participants the skills necessary in the local labor market and become part of employers’ trusted recruiting networks. They also noted that CET-San Jose is embedded in a powerful social movement (West Coast Hispanic politics and culture).","the Center for Employment Training (CET) Replication","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Hispanic of any race, Low-skilled, Low income",,"United States",1998,,"Opportunities for Youth Review Protocol" "Job Training Partnership Act: Long-term earnings and employment outcomes (GAO/HEHS-96-40).","United States General Accounting Office. (1996). Job Training Partnership Act: Long-term earnings and employment outcomes (GAO/HEHS-96-40). Washington, DC: U.S. Government Printing Office.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to estimate the impact of Job Training Partnership Act (JTPA) programs on the long-term earnings and employment of male and female out-of-school youth and adults. This review focuses on the findings for out-of-school youth. The programs’ effectiveness was evaluated by analyzing outcomes five years after program entry for a subset of participants in the National JTPA Study, a random assignment study that examined impacts of JTPA programs in 16 local service-delivery areas. The authors found no statistically significant impacts of JTPA on earnings or employment rates five years after program entry. The quality of the causal evidence presented in this study is high because it is a well-executed randomized controlled trial. This means we have confidence that estimated effects would be attributable to JTPA programs, and not other factors.","Job Training Partnership Act","Basic skills Community college education and other classroom training Job search assistance and supportive services Work based and other occupational training Youth programs",Youth,,"United States",1997,http://www.gao.gov/assets/230/222393.pdf,"Opportunities for Youth Review Protocol" "Follow-up analyses of the National JTPA Study sample","Orr, L., Barnow, B., Lerman, R., & Beecroft, E. (1997). Follow-up analyses of the National JTPA Study sample. Cambridge, MA: Abt Associates, Inc.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report presented and analyzed findings from a follow-up examination of the National Job Training Partnership Act (JTPA) Study, an impact study whose final report was published in 1994. The JTPA program offered academic and occupational training, on-the-job training, job search assistance, and other support services to adults and out-of-school youth. This report used the experimental data from the National JTPA Study to explore whether JTPA had positive effects on earnings of subgroups of youth, factors that had positive impacts on welfare recipients’ earnings, and implications of the National JTPA Study for improving the JTPA performance management system. The report found that the JTPA program had a small impact on the earnings of out-of-school youth and positive impacts on the earnings of female welfare recipients. The impact was greater for females older than 25 years than for females ages 16 to 24. JTPA services adapted toward immediate employment were more effective than other services for welfare recipients, and access to JTPA increased earnings of welfare recipients without decreasing welfare receipts because earnings increased only after they left welfare. The authors concluded that the correlation between measured impact and performance indicators was usually positive, but statistically weak, and that this suggested the performance management system did not work as intended.","National Job Training Partnership Act (JTPA)",,,,,1997,,"Opportunities for Youth Review Protocol" "Evaluation of the Maryland Unemployment Insurance Work Search Demonstration","Benus, J., Johnson, T., Klepinger, D., & Joesch, J. (1997). Evaluation of the Maryland Unemployment Insurance Work Search Demonstration. Prepared for the Maryland Department of Labor, Licensing and Regulation, 1-43. Baltimore, MD: Maryland Department of Labor.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study assessed the effectiveness of four interventions designed to encourage rapid reemployment among Unemployment Insurance (UI) recipients. The study was a randomized controlled trial with more than 27,000 participants. Participants were randomly assigned to one of four treatment groups, each of which had different work search requirements, or to a control group that abided by existing requirements for receipt of UI benefits. The study used state UI administrative records to estimate impacts on employment, earnings, and UI benefit receipt. The authors found that the three treatments that imposed stricter work search requirements than those imposed on the control group reduced the amount of benefits received by $75 to $116 and duration of benefit receipt by 0.6 to 0.9 weeks, on average. There were no statistically significant differences between treatment and control groups on employment or earnings. The quality of causal evidence presented in this report is high because it was a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the work search treatments, and not to other factors.","the Maryland Unemployment Insurance Work Search Demonstration","Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",1997,http://wdr.doleta.gov/owsdrr/98-2/98-2.pdf,"Reemployment Review Protocol" "The benefits and costs of JTPA Title II-A programs: Key findings from the National Job Training Partnership Act Study","Bloom, Howard S. et. al. (1997). The benefits and costs of JTPA Title II-A programs: Key findings from the National Job Training Partnership Act Study. The Journal of Human Resources, 32(3), 549-546.1","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study’s objective was to determine the impact of the offer to enroll in Job Training Partnership Act (JTPA) Title II-A programs on labor market earnings, educational and training participation and attainment, and welfare receipt compared with a control group that that was not allowed to enroll in JTPA services. About 6,000 out-of-school youth across 16 service delivery areas (SDAs) in the United States were randomly assigned to the treatment group (which was offered JTPA Title II-A services) or the control group (which could not participate in JTPA Title II services for 18 months). Although not the focus of this review, the study also randomly assigned more than 14,000 adults to treatment and control groups. Random assignment occurred from 1987 to 1989. The study team administered surveys to treatment and control group members 18 and 30 months after random assignment to collect information on earnings and educational attainment. The study found that, for female youth, JTPA had a statistically significant, positive impact on attainment of a general educational development (GED) or high school diploma after 30 months; however, this did not hold for male youth. In addition, JTPA did not have a statistically significant impact on earnings for either female or male youth who had never been arrested. The quality of the causal evidence presented in this study is high for the employment outcomes for female and male youth who had not been arrested. This means we are confident that estimated impacts are solely attributable to JTPA, and not other factors. The education outcomes for all groups, and the employment outcomes for male youth who had been arrested, have moderate evidence. This means we have some confidence that the estimated effects would be attributable to JTPA, but other factors might also have contributed.","Job Training Partnership Act","Basic skills Community college education and other classroom training Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs",Youth,,"United States",1997,,"Opportunities for Youth Review Protocol" "Case management at work for SSA disability beneficiaries: process results of the Project NetWork","Leiter, V., & Wood, M.L. (1997). Case management at work for SSA disability beneficiaries: process results of the Project NetWork. Social Security Bulletin, 60 (1), 29–57.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This article summarized the results of a process evaluation of Project NetWork, a demonstration launched by the Social Security Administration (SSA) to test various strategies for providing vocational rehabilitation (VR) services to its disability insurance beneficiaries as well as blind and disabled applicants for and recipients of Supplemental Security Income benefits. The study, which was part of an evaluation that also included impact and cost analyses, assessed the feasibility of providing VR services to SSA beneficiaries with severe disabilities. It drew on interviews with program staff, management information system data, and a variety of program documents to examine the roll-out and implementation of four models of service delivery, each implemented at two sites. The authors determined that it was feasible to recruit people with severe disabilities for a rehabilitation program and provide the range of required services. Models with varying institutional arrangements were equally successful in attracting the interest of this population and arranging for the services they needed to meet their vocational goals.","Project NetWork","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",1997,http://www.ssa.gov/policy/docs/ssb/v60n1/v60n1p29.pdf,"Disability Employment Policy Review Protocol" "Enhancing substance abuse treatment with case management: Its impact on employment","Siegal, H. A., Fisher, J. H., Rapp, R. C., & Kelliher, C. W. (1996). Enhancing substance abuse treatment with case management: Its impact on employment. Journal of Substance Abuse Treatment, 13(2), 93-98.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study aimed to examine the impact of a strengths-based case management intervention on veterans’ employment and earnings. Even though the treatment and control groups were randomly assigned, the study used a pre/post analysis design to compare all participants before the study to all participants six months after the study began. The study collected data using the Addiction Severity Index (ASI-5) and study-created measures including levels of drug use, substance abuse treatment history, health and psychiatric status, occupational and education functioning, living situation, relationship with family and peers, and HIV risk status. The study found all study participants, including those in the intervention and control groups, increased earnings and days employed at the six-month follow-up. The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects are attributable to strengths-based case management; other factors are likely to have contributed.","the strengths-based case management","Substance abuse recovery Job search assistance and supportive services Veterans' reemployment","Other barriers, Veteran or military",,"United States",1996,https://doi.org/10.1016/0740-5472(96)00029-3,"Employment and Training Review Protocol" "The New Jersey Unemployment Insurance Reemployment Demonstration Project: Six-year follow-up and summary report","Corson, W., & Haimson, J. (1996). The New Jersey Unemployment Insurance Reemployment Demonstration Project: Six-year follow-up and summary report. Revised edition. Unemployment Insurance Occasional Paper 96-2. Washington, DC: U.S. Department of Labor, Employment and Training Administration.","Job Search Assistance, Reemployment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the long-term impacts of the New Jersey Unemployment Insurance Reemployment Demonstration Project on the unemployment insurance (UI) receipt, employment, and earnings of UI claimants in New Jersey approximately six years after program enrollment. In this demonstration, about 11,000 UI claimants were randomized into one of three treatment groups, all of which received some variation of Job Search Assistance (JSA) services, or into the control group, which could receive only existing services in the community. For all participants, the study team collected administrative data, which provided information on UI receipt, employment, and earnings. The study found that the treatment group that received JSA services and a reemployment bonus had a statistically significant reduction in UI dollars received and UI weeks paid, compared with the control group. There were no significant impacts on the probability of working, level of earnings, or weeks worked in the long run for any of the treatment groups. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the interventions studied, and not to other factors.","JSA services","Job search assistance and supportive services Other employment and reemployment Other training and education","Dislocated or displaced worker, Unemployed",,"United States",1996,http://workforcesecurity.doleta.gov/dmstree/op/op95/op_02-95.pdf,"Job Search Assistance, Reemployment Review Protocol" "Impacts of service: Final report on the evaluation of American Conservation and Youth Service Corps.","Jastrzab, J., Masker, J., Blomquist, J., & Orr, L. (1996). Impacts of service: Final report on the evaluation of American Conservation and Youth Service Corps. Cambridge, MA: Abt Associates Inc.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to estimate the impacts of eight Conservation and Youth Service Corps programs that sought to improve educational and employment outcomes for out-of-school youth ages 18 to 25 and to improve their personal development. The full evaluation consisted of an estimation of participant impacts and cost-benefit analysis for four of eight study sites and estimation of community impacts for all eight sites. Data sources for the participant-level impact analysis included a self-administered baseline survey and enrollment form and a follow-up telephone survey conducted 15 months after random assignment. The study found statistically significant, positive impacts for program participants on the likelihood of having worked for pay since program enrollment and working a larger number of total hours since program enrollment (including time spent in the corps). The quality of the causal evidence presented in this study is moderate. This means we have some confidence that the estimated effects are attributable to the Conservation and Youth Service Corps programs, but other factors might also have contributed.","Youth Corps Programs","Job search assistance and supportive services Other training and education Youth programs",Youth,,"United States",1996,,"Opportunities for Youth Review Protocol" "The Jobs I Preventive Intervention for Unemployed Individuals: Short- and long-term effects on reemployment and mental health","Vinokur, A., Price, R., Caplan, R., van Ryn, M.,& Curran, J. (1995). The Jobs I Preventive Intervention for Unemployed Individuals: Short- and long-term effects on reemployment and mental health. In L.R. Murphy, J.J. Hurrell, Jr., S.L. Sauter, & G.P. Keita (Eds.), Job Stress Interventions. Washington, DC: American Psychological Association (125-138).",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Jobs Program on short-term earnings. The authors conducted a randomized controlled trial (RCT). Researchers administered a pre-test two weeks before the intervention and two post-tests one and four months after the intervention, comparing the outcomes of Jobs Program participants against those of a control group. The study found statistically significant associations between being offered access to the Jobs Program and increased earnings one and four months later. The quality of causal evidence presented in this report is low because the study was an RCT with post-intervention subsampling based on participation in the intervention. In addition, the authors did not include sufficient controls in their analysis. This means we are not confident that any estimated effects would be attributable to the Jobs Program; other factors are likely to have contributed.","the Jobs Program","Job search assistance and supportive services","Dislocated or displaced worker, Unemployed",,"United States",1995,,"Reemployment Review Protocol" "Lessons from the US unemployment insurance experiments","Meyer, B. (1995). Lessons from the US unemployment insurance experiments. Journal of Economic Literature, 33(1), 91-131.","Behavioral Insights","Study Type: Descriptive Analysis",,,"Summary: The article provided an overview of experimental evaluations of unemployment insurance (UI) reforms conducted from 1977 to 1992 in the United States. These reforms typically tried to improve the employment prospects of beneficiaries and reduce UI costs. The author reviewed 10 randomized controlled trials of UI reforms—4 cash bonus experiments and 6 job-search experiments—and provided a comparative analysis on how these reforms affected average weeks of UI benefits paid, UI program costs, and recipients’ earnings, when available. The cash bonus experiments offered a cash payment to participants who quickly found and kept a job for an indicated length of time, although the details varied greatly across experiments. Job-search assistance reforms also varied but typically involved changes in the way job-search programs were implemented in terms of services offered and reporting and participation requirements. The review found that some cash bonus reforms reduced the average number of weeks participants spent on UI by a statistically significant margin, compared with the control group. The review also found that some job-search assistance reforms reduced participants’ average number of weeks on UI and increased average quarterly earnings compared with the control group; however, not all findings for all reforms were statistically significant.",,"Disability insurance Job search assistance and supportive services","Adult, Dislocated or displaced worker, Unemployed",,"United States",1995,,"Behavioral Insights Review Protocol" "Outcome evaluation of the Army Career and Alumni Program’s Job Assistance Centers (Study Report 96-04)","Sadacca, R., Laurence, J. H., DiFazio, A. S., Rauch, H. J., & Hintz, D. W. (1995) Outcome evaluation of the Army Career and Alumni Program’s Job Assistance Centers (Study Report 96-04). Alexandria, VA: Human Resources Research Organization.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts Earnings and wages Public benefits receipt-Low-Mixed impacts Public benefit receipt","Summary: The study’s objective was to examine the impact Job Assistance Centers (JACs) and the Transition Assistance Program (TAP) offered to ex-servicemembers had on their earnings and public benefits receipt. The study used a nonexperimental analysis to compare the outcomes of ex-servicemembers transitioning from military to civilian jobs who received various JAC or TAP services to the outcomes of those who did not receive JAC or TAP services. The authors used administrative records from the U.S. Department of Defense, the U.S. Army, and JACs, as well as data from a follow-up survey. The study showed mixed findings on the relationships between receipt of JAC and TAP services and earnings, as well as on the relationships between receipt of JAC and TAP services and receipt of unemployment compensation. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to JACs and TAP; other factors are likely to have contributed.","Job Assistance Centers and the Transition Assistance Program","Job search assistance and supportive services Other employment and reemployment Veterans' reemployment","Dislocated or displaced worker, Veteran or military",,"United States",1995,,"Employment and Training Review Protocol" "The impact of Reemployment Bonuses on Insured Unemployment in the New Jersey and Illinois Reemployment Bonus Experiments","Decker, P. (1994). The impact of Reemployment Bonuses on Insured Unemployment in the New Jersey and Illinois Reemployment Bonus Experiments. Journal of Human Resources, 29(3), 718-741.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: This study’s objective was to assess the effectiveness of New Jersey and Illinois programs that aimed to encourage faster reemployment among Unemployment Insurance (UI) recipients by offering them financial incentives for faster reemployment. Each state conducted separate randomized controlled trials. The authors calculated weekly UI exit rates using state UI administrative records. The study found that both programs significantly increased the weekly rates at which bonus-eligible UI claimants left the UI rolls during the qualification period relative to claimants who were not bonus-eligible, by 14 percent in New Jersey and 18 percent in Illinois. The quality of causal evidence presented in this report is high because it is based on two well-implemented randomized controlled trials. This means we are confident that the estimated effects are attributable to reemployment bonus incentives and not to other factors.","the New Jersey Unemployment Insurance Reemployment Demonstration Project and Illinois Job Search Incentive Experiment","Job search assistance and supportive services Other employment and reemployment Other training and education","Dislocated or displaced worker, Unemployed",,"United States",1994,,"Reemployment Review Protocol" "The study of the replication of the CET job training model.","Hershey, A., & Rosenberg, L. (1994). The study of the replication of the CET job training model. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: The Center for Employment Training (CET) was shown by rigorous research conducted in the 1980s to increase the earnings and employment prospects of disadvantaged youth. The U.S. Department of Labor (DOL) commissioned a study to determine whether other organizations could replicate the CET model. This study reported on early efforts by 10 replication sites to implement the key features of the CET job training model. DOL later commissioned an impact evaluation of CET replication sites, including some sites examined in this study (see CLEAR profile of Miller et al. 2005). The CET model provides individualized, intensive, full-time job training. Its focus is on integrating basic and technical skills with job placement as the final goal. CET’s advisory board and instructors are well connected to industry and help to ensure that the skills taught in the program align with those desired by employers. The authors conducted telephone interviews with staff from the CET main office in San Jose, California, telephone interviews with key staff and project directors of the 10 replication sites, and site visits to 5 of the 10 sites. The authors noted that the replication sites faced considerable challenges initiating the program, including finding a suitable space and ensuring consistent funding. When the programs began offering services, the authors reported some deviations from the CET model. In particular, they found that some sites used a screening process, rather than allowing open access to training, as specified by the CET model; some sites used whole group rather than individualized instruction; some did not integrate basic skills and technical skills training; some had not formed an advisory board to provide labor market analysis and guidance for needed training areas; and most were not placing participants into jobs at the completion of training.","the Center for Employment Training (CET) Replication","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",1994,,"Opportunities for Youth Review Protocol" "Self-employment as a reemployment option: Demonstration results and national legislation","Benus, J., Johnson, T., Wood, M, & Grover, N. (1994). Self-employment as a reemployment option: Demonstration results and national legislation. Unemployment Insurance Occasional Paper, 94(3), 1-61.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study estimated the impacts of Washington State’s Self-Employment and Enterprise Demonstration (SEED) and the Massachusetts Enterprise Project. Both programs sought to determine how feasible self-employment was as a reemployment option for Unemployment Insurance (UI) recipients. This profile focused only on the program design and outcomes of the Enterprise Project. The Enterprise Project was evaluated using a randomized controlled trial in which program applicants were randomly assigned to either a treatment group, which could receive Enterprise Project services, or a control group, which received UI benefits as usual. Outcomes of interest included measures of employment, self-employment, earnings, and UI benefit receipt. The study found that applicants in the treatment group entered self-employment and wage employment at higher rates than those in the control group. They also had higher earnings, on average, and reduced UI benefit duration and amount received. The quality of the causal evidence presented in this study is high. This means we are confident that the estimated effects are attributable to the Enterprise Project, and not to other factors.","the Enterprise Project Demonstration","Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",1994,http://workforcesecurity.doleta.gov/dmstree/op/op94/op_03-94.pdf,"Reemployment Review Protocol" "First impact analysis of the Washington State Self-Employment and Enterprise Development (SEED) demonstration","Benus, J., Johnson, T., & Wood, M. (1994). First impact analysis of the Washington State Self-Employment and Enterprise Development (SEED) demonstration. Unemployment Insurance Occasional Paper, 94(1), 1-172.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Employment-Mod/high-Mixed impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study examined the impact of Washington State’s Self-Employment and Enterprise Demonstration (SEED) on reemployment via self-employment for Unemployment Insurance (UI) claimants. SEED was evaluated using a randomized controlled trial in which SEED applicants were randomly assigned to a treatment group, which could receive several types of business start-up training and support services, or a control group, which received UI benefits as usual. Outcomes of interest included measures of employment, self-employment, earnings, and UI benefit receipt. The study found that applicants in the treatment group entered self-employment at significantly higher and faster rates than those in the control group did. SEED participants also earned significantly more from self-employment than nonparticipants did. The quality of the causal evidence presented in this study is high because it was a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to SEED, and not other factors.","Washington State’s Self-Employment and Enterprise Demonstration","Other employment and reemployment Other training and education","Dislocated or displaced worker, Unemployed",,"United States",1994,http://wdr.doleta.gov/research/FullText_Documents/op_01-94.pdf,"Reemployment Review Protocol" "Job Corps costs and outcomes","Crawford, C. (1993). Job Corps costs and outcomes. Washington, DC: Government Accountability Office.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This Government Accountability Office brief studied the costs and outcomes of the Job Corps program during program year 1991 (covering calendar year July 1991 through June 1992). Job Corps offers intensive academic classroom instruction and vocational skills training, along with support services, to economically disadvantaged youth. The authors used data from the Department of Labor's Office of Job Corps to explore the differences in the costs of Job Corps centers run by contractors and those run by federal agencies. They also studied the employment outcomes of Job Corps participants who received training from sole-source contractors—those awarded contracts through a non-competitive process. The authors found that the cost per participant was higher in Job Corps centers run by federal departments than in centers run by contractors. This difference was driven by variation in the types of training the centers offered. Participants in Job Corps centers operated by sole-source contractors, especially those offering training under national training contracts, tended to have higher rates of job placement than participants in other types of Job Corps centers.","Job Corps","Job search assistance and supportive services Youth programs Other training and education Work based and other occupational training","Youth, High-skilled, Low-skilled",,"United States",1993,http://www.gao.gov/assets/90/82925.pdf,"Opportunities for Youth Review Protocol" "JOBSTART: Final report on a program for school dropouts.","Cave, G., Bos, H., Doolittle, F. & Toussaint, C. (1993). JOBSTART: Final report on a program for school dropouts. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the JOBSTART program on employment, earnings, and education and training outcomes over a four-year follow-up period. About 2,300 youth were randomly assigned to either the treatment group, which was eligible to participate in JOBSTART, or the control group, which could not participate in JOBSTART but could access other services in the community. The authors compared the outcomes of the treatment and control groups using data collected through follow-up surveys 12, 24, and 48 months after random assignment. The study found that, 48 months after random assignment, members of the treatment group were significantly more likely to have participated in education or training, and completed significantly more hours of it, compared with the control group. The treatment group was significantly less likely to be employed and earned significantly less than the control group in the first year after random assignment. There were no significant impacts on earnings or employment outcomes in later follow-up years. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the JOBSTART program, and not to other factors.","the JOBSTART Program","Basic skills Job search assistance and supportive services Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",1993,http://www.mdrc.org/sites/default/files/full_416.pdf,"Opportunities for Youth Review Protocol" "Time-varying effects of recall expectation, a reemployment bonus, and job counseling on unemployment durations","Anderson, P. (1992). Time-varying effects of recall expectation, a reemployment bonus, and job counseling on unemployment durations. Journal of Labor Economics, 10 (1), 99-115.","Job Search Assistance, Reemployment","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study assessed the effectiveness of a reemployment bonus on the reemployment rates of Unemployment Insurance (UI) claimants with differing expectations of being recalled to their previous jobs. The study used data from the New Jersey Unemployment Insurance Reemployment Demonstration Project. For the demonstration, about 11,000 UI claimants were randomized into one of three treatment groups, all of which received some variation of Job Search Assistance (JSA) services, or into the control group, which could receive only existing services in the community. The author estimated weekly UI exit rates from state UI administrative records. The study found that the JSA-plus-reemployment-bonus group members were more likely than members of the JSA-only group to leave UI for a new job during weeks 7 through 12, which corresponded to the first half of the bonus qualification period, suggesting the bonuses were effective in spurring UI claimants to find new jobs more quickly. The quality of causal evidence presented in this report is moderate because it is a secondary analysis of data from a well-implemented randomized controlled trial for which attrition cannot be calculated. However, the author included sufficient statistical controls to receive a moderate evidence rating. This means we have some confidence that the estimated effects are attributable to the interventions studied, although other factors also could have contributed.","the New Jersey Unemployment Insurance Reemployment Demonstration Project","Job search assistance and supportive services Other employment and reemployment Other training and education","Dislocated or displaced worker, Unemployed",,"United States",1992,,"Job Search Assistance, Reemployment Review Protocol" "The New Jersey Unemployment Insurance Reemployment Demonstration Project: Follow-up report","Anderson, P., Corson, W., & Decker, P. (1991). The New Jersey Unemployment Insurance Reemployment Demonstration Project: Follow-up report. Unemployment Insurance Occasional Paper 91-1. Washington, DC: U.S. Department of Labor, Employment and Training Administration.","Job Search Assistance, Reemployment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the New Jersey Unemployment Insurance Reemployment Demonstration Project on the unemployment insurance (UI) receipt, employment, and earnings of UI claimants in New Jersey three to four years after program enrollment. In this demonstration, about 11,000 UI claimants were randomized into one of three treatment groups, all of which received some variation of Job Search Assistance (JSA) services, or into the control group, which could receive only existing services in the community. For all participants, the study team collected administrative data, which provided information on UI receipt, employment, and earnings. The study found that, over the claim year and three follow-up years, the JSA-plus-reemployment-bonus group had statistically significant differences from the control group on UI dollars received ($293 fewer than control) and UI weeks paid (1.6 fewer weeks than control). The study found few statistically significant impacts on the probability of working, earnings, or weeks worked for any of the treatment groups compared with the control group. The quality of causal evidence presented in this report is high because it based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the interventions studied, and not to other factors.","JSA services","Job search assistance and supportive services Other employment and reemployment Other training and education","Dislocated or displaced worker, Unemployed",,"United States",1991,http://workforcesecurity.doleta.gov/dmstree/op/op91/op_01-91.pdf,"Job Search Assistance, Reemployment Review Protocol" "Long-term follow-up and benefit-cost analysis of the Jobs Program","Vinokur, A., van Ryn, M., Gramlich, E., & Price, R. (1991). Long-term follow-up and benefit-cost analysis of the Jobs Program. Journal of Applied Psychology, 76(2), 213-219.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Jobs Program on long-term earnings and monthly hours worked. The authors conducted a randomized controlled trial (RCT). Researchers administered a pre-test two weeks before the intervention and three post-tests at 1, 4, and 30 months after the intervention comparing the outcomes of Jobs Program participants against a control group. The study found no statistically significant relationships between the Jobs Program and increased long-term earnings or time in work during the follow-up period. The quality of causal evidence presented in this report is low because the study was an RCT with post-intervention subsampling based on participation in the intervention. In addition, the authors did not include sufficient controls in their analysis. This means we are not confident that any estimated effects would be attributable to the Jobs Program; however, the study found no statistically significant effects.","the Jobs Program","Job search assistance and supportive services","Dislocated or displaced worker, Unemployed",,"United States",1991,,"Reemployment Review Protocol" "Transitional employment training for SSI recipients with intellectual disabilities.","Prero, A.J., & Thornton, C. (1991). Transitional employment training for SSI recipients with intellectual disabilities. Social Security Bulletin, 54(11), 2-25.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This article summarized the findings of a process evaluation of the Transitional Employment Training Demonstration, which aimed to transition Supplemental Security Income (SSI) recipients with intellectual disabilities to permanent employment. To achieve this goal, the demonstration provided participants with short-term training for potentially permanent jobs in which they would conduct tasks for their employers and interact with nondisabled colleagues. The study developed findings on recruitment, training, placement, and the provision of other services by collecting data from all eight program sites. It drew on several qualitative sources, such as program staff interviews, observations of service provision, and program documents, as well as a few quantitative sources, including program, survey, and SSI administrative data. The study found that it was feasible to successfully place a wide variety of SSI recipients with intellectual disabilities in mainstream jobs using transitional employment services. However, the programs faced several challenges in program design and implementation. Recruitment and job placement could be difficult, given opinions among caregivers and employers that people with intellectual disabilities cannot perform well in competitive jobs. Job placement was hampered further by the lack of suitable transportation options.","Transitional Employment Training Demonstration","Supplemental security income (SSI) Basic skills Job search assistance and supportive services",Disability,,"United States",1991,http://www.ssa.gov/policy/docs/ssb/v54n11/v54n11p2.pdf,"Disability Employment Policy Review Protocol" "Evaluation of the impacts of the Washington Alternative Work Search Experiment","Johnson, T., & Klepinger, D. (1991). Evaluation of the impacts of the Washington Alternative Work Search Experiment. Unemployment Insurance Occasional Paper, 91(4), 1–90.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study assessed the impacts of four different work search policy approaches implemented through the Washington Alternative Work Search Experiment on Unemployment Insurance (UI) benefits receipt, employment, and earnings outcomes. Eligible UI claimants were randomly assigned to one of three treatment groups or a control group. The four study groups faced different work search requirements to continue receiving UI benefits. For all participants, the study team collected administrative data, which provided information on UI benefits receipt, employment, and earnings. The study found that UI claimants facing less-stringent work search requirements received more UI benefits for longer and were more likely to exhaust their benefits, on average, than those facing standard work search requirements. There were few differences in UI benefits, employment, or earnings among claimants subject to more stringent work search requirements compared with those facing standard work search requirements. The quality of causal evidence presented in this study is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the alternative work search requirements, and not to other factors.","the Washington Alternative Work Search Experiment","Job search assistance and supportive services Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",1991,,"Reemployment Review Protocol" "Back to work: Testing reemployment services for displaced workers","Bloom, H. (1990). Back to work: Testing reemployment services for displaced workers. Kalamazoo, MI: W.E. Upjohn Institute for Employment Research.","Job Search Assistance, Reemployment","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Texas Worker Adjustment Demonstration on the Unemployment Insurance (UI) receipt, employment, and earnings of UI claimants one year after program enrollment. In this demonstration, about 2,200 UI claimants across three sites were randomized into a treatment group, which received job-search assistance services and, if needed, occupational training, or into the control group, which could receive only existing services in the community. For all participants, the study team collected administrative data and conducted a one-year follow up survey. The study found that women who received services at the two El Paso sites earned $987 more and received $193 less in UI benefits in the first year, and were 10 to 20 percentage points more likely to be employed in the first three quarters after entering the program, compared with the control group. The study also found that men in the treatment groups at all three sites received $143 less in UI benefits than men in the control group, but there were no other statistically significant impacts one year after random assignment. The quality of causal evidence presented in this report is moderate because it is an analysis of data from a randomized controlled trial for which attrition cannot be calculated, but for which the author included sufficient statistical controls. This means we have some confidence that the estimated effects are attributable to the demonstration services, although other factors also could have contributed.","JSA services","Job search assistance and supportive services Basic skills Community college education and other classroom training Work based and other occupational training","Dislocated or displaced worker, Unemployed",,"United States",1990,,"Job Search Assistance, Reemployment Review Protocol" "The economic impact of the Nevada Claimant Employment Program","Hanna, J., & Turney, Z. (1990). The economic impact of the Nevada Claimant Employment Program. Unemployment Insurance Occasional Paper 90(4), 79-92.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study determined the effect of reemployment services, particularly job training for those with insufficient skills or education, on Unemployment Insurance (UI) receipt duration. The study was a randomized controlled trial (RCT), with sample members’ outcomes drawn from Nevada state UI records. The study found that reemployment services reduced UI receipt duration by 1.6 weeks, on average, during the first year. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to the Nevada Claimant Employment Project; other factors are likely to have contributed.","JSA services","RESEA Job search assistance and supportive services","Dislocated or displaced worker, Unemployed",,"United States",1990,,"Reemployment Review Protocol" "The New Jersey Unemployment Insurance Reemployment Demonstration Project: Final evaluation report","Corson, W., Decker, P.T., Dunstan, S.M., Gordon, A.R., Anderson, P., & Homrighausen, J. (1989). The New Jersey Unemployment Insurance Reemployment Demonstration Project: Final evaluation report. Princeton, NJ: Mathematica Policy Research.","Job Search Assistance, Reemployment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the short-term impacts of the New Jersey Unemployment Insurance Reemployment Demonstration Project on the unemployment insurance (UI) receipt, employment, and earnings of UI claimants in New Jersey approximately one year after program enrollment. In this demonstration, about 11,000 UI claimants were randomized into one of three treatment groups, all of which received some variation of Job Search Assistance (JSA) services, or into the control group, which could receive only existing services in the community. For all participants, the study team collected administrative data, which provided information on UI receipt, employment, and earnings. The study team also surveyed a subsample of roughly 7,500 participants about their experiences in the year following random assignment. The study found that all three treatments reduced at least one measure of UI benefits received in the benefit year. According to the survey data, the JSA-only and JSA-plus-bonus groups had higher employment and earnings in the year following participants’ initial UI claims than control group members (no difference was found for the JSA-plus-training group). However, these impacts were not observed in the administrative data. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the interventions studied, and not to other factors.","JSA services","Job search assistance and supportive services Other employment and reemployment Other training and education","Dislocated or displaced worker, Unemployed",,"United States",1989,http://workforcesecurity.doleta.gov/dmstree/op/op89/op_03-89.pdf,"Job Search Assistance, Reemployment Review Protocol" "Requiring Unemployment Insurance recipients to register with the Public Employment Service","Director, S., & Englander, F. (1988). Requiring Unemployment Insurance recipients to register with the Public Employment Service. The Journal of Risk and Insurance, 55(2), 245-258.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of New Jersey’s repeal of mandatory Employment Services (ES) registration for Unemployment Insurance (UI) claimants on the length of claimants’ UI spells and their probability of exhausting available UI benefits. The authors compared UI outcomes before and after repeal using an interrupted time series design based on monthly, state-level time series data from 1971 to 1981. The study found that the UI exhaustion rate and weeks of UI benefits received were lower when ES registration was mandatory than when it was voluntary. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to mandatory ES registration; other factors are likely to have contributed.","More stringent work search requirements","RESEA Unemployment Insurance Wagner-Peyser Act","Dislocated or displaced worker, Unemployed",,"United States",1988,,"Reemployment Review Protocol" "The Illinois Unemployment Insurance Incentive Experiments","Spiegelman, R., & Woodbury, S. (1987). The Illinois Unemployment Insurance Incentive Experiments. Kalamazoo, MI: W.E. UpJohn Institute for Employment Research.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Job Search Incentive Experiment and the Hiring Incentive Experiment in Illinois on Unemployment Insurance (UI) benefit receipt and earnings. In this study, about 17,000 new UI claimants were randomly assigned to one of two treatment groups, both of which could participate in a reemployment bonus program, or the control group, which faced existing UI program rules and could not receive a reemployment bonus. For all participants, the study team collected administrative data on UI benefits receipt. The study found that those in the job search incentive group had a significant reduction in UI benefits received, length of UI receipt, and proportion of claimants exhausting UI benefits, compared with the control group. Those in the hiring incentive group had a significant reduction in UI benefits received relative to the control group, but no other outcomes.  The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the reemployment bonuses, and not to other factors.","the Illinois Job Search Incentive and Hiring Incentive Experiments","Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",1987,,"Reemployment Review Protocol" "Evaluation of the Charleston Claimant Placement and Work Test Demonstration","Corson, W., Long, D., & Nicholson, W. (1985). Evaluation of the Charleston Claimant Placement and Work Test Demonstration. Department of Labor Unemployment Insurance Occasional Paper, 85(2), 1-113.","Job Search Assistance, Reemployment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to determine the impact of a more-stringent work test and enhanced employment services on Unemployment Insurance (UI) claimants’ benefits receipt and reemployment outcomes. The authors randomly assigned UI claimants to four conditions, comprising three distinct treatment groups and one control group. Administrative data sources, including UI and Employment Service (ES) records as well as records of claimants’ interactions with program staff provided outcomes for sample members in all four conditions. The study found that UI claimants in the more-intensive treatment conditions—treatment groups 1 and 2—collected UI benefits for fewer weeks than those in the control condition, by 0.76 weeks in treatment group 1 and 0.61 weeks in treatment group 2; these differences were statistically significant. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Charleston Claimant Placement and Work Test Demonstration, and not to other factors.","JSA services","Job search assistance and supportive services","Dislocated or displaced worker, Unemployed",,"United States",1985,,"Job Search Assistance, Reemployment Review Protocol" "Impacts of transitional employment for mentally retarded young adults: Results of the STETS demonstration","Kerachsky, S., Thornton, C., Bloomenthal, A., Maynard, R. & Stephens, S. (1985). Impacts of transitional employment for mentally retarded young adults: Results of the STETS demonstration. New York: Manpower Demonstration Research Corporation.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Structured Training and Employment Transitional Services (STETS) program on employment rates, earnings, and Social Security Disability Income (SSDI) and Supplemental Security Income (SSI) receipt. The STETS program included a suite of work-readiness training, transitional jobs, and postplacement support services for young adults with intellectual disabilities. The study was a randomized controlled trial that randomly assigned young adults to the treatment group, which could participate in the STETS program, or to the control group, which could not. The study drew on data from in-person interviews conducted 6, 15, and 22 months after the start of the program. The study found that young adults in the treatment group were employed at significantly higher rates and, on average, earned more than the control group 15 and 22 months after the program began. The study also found that 15 months after random assignment, the young adults in the treatment group were significantly less likely than those in the control group to receive SSI or SSDI benefits. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the STETS program, and not to other factors.","Structured Training and Employment Transitional Services","Job search assistance and supportive services Other employment and reemployment","Disability, Low income",,"United States",1985,http://www.mdrc.org/sites/default/files/impacts_of_transitional_employment_fr.p…,"Employment and Training Review Protocol" "Wisconsin Job Service: ERP Pilot Project final report","Wisconsin Department of Industry, Labor, and Human Relations (1984). Wisconsin Job Service: ERP Pilot Project final report. Madison, WI: DILHR.","Job Search Assistance, Reemployment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study estimated the effect of mandatory participation in a job search workshop for Unemployment Insurance (UI) recipients separated indefinitely from their previous employers. The study was a randomized controlled trial (RCT) conducted in six sites in Wisconsin. Eligible UI recipients were randomly assigned to either the treatment group, which was required to attend a six-hour workshop, or a control group, which was not required to attend the workshop. In general, there were no statistically significant differences in duration of UI benefit receipt between treatment and control group members across all six sites or for individual sites. The quality of causal evidence presented in this report is high because it was based on a well-implemented RCT. This means we are confident that the estimated effects are attributable to the job search workshop and not to other factors.","JSA services","Job search assistance and supportive services","Dislocated or displaced worker, Unemployed",,"United States",1984,,"Job Search Assistance, Reemployment Review Protocol" "The Nevada claimant placement project.","Steinman, J. (1978). The Nevada claimant placement project. Washington, DC: U.S. Department of Labor, Employment & Training Administration.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of the Nevada Claimant Placement Project (NCPP), an intervention designed to accelerate labor force reattachment among Unemployment Insurance (UI) claimants through mandatory, intensive case management. The study was a randomized controlled trial; UI claimants were randomly assigned to either a treatment group, which received enhanced case management services, or to a control group, which received typical services available to UI claimants. The author used UI administrative records to compare the UI benefit receipt of treatment group members with that of control group members. The study found that the treatment group members received $318 less in UI benefits than control group members. The quality of the causal evidence presented in this report is low because attrition could not be determined and the study did not include controls for claimant characteristics in its analysis. This means we are not confident that the estimated effects are attributable to the NCPP.","Reemployment Eligibility Assessment","RESEA Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",1978,,"Reemployment Review Protocol"